[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:57:20.850862   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:34263
I20260709 12:57:20.853190   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:57:20.854903   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:20.880357   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:20.880805   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:20.880360   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:22.113528   439 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 12:57:22.113688   431 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:57:22.117962   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:22.118387   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:22.118636   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601842118602 us; error 0 us; skew 500 ppm
I20260709 12:57:22.119565   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:22.127100   431 webserver.cc:533] Webserver started at http://127.0.107.254:37057/ using document root <none> and password file <none>
I20260709 12:57:22.128125   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:22.128392   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:22.128919   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:22.135565   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/master-0-root/instance:
uuid: "307ae6622c99490da718b8db32bba0d4"
format_stamp: "Formatted at 2026-07-09 12:57:22 on dist-test-slave-zhdc"
I20260709 12:57:22.145097   431 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:57:22.151068   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:22.152359   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:57:22.152817   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/master-0-root
uuid: "307ae6622c99490da718b8db32bba0d4"
format_stamp: "Formatted at 2026-07-09 12:57:22 on dist-test-slave-zhdc"
I20260709 12:57:22.153204   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:22.215371   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:22.217262   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:57:22.217828   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:22.315083   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:34263
I20260709 12:57:22.315162   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:34263 every 8 connection(s)
I20260709 12:57:22.325562   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:22.351653   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4: Bootstrap starting.
I20260709 12:57:22.359169   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:22.362098   498 log.cc:826] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4: Log is configured to *not* fsync() on all Append() calls
I20260709 12:57:22.367652   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4: No bootstrap required, opened a new log
I20260709 12:57:22.391746   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "307ae6622c99490da718b8db32bba0d4" member_type: VOTER }
I20260709 12:57:22.392419   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:22.392632   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 307ae6622c99490da718b8db32bba0d4, State: Initialized, Role: FOLLOWER
I20260709 12:57:22.393666   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "307ae6622c99490da718b8db32bba0d4" member_type: VOTER }
I20260709 12:57:22.394440   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:57:22.394794   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:57:22.395190   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:22.399891   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "307ae6622c99490da718b8db32bba0d4" member_type: VOTER }
I20260709 12:57:22.400805   498 leader_election.cc:304] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 307ae6622c99490da718b8db32bba0d4; no voters: 
I20260709 12:57:22.403403   498 leader_election.cc:290] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:57:22.403828   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:22.410151   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [term 1 LEADER]: Becoming Leader. State: Replica: 307ae6622c99490da718b8db32bba0d4, State: Running, Role: LEADER
I20260709 12:57:22.411273   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:57:22.411242   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "307ae6622c99490da718b8db32bba0d4" member_type: VOTER }
I20260709 12:57:22.428968   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 307ae6622c99490da718b8db32bba0d4. Latest consensus state: current_term: 1 leader_uuid: "307ae6622c99490da718b8db32bba0d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "307ae6622c99490da718b8db32bba0d4" member_type: VOTER } }
I20260709 12:57:22.430047   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:22.433315   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "307ae6622c99490da718b8db32bba0d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "307ae6622c99490da718b8db32bba0d4" member_type: VOTER } }
I20260709 12:57:22.434170   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:22.444422   511 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:57:22.446887   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:57:22.455880   511 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:57:22.475687   511 catalog_manager.cc:1383] Generated new cluster ID: 8363104c3c1c49509a05403e92eee2c5
I20260709 12:57:22.476013   511 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:57:22.513643   511 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:57:22.515677   511 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:57:22.535014   511 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4: Generated new TSK 0
I20260709 12:57:22.536228   511 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:57:22.578692   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:22.590688   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:22.592124   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:22.597266   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:22.598560   431 server_base.cc:1061] running on GCE node
I20260709 12:57:22.599448   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:22.599630   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:22.599852   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601842599819 us; error 0 us; skew 500 ppm
I20260709 12:57:22.600517   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:22.606423   431 webserver.cc:533] Webserver started at http://127.0.107.193:33459/ using document root <none> and password file <none>
I20260709 12:57:22.607023   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:22.607257   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:22.607610   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:22.608875   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-0-root/instance:
uuid: "b1e020e1df5446c493307cbb386ac590"
format_stamp: "Formatted at 2026-07-09 12:57:22 on dist-test-slave-zhdc"
I20260709 12:57:22.616061   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.006s
I20260709 12:57:22.621840   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:22.622905   431 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:57:22.623226   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-0-root
uuid: "b1e020e1df5446c493307cbb386ac590"
format_stamp: "Formatted at 2026-07-09 12:57:22 on dist-test-slave-zhdc"
I20260709 12:57:22.623546   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:22.652710   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:22.654290   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:22.657156   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:22.662935   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:22.663201   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:22.663516   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:22.663691   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:22.801872   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:46233
I20260709 12:57:22.801939   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:46233 every 8 connection(s)
I20260709 12:57:22.810631   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:22.825668   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:22.830091   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:22.838553   431 server_base.cc:1061] running on GCE node
W20260709 12:57:22.840548   599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:22.842020   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:22.842362   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:22.842585   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601842842563 us; error 0 us; skew 500 ppm
I20260709 12:57:22.843498   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:22.846900   431 webserver.cc:533] Webserver started at http://127.0.107.194:39575/ using document root <none> and password file <none>
I20260709 12:57:22.847648   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:22.847935   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:22.848264   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:22.849701   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-1-root/instance:
uuid: "598e24a4a3614aa3b30ffb158636a113"
format_stamp: "Formatted at 2026-07-09 12:57:22 on dist-test-slave-zhdc"
I20260709 12:57:22.852483   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34263
I20260709 12:57:22.853037   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:22.855281   591 heartbeater.cc:507] Master 127.0.107.254:34263 requested a full tablet report, sending...
I20260709 12:57:22.858014   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:57:22.859736   463 ts_manager.cc:194] Registered new tserver with Master: b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233)
I20260709 12:57:22.863965   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50768
I20260709 12:57:22.865047   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:22.866082   431 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:57:22.866448   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-1-root
uuid: "598e24a4a3614aa3b30ffb158636a113"
format_stamp: "Formatted at 2026-07-09 12:57:22 on dist-test-slave-zhdc"
I20260709 12:57:22.866834   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:22.889771   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:22.891377   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:22.894569   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:22.899117   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:22.899362   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:22.899623   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:22.899797   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:23.024835   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33475
I20260709 12:57:23.024968   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33475 every 8 connection(s)
I20260709 12:57:23.034351   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:23.041662   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:23.045483   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:23.051188   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34263
I20260709 12:57:23.051822   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:23.053113   666 heartbeater.cc:507] Master 127.0.107.254:34263 requested a full tablet report, sending...
I20260709 12:57:23.056133   463 ts_manager.cc:194] Registered new tserver with Master: 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:23.058336   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50770
W20260709 12:57:23.058331   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:23.060194   431 server_base.cc:1061] running on GCE node
I20260709 12:57:23.061226   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:23.061475   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:23.061679   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601843061658 us; error 0 us; skew 500 ppm
I20260709 12:57:23.062376   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:23.065143   431 webserver.cc:533] Webserver started at http://127.0.107.195:45703/ using document root <none> and password file <none>
I20260709 12:57:23.065670   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:23.065903   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:23.066215   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:23.067397   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-2-root/instance:
uuid: "295b837450d340428c2da51136bf4cd7"
format_stamp: "Formatted at 2026-07-09 12:57:23 on dist-test-slave-zhdc"
I20260709 12:57:23.072727   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:57:23.076781   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:23.077651   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:57:23.077962   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-2-root
uuid: "295b837450d340428c2da51136bf4cd7"
format_stamp: "Formatted at 2026-07-09 12:57:23 on dist-test-slave-zhdc"
I20260709 12:57:23.078318   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601840662384-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:23.096917   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:23.098492   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:23.101418   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:23.105338   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:23.105551   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:23.105877   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:23.106041   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:23.246610   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:37259
I20260709 12:57:23.246732   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:37259 every 8 connection(s)
I20260709 12:57:23.269757   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34263
I20260709 12:57:23.270238   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:23.271202   740 heartbeater.cc:507] Master 127.0.107.254:34263 requested a full tablet report, sending...
I20260709 12:57:23.274278   463 ts_manager.cc:194] Registered new tserver with Master: 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:23.275035   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015929853s
I20260709 12:57:23.275885   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50776
I20260709 12:57:23.344091   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50792:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:57:23.348453   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 12:57:23.433686   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:23.478955   628 tablet_service.cc:1511] Processing CreateTablet for tablet a16052ff474946cd8f60307f76e070c6 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:57:23.481065   629 tablet_service.cc:1511] Processing CreateTablet for tablet 995ef6e306984e489cb5ddb6a810766e (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:57:23.482781   631 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4a248a564f4dfea44d76b1a0890c16 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:57:23.482218   630 tablet_service.cc:1511] Processing CreateTablet for tablet 1074a307786b4f2c8f9c1197f7007a36 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:57:23.484779   627 tablet_service.cc:1511] Processing CreateTablet for tablet 59793ce40b114fae99146e21be9f2847 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:57:23.485740   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16052ff474946cd8f60307f76e070c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.490204   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995ef6e306984e489cb5ddb6a810766e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.491217   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4a248a564f4dfea44d76b1a0890c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.492527   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1074a307786b4f2c8f9c1197f7007a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.495321   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59793ce40b114fae99146e21be9f2847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.500974   626 tablet_service.cc:1511] Processing CreateTablet for tablet ddc1580435fa48ef83af27238f7fd421 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:57:23.504556   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddc1580435fa48ef83af27238f7fd421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.535269   625 tablet_service.cc:1511] Processing CreateTablet for tablet 0e915b506968455a8bf0a49a69d24bd5 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:57:23.538987   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e915b506968455a8bf0a49a69d24bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.553454   624 tablet_service.cc:1511] Processing CreateTablet for tablet 258ad8e4f9934e38915c725ddeb66476 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:57:23.570094   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 258ad8e4f9934e38915c725ddeb66476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.560973   555 tablet_service.cc:1511] Processing CreateTablet for tablet 1074a307786b4f2c8f9c1197f7007a36 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:57:23.572184   553 tablet_service.cc:1511] Processing CreateTablet for tablet a16052ff474946cd8f60307f76e070c6 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:57:23.571117   554 tablet_service.cc:1511] Processing CreateTablet for tablet 995ef6e306984e489cb5ddb6a810766e (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:57:23.583729   705 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4a248a564f4dfea44d76b1a0890c16 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:57:23.588359   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4a248a564f4dfea44d76b1a0890c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.593953   556 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4a248a564f4dfea44d76b1a0890c16 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:57:23.595587   549 tablet_service.cc:1511] Processing CreateTablet for tablet 258ad8e4f9934e38915c725ddeb66476 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:57:23.605072   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4a248a564f4dfea44d76b1a0890c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.610092   758 tablet_bootstrap.cc:492] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113: Bootstrap starting.
I20260709 12:57:23.614611   551 tablet_service.cc:1511] Processing CreateTablet for tablet ddc1580435fa48ef83af27238f7fd421 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:57:23.624536   700 tablet_service.cc:1511] Processing CreateTablet for tablet ddc1580435fa48ef83af27238f7fd421 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:57:23.620522   704 tablet_service.cc:1511] Processing CreateTablet for tablet 1074a307786b4f2c8f9c1197f7007a36 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:57:23.606850   550 tablet_service.cc:1511] Processing CreateTablet for tablet 0e915b506968455a8bf0a49a69d24bd5 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:57:23.628677   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 258ad8e4f9934e38915c725ddeb66476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.632300   701 tablet_service.cc:1511] Processing CreateTablet for tablet 59793ce40b114fae99146e21be9f2847 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:57:23.610242   552 tablet_service.cc:1511] Processing CreateTablet for tablet 59793ce40b114fae99146e21be9f2847 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:57:23.629217   699 tablet_service.cc:1511] Processing CreateTablet for tablet 0e915b506968455a8bf0a49a69d24bd5 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:57:23.612144   703 tablet_service.cc:1511] Processing CreateTablet for tablet 995ef6e306984e489cb5ddb6a810766e (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:57:23.645126   548 tablet_service.cc:1511] Processing CreateTablet for tablet 1478258de7414f83852bcf506f6a6268 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:57:23.656883   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1074a307786b4f2c8f9c1197f7007a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.654033   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddc1580435fa48ef83af27238f7fd421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.664147   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e915b506968455a8bf0a49a69d24bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.647363   702 tablet_service.cc:1511] Processing CreateTablet for tablet a16052ff474946cd8f60307f76e070c6 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:57:23.662529   626 tablet_service.cc:1511] Processing CreateTablet for tablet 1478258de7414f83852bcf506f6a6268 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:57:23.667932   698 tablet_service.cc:1511] Processing CreateTablet for tablet 258ad8e4f9934e38915c725ddeb66476 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:57:23.669786   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1478258de7414f83852bcf506f6a6268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.675712   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddc1580435fa48ef83af27238f7fd421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.679138   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1478258de7414f83852bcf506f6a6268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.678587   697 tablet_service.cc:1511] Processing CreateTablet for tablet 1478258de7414f83852bcf506f6a6268 (DEFAULT_TABLE table=test-workload [id=f7e756df9e9341d5a5ffd65e35f64ac3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:57:23.684283   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1074a307786b4f2c8f9c1197f7007a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.685459   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995ef6e306984e489cb5ddb6a810766e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.690042   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e915b506968455a8bf0a49a69d24bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.704510   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995ef6e306984e489cb5ddb6a810766e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.707537   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16052ff474946cd8f60307f76e070c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.714437   697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1478258de7414f83852bcf506f6a6268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.718577   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16052ff474946cd8f60307f76e070c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.721453   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59793ce40b114fae99146e21be9f2847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.731302   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 258ad8e4f9934e38915c725ddeb66476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.769249   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59793ce40b114fae99146e21be9f2847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:23.834321   758 tablet_bootstrap.cc:654] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:23.871624   591 heartbeater.cc:499] Master 127.0.107.254:34263 was elected leader, sending a full tablet report...
I20260709 12:57:23.883731   759 tablet_bootstrap.cc:492] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590: Bootstrap starting.
I20260709 12:57:23.884459   758 tablet_bootstrap.cc:492] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113: No bootstrap required, opened a new log
I20260709 12:57:23.885070   758 ts_tablet_manager.cc:1403] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113: Time spent bootstrapping tablet: real 0.295s	user 0.030s	sys 0.022s
I20260709 12:57:23.889998   761 tablet_bootstrap.cc:492] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7: Bootstrap starting.
I20260709 12:57:23.905453   758 raft_consensus.cc:359] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:23.906657   758 raft_consensus.cc:385] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:23.907007   758 raft_consensus.cc:740] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Initialized, Role: FOLLOWER
I20260709 12:57:23.907354   761 tablet_bootstrap.cc:654] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:23.908094   758 consensus_queue.cc:260] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:23.907357   759 tablet_bootstrap.cc:654] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:23.919556   666 heartbeater.cc:499] Master 127.0.107.254:34263 was elected leader, sending a full tablet report...
I20260709 12:57:23.920048   758 ts_tablet_manager.cc:1434] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.007s
I20260709 12:57:23.921206   758 tablet_bootstrap.cc:492] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113: Bootstrap starting.
I20260709 12:57:23.927774   761 tablet_bootstrap.cc:492] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7: No bootstrap required, opened a new log
I20260709 12:57:23.928449   761 ts_tablet_manager.cc:1403] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.012s
I20260709 12:57:23.929961   758 tablet_bootstrap.cc:654] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:23.931959   759 tablet_bootstrap.cc:492] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590: No bootstrap required, opened a new log
I20260709 12:57:23.932477   759 ts_tablet_manager.cc:1403] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.008s
I20260709 12:57:23.934368   761 raft_consensus.cc:359] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:23.935209   761 raft_consensus.cc:385] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:23.935570   761 raft_consensus.cc:740] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Initialized, Role: FOLLOWER
I20260709 12:57:23.936571   761 consensus_queue.cc:260] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:23.936417   759 raft_consensus.cc:359] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:23.937680   759 raft_consensus.cc:385] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:23.938187   759 raft_consensus.cc:740] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Initialized, Role: FOLLOWER
I20260709 12:57:23.939258   759 consensus_queue.cc:260] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:23.951064   759 ts_tablet_manager.cc:1434] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.010s
I20260709 12:57:23.953338   759 tablet_bootstrap.cc:492] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590: Bootstrap starting.
I20260709 12:57:23.961084   759 tablet_bootstrap.cc:654] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:23.963294   761 ts_tablet_manager.cc:1434] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.019s
I20260709 12:57:23.964143   740 heartbeater.cc:499] Master 127.0.107.254:34263 was elected leader, sending a full tablet report...
I20260709 12:57:23.964471   761 tablet_bootstrap.cc:492] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7: Bootstrap starting.
I20260709 12:57:23.969704   758 tablet_bootstrap.cc:492] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113: No bootstrap required, opened a new log
I20260709 12:57:23.970299   758 ts_tablet_manager.cc:1403] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.017s
I20260709 12:57:23.981343   759 tablet_bootstrap.cc:492] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590: No bootstrap required, opened a new log
I20260709 12:57:23.981832   761 tablet_bootstrap.cc:654] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:23.973533   758 raft_consensus.cc:359] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:23.981984   759 ts_tablet_manager.cc:1403] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.007s
I20260709 12:57:23.982281   758 raft_consensus.cc:385] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:23.982647   758 raft_consensus.cc:740] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Initialized, Role: FOLLOWER
I20260709 12:57:23.984313   758 consensus_queue.cc:260] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:23.987098   759 raft_consensus.cc:359] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:23.987877   759 raft_consensus.cc:385] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:23.988191   759 raft_consensus.cc:740] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Initialized, Role: FOLLOWER
I20260709 12:57:23.988974   759 consensus_queue.cc:260] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:23.991250   759 ts_tablet_manager.cc:1434] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:57:23.995213   759 tablet_bootstrap.cc:492] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590: Bootstrap starting.
I20260709 12:57:23.998360   758 ts_tablet_manager.cc:1434] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.004s
I20260709 12:57:24.002974   758 tablet_bootstrap.cc:492] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113: Bootstrap starting.
I20260709 12:57:24.006399   759 tablet_bootstrap.cc:654] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:24.010232   741 tablet.cc:2406] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:57:24.014802   758 tablet_bootstrap.cc:654] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.016855   761 tablet_bootstrap.cc:492] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7: No bootstrap required, opened a new log
I20260709 12:57:24.017390   761 ts_tablet_manager.cc:1403] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.021s
I20260709 12:57:24.021360   761 raft_consensus.cc:359] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.022083   761 raft_consensus.cc:385] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.022359   761 raft_consensus.cc:740] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.024032   761 consensus_queue.cc:260] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.026165   761 ts_tablet_manager.cc:1434] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:57:24.027216   761 tablet_bootstrap.cc:492] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7: Bootstrap starting.
I20260709 12:57:24.029385   759 tablet_bootstrap.cc:492] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590: No bootstrap required, opened a new log
I20260709 12:57:24.030701   759 ts_tablet_manager.cc:1403] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.012s
I20260709 12:57:24.031224   758 tablet_bootstrap.cc:492] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113: No bootstrap required, opened a new log
I20260709 12:57:24.031790   758 ts_tablet_manager.cc:1403] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.007s
I20260709 12:57:24.034808   759 raft_consensus.cc:359] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.035593   761 tablet_bootstrap.cc:654] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.035673   759 raft_consensus.cc:385] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.036173   759 raft_consensus.cc:740] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.036989   759 consensus_queue.cc:260] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.044831   759 ts_tablet_manager.cc:1434] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 12:57:24.043908   758 raft_consensus.cc:359] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.045254   758 raft_consensus.cc:385] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.045584   758 raft_consensus.cc:740] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.045869   759 tablet_bootstrap.cc:492] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590: Bootstrap starting.
I20260709 12:57:24.046392   758 consensus_queue.cc:260] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.055912   758 ts_tablet_manager.cc:1434] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.006s
I20260709 12:57:24.057551   761 tablet_bootstrap.cc:492] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7: No bootstrap required, opened a new log
I20260709 12:57:24.058084   761 ts_tablet_manager.cc:1403] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.005s
I20260709 12:57:24.058794   759 tablet_bootstrap.cc:654] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.063195   758 tablet_bootstrap.cc:492] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113: Bootstrap starting.
I20260709 12:57:24.065109   761 raft_consensus.cc:359] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.066006   761 raft_consensus.cc:385] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.066352   761 raft_consensus.cc:740] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.067139   761 consensus_queue.cc:260] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.069497   761 ts_tablet_manager.cc:1434] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:57:24.069598   759 tablet_bootstrap.cc:492] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590: No bootstrap required, opened a new log
I20260709 12:57:24.070155   759 ts_tablet_manager.cc:1403] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.001s
I20260709 12:57:24.070515   761 tablet_bootstrap.cc:492] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7: Bootstrap starting.
I20260709 12:57:24.073489   758 tablet_bootstrap.cc:654] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.073992   759 raft_consensus.cc:359] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.083176   761 tablet_bootstrap.cc:654] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.083170   759 raft_consensus.cc:385] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.083721   759 raft_consensus.cc:740] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.084703   759 consensus_queue.cc:260] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.088832   762 raft_consensus.cc:493] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.089519   762 raft_consensus.cc:515] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.091768   759 ts_tablet_manager.cc:1434] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:57:24.092856   759 tablet_bootstrap.cc:492] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590: Bootstrap starting.
I20260709 12:57:24.096321   762 leader_election.cc:290] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.102475   759 tablet_bootstrap.cc:654] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.103202   758 tablet_bootstrap.cc:492] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113: No bootstrap required, opened a new log
I20260709 12:57:24.103709   758 ts_tablet_manager.cc:1403] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.007s
I20260709 12:57:24.107899   758 raft_consensus.cc:359] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.108664   758 raft_consensus.cc:385] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.112592   758 raft_consensus.cc:740] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.118077   758 consensus_queue.cc:260] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.120445   759 tablet_bootstrap.cc:492] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590: No bootstrap required, opened a new log
I20260709 12:57:24.121055   759 ts_tablet_manager.cc:1403] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.011s
I20260709 12:57:24.123163   758 ts_tablet_manager.cc:1434] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:57:24.124250   758 tablet_bootstrap.cc:492] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113: Bootstrap starting.
I20260709 12:57:24.124778   759 raft_consensus.cc:359] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.125618   759 raft_consensus.cc:385] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.125985   759 raft_consensus.cc:740] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.126858   759 consensus_queue.cc:260] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.135953   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7" is_pre_election: true
I20260709 12:57:24.136453   759 ts_tablet_manager.cc:1434] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:57:24.136916   715 raft_consensus.cc:2468] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 0.
I20260709 12:57:24.137862   767 raft_consensus.cc:493] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.138406   767 raft_consensus.cc:515] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.139403   761 tablet_bootstrap.cc:492] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7: No bootstrap required, opened a new log
I20260709 12:57:24.139778   761 ts_tablet_manager.cc:1403] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.000s
I20260709 12:57:24.140355   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590" is_pre_election: true
I20260709 12:57:24.141131   566 raft_consensus.cc:2468] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 0.
I20260709 12:57:24.142379   766 raft_consensus.cc:493] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.142447   767 leader_election.cc:290] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.143006   766 raft_consensus.cc:515] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.137543   759 tablet_bootstrap.cc:492] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590: Bootstrap starting.
I20260709 12:57:24.146323   761 raft_consensus.cc:359] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.147823   761 raft_consensus.cc:385] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.147639   606 leader_election.cc:304] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:24.149044   762 raft_consensus.cc:2804] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:24.150099   762 raft_consensus.cc:493] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.148490   761 raft_consensus.cc:740] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.151448   766 leader_election.cc:290] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:24.152555   762 raft_consensus.cc:3060] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.167946   761 consensus_queue.cc:260] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.182602   762 raft_consensus.cc:515] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.190431   761 ts_tablet_manager.cc:1434] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7: Time spent starting tablet: real 0.050s	user 0.011s	sys 0.000s
I20260709 12:57:24.189680   766 raft_consensus.cc:493] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.196774   761 tablet_bootstrap.cc:492] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7: Bootstrap starting.
I20260709 12:57:24.193523   766 raft_consensus.cc:515] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.198197   758 tablet_bootstrap.cc:654] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.199741   766 leader_election.cc:290] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:24.203610   767 raft_consensus.cc:493] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.204309   767 raft_consensus.cc:515] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.208575   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:24.210676   566 raft_consensus.cc:3060] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.215780   767 leader_election.cc:290] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.216475   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:24.217307   715 raft_consensus.cc:3060] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.219103   762 leader_election.cc:290] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 1 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.224051   759 tablet_bootstrap.cc:654] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.228173   766 raft_consensus.cc:493] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.229238   766 raft_consensus.cc:515] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.234792   766 leader_election.cc:290] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:24.236864   566 raft_consensus.cc:2468] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 1.
I20260709 12:57:24.238462   606 leader_election.cc:304] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:24.239616   762 raft_consensus.cc:2804] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:24.256078   715 raft_consensus.cc:2468] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 1.
I20260709 12:57:24.277952   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4a248a564f4dfea44d76b1a0890c16" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7" is_pre_election: true
I20260709 12:57:24.276795   762 raft_consensus.cc:697] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 1 LEADER]: Becoming Leader. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:24.284360   761 tablet_bootstrap.cc:654] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.284009   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc1580435fa48ef83af27238f7fd421" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7" is_pre_election: true
W20260709 12:57:24.286578   529 leader_election.cc:343] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:24.289794   529 leader_election.cc:343] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:24.290822   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16052ff474946cd8f60307f76e070c6" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590" is_pre_election: true
I20260709 12:57:24.289239   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590" is_pre_election: true
I20260709 12:57:24.290967   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e915b506968455a8bf0a49a69d24bd5" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590" is_pre_election: true
I20260709 12:57:24.294548   566 raft_consensus.cc:2393] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 295b837450d340428c2da51136bf4cd7 in current term 1: Already voted for candidate 598e24a4a3614aa3b30ffb158636a113 in this term.
I20260709 12:57:24.291693   762 consensus_queue.cc:237] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.299149   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4a248a564f4dfea44d76b1a0890c16" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:24.299909   641 raft_consensus.cc:2468] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 0.
W20260709 12:57:24.302104   680 leader_election.cc:343] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:24.297698   564 raft_consensus.cc:2468] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 0.
I20260709 12:57:24.300614   758 tablet_bootstrap.cc:492] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113: No bootstrap required, opened a new log
I20260709 12:57:24.305909   680 leader_election.cc:304] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:24.307781   759 tablet_bootstrap.cc:492] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590: No bootstrap required, opened a new log
I20260709 12:57:24.307654   758 ts_tablet_manager.cc:1403] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113: Time spent bootstrapping tablet: real 0.184s	user 0.027s	sys 0.005s
I20260709 12:57:24.309145   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:24.304649   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc1580435fa48ef83af27238f7fd421" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:24.309234   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16052ff474946cd8f60307f76e070c6" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:24.306221   531 leader_election.cc:304] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 295b837450d340428c2da51136bf4cd7
I20260709 12:57:24.310566   766 raft_consensus.cc:2804] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:24.311384   766 raft_consensus.cc:493] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.309664   759 ts_tablet_manager.cc:1403] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590: Time spent bootstrapping tablet: real 0.172s	user 0.020s	sys 0.004s
I20260709 12:57:24.311758   766 raft_consensus.cc:3060] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.312098   767 raft_consensus.cc:2804] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:24.306977   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e915b506968455a8bf0a49a69d24bd5" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:24.313055   767 raft_consensus.cc:493] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.314487   767 raft_consensus.cc:3060] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.315090   639 raft_consensus.cc:2468] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 0.
I20260709 12:57:24.315760   641 raft_consensus.cc:2468] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 0.
I20260709 12:57:24.321751   531 leader_election.cc:304] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 295b837450d340428c2da51136bf4cd7
I20260709 12:57:24.327653   680 leader_election.cc:304] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 295b837450d340428c2da51136bf4cd7; no voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590
I20260709 12:57:24.322194   758 raft_consensus.cc:359] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.331897   758 raft_consensus.cc:385] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.332266   758 raft_consensus.cc:740] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.333070   758 consensus_queue.cc:260] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.334877   766 raft_consensus.cc:515] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.339720   766 leader_election.cc:290] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:24.340333   766 raft_consensus.cc:2749] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:24.338840   758 ts_tablet_manager.cc:1434] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.001s
I20260709 12:57:24.341961   758 tablet_bootstrap.cc:492] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113: Bootstrap starting.
I20260709 12:57:24.343268   759 raft_consensus.cc:359] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.344058   759 raft_consensus.cc:385] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.345139   759 raft_consensus.cc:740] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.353627   759 consensus_queue.cc:260] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.352486   767 raft_consensus.cc:515] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.366523   680 leader_election.cc:304] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, 598e24a4a3614aa3b30ffb158636a113; no voters: b1e020e1df5446c493307cbb386ac590
I20260709 12:57:24.366541   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e915b506968455a8bf0a49a69d24bd5" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
W20260709 12:57:24.367972   680 leader_election.cc:343] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:24.371068   792 raft_consensus.cc:2804] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:24.365886   767 leader_election.cc:290] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 election: Requested vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.371306   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4a248a564f4dfea44d76b1a0890c16" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:24.371388   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e915b506968455a8bf0a49a69d24bd5" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:24.364322   791 raft_consensus.cc:2804] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:24.373240   564 raft_consensus.cc:3060] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.373845   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4a248a564f4dfea44d76b1a0890c16" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:24.372917   641 raft_consensus.cc:3060] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:24.377580   529 leader_election.cc:343] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:24.382957   761 tablet_bootstrap.cc:492] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7: No bootstrap required, opened a new log
I20260709 12:57:24.383620   761 ts_tablet_manager.cc:1403] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7: Time spent bootstrapping tablet: real 0.189s	user 0.014s	sys 0.010s
I20260709 12:57:24.379630   791 raft_consensus.cc:493] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.385004   791 raft_consensus.cc:3060] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.388875   761 raft_consensus.cc:359] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.378173   462 catalog_manager.cc:5697] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 reported cstate change: term changed from 0 to 1, leader changed from <none> to 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "598e24a4a3614aa3b30ffb158636a113" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:24.377043   792 raft_consensus.cc:493] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:24.380313   680 leader_election.cc:343] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:24.396109   758 tablet_bootstrap.cc:654] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.396030   564 raft_consensus.cc:2468] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 1.
I20260709 12:57:24.398578   761 raft_consensus.cc:385] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.400537   792 raft_consensus.cc:3060] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.408557   761 raft_consensus.cc:740] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.411140   761 consensus_queue.cc:260] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.414621   680 leader_election.cc:304] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, b1e020e1df5446c493307cbb386ac590; no voters: 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:24.419754   761 ts_tablet_manager.cc:1434] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.005s
I20260709 12:57:24.420698   766 raft_consensus.cc:2804] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:24.430693   761 tablet_bootstrap.cc:492] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7: Bootstrap starting.
W20260709 12:57:24.436254   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:24.436818   641 raft_consensus.cc:2468] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 1.
I20260709 12:57:24.438918   531 leader_election.cc:304] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 295b837450d340428c2da51136bf4cd7
I20260709 12:57:24.439886   767 raft_consensus.cc:2804] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:24.440471   767 raft_consensus.cc:697] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Becoming Leader. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:24.441380   767 consensus_queue.cc:237] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.443392   792 raft_consensus.cc:515] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.450237   766 raft_consensus.cc:697] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Becoming Leader. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Running, Role: LEADER
I20260709 12:57:24.455204   759 ts_tablet_manager.cc:1434] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590: Time spent starting tablet: real 0.140s	user 0.014s	sys 0.027s
I20260709 12:57:24.456754   759 tablet_bootstrap.cc:492] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590: Bootstrap starting.
I20260709 12:57:24.457365   758 tablet_bootstrap.cc:492] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113: No bootstrap required, opened a new log
I20260709 12:57:24.459674   758 ts_tablet_manager.cc:1403] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.011s
I20260709 12:57:24.467092   758 raft_consensus.cc:359] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.469987   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16052ff474946cd8f60307f76e070c6" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:24.469826   791 raft_consensus.cc:515] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
W20260709 12:57:24.473285   680 leader_election.cc:343] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:24.468848   758 raft_consensus.cc:385] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.452579   766 consensus_queue.cc:237] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.474217   758 raft_consensus.cc:740] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.476662   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16052ff474946cd8f60307f76e070c6" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:24.476933   791 leader_election.cc:290] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 election: Requested vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.478372   641 raft_consensus.cc:3060] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.478790   758 consensus_queue.cc:260] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.479197   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc1580435fa48ef83af27238f7fd421" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:24.474654   463 catalog_manager.cc:5697] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1e020e1df5446c493307cbb386ac590 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b1e020e1df5446c493307cbb386ac590" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:24.480002   638 raft_consensus.cc:3060] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.481045   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc1580435fa48ef83af27238f7fd421" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:24.481060   761 tablet_bootstrap.cc:654] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.475329   792 leader_election.cc:290] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:24.484308   758 ts_tablet_manager.cc:1434] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.007s
W20260709 12:57:24.486354   529 leader_election.cc:343] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:24.486753   758 tablet_bootstrap.cc:492] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113: Bootstrap starting.
I20260709 12:57:24.487546   759 tablet_bootstrap.cc:654] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.492377   638 raft_consensus.cc:2468] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 1.
I20260709 12:57:24.499572   758 tablet_bootstrap.cc:654] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.500047   531 leader_election.cc:304] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 295b837450d340428c2da51136bf4cd7
I20260709 12:57:24.500984   791 raft_consensus.cc:2804] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:24.501900   791 raft_consensus.cc:697] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Becoming Leader. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:24.503125   641 raft_consensus.cc:2468] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 1.
I20260709 12:57:24.503949   791 consensus_queue.cc:237] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.504277   680 leader_election.cc:304] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, 598e24a4a3614aa3b30ffb158636a113; no voters: b1e020e1df5446c493307cbb386ac590
I20260709 12:57:24.505585   792 raft_consensus.cc:2804] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:24.506109   792 raft_consensus.cc:697] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Becoming Leader. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Running, Role: LEADER
I20260709 12:57:24.506958   792 consensus_queue.cc:237] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.515197   759 tablet_bootstrap.cc:492] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590: No bootstrap required, opened a new log
I20260709 12:57:24.515905   759 ts_tablet_manager.cc:1403] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.003s
I20260709 12:57:24.520581   759 raft_consensus.cc:359] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.521281   759 raft_consensus.cc:385] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.521654   759 raft_consensus.cc:740] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.523842   767 raft_consensus.cc:493] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.524530   767 raft_consensus.cc:515] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.528718   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478258de7414f83852bcf506f6a6268" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:24.529299   767 leader_election.cc:290] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
W20260709 12:57:24.530194   531 leader_election.cc:343] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:24.530109   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478258de7414f83852bcf506f6a6268" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7" is_pre_election: true
W20260709 12:57:24.531950   529 leader_election.cc:343] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:24.532438   529 leader_election.cc:304] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e020e1df5446c493307cbb386ac590; no voters: 295b837450d340428c2da51136bf4cd7, 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:24.533265   767 raft_consensus.cc:2749] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:24.533555   759 consensus_queue.cc:260] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.537446   759 ts_tablet_manager.cc:1434] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:57:24.538606   759 tablet_bootstrap.cc:492] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590: Bootstrap starting.
I20260709 12:57:24.546247   766 raft_consensus.cc:493] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.547226   766 raft_consensus.cc:515] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.550971   759 tablet_bootstrap.cc:654] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.552794   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590" is_pre_election: true
W20260709 12:57:24.556164   680 leader_election.cc:343] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:24.553822   461 catalog_manager.cc:5697] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 295b837450d340428c2da51136bf4cd7 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "295b837450d340428c2da51136bf4cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:24.560197   766 leader_election.cc:290] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:24.561798   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:24.562674   641 raft_consensus.cc:2468] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 0.
I20260709 12:57:24.564205   761 tablet_bootstrap.cc:492] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7: No bootstrap required, opened a new log
I20260709 12:57:24.564119   680 leader_election.cc:304] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, 598e24a4a3614aa3b30ffb158636a113; no voters: b1e020e1df5446c493307cbb386ac590
I20260709 12:57:24.564746   761 ts_tablet_manager.cc:1403] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7: Time spent bootstrapping tablet: real 0.134s	user 0.020s	sys 0.009s
I20260709 12:57:24.568964   766 raft_consensus.cc:2804] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:24.569489   766 raft_consensus.cc:493] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.568966   761 raft_consensus.cc:359] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.569857   766 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.570266   761 raft_consensus.cc:385] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.570643   761 raft_consensus.cc:740] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.571553   761 consensus_queue.cc:260] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.571676   463 catalog_manager.cc:5697] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1e020e1df5446c493307cbb386ac590 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b1e020e1df5446c493307cbb386ac590" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:24.574860   761 ts_tablet_manager.cc:1434] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.004s
I20260709 12:57:24.576009   761 tablet_bootstrap.cc:492] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7: Bootstrap starting.
I20260709 12:57:24.577834   758 tablet_bootstrap.cc:492] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113: No bootstrap required, opened a new log
I20260709 12:57:24.578364   758 ts_tablet_manager.cc:1403] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113: Time spent bootstrapping tablet: real 0.092s	user 0.019s	sys 0.032s
I20260709 12:57:24.582208   791 raft_consensus.cc:493] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.582716   791 raft_consensus.cc:515] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.585055   758 raft_consensus.cc:359] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.585778   758 raft_consensus.cc:385] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.586122   758 raft_consensus.cc:740] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.588498   767 raft_consensus.cc:493] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.589035   767 raft_consensus.cc:515] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.590026   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16052ff474946cd8f60307f76e070c6" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:24.591162   641 raft_consensus.cc:2393] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e020e1df5446c493307cbb386ac590 in current term 1: Already voted for candidate 295b837450d340428c2da51136bf4cd7 in this term.
I20260709 12:57:24.592363   767 leader_election.cc:290] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.593582   791 leader_election.cc:290] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.597826   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16052ff474946cd8f60307f76e070c6" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7" is_pre_election: true
I20260709 12:57:24.598791   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7" is_pre_election: true
I20260709 12:57:24.599972   714 raft_consensus.cc:2468] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 0.
I20260709 12:57:24.600206   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:24.600842   641 raft_consensus.cc:2468] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 0.
I20260709 12:57:24.601189   529 leader_election.cc:304] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:24.602370   759 tablet_bootstrap.cc:492] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590: No bootstrap required, opened a new log
I20260709 12:57:24.602856   759 ts_tablet_manager.cc:1403] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.021s
I20260709 12:57:24.603814   791 raft_consensus.cc:2804] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:24.602911   766 raft_consensus.cc:515] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.605335   791 raft_consensus.cc:493] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.605813   791 raft_consensus.cc:3060] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.599705   758 consensus_queue.cc:260] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.604393   529 leader_election.cc:304] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e020e1df5446c493307cbb386ac590; no voters: 295b837450d340428c2da51136bf4cd7, 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:24.609067   767 raft_consensus.cc:3060] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.610323   759 raft_consensus.cc:359] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.611043   759 raft_consensus.cc:385] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.611315   759 raft_consensus.cc:740] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.607622   461 catalog_manager.cc:5697] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 295b837450d340428c2da51136bf4cd7 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "295b837450d340428c2da51136bf4cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:24.612015   759 consensus_queue.cc:260] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.614919   761 tablet_bootstrap.cc:654] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.616933   766 leader_election.cc:290] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:24.617654   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:24.619518   758 ts_tablet_manager.cc:1434] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.001s
W20260709 12:57:24.620201   680 leader_election.cc:343] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:24.620579   758 tablet_bootstrap.cc:492] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113: Bootstrap starting.
I20260709 12:57:24.621656   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:24.622008   759 ts_tablet_manager.cc:1434] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:57:24.622323   641 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.623024   759 tablet_bootstrap.cc:492] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590: Bootstrap starting.
I20260709 12:57:24.627708   767 raft_consensus.cc:2749] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:24.641605   759 tablet_bootstrap.cc:654] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.642172   791 raft_consensus.cc:515] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.646734   641 raft_consensus.cc:2468] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 1.
I20260709 12:57:24.648283   680 leader_election.cc:304] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, 598e24a4a3614aa3b30ffb158636a113; no voters: b1e020e1df5446c493307cbb386ac590
I20260709 12:57:24.649179   761 tablet_bootstrap.cc:492] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7: No bootstrap required, opened a new log
I20260709 12:57:24.650471   761 ts_tablet_manager.cc:1403] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.010s
I20260709 12:57:24.651703   766 raft_consensus.cc:2804] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:24.652300   766 raft_consensus.cc:697] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Becoming Leader. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Running, Role: LEADER
I20260709 12:57:24.653257   766 consensus_queue.cc:237] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.654593   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:24.655055   758 tablet_bootstrap.cc:654] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.655244   641 raft_consensus.cc:3060] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.659550   761 raft_consensus.cc:359] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.660606   761 raft_consensus.cc:385] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.661000   761 raft_consensus.cc:740] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.664186   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:24.664847   791 leader_election.cc:290] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 election: Requested vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.664951   715 raft_consensus.cc:3060] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.668785   641 raft_consensus.cc:2468] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 1.
I20260709 12:57:24.670233   531 leader_election.cc:304] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:24.670593   761 consensus_queue.cc:260] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.671159   791 raft_consensus.cc:2804] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:24.671662   791 raft_consensus.cc:697] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Becoming Leader. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:24.673333   791 consensus_queue.cc:237] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.673910   761 ts_tablet_manager.cc:1434] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.005s
I20260709 12:57:24.674842   715 raft_consensus.cc:2468] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 1.
I20260709 12:57:24.675160   761 tablet_bootstrap.cc:492] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7: Bootstrap starting.
I20260709 12:57:24.678431   759 tablet_bootstrap.cc:492] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590: No bootstrap required, opened a new log
I20260709 12:57:24.679720   759 ts_tablet_manager.cc:1403] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590: Time spent bootstrapping tablet: real 0.057s	user 0.027s	sys 0.003s
I20260709 12:57:24.684502   758 tablet_bootstrap.cc:492] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113: No bootstrap required, opened a new log
I20260709 12:57:24.683831   463 catalog_manager.cc:5697] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 295b837450d340428c2da51136bf4cd7 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "295b837450d340428c2da51136bf4cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:24.685751   758 ts_tablet_manager.cc:1403] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.007s
I20260709 12:57:24.686532   759 raft_consensus.cc:359] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.687168   759 raft_consensus.cc:385] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.687402   759 raft_consensus.cc:740] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.688097   759 consensus_queue.cc:260] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.688796   758 raft_consensus.cc:359] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.689465   758 raft_consensus.cc:385] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.689651   758 raft_consensus.cc:740] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.690227   759 ts_tablet_manager.cc:1434] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:57:24.690415   758 consensus_queue.cc:260] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.695751   758 ts_tablet_manager.cc:1434] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:57:24.696869   758 tablet_bootstrap.cc:492] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113: Bootstrap starting.
I20260709 12:57:24.697454   461 catalog_manager.cc:5697] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1e020e1df5446c493307cbb386ac590 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b1e020e1df5446c493307cbb386ac590" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:24.705900   758 tablet_bootstrap.cc:654] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.715968   761 tablet_bootstrap.cc:654] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.725615   758 tablet_bootstrap.cc:492] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113: No bootstrap required, opened a new log
I20260709 12:57:24.726176   758 ts_tablet_manager.cc:1403] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.011s
I20260709 12:57:24.726182   761 tablet_bootstrap.cc:492] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7: No bootstrap required, opened a new log
I20260709 12:57:24.727088   761 ts_tablet_manager.cc:1403] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.006s
I20260709 12:57:24.728545   758 raft_consensus.cc:359] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.729097   758 raft_consensus.cc:385] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.729282   758 raft_consensus.cc:740] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.730715   758 consensus_queue.cc:260] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.730891   761 raft_consensus.cc:359] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.731701   761 raft_consensus.cc:385] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.732019   761 raft_consensus.cc:740] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.732841   761 consensus_queue.cc:260] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.734304   758 ts_tablet_manager.cc:1434] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:57:24.736069   761 ts_tablet_manager.cc:1434] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:57:24.738692   761 tablet_bootstrap.cc:492] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7: Bootstrap starting.
I20260709 12:57:24.746263   761 tablet_bootstrap.cc:654] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:24.754732   761 tablet_bootstrap.cc:492] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7: No bootstrap required, opened a new log
I20260709 12:57:24.755312   761 ts_tablet_manager.cc:1403] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.010s
I20260709 12:57:24.759702   761 raft_consensus.cc:359] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.760826   761 raft_consensus.cc:385] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:24.761106   761 raft_consensus.cc:740] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Initialized, Role: FOLLOWER
I20260709 12:57:24.761861   761 consensus_queue.cc:260] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.764264   761 ts_tablet_manager.cc:1434] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:57:24.809793   762 consensus_queue.cc:1048] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:24.830382   791 consensus_queue.cc:1048] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:24.835469   788 consensus_queue.cc:1048] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:24.853433   766 raft_consensus.cc:493] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.854840   766 raft_consensus.cc:515] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.855926   762 raft_consensus.cc:493] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.856449   762 raft_consensus.cc:515] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.856927   766 leader_election.cc:290] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:24.858915   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:24.859558   641 raft_consensus.cc:2468] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 0.
I20260709 12:57:24.860046   791 raft_consensus.cc:493] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.860663   791 raft_consensus.cc:515] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.861630   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590" is_pre_election: true
I20260709 12:57:24.862280   564 raft_consensus.cc:2468] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 0.
I20260709 12:57:24.862890   791 leader_election.cc:290] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.864979   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:24.866488   714 raft_consensus.cc:3060] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.872812   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590" is_pre_election: true
I20260709 12:57:24.873500   564 raft_consensus.cc:2468] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 0.
I20260709 12:57:24.874799   680 leader_election.cc:304] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:24.875439   606 leader_election.cc:304] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:24.875972   762 leader_election.cc:290] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.878108   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7" is_pre_election: true
I20260709 12:57:24.878839   713 raft_consensus.cc:2468] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 0.
I20260709 12:57:24.883256   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7" is_pre_election: true
I20260709 12:57:24.883949   715 raft_consensus.cc:2468] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 0.
I20260709 12:57:24.884886   766 raft_consensus.cc:2804] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:24.885303   766 raft_consensus.cc:493] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.885416   529 leader_election.cc:304] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, b1e020e1df5446c493307cbb386ac590; no voters: 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:24.885778   766 raft_consensus.cc:3060] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.886308   767 raft_consensus.cc:2804] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:24.886694   767 raft_consensus.cc:493] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.887039   767 raft_consensus.cc:3060] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.892143   762 raft_consensus.cc:2804] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:24.893842   762 raft_consensus.cc:493] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.894411   762 raft_consensus.cc:3060] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.898258   792 raft_consensus.cc:493] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.899614   792 raft_consensus.cc:515] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.906318   762 raft_consensus.cc:515] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.908017   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4a248a564f4dfea44d76b1a0890c16" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:24.903067   767 raft_consensus.cc:515] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.908389   794 consensus_queue.cc:1048] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:24.909080   796 consensus_queue.cc:1048] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:24.912659   792 leader_election.cc:290] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233)
I20260709 12:57:24.914153   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4a248a564f4dfea44d76b1a0890c16" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590" is_pre_election: true
I20260709 12:57:24.914777   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:24.916399   641 raft_consensus.cc:2393] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b1e020e1df5446c493307cbb386ac590 in current term 1: Already voted for candidate 598e24a4a3614aa3b30ffb158636a113 in this term.
I20260709 12:57:24.917397   680 leader_election.cc:304] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 295b837450d340428c2da51136bf4cd7; no voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590
I20260709 12:57:24.922304   824 raft_consensus.cc:493] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.922911   824 raft_consensus.cc:515] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.923595   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:24.923990   762 leader_election.cc:290] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 1 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.924451   565 raft_consensus.cc:2393] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 598e24a4a3614aa3b30ffb158636a113 in current term 1: Already voted for candidate b1e020e1df5446c493307cbb386ac590 in this term.
I20260709 12:57:24.924818   796 raft_consensus.cc:493] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.925350   796 raft_consensus.cc:515] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.926537   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:24.928113   796 leader_election.cc:290] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:24.930193   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc1580435fa48ef83af27238f7fd421" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:24.931037   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e915b506968455a8bf0a49a69d24bd5" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590" is_pre_election: true
I20260709 12:57:24.931921   824 leader_election.cc:290] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.932526   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e915b506968455a8bf0a49a69d24bd5" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7" is_pre_election: true
I20260709 12:57:24.933667   767 leader_election.cc:290] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 election: Requested vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.934907   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:24.931056   641 raft_consensus.cc:2393] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 295b837450d340428c2da51136bf4cd7 in current term 1: Already voted for candidate b1e020e1df5446c493307cbb386ac590 in this term.
I20260709 12:57:24.936770   604 leader_election.cc:304] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113; no voters: 295b837450d340428c2da51136bf4cd7, b1e020e1df5446c493307cbb386ac590
I20260709 12:57:24.938481   824 raft_consensus.cc:2749] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:24.936118   766 raft_consensus.cc:515] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.931404   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc1580435fa48ef83af27238f7fd421" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590" is_pre_election: true
I20260709 12:57:24.941244   531 leader_election.cc:304] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e020e1df5446c493307cbb386ac590; no voters: 295b837450d340428c2da51136bf4cd7, 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:24.943441   680 leader_election.cc:304] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 295b837450d340428c2da51136bf4cd7; no voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590
I20260709 12:57:24.948042   794 raft_consensus.cc:2749] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:24.949039   794 consensus_queue.cc:1048] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:24.961993   824 raft_consensus.cc:493] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.962625   824 raft_consensus.cc:515] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:24.965931   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478258de7414f83852bcf506f6a6268" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590" is_pre_election: true
I20260709 12:57:24.966696   565 raft_consensus.cc:2468] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 0.
I20260709 12:57:24.968114   715 raft_consensus.cc:2393] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 598e24a4a3614aa3b30ffb158636a113 in current term 1: Already voted for candidate 295b837450d340428c2da51136bf4cd7 in this term.
I20260709 12:57:24.968130   606 leader_election.cc:304] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:24.971489   762 raft_consensus.cc:2804] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:24.971911   762 raft_consensus.cc:493] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.972254   762 raft_consensus.cc:3060] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.975023   792 raft_consensus.cc:2749] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.976521   824 leader_election.cc:290] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:24.976665   792 raft_consensus.cc:3060] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:24.978921   766 leader_election.cc:290] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:24.981884   604 leader_election.cc:304] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113; no voters: 295b837450d340428c2da51136bf4cd7, b1e020e1df5446c493307cbb386ac590
I20260709 12:57:24.984606   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478258de7414f83852bcf506f6a6268" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7" is_pre_election: true
I20260709 12:57:24.985354   714 raft_consensus.cc:2468] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 0.
I20260709 12:57:24.988790   824 raft_consensus.cc:2749] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:57:24.994895   680 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:46233, user_credentials={real_user=slave}} blocked reactor thread for 51513.7us
I20260709 12:57:24.997457   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:24.998661   565 raft_consensus.cc:2393] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 295b837450d340428c2da51136bf4cd7 in current term 1: Already voted for candidate b1e020e1df5446c493307cbb386ac590 in this term.
I20260709 12:57:25.006295   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:25.007378   639 raft_consensus.cc:2393] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 295b837450d340428c2da51136bf4cd7 in current term 1: Already voted for candidate 598e24a4a3614aa3b30ffb158636a113 in this term.
I20260709 12:57:25.007886   792 raft_consensus.cc:2749] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:25.010872   762 raft_consensus.cc:515] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:25.011590   639 raft_consensus.cc:3060] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:25.017728   767 consensus_queue.cc:1048] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:25.018337   680 leader_election.cc:304] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 295b837450d340428c2da51136bf4cd7; no voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590
I20260709 12:57:25.019770   762 leader_election.cc:290] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 1 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:25.020704   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478258de7414f83852bcf506f6a6268" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:25.021325   565 raft_consensus.cc:3060] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:25.022547   796 raft_consensus.cc:2749] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:25.024479   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478258de7414f83852bcf506f6a6268" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:25.025067   714 raft_consensus.cc:3060] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:25.053493   714 raft_consensus.cc:2468] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 1.
I20260709 12:57:25.061100   604 leader_election.cc:304] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, 598e24a4a3614aa3b30ffb158636a113; no voters: 
I20260709 12:57:25.060143   565 raft_consensus.cc:2468] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 1.
I20260709 12:57:25.063170   762 raft_consensus.cc:2804] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:25.074802   762 raft_consensus.cc:697] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 1 LEADER]: Becoming Leader. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:25.075721   762 consensus_queue.cc:237] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:25.082254   791 raft_consensus.cc:493] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.082918   791 raft_consensus.cc:515] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:25.084867   796 consensus_queue.cc:1048] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:25.087821   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:25.088739   641 raft_consensus.cc:2393] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1e020e1df5446c493307cbb386ac590 in current term 1: Already voted for candidate 295b837450d340428c2da51136bf4cd7 in this term.
I20260709 12:57:25.085577   827 consensus_queue.cc:1048] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:57:25.091143   791 leader_election.cc:290] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:25.092561   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7" is_pre_election: true
I20260709 12:57:25.095706   796 consensus_queue.cc:1048] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:25.096206   529 leader_election.cc:304] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1e020e1df5446c493307cbb386ac590; no voters: 295b837450d340428c2da51136bf4cd7, 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:25.097118   791 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:25.109469   791 raft_consensus.cc:2749] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:25.123000   460 catalog_manager.cc:5697] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 reported cstate change: term changed from 0 to 1, leader changed from <none> to 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "598e24a4a3614aa3b30ffb158636a113" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:25.164091   827 consensus_queue.cc:1048] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:25.177543   792 consensus_queue.cc:1048] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:25.186929   791 consensus_queue.cc:1048] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:25.205438   767 consensus_queue.cc:1048] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:57:25.441412   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:25.494547   762 consensus_queue.cc:1048] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:25.507622   762 consensus_queue.cc:1048] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:57:26.445683   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:26.482657   767 raft_consensus.cc:493] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.483345   767 raft_consensus.cc:515] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:26.485194   767 leader_election.cc:290] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:26.486167   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113" is_pre_election: true
I20260709 12:57:26.486280   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7" is_pre_election: true
I20260709 12:57:26.486784   639 raft_consensus.cc:2468] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 1.
I20260709 12:57:26.486874   715 raft_consensus.cc:2468] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 1.
I20260709 12:57:26.487974   531 leader_election.cc:304] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:26.488946   767 raft_consensus.cc:2804] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:26.489347   767 raft_consensus.cc:493] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.489728   767 raft_consensus.cc:3060] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:26.495306   767 raft_consensus.cc:515] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:26.497020   767 leader_election.cc:290] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 2 election: Requested vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:26.497997   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:26.498179   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:26.498577   639 raft_consensus.cc:3060] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:26.498750   715 raft_consensus.cc:3060] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:26.503612   639 raft_consensus.cc:2468] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 2.
I20260709 12:57:26.503613   715 raft_consensus.cc:2468] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 2.
I20260709 12:57:26.504992   531 leader_election.cc:304] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:26.505689   767 raft_consensus.cc:2804] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:26.506177   767 raft_consensus.cc:697] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Becoming Leader. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:26.507011   767 consensus_queue.cc:237] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:26.515079   460 catalog_manager.cc:5697] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 reported cstate change: term changed from 0 to 2, leader changed from <none> to b1e020e1df5446c493307cbb386ac590 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b1e020e1df5446c493307cbb386ac590" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:26.846040   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
mode: GRACEFUL
new_leader_uuid: "b1e020e1df5446c493307cbb386ac590"
 from {username='slave'} at 127.0.0.1:41684
I20260709 12:57:26.846799   639 raft_consensus.cc:606] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 1 LEADER]: Received request to transfer leadership to TS b1e020e1df5446c493307cbb386ac590
I20260709 12:57:26.860344   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a16052ff474946cd8f60307f76e070c6"
dest_uuid: "295b837450d340428c2da51136bf4cd7"
mode: GRACEFUL
new_leader_uuid: "b1e020e1df5446c493307cbb386ac590"
 from {username='slave'} at 127.0.0.1:38344
I20260709 12:57:26.860947   715 raft_consensus.cc:606] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Received request to transfer leadership to TS b1e020e1df5446c493307cbb386ac590
I20260709 12:57:26.874806   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59793ce40b114fae99146e21be9f2847"
dest_uuid: "b1e020e1df5446c493307cbb386ac590"
mode: GRACEFUL
new_leader_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:44184
I20260709 12:57:26.875464   565 raft_consensus.cc:606] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Received request to transfer leadership to TS 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:26.880652   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddc1580435fa48ef83af27238f7fd421"
dest_uuid: "b1e020e1df5446c493307cbb386ac590"
mode: GRACEFUL
new_leader_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:44184
I20260709 12:57:26.881240   565 raft_consensus.cc:606] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Received request to transfer leadership to TS 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:26.886248   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e915b506968455a8bf0a49a69d24bd5"
dest_uuid: "295b837450d340428c2da51136bf4cd7"
mode: GRACEFUL
new_leader_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:38344
I20260709 12:57:26.886798   715 raft_consensus.cc:606] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Received request to transfer leadership to TS 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:26.891515   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476"
dest_uuid: "295b837450d340428c2da51136bf4cd7"
mode: GRACEFUL
new_leader_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:38344
I20260709 12:57:26.892036   715 raft_consensus.cc:606] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Received request to transfer leadership to TS 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:26.897200   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1478258de7414f83852bcf506f6a6268"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
mode: GRACEFUL
new_leader_uuid: "295b837450d340428c2da51136bf4cd7"
 from {username='slave'} at 127.0.0.1:41684
I20260709 12:57:26.897872   639 raft_consensus.cc:606] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 1 LEADER]: Received request to transfer leadership to TS 295b837450d340428c2da51136bf4cd7
I20260709 12:57:26.910446   715 raft_consensus.cc:1275] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Refusing update from remote peer b1e020e1df5446c493307cbb386ac590: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:57:26.911795   767 consensus_queue.cc:1048] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:26.923487   639 raft_consensus.cc:1275] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Refusing update from remote peer b1e020e1df5446c493307cbb386ac590: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:57:26.925513   858 consensus_queue.cc:1048] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:26.934296   767 raft_consensus.cc:993] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590: : Instructing follower 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:26.934849   858 raft_consensus.cc:1081] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Signalling peer 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:26.936604   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59793ce40b114fae99146e21be9f2847"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:41660
I20260709 12:57:26.937132   639 raft_consensus.cc:493] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:26.937444   639 raft_consensus.cc:3060] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.942408   639 raft_consensus.cc:515] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:26.944067   639 leader_election.cc:290] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 3 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:26.945077   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:26.945169   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:26.945753   565 raft_consensus.cc:3055] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:26.945783   715 raft_consensus.cc:3060] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.946254   565 raft_consensus.cc:740] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:26.947190   565 consensus_queue.cc:260] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:26.948818   565 raft_consensus.cc:3060] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:26.953856   715 raft_consensus.cc:2468] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 3.
I20260709 12:57:26.955053   604 leader_election.cc:304] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, 598e24a4a3614aa3b30ffb158636a113; no voters: 
I20260709 12:57:26.955869   824 raft_consensus.cc:2804] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:26.956593   565 raft_consensus.cc:2468] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 3.
I20260709 12:57:26.957140   824 raft_consensus.cc:697] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Becoming Leader. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:26.957988   824 consensus_queue.cc:237] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:26.964383   460 catalog_manager.cc:5697] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 reported cstate change: term changed from 2 to 3, leader changed from b1e020e1df5446c493307cbb386ac590 (127.0.107.193) to 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "598e24a4a3614aa3b30ffb158636a113" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:26.993566   767 raft_consensus.cc:993] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590: : Instructing follower 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:26.994159   858 raft_consensus.cc:1081] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Signalling peer 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:26.995978   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddc1580435fa48ef83af27238f7fd421"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:41660
I20260709 12:57:26.996546   639 raft_consensus.cc:493] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:26.996930   639 raft_consensus.cc:3060] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:26.998297   862 raft_consensus.cc:993] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113: : Instructing follower b1e020e1df5446c493307cbb386ac590 to start an election
I20260709 12:57:26.998747   824 raft_consensus.cc:1081] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 1 LEADER]: Signalling peer b1e020e1df5446c493307cbb386ac590 to start an election
I20260709 12:57:27.000176   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e"
dest_uuid: "b1e020e1df5446c493307cbb386ac590"
 from {username='slave'} at 127.0.0.1:44160
I20260709 12:57:27.000766   565 raft_consensus.cc:493] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:27.001124   565 raft_consensus.cc:3060] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.003957   639 raft_consensus.cc:515] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.006739   639 leader_election.cc:290] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 2 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:27.007311   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc1580435fa48ef83af27238f7fd421" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:27.007966   564 raft_consensus.cc:3055] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:27.008293   564 raft_consensus.cc:740] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:27.008648   565 raft_consensus.cc:515] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.009104   564 consensus_queue.cc:260] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.010136   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddc1580435fa48ef83af27238f7fd421" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:27.010533   564 raft_consensus.cc:3060] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.010716   715 raft_consensus.cc:3060] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.011303   565 leader_election.cc:290] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 2 election: Requested vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:27.011444   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:27.012051   641 raft_consensus.cc:3055] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:27.012346   641 raft_consensus.cc:740] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:27.013183   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:27.013182   641 consensus_queue.cc:260] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.013942   714 raft_consensus.cc:3060] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.014535   641 raft_consensus.cc:3060] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.020027   715 raft_consensus.cc:2468] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 2.
I20260709 12:57:27.021423   604 leader_election.cc:304] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, 598e24a4a3614aa3b30ffb158636a113; no voters: 
I20260709 12:57:27.021633   641 raft_consensus.cc:2468] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 2.
I20260709 12:57:27.021633   714 raft_consensus.cc:2468] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 2.
I20260709 12:57:27.022475   824 raft_consensus.cc:2804] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:27.023095   531 leader_election.cc:304] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:27.023622   824 raft_consensus.cc:697] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [term 2 LEADER]: Becoming Leader. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:27.023912   858 raft_consensus.cc:2804] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:27.024451   858 raft_consensus.cc:697] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Becoming Leader. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:27.024950   564 raft_consensus.cc:2468] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 2.
I20260709 12:57:27.024677   824 consensus_queue.cc:237] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.025331   858 consensus_queue.cc:237] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.033932   460 catalog_manager.cc:5697] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 reported cstate change: term changed from 1 to 2, leader changed from b1e020e1df5446c493307cbb386ac590 (127.0.107.193) to 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "598e24a4a3614aa3b30ffb158636a113" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:27.035210   463 catalog_manager.cc:5697] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 reported cstate change: term changed from 1 to 2, leader changed from 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194) to b1e020e1df5446c493307cbb386ac590 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b1e020e1df5446c493307cbb386ac590" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:27.067898   862 raft_consensus.cc:993] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113: : Instructing follower 295b837450d340428c2da51136bf4cd7 to start an election
I20260709 12:57:27.068385   824 raft_consensus.cc:1081] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 1 LEADER]: Signalling peer 295b837450d340428c2da51136bf4cd7 to start an election
I20260709 12:57:27.070242   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1478258de7414f83852bcf506f6a6268"
dest_uuid: "295b837450d340428c2da51136bf4cd7"
 from {username='slave'} at 127.0.0.1:38328
I20260709 12:57:27.070768   714 raft_consensus.cc:493] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:27.071120   714 raft_consensus.cc:3060] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.077302   714 raft_consensus.cc:515] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.079531   865 raft_consensus.cc:993] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7: : Instructing follower 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:27.079859   714 leader_election.cc:290] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 2 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:27.080274   865 raft_consensus.cc:1081] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Signalling peer 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:27.080636   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478258de7414f83852bcf506f6a6268" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:27.081070   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478258de7414f83852bcf506f6a6268" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:27.081290   564 raft_consensus.cc:3060] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.081679   641 raft_consensus.cc:3055] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:27.081952   641 raft_consensus.cc:740] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:27.082293   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e915b506968455a8bf0a49a69d24bd5"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:41674
I20260709 12:57:27.082863   639 raft_consensus.cc:493] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:27.083382   639 raft_consensus.cc:3060] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.082803   641 consensus_queue.cc:260] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.084353   641 raft_consensus.cc:3060] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.087306   564 raft_consensus.cc:2468] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 2.
I20260709 12:57:27.088565   680 leader_election.cc:304] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:27.089306   865 raft_consensus.cc:2804] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:27.089768   865 raft_consensus.cc:697] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [term 2 LEADER]: Becoming Leader. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Running, Role: LEADER
I20260709 12:57:27.090669   865 consensus_queue.cc:237] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.090850   639 raft_consensus.cc:515] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.091446   641 raft_consensus.cc:2468] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 2.
I20260709 12:57:27.093235   639 leader_election.cc:290] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 2 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:27.093888   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e915b506968455a8bf0a49a69d24bd5" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:27.094713   564 raft_consensus.cc:3060] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.094821   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e915b506968455a8bf0a49a69d24bd5" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:27.097545   714 raft_consensus.cc:3055] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:27.097870   714 raft_consensus.cc:740] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Running, Role: LEADER
I20260709 12:57:27.098734   714 consensus_queue.cc:260] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.099960   714 raft_consensus.cc:3060] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.100171   463 catalog_manager.cc:5697] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 reported cstate change: term changed from 1 to 2, leader changed from 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194) to 295b837450d340428c2da51136bf4cd7 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "295b837450d340428c2da51136bf4cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:27.104331   564 raft_consensus.cc:2468] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 2.
I20260709 12:57:27.105846   606 leader_election.cc:304] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:27.106802   824 raft_consensus.cc:2804] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:27.107267   824 raft_consensus.cc:697] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [term 2 LEADER]: Becoming Leader. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:27.107513   714 raft_consensus.cc:2468] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 2.
I20260709 12:57:27.108153   824 consensus_queue.cc:237] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.116973   463 catalog_manager.cc:5697] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 reported cstate change: term changed from 1 to 2, leader changed from 295b837450d340428c2da51136bf4cd7 (127.0.107.195) to 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "598e24a4a3614aa3b30ffb158636a113" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:27.135939   865 raft_consensus.cc:993] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7: : Instructing follower 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:27.136479   828 raft_consensus.cc:1081] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Signalling peer 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:27.137977   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:41674
I20260709 12:57:27.138546   639 raft_consensus.cc:493] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:27.138809   639 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.143879   639 raft_consensus.cc:515] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.145704   639 leader_election.cc:290] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 2 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:27.146602   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:27.146863   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:27.147152   564 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.147413   714 raft_consensus.cc:3055] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:27.147737   714 raft_consensus.cc:740] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Running, Role: LEADER
I20260709 12:57:27.148550   714 consensus_queue.cc:260] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.149513   714 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.152603   564 raft_consensus.cc:2468] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 2.
I20260709 12:57:27.153785   606 leader_election.cc:304] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:27.154721   824 raft_consensus.cc:2804] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:27.155144   824 raft_consensus.cc:697] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 2 LEADER]: Becoming Leader. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:27.155153   714 raft_consensus.cc:2468] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 2.
I20260709 12:57:27.156088   824 consensus_queue.cc:237] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.163877   463 catalog_manager.cc:5697] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 reported cstate change: term changed from 1 to 2, leader changed from 295b837450d340428c2da51136bf4cd7 (127.0.107.195) to 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "598e24a4a3614aa3b30ffb158636a113" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:27.171955   865 raft_consensus.cc:993] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7: : Instructing follower b1e020e1df5446c493307cbb386ac590 to start an election
I20260709 12:57:27.172544   865 raft_consensus.cc:1081] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Signalling peer b1e020e1df5446c493307cbb386ac590 to start an election
I20260709 12:57:27.174126   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a16052ff474946cd8f60307f76e070c6"
dest_uuid: "b1e020e1df5446c493307cbb386ac590"
 from {username='slave'} at 127.0.0.1:44170
I20260709 12:57:27.174659   564 raft_consensus.cc:493] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:27.174983   564 raft_consensus.cc:3060] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.180634   564 raft_consensus.cc:515] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.182402   564 leader_election.cc:290] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 2 election: Requested vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:27.183324   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16052ff474946cd8f60307f76e070c6" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:27.183461   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16052ff474946cd8f60307f76e070c6" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:27.184053   639 raft_consensus.cc:3060] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.184142   714 raft_consensus.cc:3055] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:27.184588   714 raft_consensus.cc:740] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Running, Role: LEADER
I20260709 12:57:27.185261   714 consensus_queue.cc:260] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.186285   714 raft_consensus.cc:3060] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.189541   639 raft_consensus.cc:2468] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 2.
I20260709 12:57:27.190716   531 leader_election.cc:304] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:27.191500   858 raft_consensus.cc:2804] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:27.191871   714 raft_consensus.cc:2468] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 2.
I20260709 12:57:27.192040   858 raft_consensus.cc:697] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Becoming Leader. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:27.192993   858 consensus_queue.cc:237] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:27.200526   463 catalog_manager.cc:5697] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 reported cstate change: term changed from 1 to 2, leader changed from 295b837450d340428c2da51136bf4cd7 (127.0.107.195) to b1e020e1df5446c493307cbb386ac590 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b1e020e1df5446c493307cbb386ac590" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:27.413620   564 raft_consensus.cc:1275] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:27.415184   824 consensus_queue.cc:1048] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:27.423061   714 raft_consensus.cc:1275] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:27.425892   870 consensus_queue.cc:1048] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:27.462469   714 raft_consensus.cc:1275] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.463774   824 consensus_queue.cc:1048] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:27.473934   564 raft_consensus.cc:1275] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.477233   824 consensus_queue.cc:1048] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:27.484073   639 raft_consensus.cc:1275] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Refusing update from remote peer b1e020e1df5446c493307cbb386ac590: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.486610   846 consensus_queue.cc:1048] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:27.487525   639 raft_consensus.cc:1275] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Refusing update from remote peer 295b837450d340428c2da51136bf4cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.488881   865 consensus_queue.cc:1048] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:27.504526   714 raft_consensus.cc:1275] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Refusing update from remote peer b1e020e1df5446c493307cbb386ac590: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.506548   858 consensus_queue.cc:1048] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:27.507223   564 raft_consensus.cc:1275] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Refusing update from remote peer 295b837450d340428c2da51136bf4cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.509068   877 consensus_queue.cc:1048] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:27.509970   715 raft_consensus.cc:1275] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.511770   824 consensus_queue.cc:1048] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:27.534264   565 raft_consensus.cc:1275] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.535854   870 consensus_queue.cc:1048] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:27.613518   715 raft_consensus.cc:1275] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Refusing update from remote peer b1e020e1df5446c493307cbb386ac590: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.615044   858 consensus_queue.cc:1048] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:27.625056   639 raft_consensus.cc:1275] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Refusing update from remote peer b1e020e1df5446c493307cbb386ac590: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.626909   767 consensus_queue.cc:1048] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:27.634963   564 raft_consensus.cc:1275] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.636361   870 consensus_queue.cc:1048] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:27.646626   715 raft_consensus.cc:1275] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:27.648192   824 consensus_queue.cc:1048] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:29.930651   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:57:29.931807   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:29.949914   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36"
dest_uuid: "b1e020e1df5446c493307cbb386ac590"
mode: GRACEFUL
new_leader_uuid: "295b837450d340428c2da51136bf4cd7"
 from {username='slave'} at 127.0.0.1:57096
I20260709 12:57:29.950551   564 raft_consensus.cc:606] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Received request to transfer leadership to TS 295b837450d340428c2da51136bf4cd7
I20260709 12:57:29.963371   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
mode: GRACEFUL
new_leader_uuid: "295b837450d340428c2da51136bf4cd7"
 from {username='slave'} at 127.0.0.1:53874
I20260709 12:57:29.964056   639 raft_consensus.cc:606] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 2 LEADER]: Received request to transfer leadership to TS 295b837450d340428c2da51136bf4cd7
I20260709 12:57:29.965518   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:57:29.966161   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:30.122375   891 raft_consensus.cc:993] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590: : Instructing follower 295b837450d340428c2da51136bf4cd7 to start an election
I20260709 12:57:30.122922   889 raft_consensus.cc:1081] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Signalling peer 295b837450d340428c2da51136bf4cd7 to start an election
I20260709 12:57:30.124603   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36"
dest_uuid: "295b837450d340428c2da51136bf4cd7"
 from {username='slave'} at 127.0.0.1:38332
I20260709 12:57:30.125166   715 raft_consensus.cc:493] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:30.125566   715 raft_consensus.cc:3060] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:30.131568   715 raft_consensus.cc:515] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:30.133221   715 leader_election.cc:290] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 2 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:30.135143   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:30.135840   641 raft_consensus.cc:3060] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:30.136050   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:30.136684   564 raft_consensus.cc:3055] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:30.137019   564 raft_consensus.cc:740] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:30.138358   564 consensus_queue.cc:260] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:30.140200   564 raft_consensus.cc:3060] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:30.143522   641 raft_consensus.cc:2468] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 2.
I20260709 12:57:30.144647   680 leader_election.cc:304] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, 598e24a4a3614aa3b30ffb158636a113; no voters: 
I20260709 12:57:30.145418   888 raft_consensus.cc:2804] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:30.146549   888 raft_consensus.cc:697] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 2 LEADER]: Becoming Leader. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Running, Role: LEADER
I20260709 12:57:30.148342   564 raft_consensus.cc:2468] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 2.
I20260709 12:57:30.148330   888 consensus_queue.cc:237] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:30.156147   463 catalog_manager.cc:5697] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 reported cstate change: term changed from 1 to 2, leader changed from b1e020e1df5446c493307cbb386ac590 (127.0.107.193) to 295b837450d340428c2da51136bf4cd7 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "295b837450d340428c2da51136bf4cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.188807   862 raft_consensus.cc:993] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113: : Instructing follower 295b837450d340428c2da51136bf4cd7 to start an election
I20260709 12:57:30.189311   862 raft_consensus.cc:1081] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 2 LEADER]: Signalling peer 295b837450d340428c2da51136bf4cd7 to start an election
I20260709 12:57:30.190853   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476"
dest_uuid: "295b837450d340428c2da51136bf4cd7"
 from {username='slave'} at 127.0.0.1:38328
I20260709 12:57:30.191416   715 raft_consensus.cc:493] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:30.191723   715 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:30.196976   715 raft_consensus.cc:515] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:30.198457   715 leader_election.cc:290] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 3 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:30.199389   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:30.199769   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:30.199960   564 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:30.200356   641 raft_consensus.cc:3055] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:30.200632   641 raft_consensus.cc:740] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:30.201514   641 consensus_queue.cc:260] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:30.202885   641 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:30.207324   564 raft_consensus.cc:2468] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 3.
I20260709 12:57:30.208619   641 raft_consensus.cc:2468] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 3.
I20260709 12:57:30.208528   680 leader_election.cc:304] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:30.210186   888 raft_consensus.cc:2804] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:30.210696   888 raft_consensus.cc:697] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 3 LEADER]: Becoming Leader. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Running, Role: LEADER
I20260709 12:57:30.211498   888 consensus_queue.cc:237] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:30.218801   463 catalog_manager.cc:5697] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 reported cstate change: term changed from 2 to 3, leader changed from 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194) to 295b837450d340428c2da51136bf4cd7 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "295b837450d340428c2da51136bf4cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.609547   641 raft_consensus.cc:1275] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Refusing update from remote peer 295b837450d340428c2da51136bf4cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:30.610874   888 consensus_queue.cc:1048] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:30.622267   564 raft_consensus.cc:1275] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Refusing update from remote peer 295b837450d340428c2da51136bf4cd7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:30.624641   895 consensus_queue.cc:1048] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:30.674693   564 raft_consensus.cc:1275] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Refusing update from remote peer 295b837450d340428c2da51136bf4cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:30.676293   906 consensus_queue.cc:1048] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:30.685457   641 raft_consensus.cc:1275] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Refusing update from remote peer 295b837450d340428c2da51136bf4cd7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:30.687922   895 consensus_queue.cc:1048] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:30.967609   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:30.980736   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f4a248a564f4dfea44d76b1a0890c16"
dest_uuid: "b1e020e1df5446c493307cbb386ac590"
mode: GRACEFUL
new_leader_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:44184
I20260709 12:57:30.981547   564 raft_consensus.cc:606] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Received request to transfer leadership to TS 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:30.987545   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36"
dest_uuid: "295b837450d340428c2da51136bf4cd7"
mode: GRACEFUL
new_leader_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:38344
I20260709 12:57:30.988086   715 raft_consensus.cc:606] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 2 LEADER]: Received request to transfer leadership to TS 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:30.993204   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e"
dest_uuid: "b1e020e1df5446c493307cbb386ac590"
mode: GRACEFUL
new_leader_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:44184
I20260709 12:57:30.993782   564 raft_consensus.cc:606] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Received request to transfer leadership to TS 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:30.998379   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a16052ff474946cd8f60307f76e070c6"
dest_uuid: "b1e020e1df5446c493307cbb386ac590"
mode: GRACEFUL
new_leader_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:44184
I20260709 12:57:30.998847   564 raft_consensus.cc:606] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Received request to transfer leadership to TS 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:31.011747   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476"
dest_uuid: "295b837450d340428c2da51136bf4cd7"
mode: GRACEFUL
new_leader_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:38344
I20260709 12:57:31.012385   715 raft_consensus.cc:606] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 3 LEADER]: Received request to transfer leadership to TS 598e24a4a3614aa3b30ffb158636a113
I20260709 12:57:31.094702   889 raft_consensus.cc:993] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590: : Instructing follower 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:31.095309   912 raft_consensus.cc:1081] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Signalling peer 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:31.097133   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f4a248a564f4dfea44d76b1a0890c16"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:41660
I20260709 12:57:31.097688   641 raft_consensus.cc:493] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:31.098038   641 raft_consensus.cc:3060] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:31.104243   641 raft_consensus.cc:515] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.106123   641 leader_election.cc:290] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 2 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:31.107139   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4a248a564f4dfea44d76b1a0890c16" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:31.107272   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4a248a564f4dfea44d76b1a0890c16" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:31.107976   564 raft_consensus.cc:3055] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:31.108094   715 raft_consensus.cc:3060] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:31.108273   564 raft_consensus.cc:740] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:31.109169   564 consensus_queue.cc:260] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.110356   564 raft_consensus.cc:3060] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:31.113456   715 raft_consensus.cc:2468] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 2.
I20260709 12:57:31.114734   604 leader_election.cc:304] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, 598e24a4a3614aa3b30ffb158636a113; no voters: 
I20260709 12:57:31.115180   564 raft_consensus.cc:2468] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 2.
I20260709 12:57:31.115597   862 raft_consensus.cc:2804] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:31.116129   862 raft_consensus.cc:697] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 2 LEADER]: Becoming Leader. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:31.117169   862 consensus_queue.cc:237] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.127768   462 catalog_manager.cc:5697] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 reported cstate change: term changed from 1 to 2, leader changed from b1e020e1df5446c493307cbb386ac590 (127.0.107.193) to 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "598e24a4a3614aa3b30ffb158636a113" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:31.138836   906 raft_consensus.cc:993] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7: : Instructing follower 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:31.139467   906 raft_consensus.cc:1081] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 2 LEADER]: Signalling peer 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:31.141530   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:41674
I20260709 12:57:31.142213   641 raft_consensus.cc:493] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:31.142624   641 raft_consensus.cc:3060] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.147945   641 raft_consensus.cc:515] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.149814   641 leader_election.cc:290] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 3 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:31.150767   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:31.151026   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:31.151353   564 raft_consensus.cc:3060] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.151597   715 raft_consensus.cc:3055] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:31.151904   715 raft_consensus.cc:740] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Running, Role: LEADER
I20260709 12:57:31.152565   715 consensus_queue.cc:260] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.153476   715 raft_consensus.cc:3060] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.156800   564 raft_consensus.cc:2468] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 3.
I20260709 12:57:31.157966   606 leader_election.cc:304] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:31.158293   715 raft_consensus.cc:2468] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 3.
I20260709 12:57:31.159082   862 raft_consensus.cc:2804] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:31.159562   862 raft_consensus.cc:697] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Becoming Leader. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:31.160549   862 consensus_queue.cc:237] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.167989   462 catalog_manager.cc:5697] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 reported cstate change: term changed from 2 to 3, leader changed from 295b837450d340428c2da51136bf4cd7 (127.0.107.195) to 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "598e24a4a3614aa3b30ffb158636a113" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:31.186131   889 raft_consensus.cc:993] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590: : Instructing follower 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:31.186851   917 raft_consensus.cc:993] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590: : Instructing follower 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:31.186952   912 raft_consensus.cc:1081] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Signalling peer 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:31.188126   912 raft_consensus.cc:1081] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Signalling peer 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:31.189332   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a16052ff474946cd8f60307f76e070c6"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:41660
I20260709 12:57:31.189960   641 raft_consensus.cc:493] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:31.190383   641 raft_consensus.cc:3060] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.190450   638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:41660
I20260709 12:57:31.191130   638 raft_consensus.cc:493] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:31.191501   638 raft_consensus.cc:3060] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.191838   888 raft_consensus.cc:993] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7: : Instructing follower 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:31.192323   888 raft_consensus.cc:1081] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 3 LEADER]: Signalling peer 598e24a4a3614aa3b30ffb158636a113 to start an election
I20260709 12:57:31.194223   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
 from {username='slave'} at 127.0.0.1:41674
I20260709 12:57:31.194715   639 raft_consensus.cc:493] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:31.195024   639 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:31.198876   638 raft_consensus.cc:515] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.199011   641 raft_consensus.cc:515] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.200889   641 leader_election.cc:290] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 3 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:31.206982   638 leader_election.cc:290] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 3 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:31.207451   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:31.207425   639 raft_consensus.cc:515] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.208278   564 raft_consensus.cc:3055] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:31.208433   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16052ff474946cd8f60307f76e070c6" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:31.208455   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16052ff474946cd8f60307f76e070c6" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:31.208680   564 raft_consensus.cc:740] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:31.209352   715 raft_consensus.cc:3060] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.210240   565 raft_consensus.cc:3055] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:31.210671   565 raft_consensus.cc:740] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:31.210354   564 consensus_queue.cc:260] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.211514   564 raft_consensus.cc:3060] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.211681   565 consensus_queue.cc:260] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.213105   565 raft_consensus.cc:3060] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.214156   639 leader_election.cc:290] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 4 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:31.215574   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:31.216493   566 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:31.218295   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:31.219040   712 raft_consensus.cc:3060] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.220798   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476" candidate_uuid: "598e24a4a3614aa3b30ffb158636a113" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:31.221408   714 raft_consensus.cc:3055] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:31.221732   714 raft_consensus.cc:740] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Running, Role: LEADER
I20260709 12:57:31.222661   714 consensus_queue.cc:260] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.224293   714 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:31.225234   566 raft_consensus.cc:2468] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 4.
I20260709 12:57:31.227316   712 raft_consensus.cc:2468] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 3.
I20260709 12:57:31.229667   564 raft_consensus.cc:2468] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 3.
I20260709 12:57:31.232378   606 leader_election.cc:304] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:31.233239   862 raft_consensus.cc:2804] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:31.233896   862 raft_consensus.cc:697] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 4 LEADER]: Becoming Leader. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:31.234754   862 consensus_queue.cc:237] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.230265   604 leader_election.cc:304] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, 598e24a4a3614aa3b30ffb158636a113; no voters: 
I20260709 12:57:31.237084   714 raft_consensus.cc:2468] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 4.
I20260709 12:57:31.233197   565 raft_consensus.cc:2468] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 3.
I20260709 12:57:31.238852   862 raft_consensus.cc:2804] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:31.239382   862 raft_consensus.cc:697] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Becoming Leader. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:31.237171   715 raft_consensus.cc:2468] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 598e24a4a3614aa3b30ffb158636a113 in term 3.
I20260709 12:57:31.240232   862 consensus_queue.cc:237] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.240737   606 leader_election.cc:304] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 598e24a4a3614aa3b30ffb158636a113, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:31.242950   901 raft_consensus.cc:2804] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:31.243623   462 catalog_manager.cc:5697] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 reported cstate change: term changed from 3 to 4, leader changed from 295b837450d340428c2da51136bf4cd7 (127.0.107.195) to 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "598e24a4a3614aa3b30ffb158636a113" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:31.250569   901 raft_consensus.cc:697] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Becoming Leader. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:31.252651   901 consensus_queue.cc:237] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:31.262985   462 catalog_manager.cc:5697] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 reported cstate change: term changed from 2 to 3, leader changed from b1e020e1df5446c493307cbb386ac590 (127.0.107.193) to 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "598e24a4a3614aa3b30ffb158636a113" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:31.265144   462 catalog_manager.cc:5697] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 reported cstate change: term changed from 2 to 3, leader changed from b1e020e1df5446c493307cbb386ac590 (127.0.107.193) to 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "598e24a4a3614aa3b30ffb158636a113" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:31.536492   712 raft_consensus.cc:1275] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:31.537957   901 consensus_queue.cc:1048] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:31.548834   565 raft_consensus.cc:1275] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:31.551435   862 consensus_queue.cc:1048] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:31.626287   565 raft_consensus.cc:1275] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:31.627316   712 raft_consensus.cc:1275] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:31.627760   920 consensus_queue.cc:1048] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:31.628633   862 consensus_queue.cc:1048] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:31.634615   714 raft_consensus.cc:1275] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:31.636198   901 consensus_queue.cc:1048] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:31.639947   715 raft_consensus.cc:1275] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 4 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:31.647979   921 consensus_queue.cc:1048] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:31.651578   564 raft_consensus.cc:1275] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:31.653707   920 consensus_queue.cc:1048] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:31.663419   565 raft_consensus.cc:1275] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:31.670261   920 consensus_queue.cc:1048] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:31.688446   715 raft_consensus.cc:1275] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:31.690096   921 consensus_queue.cc:1048] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:31.701643   565 raft_consensus.cc:1275] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Refusing update from remote peer 598e24a4a3614aa3b30ffb158636a113: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:31.703310   920 consensus_queue.cc:1048] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:34.017263   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:34.024647   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
mode: GRACEFUL
new_leader_uuid: "b1e020e1df5446c493307cbb386ac590"
 from {username='slave'} at 127.0.0.1:53874
I20260709 12:57:34.025243   639 raft_consensus.cc:606] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Received request to transfer leadership to TS b1e020e1df5446c493307cbb386ac590
I20260709 12:57:34.028064   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f4a248a564f4dfea44d76b1a0890c16"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
mode: GRACEFUL
new_leader_uuid: "b1e020e1df5446c493307cbb386ac590"
 from {username='slave'} at 127.0.0.1:53874
I20260709 12:57:34.028561   639 raft_consensus.cc:606] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 2 LEADER]: Received request to transfer leadership to TS b1e020e1df5446c493307cbb386ac590
I20260709 12:57:34.030709   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
mode: GRACEFUL
new_leader_uuid: "b1e020e1df5446c493307cbb386ac590"
 from {username='slave'} at 127.0.0.1:53874
I20260709 12:57:34.031141   639 raft_consensus.cc:606] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 4 LEADER]: Received request to transfer leadership to TS b1e020e1df5446c493307cbb386ac590
I20260709 12:57:34.033341   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59793ce40b114fae99146e21be9f2847"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
mode: GRACEFUL
new_leader_uuid: "295b837450d340428c2da51136bf4cd7"
 from {username='slave'} at 127.0.0.1:53874
I20260709 12:57:34.033778   639 raft_consensus.cc:606] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Received request to transfer leadership to TS 295b837450d340428c2da51136bf4cd7
I20260709 12:57:34.036091   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e"
dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
mode: GRACEFUL
new_leader_uuid: "295b837450d340428c2da51136bf4cd7"
 from {username='slave'} at 127.0.0.1:53874
I20260709 12:57:34.036594   639 raft_consensus.cc:606] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Received request to transfer leadership to TS 295b837450d340428c2da51136bf4cd7
I20260709 12:57:34.037539   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:57:34.038072   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:34.149853   920 raft_consensus.cc:993] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113: : Instructing follower b1e020e1df5446c493307cbb386ac590 to start an election
I20260709 12:57:34.150441   920 raft_consensus.cc:1081] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 2 LEADER]: Signalling peer b1e020e1df5446c493307cbb386ac590 to start an election
I20260709 12:57:34.152035   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f4a248a564f4dfea44d76b1a0890c16"
dest_uuid: "b1e020e1df5446c493307cbb386ac590"
 from {username='slave'} at 127.0.0.1:44160
I20260709 12:57:34.152578   565 raft_consensus.cc:493] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:34.152915   565 raft_consensus.cc:3060] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:34.158860   565 raft_consensus.cc:515] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.160571   565 leader_election.cc:290] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 3 election: Requested vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:34.161504   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4a248a564f4dfea44d76b1a0890c16" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:34.161672   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4a248a564f4dfea44d76b1a0890c16" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:34.162110   639 raft_consensus.cc:3055] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:34.162320   714 raft_consensus.cc:3060] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:34.162467   639 raft_consensus.cc:740] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:34.163228   639 consensus_queue.cc:260] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.164124   639 raft_consensus.cc:3060] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:34.167313   714 raft_consensus.cc:2468] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 3.
I20260709 12:57:34.168517   529 leader_election.cc:304] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:34.168980   639 raft_consensus.cc:2468] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 3.
I20260709 12:57:34.170200   935 raft_consensus.cc:2804] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:34.171104   935 raft_consensus.cc:697] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 3 LEADER]: Becoming Leader. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:34.171803   935 consensus_queue.cc:237] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.178515   463 catalog_manager.cc:5697] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 reported cstate change: term changed from 2 to 3, leader changed from 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194) to b1e020e1df5446c493307cbb386ac590 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b1e020e1df5446c493307cbb386ac590" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:34.193195   934 raft_consensus.cc:993] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113: : Instructing follower 295b837450d340428c2da51136bf4cd7 to start an election
I20260709 12:57:34.193698   920 raft_consensus.cc:1081] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Signalling peer 295b837450d340428c2da51136bf4cd7 to start an election
I20260709 12:57:34.195322   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59793ce40b114fae99146e21be9f2847"
dest_uuid: "295b837450d340428c2da51136bf4cd7"
 from {username='slave'} at 127.0.0.1:38328
I20260709 12:57:34.195845   714 raft_consensus.cc:493] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:34.196182   714 raft_consensus.cc:3060] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.201962   714 raft_consensus.cc:515] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.203686   714 leader_election.cc:290] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 4 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:34.204778   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:34.204746   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59793ce40b114fae99146e21be9f2847" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:34.205509   639 raft_consensus.cc:3055] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:34.205588   565 raft_consensus.cc:3060] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.205920   639 raft_consensus.cc:740] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:34.206785   639 consensus_queue.cc:260] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.208006   639 raft_consensus.cc:3060] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.212986   565 raft_consensus.cc:2468] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 4.
I20260709 12:57:34.214449   680 leader_election.cc:304] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:34.214884   639 raft_consensus.cc:2468] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 4.
I20260709 12:57:34.215401   888 raft_consensus.cc:2804] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:34.216651   888 raft_consensus.cc:697] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 4 LEADER]: Becoming Leader. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Running, Role: LEADER
I20260709 12:57:34.217548   888 consensus_queue.cc:237] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.227032   463 catalog_manager.cc:5697] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 reported cstate change: term changed from 3 to 4, leader changed from 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194) to 295b837450d340428c2da51136bf4cd7 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "295b837450d340428c2da51136bf4cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:34.333645   934 raft_consensus.cc:993] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113: : Instructing follower 295b837450d340428c2da51136bf4cd7 to start an election
I20260709 12:57:34.334277   934 raft_consensus.cc:1081] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Signalling peer 295b837450d340428c2da51136bf4cd7 to start an election
I20260709 12:57:34.335810   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e"
dest_uuid: "295b837450d340428c2da51136bf4cd7"
 from {username='slave'} at 127.0.0.1:38328
I20260709 12:57:34.336256   714 raft_consensus.cc:493] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:34.336496   714 raft_consensus.cc:3060] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.341023   714 raft_consensus.cc:515] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.342586   714 leader_election.cc:290] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 4 election: Requested vote from peers b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233), 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475)
I20260709 12:57:34.343601   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b1e020e1df5446c493307cbb386ac590"
I20260709 12:57:34.343797   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995ef6e306984e489cb5ddb6a810766e" candidate_uuid: "295b837450d340428c2da51136bf4cd7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:34.344290   639 raft_consensus.cc:3055] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:34.344255   565 raft_consensus.cc:3060] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.344726   639 raft_consensus.cc:740] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:34.345527   639 consensus_queue.cc:260] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.346719   639 raft_consensus.cc:3060] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.351773   565 raft_consensus.cc:2468] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 4.
I20260709 12:57:34.352972   680 leader_election.cc:304] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:34.353660   639 raft_consensus.cc:2468] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 295b837450d340428c2da51136bf4cd7 in term 4.
I20260709 12:57:34.353791   888 raft_consensus.cc:2804] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:34.354450   888 raft_consensus.cc:697] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 4 LEADER]: Becoming Leader. State: Replica: 295b837450d340428c2da51136bf4cd7, State: Running, Role: LEADER
I20260709 12:57:34.355302   888 consensus_queue.cc:237] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.362903   463 catalog_manager.cc:5697] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 reported cstate change: term changed from 3 to 4, leader changed from 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194) to 295b837450d340428c2da51136bf4cd7 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "295b837450d340428c2da51136bf4cd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:34.549461   920 raft_consensus.cc:993] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113: : Instructing follower b1e020e1df5446c493307cbb386ac590 to start an election
I20260709 12:57:34.549970   934 raft_consensus.cc:1081] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Signalling peer b1e020e1df5446c493307cbb386ac590 to start an election
I20260709 12:57:34.551522   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36"
dest_uuid: "b1e020e1df5446c493307cbb386ac590"
 from {username='slave'} at 127.0.0.1:44160
I20260709 12:57:34.552045   565 raft_consensus.cc:493] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:34.552380   565 raft_consensus.cc:3060] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.557395   565 raft_consensus.cc:515] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.558867   565 leader_election.cc:290] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 4 election: Requested vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:34.559726   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:34.560040   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1074a307786b4f2c8f9c1197f7007a36" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:34.560267   639 raft_consensus.cc:3055] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:34.560565   714 raft_consensus.cc:3060] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.560595   639 raft_consensus.cc:740] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:34.561369   639 consensus_queue.cc:260] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.562301   639 raft_consensus.cc:3060] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.565775   714 raft_consensus.cc:2468] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 4.
I20260709 12:57:34.566794   529 leader_election.cc:304] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:34.567612   935 raft_consensus.cc:2804] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:34.567888   639 raft_consensus.cc:2468] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 4.
I20260709 12:57:34.568120   935 raft_consensus.cc:697] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 4 LEADER]: Becoming Leader. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:34.569047   935 consensus_queue.cc:237] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.576165   463 catalog_manager.cc:5697] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 reported cstate change: term changed from 3 to 4, leader changed from 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194) to b1e020e1df5446c493307cbb386ac590 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "b1e020e1df5446c493307cbb386ac590" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:34.577605   920 raft_consensus.cc:993] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113: : Instructing follower b1e020e1df5446c493307cbb386ac590 to start an election
I20260709 12:57:34.578166   934 raft_consensus.cc:1081] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 4 LEADER]: Signalling peer b1e020e1df5446c493307cbb386ac590 to start an election
I20260709 12:57:34.579639   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476"
dest_uuid: "b1e020e1df5446c493307cbb386ac590"
 from {username='slave'} at 127.0.0.1:44160
I20260709 12:57:34.580158   565 raft_consensus.cc:493] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:34.580520   565 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.586046   565 raft_consensus.cc:515] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.587620   565 leader_election.cc:290] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 5 election: Requested vote from peers 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475), 295b837450d340428c2da51136bf4cd7 (127.0.107.195:37259)
I20260709 12:57:34.588716   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "598e24a4a3614aa3b30ffb158636a113"
I20260709 12:57:34.588666   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258ad8e4f9934e38915c725ddeb66476" candidate_uuid: "b1e020e1df5446c493307cbb386ac590" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "295b837450d340428c2da51136bf4cd7"
I20260709 12:57:34.589298   639 raft_consensus.cc:3055] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:34.589414   714 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.589582   639 raft_consensus.cc:740] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 598e24a4a3614aa3b30ffb158636a113, State: Running, Role: LEADER
I20260709 12:57:34.590378   639 consensus_queue.cc:260] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.591226   639 raft_consensus.cc:3060] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.594159   714 raft_consensus.cc:2468] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 5.
I20260709 12:57:34.595309   529 leader_election.cc:304] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 295b837450d340428c2da51136bf4cd7, b1e020e1df5446c493307cbb386ac590; no voters: 
I20260709 12:57:34.595757   639 raft_consensus.cc:2468] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1e020e1df5446c493307cbb386ac590 in term 5.
I20260709 12:57:34.595991   935 raft_consensus.cc:2804] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:34.596459   935 raft_consensus.cc:697] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 5 LEADER]: Becoming Leader. State: Replica: b1e020e1df5446c493307cbb386ac590, State: Running, Role: LEADER
I20260709 12:57:34.597347   935 consensus_queue.cc:237] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } }
I20260709 12:57:34.603813   463 catalog_manager.cc:5697] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 reported cstate change: term changed from 4 to 5, leader changed from 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194) to b1e020e1df5446c493307cbb386ac590 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "b1e020e1df5446c493307cbb386ac590" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:34.710975   639 raft_consensus.cc:1275] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Refusing update from remote peer b1e020e1df5446c493307cbb386ac590: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:34.712221   935 consensus_queue.cc:1048] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:34.723067   714 raft_consensus.cc:1275] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Refusing update from remote peer b1e020e1df5446c493307cbb386ac590: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:34.725198   936 consensus_queue.cc:1048] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [LEADER]: Connected to new peer: Peer: permanent_uuid: "295b837450d340428c2da51136bf4cd7" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:34.752724   639 raft_consensus.cc:1275] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 4 FOLLOWER]: Refusing update from remote peer 295b837450d340428c2da51136bf4cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:34.753955   888 consensus_queue.cc:1048] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:34.763022   565 raft_consensus.cc:1275] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Refusing update from remote peer 295b837450d340428c2da51136bf4cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:34.764842   888 consensus_queue.cc:1048] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:34.799207   639 raft_consensus.cc:1275] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 4 FOLLOWER]: Refusing update from remote peer 295b837450d340428c2da51136bf4cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:34.800428   888 consensus_queue.cc:1048] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "598e24a4a3614aa3b30ffb158636a113" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:34.809773   565 raft_consensus.cc:1275] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Refusing update from remote peer 295b837450d340428c2da51136bf4cd7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:34.812438   957 consensus_queue.cc:1048] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1e020e1df5446c493307cbb386ac590" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:35.039083   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:35.044828   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:57:35.067623   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:35.068697   431 tablet_replica.cc:333] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590: stopping tablet replica
I20260709 12:57:35.069909   431 raft_consensus.cc:2243] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.070600   431 raft_consensus.cc:2272] T a16052ff474946cd8f60307f76e070c6 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.073087   431 tablet_replica.cc:333] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590: stopping tablet replica
I20260709 12:57:35.073637   431 raft_consensus.cc:2243] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.074119   431 raft_consensus.cc:2272] T 1478258de7414f83852bcf506f6a6268 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.075975   431 tablet_replica.cc:333] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590: stopping tablet replica
I20260709 12:57:35.076532   431 raft_consensus.cc:2243] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:57:35.077184   431 pending_rounds.cc:70] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590: Trying to abort 1 pending ops.
I20260709 12:57:35.077448   431 pending_rounds.cc:77] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590: Aborting op as it isn't in flight: id { term: 5 index: 5 } timestamp: 7305633196438433792 op_type: NO_OP noop_request { }
I20260709 12:57:35.077802   431 raft_consensus.cc:2889] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 5 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:57:35.078166   431 raft_consensus.cc:2272] T 258ad8e4f9934e38915c725ddeb66476 P b1e020e1df5446c493307cbb386ac590 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.080852   431 tablet_replica.cc:333] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590: stopping tablet replica
I20260709 12:57:35.081468   431 raft_consensus.cc:2243] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.081848   431 raft_consensus.cc:2272] T 0e915b506968455a8bf0a49a69d24bd5 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.083818   431 tablet_replica.cc:333] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590: stopping tablet replica
I20260709 12:57:35.084276   431 raft_consensus.cc:2243] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:35.085117   431 raft_consensus.cc:2272] T 1f4a248a564f4dfea44d76b1a0890c16 P b1e020e1df5446c493307cbb386ac590 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.087319   431 tablet_replica.cc:333] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590: stopping tablet replica
I20260709 12:57:35.087780   431 raft_consensus.cc:2243] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.088150   431 raft_consensus.cc:2272] T ddc1580435fa48ef83af27238f7fd421 P b1e020e1df5446c493307cbb386ac590 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.089768   431 tablet_replica.cc:333] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590: stopping tablet replica
I20260709 12:57:35.090261   431 raft_consensus.cc:2243] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.090619   431 raft_consensus.cc:2272] T 59793ce40b114fae99146e21be9f2847 P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.092552   431 tablet_replica.cc:333] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590: stopping tablet replica
I20260709 12:57:35.092985   431 raft_consensus.cc:2243] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:57:35.093631   431 pending_rounds.cc:70] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590: Trying to abort 1 pending ops.
I20260709 12:57:35.093801   431 pending_rounds.cc:77] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305633196322566144 op_type: NO_OP noop_request { }
I20260709 12:57:35.094044   431 raft_consensus.cc:2889] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:57:35.094377   431 raft_consensus.cc:2272] T 1074a307786b4f2c8f9c1197f7007a36 P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.096187   431 tablet_replica.cc:333] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590: stopping tablet replica
I20260709 12:57:35.096644   431 raft_consensus.cc:2243] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.097075   431 raft_consensus.cc:2272] T 995ef6e306984e489cb5ddb6a810766e P b1e020e1df5446c493307cbb386ac590 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.199421   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:57:35.222186   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:57:35.248873   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:35.249640   431 tablet_replica.cc:333] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113: stopping tablet replica
I20260709 12:57:35.250587   431 raft_consensus.cc:2243] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:35.251685   431 raft_consensus.cc:2272] T 0e915b506968455a8bf0a49a69d24bd5 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.253612   431 tablet_replica.cc:333] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113: stopping tablet replica
I20260709 12:57:35.254185   431 raft_consensus.cc:2243] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.254530   431 raft_consensus.cc:2272] T 258ad8e4f9934e38915c725ddeb66476 P 598e24a4a3614aa3b30ffb158636a113 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.256071   431 tablet_replica.cc:333] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113: stopping tablet replica
I20260709 12:57:35.256508   431 raft_consensus.cc:2243] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:35.257184   431 raft_consensus.cc:2272] T ddc1580435fa48ef83af27238f7fd421 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.259042   431 tablet_replica.cc:333] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113: stopping tablet replica
I20260709 12:57:35.259495   431 raft_consensus.cc:2243] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.259828   431 raft_consensus.cc:2272] T 1f4a248a564f4dfea44d76b1a0890c16 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.261655   431 tablet_replica.cc:333] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113: stopping tablet replica
I20260709 12:57:35.262188   431 raft_consensus.cc:2243] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.262545   431 raft_consensus.cc:2272] T 1478258de7414f83852bcf506f6a6268 P 598e24a4a3614aa3b30ffb158636a113 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.264008   431 tablet_replica.cc:333] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113: stopping tablet replica
I20260709 12:57:35.264496   431 raft_consensus.cc:2243] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:35.265172   431 raft_consensus.cc:2272] T a16052ff474946cd8f60307f76e070c6 P 598e24a4a3614aa3b30ffb158636a113 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.266747   431 tablet_replica.cc:333] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113: stopping tablet replica
I20260709 12:57:35.267184   431 raft_consensus.cc:2243] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.267503   431 raft_consensus.cc:2272] T 59793ce40b114fae99146e21be9f2847 P 598e24a4a3614aa3b30ffb158636a113 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.269958   431 tablet_replica.cc:333] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113: stopping tablet replica
I20260709 12:57:35.270514   431 raft_consensus.cc:2243] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.270860   431 raft_consensus.cc:2272] T 995ef6e306984e489cb5ddb6a810766e P 598e24a4a3614aa3b30ffb158636a113 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.272930   431 tablet_replica.cc:333] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113: stopping tablet replica
I20260709 12:57:35.273332   431 raft_consensus.cc:2243] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.273631   431 raft_consensus.cc:2272] T 1074a307786b4f2c8f9c1197f7007a36 P 598e24a4a3614aa3b30ffb158636a113 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.302533   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:57:35.323212   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 12:57:35.347349   680 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46233: connect: Connection refused (error 111)
I20260709 12:57:35.356542   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:35.357429   431 tablet_replica.cc:333] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7: stopping tablet replica
I20260709 12:57:35.358439   431 raft_consensus.cc:2243] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:57:35.358647   680 consensus_peers.cc:597] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 -> Peer 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475): Couldn't send request to peer 598e24a4a3614aa3b30ffb158636a113. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33475: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:57:35.359571   680 consensus_peers.cc:597] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 -> Peer b1e020e1df5446c493307cbb386ac590 (127.0.107.193:46233): Couldn't send request to peer b1e020e1df5446c493307cbb386ac590. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46233: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:35.359788   431 raft_consensus.cc:2272] T 59793ce40b114fae99146e21be9f2847 P 295b837450d340428c2da51136bf4cd7 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:57:35.361917   680 consensus_peers.cc:597] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 -> Peer 598e24a4a3614aa3b30ffb158636a113 (127.0.107.194:33475): Couldn't send request to peer 598e24a4a3614aa3b30ffb158636a113. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33475: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:35.362599   431 tablet_replica.cc:333] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7: stopping tablet replica
I20260709 12:57:35.363178   431 raft_consensus.cc:2243] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:57:35.363962   431 raft_consensus.cc:2272] T 995ef6e306984e489cb5ddb6a810766e P 295b837450d340428c2da51136bf4cd7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.366237   431 tablet_replica.cc:333] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7: stopping tablet replica
I20260709 12:57:35.366787   431 raft_consensus.cc:2243] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.367215   431 raft_consensus.cc:2272] T 1074a307786b4f2c8f9c1197f7007a36 P 295b837450d340428c2da51136bf4cd7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.368850   431 tablet_replica.cc:333] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7: stopping tablet replica
I20260709 12:57:35.369357   431 raft_consensus.cc:2243] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.369761   431 raft_consensus.cc:2272] T 1f4a248a564f4dfea44d76b1a0890c16 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.371811   431 tablet_replica.cc:333] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7: stopping tablet replica
I20260709 12:57:35.372373   431 raft_consensus.cc:2243] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.372803   431 raft_consensus.cc:2272] T ddc1580435fa48ef83af27238f7fd421 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.374528   431 tablet_replica.cc:333] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7: stopping tablet replica
I20260709 12:57:35.375005   431 raft_consensus.cc:2243] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.375422   431 raft_consensus.cc:2272] T 0e915b506968455a8bf0a49a69d24bd5 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.377051   431 tablet_replica.cc:333] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7: stopping tablet replica
I20260709 12:57:35.377513   431 raft_consensus.cc:2243] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.377899   431 raft_consensus.cc:2272] T 258ad8e4f9934e38915c725ddeb66476 P 295b837450d340428c2da51136bf4cd7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.379380   431 tablet_replica.cc:333] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7: stopping tablet replica
I20260709 12:57:35.379835   431 raft_consensus.cc:2243] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:35.380604   431 raft_consensus.cc:2272] T 1478258de7414f83852bcf506f6a6268 P 295b837450d340428c2da51136bf4cd7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.382453   431 tablet_replica.cc:333] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7: stopping tablet replica
I20260709 12:57:35.382931   431 raft_consensus.cc:2243] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:35.383447   431 raft_consensus.cc:2272] T a16052ff474946cd8f60307f76e070c6 P 295b837450d340428c2da51136bf4cd7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.412626   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:57:35.431154   431 master.cc:562] Master@127.0.107.254:34263 shutting down...
I20260709 12:57:35.578665   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:57:35.579320   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:35.579696   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 307ae6622c99490da718b8db32bba0d4: stopping tablet replica
I20260709 12:57:35.601114   431 master.cc:584] Master@127.0.107.254:34263 shutdown complete.
295b837450d340428c2da51136bf4cd7  1
598e24a4a3614aa3b30ffb158636a113  4
b1e020e1df5446c493307cbb386ac590  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (14796 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:57:35.643884   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:39997
I20260709 12:57:35.645181   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:35.651257   964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:35.651378   965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:35.652385   967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:35.653151   431 server_base.cc:1061] running on GCE node
I20260709 12:57:35.654218   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:35.654458   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:35.654630   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601855654597 us; error 0 us; skew 500 ppm
I20260709 12:57:35.655191   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:35.657783   431 webserver.cc:533] Webserver started at http://127.0.107.254:46131/ using document root <none> and password file <none>
I20260709 12:57:35.658406   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:35.658599   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:35.658921   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:35.660142   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/master-0-root/instance:
uuid: "112b2a2e31464c02a1507cc2c7d9fec7"
format_stamp: "Formatted at 2026-07-09 12:57:35 on dist-test-slave-zhdc"
I20260709 12:57:35.664851   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:57:35.668385   972 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:35.669092   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:57:35.669386   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/master-0-root
uuid: "112b2a2e31464c02a1507cc2c7d9fec7"
format_stamp: "Formatted at 2026-07-09 12:57:35 on dist-test-slave-zhdc"
I20260709 12:57:35.669673   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:35.681036   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:35.682592   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:35.724707   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:39997
I20260709 12:57:35.724803  1023 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:39997 every 8 connection(s)
I20260709 12:57:35.729107  1024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:35.740779  1024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7: Bootstrap starting.
I20260709 12:57:35.745874  1024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:35.751132  1024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7: No bootstrap required, opened a new log
I20260709 12:57:35.753531  1024 raft_consensus.cc:359] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112b2a2e31464c02a1507cc2c7d9fec7" member_type: VOTER }
I20260709 12:57:35.753944  1024 raft_consensus.cc:385] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:35.754266  1024 raft_consensus.cc:740] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112b2a2e31464c02a1507cc2c7d9fec7, State: Initialized, Role: FOLLOWER
I20260709 12:57:35.754896  1024 consensus_queue.cc:260] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112b2a2e31464c02a1507cc2c7d9fec7" member_type: VOTER }
I20260709 12:57:35.755371  1024 raft_consensus.cc:399] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:57:35.755594  1024 raft_consensus.cc:493] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:57:35.755873  1024 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:35.761126  1024 raft_consensus.cc:515] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112b2a2e31464c02a1507cc2c7d9fec7" member_type: VOTER }
I20260709 12:57:35.761742  1024 leader_election.cc:304] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 112b2a2e31464c02a1507cc2c7d9fec7; no voters: 
I20260709 12:57:35.762969  1024 leader_election.cc:290] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:57:35.763505  1027 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:35.764935  1027 raft_consensus.cc:697] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [term 1 LEADER]: Becoming Leader. State: Replica: 112b2a2e31464c02a1507cc2c7d9fec7, State: Running, Role: LEADER
I20260709 12:57:35.765648  1027 consensus_queue.cc:237] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112b2a2e31464c02a1507cc2c7d9fec7" member_type: VOTER }
I20260709 12:57:35.765988  1024 sys_catalog.cc:565] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:57:35.770406  1028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "112b2a2e31464c02a1507cc2c7d9fec7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112b2a2e31464c02a1507cc2c7d9fec7" member_type: VOTER } }
I20260709 12:57:35.771492  1029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 112b2a2e31464c02a1507cc2c7d9fec7. Latest consensus state: current_term: 1 leader_uuid: "112b2a2e31464c02a1507cc2c7d9fec7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112b2a2e31464c02a1507cc2c7d9fec7" member_type: VOTER } }
I20260709 12:57:35.772260  1028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:35.772357  1029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:35.774427  1035 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:57:35.780215  1035 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:57:35.782634   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:57:35.789592  1035 catalog_manager.cc:1383] Generated new cluster ID: d3afabeffe314708b827c0dc2e381cbc
I20260709 12:57:35.789901  1035 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:57:35.805235  1035 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:57:35.806699  1035 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:57:35.824254  1035 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7: Generated new TSK 0
I20260709 12:57:35.824934  1035 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:57:35.849342   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:35.856060  1045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:35.857337  1046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:35.862577  1048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:35.862942   431 server_base.cc:1061] running on GCE node
I20260709 12:57:35.864069   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:35.864259   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:35.864447   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601855864429 us; error 0 us; skew 500 ppm
I20260709 12:57:35.865082   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:35.867910   431 webserver.cc:533] Webserver started at http://127.0.107.193:43547/ using document root <none> and password file <none>
I20260709 12:57:35.868450   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:35.868664   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:35.868991   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:35.870261   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-0-root/instance:
uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
format_stamp: "Formatted at 2026-07-09 12:57:35 on dist-test-slave-zhdc"
I20260709 12:57:35.882903   431 fs_manager.cc:696] Time spent creating directory manager: real 0.012s	user 0.010s	sys 0.002s
I20260709 12:57:35.886752  1053 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:35.887650   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:57:35.888067   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-0-root
uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
format_stamp: "Formatted at 2026-07-09 12:57:35 on dist-test-slave-zhdc"
I20260709 12:57:35.888447   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:35.904973   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:35.906462   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:35.908100   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:35.910616   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:35.910851   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:35.911123   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:35.911316   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:35.956504   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34617
I20260709 12:57:35.956632  1115 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34617 every 8 connection(s)
I20260709 12:57:35.961966   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:35.970002  1120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:35.972231  1121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:35.975875  1123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:35.976378   431 server_base.cc:1061] running on GCE node
I20260709 12:57:35.977789   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:35.977993   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:35.978199   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601855978181 us; error 0 us; skew 500 ppm
I20260709 12:57:35.978703   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:35.981913   431 webserver.cc:533] Webserver started at http://127.0.107.194:35693/ using document root <none> and password file <none>
I20260709 12:57:35.982673   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:35.982973   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:35.983321   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:35.983690  1116 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39997
I20260709 12:57:35.984124  1116 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:35.984822   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-1-root/instance:
uuid: "1a301f13fe144f5bb35909a905db00b6"
format_stamp: "Formatted at 2026-07-09 12:57:35 on dist-test-slave-zhdc"
I20260709 12:57:35.985124  1116 heartbeater.cc:507] Master 127.0.107.254:39997 requested a full tablet report, sending...
I20260709 12:57:35.987648   989 ts_manager.cc:194] Registered new tserver with Master: ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617)
I20260709 12:57:35.990346   989 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58626
I20260709 12:57:35.991462   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:57:35.995436  1128 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:35.996322   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:57:35.996680   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-1-root
uuid: "1a301f13fe144f5bb35909a905db00b6"
format_stamp: "Formatted at 2026-07-09 12:57:35 on dist-test-slave-zhdc"
I20260709 12:57:35.996968   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:36.030702   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:36.032181   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:36.033876   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:36.036360   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:36.036583   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:36.036906   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:36.037055   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:36.083256   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:45215
I20260709 12:57:36.083400  1190 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:45215 every 8 connection(s)
I20260709 12:57:36.088402   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:36.097592  1194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:36.099632  1195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:36.101650   431 server_base.cc:1061] running on GCE node
W20260709 12:57:36.101980  1197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:36.102926  1191 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39997
I20260709 12:57:36.103282   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:57:36.103358  1191 heartbeater.cc:461] Registering TS with master...
W20260709 12:57:36.103583   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:36.103803   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601856103778 us; error 0 us; skew 500 ppm
I20260709 12:57:36.104408   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:36.104350  1191 heartbeater.cc:507] Master 127.0.107.254:39997 requested a full tablet report, sending...
I20260709 12:57:36.107128   989 ts_manager.cc:194] Registered new tserver with Master: 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215)
I20260709 12:57:36.107383   431 webserver.cc:533] Webserver started at http://127.0.107.195:45295/ using document root <none> and password file <none>
I20260709 12:57:36.107990   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:36.108215   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:36.108507   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:36.109021   989 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58640
I20260709 12:57:36.109840   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-2-root/instance:
uuid: "6081cc990e4c49909d2ebd83256f6938"
format_stamp: "Formatted at 2026-07-09 12:57:36 on dist-test-slave-zhdc"
I20260709 12:57:36.114739   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:57:36.118328  1202 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:36.119164   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:57:36.119508   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-2-root
uuid: "6081cc990e4c49909d2ebd83256f6938"
format_stamp: "Formatted at 2026-07-09 12:57:36 on dist-test-slave-zhdc"
I20260709 12:57:36.119825   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601840662384-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:36.131932   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:36.133342   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:36.135040   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:36.137491   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:36.137727   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:36.137995   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:36.138249   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:57:36.185134   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:34357
I20260709 12:57:36.185334  1264 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:34357 every 8 connection(s)
I20260709 12:57:36.201267  1265 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39997
I20260709 12:57:36.201764  1265 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:36.202718  1265 heartbeater.cc:507] Master 127.0.107.254:39997 requested a full tablet report, sending...
I20260709 12:57:36.205027   989 ts_manager.cc:194] Registered new tserver with Master: 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:36.205762   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017074777s
I20260709 12:57:36.206668   989 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58642
I20260709 12:57:36.234352   989 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58654:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:57:36.237730   989 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:57:36.316192  1081 tablet_service.cc:1511] Processing CreateTablet for tablet b42f18d2dd3f45579c13f2665d2028f3 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:57:36.317847  1079 tablet_service.cc:1511] Processing CreateTablet for tablet 09631d931dd142dabc34bab1070a5351 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:57:36.318216  1080 tablet_service.cc:1511] Processing CreateTablet for tablet a40cc14fa316476ab70337a1f490099c (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:57:36.319788  1079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09631d931dd142dabc34bab1070a5351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.320596  1080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40cc14fa316476ab70337a1f490099c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.326485  1081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42f18d2dd3f45579c13f2665d2028f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.329105  1156 tablet_service.cc:1511] Processing CreateTablet for tablet b42f18d2dd3f45579c13f2665d2028f3 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:57:36.330564  1156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42f18d2dd3f45579c13f2665d2028f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.335294  1155 tablet_service.cc:1511] Processing CreateTablet for tablet a40cc14fa316476ab70337a1f490099c (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:57:36.336891  1155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40cc14fa316476ab70337a1f490099c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.338428  1076 tablet_service.cc:1511] Processing CreateTablet for tablet 83d350dd137342dcb19629f2f098c97a (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:57:36.339359  1154 tablet_service.cc:1511] Processing CreateTablet for tablet 09631d931dd142dabc34bab1070a5351 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:57:36.340425  1076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83d350dd137342dcb19629f2f098c97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.340837  1154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09631d931dd142dabc34bab1070a5351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.343392  1153 tablet_service.cc:1511] Processing CreateTablet for tablet a9dc1a66a27b4a6b9c60f6695c43d661 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:57:36.344888  1153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9dc1a66a27b4a6b9c60f6695c43d661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.345412  1280 tablet_bootstrap.cc:492] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7: Bootstrap starting.
I20260709 12:57:36.347368  1078 tablet_service.cc:1511] Processing CreateTablet for tablet a9dc1a66a27b4a6b9c60f6695c43d661 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:57:36.348788  1078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9dc1a66a27b4a6b9c60f6695c43d661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.351511  1077 tablet_service.cc:1511] Processing CreateTablet for tablet 9d8172c7b4f744b8afef76aa5803bdb8 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:57:36.353080  1077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8172c7b4f744b8afef76aa5803bdb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.353624  1280 tablet_bootstrap.cc:654] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.360816  1079 tablet_service.cc:1511] Processing CreateTablet for tablet f44af6c9e5f84fa7adc2d6d66d61f8ba (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:57:36.360949  1152 tablet_service.cc:1511] Processing CreateTablet for tablet 9d8172c7b4f744b8afef76aa5803bdb8 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:57:36.362375  1079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44af6c9e5f84fa7adc2d6d66d61f8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.362461  1152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8172c7b4f744b8afef76aa5803bdb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.365633  1151 tablet_service.cc:1511] Processing CreateTablet for tablet 83d350dd137342dcb19629f2f098c97a (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:57:36.367154  1151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83d350dd137342dcb19629f2f098c97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.368394  1075 tablet_service.cc:1511] Processing CreateTablet for tablet bafca245ca284c719970f20afbcf2de5 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:57:36.370178  1075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bafca245ca284c719970f20afbcf2de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.370662  1150 tablet_service.cc:1511] Processing CreateTablet for tablet f44af6c9e5f84fa7adc2d6d66d61f8ba (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:57:36.372051  1150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44af6c9e5f84fa7adc2d6d66d61f8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.375945  1149 tablet_service.cc:1511] Processing CreateTablet for tablet bafca245ca284c719970f20afbcf2de5 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:57:36.377436  1149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bafca245ca284c719970f20afbcf2de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.383848  1148 tablet_service.cc:1511] Processing CreateTablet for tablet 311fcc470d1b454fbde9dc6962d12616 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:57:36.384500  1074 tablet_service.cc:1511] Processing CreateTablet for tablet 311fcc470d1b454fbde9dc6962d12616 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:57:36.385378  1148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311fcc470d1b454fbde9dc6962d12616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.386101  1074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311fcc470d1b454fbde9dc6962d12616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.395936  1147 tablet_service.cc:1511] Processing CreateTablet for tablet a5fd4266e26147578dce43c6a1d8845a (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:57:36.397538  1147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5fd4266e26147578dce43c6a1d8845a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.425410  1280 tablet_bootstrap.cc:492] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7: No bootstrap required, opened a new log
I20260709 12:57:36.426352  1280 ts_tablet_manager.cc:1403] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent bootstrapping tablet: real 0.081s	user 0.020s	sys 0.005s
I20260709 12:57:36.435341  1079 tablet_service.cc:1511] Processing CreateTablet for tablet a5fd4266e26147578dce43c6a1d8845a (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:57:36.437067  1079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5fd4266e26147578dce43c6a1d8845a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.444368  1280 raft_consensus.cc:359] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.445335  1280 raft_consensus.cc:385] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.445746  1280 raft_consensus.cc:740] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.446707  1280 consensus_queue.cc:260] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.452080  1227 tablet_service.cc:1511] Processing CreateTablet for tablet a9dc1a66a27b4a6b9c60f6695c43d661 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:57:36.455979  1224 tablet_service.cc:1511] Processing CreateTablet for tablet f44af6c9e5f84fa7adc2d6d66d61f8ba (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:57:36.455830  1228 tablet_service.cc:1511] Processing CreateTablet for tablet 09631d931dd142dabc34bab1070a5351 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:57:36.458658  1229 tablet_service.cc:1511] Processing CreateTablet for tablet a40cc14fa316476ab70337a1f490099c (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:57:36.460709  1222 tablet_service.cc:1511] Processing CreateTablet for tablet 311fcc470d1b454fbde9dc6962d12616 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:57:36.462756  1225 tablet_service.cc:1511] Processing CreateTablet for tablet 83d350dd137342dcb19629f2f098c97a (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:57:36.462857  1230 tablet_service.cc:1511] Processing CreateTablet for tablet b42f18d2dd3f45579c13f2665d2028f3 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:57:36.453632  1221 tablet_service.cc:1511] Processing CreateTablet for tablet a5fd4266e26147578dce43c6a1d8845a (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:57:36.458783  1223 tablet_service.cc:1511] Processing CreateTablet for tablet bafca245ca284c719970f20afbcf2de5 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:57:36.449276  1226 tablet_service.cc:1511] Processing CreateTablet for tablet 9d8172c7b4f744b8afef76aa5803bdb8 (DEFAULT_TABLE table=test-workload [id=e4475c7be1ae4b2bbf39eb2ebc7af788]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:57:36.466360  1227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9dc1a66a27b4a6b9c60f6695c43d661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.467703  1230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42f18d2dd3f45579c13f2665d2028f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.470608  1224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44af6c9e5f84fa7adc2d6d66d61f8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.472064  1222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311fcc470d1b454fbde9dc6962d12616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.476660  1223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bafca245ca284c719970f20afbcf2de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.477661  1226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8172c7b4f744b8afef76aa5803bdb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.479779  1228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09631d931dd142dabc34bab1070a5351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.483136  1225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83d350dd137342dcb19629f2f098c97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.490608  1221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5fd4266e26147578dce43c6a1d8845a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.495325  1229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40cc14fa316476ab70337a1f490099c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:36.599079  1282 tablet_bootstrap.cc:492] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6: Bootstrap starting.
I20260709 12:57:36.603309  1280 ts_tablet_manager.cc:1434] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent starting tablet: real 0.177s	user 0.050s	sys 0.096s
I20260709 12:57:36.604234  1116 heartbeater.cc:499] Master 127.0.107.254:39997 was elected leader, sending a full tablet report...
W20260709 12:57:36.604882   973 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:45215, user_credentials={real_user=slave}} blocked reactor thread for 46520.5us
I20260709 12:57:36.609393  1280 tablet_bootstrap.cc:492] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7: Bootstrap starting.
I20260709 12:57:36.616905  1280 tablet_bootstrap.cc:654] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.625665  1282 tablet_bootstrap.cc:654] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.646821  1282 tablet_bootstrap.cc:492] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6: No bootstrap required, opened a new log
I20260709 12:57:36.649369  1282 ts_tablet_manager.cc:1403] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.000s
I20260709 12:57:36.652518  1282 raft_consensus.cc:359] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.653139  1282 raft_consensus.cc:385] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.653401  1282 raft_consensus.cc:740] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.654822  1282 consensus_queue.cc:260] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.656839  1286 tablet_bootstrap.cc:492] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938: Bootstrap starting.
I20260709 12:57:36.658567  1191 heartbeater.cc:499] Master 127.0.107.254:39997 was elected leader, sending a full tablet report...
I20260709 12:57:36.659065  1282 ts_tablet_manager.cc:1434] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 12:57:36.660048  1282 tablet_bootstrap.cc:492] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6: Bootstrap starting.
I20260709 12:57:36.660084  1280 tablet_bootstrap.cc:492] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7: No bootstrap required, opened a new log
I20260709 12:57:36.660705  1280 ts_tablet_manager.cc:1403] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.034s
I20260709 12:57:36.663466  1280 raft_consensus.cc:359] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.664278  1280 raft_consensus.cc:385] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.664603  1280 raft_consensus.cc:740] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.665482  1280 consensus_queue.cc:260] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.667778  1282 tablet_bootstrap.cc:654] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.668136  1280 ts_tablet_manager.cc:1434] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.001s
I20260709 12:57:36.669488  1280 tablet_bootstrap.cc:492] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7: Bootstrap starting.
I20260709 12:57:36.669808  1286 tablet_bootstrap.cc:654] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.678897  1280 tablet_bootstrap.cc:654] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.719180  1282 tablet_bootstrap.cc:492] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6: No bootstrap required, opened a new log
I20260709 12:57:36.719259  1280 tablet_bootstrap.cc:492] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7: No bootstrap required, opened a new log
I20260709 12:57:36.719480  1286 tablet_bootstrap.cc:492] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938: No bootstrap required, opened a new log
I20260709 12:57:36.719858  1282 ts_tablet_manager.cc:1403] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6: Time spent bootstrapping tablet: real 0.060s	user 0.033s	sys 0.021s
I20260709 12:57:36.719933  1286 ts_tablet_manager.cc:1403] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.035s
I20260709 12:57:36.719911  1280 ts_tablet_manager.cc:1403] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent bootstrapping tablet: real 0.051s	user 0.026s	sys 0.024s
I20260709 12:57:36.723193  1280 raft_consensus.cc:359] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.723090  1286 raft_consensus.cc:359] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.723594  1282 raft_consensus.cc:359] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.723973  1280 raft_consensus.cc:385] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.724076  1286 raft_consensus.cc:385] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.724355  1282 raft_consensus.cc:385] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.724459  1286 raft_consensus.cc:740] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.724417  1280 raft_consensus.cc:740] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.724825  1282 raft_consensus.cc:740] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.725518  1280 consensus_queue.cc:260] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.725669  1286 consensus_queue.cc:260] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.725744  1282 consensus_queue.cc:260] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.727998  1280 ts_tablet_manager.cc:1434] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:57:36.728116  1282 ts_tablet_manager.cc:1434] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:57:36.729084  1282 tablet_bootstrap.cc:492] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6: Bootstrap starting.
I20260709 12:57:36.729084  1280 tablet_bootstrap.cc:492] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7: Bootstrap starting.
I20260709 12:57:36.736243  1282 tablet_bootstrap.cc:654] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.739097  1280 tablet_bootstrap.cc:654] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.744168  1265 heartbeater.cc:499] Master 127.0.107.254:39997 was elected leader, sending a full tablet report...
I20260709 12:57:36.744737  1286 ts_tablet_manager.cc:1434] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938: Time spent starting tablet: real 0.024s	user 0.012s	sys 0.009s
I20260709 12:57:36.745772  1286 tablet_bootstrap.cc:492] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938: Bootstrap starting.
I20260709 12:57:36.752568  1280 tablet_bootstrap.cc:492] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7: No bootstrap required, opened a new log
I20260709 12:57:36.753206  1280 ts_tablet_manager.cc:1403] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.003s
I20260709 12:57:36.755306  1282 tablet_bootstrap.cc:492] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6: No bootstrap required, opened a new log
I20260709 12:57:36.755980  1282 ts_tablet_manager.cc:1403] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.020s
I20260709 12:57:36.756431  1280 raft_consensus.cc:359] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } }
I20260709 12:57:36.757220  1280 raft_consensus.cc:385] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.757525  1280 raft_consensus.cc:740] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.758473  1280 consensus_queue.cc:260] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } }
I20260709 12:57:36.759133  1286 tablet_bootstrap.cc:654] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.759567  1282 raft_consensus.cc:359] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } }
I20260709 12:57:36.762009  1282 raft_consensus.cc:385] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.762115  1283 raft_consensus.cc:493] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.762535  1282 raft_consensus.cc:740] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.762646  1283 raft_consensus.cc:515] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.763988  1282 consensus_queue.cc:260] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } }
I20260709 12:57:36.773211  1282 ts_tablet_manager.cc:1434] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:57:36.774362  1283 leader_election.cc:290] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:36.774992  1282 tablet_bootstrap.cc:492] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6: Bootstrap starting.
W20260709 12:57:36.777842  1037 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:36.779271  1280 ts_tablet_manager.cc:1434] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:57:36.786743  1280 tablet_bootstrap.cc:492] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7: Bootstrap starting.
I20260709 12:57:36.788951  1282 tablet_bootstrap.cc:654] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.797744  1286 tablet_bootstrap.cc:492] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938: No bootstrap required, opened a new log
I20260709 12:57:36.797945  1282 tablet_bootstrap.cc:492] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6: No bootstrap required, opened a new log
I20260709 12:57:36.798368  1286 ts_tablet_manager.cc:1403] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938: Time spent bootstrapping tablet: real 0.053s	user 0.025s	sys 0.019s
I20260709 12:57:36.798640  1282 ts_tablet_manager.cc:1403] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.005s
I20260709 12:57:36.801677  1286 raft_consensus.cc:359] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.802496  1286 raft_consensus.cc:385] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.802284  1282 raft_consensus.cc:359] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.802851  1286 raft_consensus.cc:740] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.803112  1282 raft_consensus.cc:385] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.803469  1282 raft_consensus.cc:740] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.803812  1286 consensus_queue.cc:260] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.805729  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44af6c9e5f84fa7adc2d6d66d61f8ba" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6" is_pre_election: true
I20260709 12:57:36.806146  1286 ts_tablet_manager.cc:1434] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:57:36.807152  1286 tablet_bootstrap.cc:492] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938: Bootstrap starting.
I20260709 12:57:36.805693  1282 consensus_queue.cc:260] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.808259  1280 tablet_bootstrap.cc:654] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.808951  1291 raft_consensus.cc:493] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.809404  1291 raft_consensus.cc:515] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
W20260709 12:57:36.808754  1054 leader_election.cc:343] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.813503  1282 ts_tablet_manager.cc:1434] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:57:36.815001  1282 tablet_bootstrap.cc:492] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6: Bootstrap starting.
I20260709 12:57:36.815339  1286 tablet_bootstrap.cc:654] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.824445  1282 tablet_bootstrap.cc:654] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.825201  1280 tablet_bootstrap.cc:492] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7: No bootstrap required, opened a new log
I20260709 12:57:36.825858  1280 ts_tablet_manager.cc:1403] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.005s
I20260709 12:57:36.829172  1280 raft_consensus.cc:359] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.830034  1280 raft_consensus.cc:385] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.830430  1280 raft_consensus.cc:740] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.831499  1280 consensus_queue.cc:260] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.833384  1291 leader_election.cc:290] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215)
I20260709 12:57:36.836764  1280 ts_tablet_manager.cc:1434] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:57:36.837273  1286 tablet_bootstrap.cc:492] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938: No bootstrap required, opened a new log
I20260709 12:57:36.837807  1286 ts_tablet_manager.cc:1403] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.003s
I20260709 12:57:36.841712  1282 tablet_bootstrap.cc:492] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6: No bootstrap required, opened a new log
I20260709 12:57:36.841460  1286 raft_consensus.cc:359] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.842320  1282 ts_tablet_manager.cc:1403] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.006s
I20260709 12:57:36.837832  1280 tablet_bootstrap.cc:492] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7: Bootstrap starting.
I20260709 12:57:36.845118  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44af6c9e5f84fa7adc2d6d66d61f8ba" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938" is_pre_election: true
I20260709 12:57:36.845170  1282 raft_consensus.cc:359] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.842518  1286 raft_consensus.cc:385] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.854466  1286 raft_consensus.cc:740] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Initialized, Role: FOLLOWER
W20260709 12:57:36.854996  1056 leader_election.cc:343] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.855360  1286 consensus_queue.cc:260] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.855525  1056 leader_election.cc:304] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 1a301f13fe144f5bb35909a905db00b6, 6081cc990e4c49909d2ebd83256f6938
I20260709 12:57:36.845969  1282 raft_consensus.cc:385] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.858944  1283 raft_consensus.cc:2749] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:36.858817  1282 raft_consensus.cc:740] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.861853  1282 consensus_queue.cc:260] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.866436  1280 tablet_bootstrap.cc:654] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.866822  1282 ts_tablet_manager.cc:1434] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.007s
I20260709 12:57:36.867937  1282 tablet_bootstrap.cc:492] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6: Bootstrap starting.
I20260709 12:57:36.871385  1286 ts_tablet_manager.cc:1434] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.003s
I20260709 12:57:36.876953  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6" is_pre_election: true
I20260709 12:57:36.877758  1166 raft_consensus.cc:2468] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 0.
I20260709 12:57:36.879248  1286 tablet_bootstrap.cc:492] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938: Bootstrap starting.
I20260709 12:57:36.880182  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" is_pre_election: true
W20260709 12:57:36.882011  1205 leader_election.cc:343] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.885982  1282 tablet_bootstrap.cc:654] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.886143  1203 leader_election.cc:304] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, 6081cc990e4c49909d2ebd83256f6938; no voters: ec6fa7e59c2047b09a4ef741bc4f24f7
I20260709 12:57:36.890712  1291 raft_consensus.cc:2804] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:36.891243  1291 raft_consensus.cc:493] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.891675  1291 raft_consensus.cc:3060] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.890437  1286 tablet_bootstrap.cc:654] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.901106  1286 tablet_bootstrap.cc:492] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938: No bootstrap required, opened a new log
I20260709 12:57:36.901105  1283 raft_consensus.cc:493] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.902235  1286 ts_tablet_manager.cc:1403] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.004s
I20260709 12:57:36.901963  1283 raft_consensus.cc:515] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.901664  1291 raft_consensus.cc:515] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.904382  1283 leader_election.cc:290] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:36.905252  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6" is_pre_election: true
I20260709 12:57:36.905896  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938" is_pre_election: true
I20260709 12:57:36.905915  1166 raft_consensus.cc:2468] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 0.
I20260709 12:57:36.906246  1286 raft_consensus.cc:359] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } }
I20260709 12:57:36.907291  1286 raft_consensus.cc:385] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:57:36.907441  1056 leader_election.cc:343] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.905892  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
I20260709 12:57:36.907663  1286 raft_consensus.cc:740] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.908267  1054 leader_election.cc:304] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 6081cc990e4c49909d2ebd83256f6938
I20260709 12:57:36.908664  1286 consensus_queue.cc:260] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } }
W20260709 12:57:36.909632  1205 leader_election.cc:343] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:36.910000  1280 tablet_bootstrap.cc:492] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7: No bootstrap required, opened a new log
I20260709 12:57:36.910377  1283 raft_consensus.cc:2804] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:36.910575  1280 ts_tablet_manager.cc:1403] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.021s
I20260709 12:57:36.910776  1283 raft_consensus.cc:493] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.911156  1283 raft_consensus.cc:3060] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.907420  1291 leader_election.cc:290] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 1 election: Requested vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215)
I20260709 12:57:36.914556  1280 raft_consensus.cc:359] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.916052  1280 raft_consensus.cc:385] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.915820  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:36.916647  1166 raft_consensus.cc:3060] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.916401  1280 raft_consensus.cc:740] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.918260  1280 consensus_queue.cc:260] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.938143  1287 raft_consensus.cc:493] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.938927  1287 raft_consensus.cc:515] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.944564  1282 tablet_bootstrap.cc:492] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6: No bootstrap required, opened a new log
I20260709 12:57:36.945065  1286 ts_tablet_manager.cc:1434] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938: Time spent starting tablet: real 0.042s	user 0.014s	sys 0.010s
I20260709 12:57:36.945190  1282 ts_tablet_manager.cc:1403] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6: Time spent bootstrapping tablet: real 0.077s	user 0.019s	sys 0.015s
I20260709 12:57:36.946410  1286 tablet_bootstrap.cc:492] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938: Bootstrap starting.
I20260709 12:57:36.948527  1282 raft_consensus.cc:359] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.949319  1282 raft_consensus.cc:385] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:36.949649  1282 raft_consensus.cc:740] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Initialized, Role: FOLLOWER
I20260709 12:57:36.950624  1282 consensus_queue.cc:260] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.951303  1287 leader_election.cc:290] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:36.944557  1166 raft_consensus.cc:2468] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 1.
I20260709 12:57:36.953696  1203 leader_election.cc:304] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, 6081cc990e4c49909d2ebd83256f6938; no voters: ec6fa7e59c2047b09a4ef741bc4f24f7
I20260709 12:57:36.954892  1286 tablet_bootstrap.cc:654] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:36.954948  1291 raft_consensus.cc:2804] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:36.955710  1291 raft_consensus.cc:697] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 1 LEADER]: Becoming Leader. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Running, Role: LEADER
I20260709 12:57:36.956684  1291 consensus_queue.cc:237] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.960238  1309 raft_consensus.cc:493] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.960951  1309 raft_consensus.cc:515] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.968425  1309 leader_election.cc:290] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:36.969712  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09631d931dd142dabc34bab1070a5351" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938" is_pre_election: true
I20260709 12:57:36.970537  1240 raft_consensus.cc:2468] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 0.
I20260709 12:57:36.971226  1309 raft_consensus.cc:493] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.971700  1309 raft_consensus.cc:515] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } }
I20260709 12:57:36.972680  1056 leader_election.cc:304] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6081cc990e4c49909d2ebd83256f6938, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:36.973701  1309 leader_election.cc:290] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357), 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215)
I20260709 12:57:36.974763  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f18d2dd3f45579c13f2665d2028f3" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938" is_pre_election: true
I20260709 12:57:36.975425  1240 raft_consensus.cc:2468] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 0.
I20260709 12:57:36.970808  1308 raft_consensus.cc:493] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.976779  1056 leader_election.cc:304] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6081cc990e4c49909d2ebd83256f6938, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:36.977206  1308 raft_consensus.cc:515] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.979719  1308 leader_election.cc:290] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:36.980234  1308 raft_consensus.cc:2804] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:36.980652  1308 raft_consensus.cc:493] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.980983  1308 raft_consensus.cc:3060] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.983579  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311fcc470d1b454fbde9dc6962d12616" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938" is_pre_election: true
I20260709 12:57:36.984423  1240 raft_consensus.cc:2468] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 0.
I20260709 12:57:36.985383  1309 raft_consensus.cc:2804] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:36.985744  1309 raft_consensus.cc:493] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.986115  1309 raft_consensus.cc:3060] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.985980  1056 leader_election.cc:304] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6081cc990e4c49909d2ebd83256f6938, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:36.992376  1283 raft_consensus.cc:515] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:36.993645  1313 raft_consensus.cc:2804] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:36.994098  1313 raft_consensus.cc:493] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.994436  1313 raft_consensus.cc:3060] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:36.995609  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09631d931dd142dabc34bab1070a5351" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6" is_pre_election: true
I20260709 12:57:36.996410  1165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f18d2dd3f45579c13f2665d2028f3" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6" is_pre_election: true
I20260709 12:57:36.996510  1166 raft_consensus.cc:2468] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 0.
I20260709 12:57:36.997164  1165 raft_consensus.cc:2468] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 0.
I20260709 12:57:36.999203  1165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311fcc470d1b454fbde9dc6962d12616" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6" is_pre_election: true
W20260709 12:57:37.002017  1054 leader_election.cc:343] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:37.009457  1283 leader_election.cc:290] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 election: Requested vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:37.010738  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:37.011389  1165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:37.012013  1165 raft_consensus.cc:3060] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:37.012421  1056 leader_election.cc:343] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:37.012666  1286 tablet_bootstrap.cc:492] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938: No bootstrap required, opened a new log
I20260709 12:57:37.014250  1286 ts_tablet_manager.cc:1403] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.025s
I20260709 12:57:37.015157   989 catalog_manager.cc:5697] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6081cc990e4c49909d2ebd83256f6938" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:37.029661  1280 ts_tablet_manager.cc:1434] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent starting tablet: real 0.119s	user 0.020s	sys 0.023s
I20260709 12:57:37.026208  1165 raft_consensus.cc:2468] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 1.
I20260709 12:57:37.030462  1286 raft_consensus.cc:359] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.031651  1286 raft_consensus.cc:385] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.031988  1286 raft_consensus.cc:740] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.032784  1282 ts_tablet_manager.cc:1434] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6: Time spent starting tablet: real 0.087s	user 0.026s	sys 0.047s
I20260709 12:57:37.032927  1054 leader_election.cc:304] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 6081cc990e4c49909d2ebd83256f6938
I20260709 12:57:37.034233  1282 tablet_bootstrap.cc:492] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6: Bootstrap starting.
I20260709 12:57:37.032847  1286 consensus_queue.cc:260] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.035030  1310 raft_consensus.cc:2804] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.036631  1280 tablet_bootstrap.cc:492] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7: Bootstrap starting.
I20260709 12:57:37.038744  1310 raft_consensus.cc:697] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Becoming Leader. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:37.039721  1310 consensus_queue.cc:237] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.041939  1309 raft_consensus.cc:515] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } }
I20260709 12:57:37.044008  1308 raft_consensus.cc:515] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.046566  1280 tablet_bootstrap.cc:654] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.046551  1308 leader_election.cc:290] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 election: Requested vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:37.047395  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09631d931dd142dabc34bab1070a5351" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:37.047891  1240 raft_consensus.cc:3060] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.053845  1165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09631d931dd142dabc34bab1070a5351" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:37.053988  1239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f18d2dd3f45579c13f2665d2028f3" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:37.055152  1239 raft_consensus.cc:3060] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.055188  1165 raft_consensus.cc:3060] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.058638  1240 raft_consensus.cc:2468] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 1.
I20260709 12:57:37.060268  1056 leader_election.cc:304] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6081cc990e4c49909d2ebd83256f6938, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:37.053846  1313 raft_consensus.cc:515] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.061852  1308 raft_consensus.cc:2804] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.062430  1308 raft_consensus.cc:697] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Becoming Leader. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:37.062897  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44af6c9e5f84fa7adc2d6d66d61f8ba" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" is_pre_election: true
I20260709 12:57:37.063565  1091 raft_consensus.cc:2468] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 0.
I20260709 12:57:37.063438  1308 consensus_queue.cc:237] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.065877  1282 tablet_bootstrap.cc:654] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.079664  1286 ts_tablet_manager.cc:1434] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.002s
I20260709 12:57:37.081072  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42f18d2dd3f45579c13f2665d2028f3" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:37.081856  1286 tablet_bootstrap.cc:492] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938: Bootstrap starting.
I20260709 12:57:37.081817  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311fcc470d1b454fbde9dc6962d12616" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:37.082571  1240 raft_consensus.cc:3060] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.081759  1166 raft_consensus.cc:3060] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.083580  1164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311fcc470d1b454fbde9dc6962d12616" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
W20260709 12:57:37.085112  1054 leader_election.cc:343] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:37.075958  1309 leader_election.cc:290] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 election: Requested vote from peers 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357), 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215)
I20260709 12:57:37.088146  1313 leader_election.cc:290] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 election: Requested vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:37.095191  1280 tablet_bootstrap.cc:492] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7: No bootstrap required, opened a new log
I20260709 12:57:37.095750  1280 ts_tablet_manager.cc:1403] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.006s
I20260709 12:57:37.096195  1166 raft_consensus.cc:2468] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 1.
I20260709 12:57:37.097023  1131 leader_election.cc:304] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:37.097558  1054 leader_election.cc:304] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:37.098104  1312 raft_consensus.cc:2804] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:37.098554  1312 raft_consensus.cc:493] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.098634  1308 raft_consensus.cc:2804] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.098945  1312 raft_consensus.cc:3060] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.099484  1308 raft_consensus.cc:697] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Becoming Leader. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:37.099388  1280 raft_consensus.cc:359] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.100543  1280 raft_consensus.cc:385] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.100879  1280 raft_consensus.cc:740] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.101001  1308 consensus_queue.cc:237] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } }
I20260709 12:57:37.101761  1280 consensus_queue.cc:260] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.098084  1286 tablet_bootstrap.cc:654] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.110253  1239 raft_consensus.cc:2468] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 1.
I20260709 12:57:37.112519  1238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44af6c9e5f84fa7adc2d6d66d61f8ba" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938" is_pre_election: true
I20260709 12:57:37.116225  1280 ts_tablet_manager.cc:1434] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.001s
I20260709 12:57:37.117357  1280 tablet_bootstrap.cc:492] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7: Bootstrap starting.
I20260709 12:57:37.118422  1282 tablet_bootstrap.cc:492] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6: No bootstrap required, opened a new log
I20260709 12:57:37.118956  1282 ts_tablet_manager.cc:1403] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.002s
W20260709 12:57:37.121268  1131 leader_election.cc:343] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:37.123980  1282 raft_consensus.cc:359] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.124969  1282 raft_consensus.cc:385] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.125368  1282 raft_consensus.cc:740] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.117568  1312 raft_consensus.cc:515] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.127310  1240 raft_consensus.cc:2468] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 1.
I20260709 12:57:37.129611  1312 leader_election.cc:290] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 election: Requested vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:37.130231  1310 raft_consensus.cc:493] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.130896  1310 raft_consensus.cc:515] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.132534  1238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44af6c9e5f84fa7adc2d6d66d61f8ba" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:37.134248  1310 leader_election.cc:290] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:37.135226  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d350dd137342dcb19629f2f098c97a" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6" is_pre_election: true
I20260709 12:57:37.136204  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44af6c9e5f84fa7adc2d6d66d61f8ba" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
I20260709 12:57:37.136782  1091 raft_consensus.cc:3060] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:37.136881  1054 leader_election.cc:343] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:37.136766  1056 leader_election.cc:304] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6081cc990e4c49909d2ebd83256f6938, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 1a301f13fe144f5bb35909a905db00b6
W20260709 12:57:37.140422  1131 leader_election.cc:343] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:37.140889  1286 tablet_bootstrap.cc:492] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938: No bootstrap required, opened a new log
I20260709 12:57:37.141304  1310 raft_consensus.cc:2804] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.141458  1286 ts_tablet_manager.cc:1403] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.000s
I20260709 12:57:37.142274  1310 raft_consensus.cc:697] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Becoming Leader. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:37.143539  1310 consensus_queue.cc:237] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.145216  1286 raft_consensus.cc:359] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.146010  1286 raft_consensus.cc:385] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.146379  1286 raft_consensus.cc:740] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.145869  1282 consensus_queue.cc:260] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.147329  1286 consensus_queue.cc:260] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.147821  1091 raft_consensus.cc:2468] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 1.
I20260709 12:57:37.138448  1238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d350dd137342dcb19629f2f098c97a" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938" is_pre_election: true
W20260709 12:57:37.149803  1056 leader_election.cc:343] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:37.150457  1286 ts_tablet_manager.cc:1434] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:57:37.150373  1056 leader_election.cc:304] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 1a301f13fe144f5bb35909a905db00b6, 6081cc990e4c49909d2ebd83256f6938
I20260709 12:57:37.151654  1286 tablet_bootstrap.cc:492] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938: Bootstrap starting.
I20260709 12:57:37.155406  1282 ts_tablet_manager.cc:1434] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.000s
I20260709 12:57:37.156629  1282 tablet_bootstrap.cc:492] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6: Bootstrap starting.
I20260709 12:57:37.154112  1308 raft_consensus.cc:2749] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:37.157729   988 catalog_manager.cc:5697] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.161708  1280 tablet_bootstrap.cc:654] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.163899  1131 leader_election.cc:304] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 6081cc990e4c49909d2ebd83256f6938
I20260709 12:57:37.162580   988 catalog_manager.cc:5697] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.167433  1312 raft_consensus.cc:2804] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.161144  1165 raft_consensus.cc:2468] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 1.
I20260709 12:57:37.168109  1312 raft_consensus.cc:697] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Becoming Leader. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Running, Role: LEADER
I20260709 12:57:37.169332  1312 consensus_queue.cc:237] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.187428  1282 tablet_bootstrap.cc:654] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.190948  1286 tablet_bootstrap.cc:654] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.207782  1280 tablet_bootstrap.cc:492] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7: No bootstrap required, opened a new log
I20260709 12:57:37.208365  1280 ts_tablet_manager.cc:1403] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.037s
I20260709 12:57:37.208904  1286 tablet_bootstrap.cc:492] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938: No bootstrap required, opened a new log
I20260709 12:57:37.209401  1286 ts_tablet_manager.cc:1403] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938: Time spent bootstrapping tablet: real 0.058s	user 0.003s	sys 0.011s
I20260709 12:57:37.209985  1282 tablet_bootstrap.cc:492] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6: No bootstrap required, opened a new log
I20260709 12:57:37.210527  1282 ts_tablet_manager.cc:1403] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.000s
I20260709 12:57:37.211261  1280 raft_consensus.cc:359] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.211957  1280 raft_consensus.cc:385] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.212210  1280 raft_consensus.cc:740] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.212498  1286 raft_consensus.cc:359] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.213301  1286 raft_consensus.cc:385] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.212985  1280 consensus_queue.cc:260] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.213127  1282 raft_consensus.cc:359] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.209234   988 catalog_manager.cc:5697] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a301f13fe144f5bb35909a905db00b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.213658  1286 raft_consensus.cc:740] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.213938  1282 raft_consensus.cc:385] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.214268  1282 raft_consensus.cc:740] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.215243  1280 ts_tablet_manager.cc:1434] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:57:37.215096  1282 consensus_queue.cc:260] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.215061  1286 consensus_queue.cc:260] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.216270  1280 tablet_bootstrap.cc:492] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7: Bootstrap starting.
I20260709 12:57:37.217505  1282 ts_tablet_manager.cc:1434] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:37.218724  1282 tablet_bootstrap.cc:492] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6: Bootstrap starting.
I20260709 12:57:37.223479  1280 tablet_bootstrap.cc:654] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.224818  1282 tablet_bootstrap.cc:654] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.227039  1286 ts_tablet_manager.cc:1434] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.005s
I20260709 12:57:37.228178  1286 tablet_bootstrap.cc:492] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938: Bootstrap starting.
I20260709 12:57:37.235468  1280 tablet_bootstrap.cc:492] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7: No bootstrap required, opened a new log
I20260709 12:57:37.235481  1286 tablet_bootstrap.cc:654] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.236310  1280 ts_tablet_manager.cc:1403] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 12:57:37.236075   989 catalog_manager.cc:5697] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.238374   989 catalog_manager.cc:5697] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.240674  1282 tablet_bootstrap.cc:492] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6: No bootstrap required, opened a new log
I20260709 12:57:37.241173  1282 ts_tablet_manager.cc:1403] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.010s
I20260709 12:57:37.240921  1280 raft_consensus.cc:359] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.241597  1280 raft_consensus.cc:385] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.241907  1280 raft_consensus.cc:740] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.242730  1280 consensus_queue.cc:260] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.244052  1282 raft_consensus.cc:359] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.244680  1282 raft_consensus.cc:385] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.244799  1280 ts_tablet_manager.cc:1434] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:57:37.244971  1282 raft_consensus.cc:740] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.245733  1280 tablet_bootstrap.cc:492] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7: Bootstrap starting.
I20260709 12:57:37.245635  1282 consensus_queue.cc:260] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.247850  1282 ts_tablet_manager.cc:1434] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:57:37.248821  1282 tablet_bootstrap.cc:492] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6: Bootstrap starting.
I20260709 12:57:37.252962  1280 tablet_bootstrap.cc:654] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.255290  1282 tablet_bootstrap.cc:654] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.257571  1286 tablet_bootstrap.cc:492] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938: No bootstrap required, opened a new log
I20260709 12:57:37.258088  1286 ts_tablet_manager.cc:1403] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.003s
I20260709 12:57:37.260980  1286 raft_consensus.cc:359] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.261688  1286 raft_consensus.cc:385] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.261974  1286 raft_consensus.cc:740] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.263084  1286 consensus_queue.cc:260] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.265075  1280 tablet_bootstrap.cc:492] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7: No bootstrap required, opened a new log
I20260709 12:57:37.265051  1312 raft_consensus.cc:493] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.265664  1312 raft_consensus.cc:515] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.267845  1312 leader_election.cc:290] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:37.268025  1282 tablet_bootstrap.cc:492] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6: No bootstrap required, opened a new log
I20260709 12:57:37.268503  1282 ts_tablet_manager.cc:1403] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:57:37.269536  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fd4266e26147578dce43c6a1d8845a" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" is_pre_election: true
I20260709 12:57:37.269817  1238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fd4266e26147578dce43c6a1d8845a" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938" is_pre_election: true
I20260709 12:57:37.270279  1091 raft_consensus.cc:2468] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 0.
W20260709 12:57:37.271282  1131 leader_election.cc:343] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:37.271667  1282 raft_consensus.cc:359] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.272055  1131 leader_election.cc:304] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 6081cc990e4c49909d2ebd83256f6938
I20260709 12:57:37.272379  1282 raft_consensus.cc:385] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.272531  1286 ts_tablet_manager.cc:1434] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:57:37.272648  1282 raft_consensus.cc:740] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.272933  1312 raft_consensus.cc:2804] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:37.273320  1280 ts_tablet_manager.cc:1403] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.008s
I20260709 12:57:37.273435  1312 raft_consensus.cc:493] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.273522  1282 consensus_queue.cc:260] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.274029  1312 raft_consensus.cc:3060] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.275576  1286 tablet_bootstrap.cc:492] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938: Bootstrap starting.
I20260709 12:57:37.279695  1282 ts_tablet_manager.cc:1434] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:57:37.281519  1312 raft_consensus.cc:515] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.281626  1291 raft_consensus.cc:493] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.282716  1291 raft_consensus.cc:515] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.284636  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fd4266e26147578dce43c6a1d8845a" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
I20260709 12:57:37.284859  1291 leader_election.cc:290] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215)
I20260709 12:57:37.285261  1091 raft_consensus.cc:3060] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.285691  1286 tablet_bootstrap.cc:654] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.276183  1280 raft_consensus.cc:359] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.286262  1280 raft_consensus.cc:385] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.286556  1280 raft_consensus.cc:740] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.287438  1280 consensus_queue.cc:260] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.288223  1090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8172c7b4f744b8afef76aa5803bdb8" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" is_pre_election: true
I20260709 12:57:37.288902  1090 raft_consensus.cc:2468] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 0.
I20260709 12:57:37.289661  1280 ts_tablet_manager.cc:1434] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 12:57:37.292495  1091 raft_consensus.cc:2468] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 1.
I20260709 12:57:37.293634  1131 leader_election.cc:304] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:37.293720  1205 leader_election.cc:304] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6081cc990e4c49909d2ebd83256f6938, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:37.295073  1291 raft_consensus.cc:2804] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:37.296039  1291 raft_consensus.cc:493] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.286540  1165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8172c7b4f744b8afef76aa5803bdb8" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6" is_pre_election: true
I20260709 12:57:37.296613  1287 raft_consensus.cc:2804] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.296876  1165 raft_consensus.cc:2468] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 0.
I20260709 12:57:37.301733  1291 raft_consensus.cc:3060] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.308068  1312 leader_election.cc:290] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 election: Requested vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:37.308460  1238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fd4266e26147578dce43c6a1d8845a" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
W20260709 12:57:37.310104  1131 leader_election.cc:343] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:37.314814  1287 raft_consensus.cc:697] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Becoming Leader. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Running, Role: LEADER
I20260709 12:57:37.315881  1287 consensus_queue.cc:237] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.316612  1291 raft_consensus.cc:515] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.317638  1286 tablet_bootstrap.cc:492] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938: No bootstrap required, opened a new log
I20260709 12:57:37.318171  1286 ts_tablet_manager.cc:1403] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938: Time spent bootstrapping tablet: real 0.043s	user 0.022s	sys 0.016s
I20260709 12:57:37.319598  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8172c7b4f744b8afef76aa5803bdb8" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
I20260709 12:57:37.320298  1091 raft_consensus.cc:3060] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.320851  1165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8172c7b4f744b8afef76aa5803bdb8" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:37.321007  1286 raft_consensus.cc:359] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.321441  1165 raft_consensus.cc:3060] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.321717  1286 raft_consensus.cc:385] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.322013  1286 raft_consensus.cc:740] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.322708  1286 consensus_queue.cc:260] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.325330  1286 ts_tablet_manager.cc:1434] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:57:37.326299  1286 tablet_bootstrap.cc:492] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938: Bootstrap starting.
I20260709 12:57:37.328723  1091 raft_consensus.cc:2468] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 1.
I20260709 12:57:37.330319  1165 raft_consensus.cc:2468] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 1.
I20260709 12:57:37.331087  1291 leader_election.cc:290] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 1 election: Requested vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215)
I20260709 12:57:37.331593  1203 leader_election.cc:304] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, 6081cc990e4c49909d2ebd83256f6938; no voters: 
I20260709 12:57:37.332490  1291 raft_consensus.cc:2804] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.332653  1286 tablet_bootstrap.cc:654] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:37.333016  1291 raft_consensus.cc:697] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 1 LEADER]: Becoming Leader. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Running, Role: LEADER
I20260709 12:57:37.334086  1291 consensus_queue.cc:237] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.337299   989 catalog_manager.cc:5697] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a301f13fe144f5bb35909a905db00b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.342864  1286 tablet_bootstrap.cc:492] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938: No bootstrap required, opened a new log
I20260709 12:57:37.343328  1286 ts_tablet_manager.cc:1403] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.001s
I20260709 12:57:37.345858  1286 raft_consensus.cc:359] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.346530  1286 raft_consensus.cc:385] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:37.346812  1286 raft_consensus.cc:740] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Initialized, Role: FOLLOWER
I20260709 12:57:37.347474  1286 consensus_queue.cc:260] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.349607  1286 ts_tablet_manager.cc:1434] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:57:37.349750   988 catalog_manager.cc:5697] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6081cc990e4c49909d2ebd83256f6938" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:37.362160  1310 raft_consensus.cc:493] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.362695  1310 raft_consensus.cc:515] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.364567  1310 leader_election.cc:290] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:37.365542  1165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6" is_pre_election: true
I20260709 12:57:37.366051  1238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938" is_pre_election: true
I20260709 12:57:37.366339  1165 raft_consensus.cc:2393] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in current term 1: Already voted for candidate 6081cc990e4c49909d2ebd83256f6938 in this term.
I20260709 12:57:37.367532  1056 leader_election.cc:304] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 1a301f13fe144f5bb35909a905db00b6, 6081cc990e4c49909d2ebd83256f6938
I20260709 12:57:37.368191  1310 raft_consensus.cc:3060] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.373871  1310 raft_consensus.cc:2749] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:37.392182  1291 consensus_queue.cc:1048] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.404675  1291 consensus_queue.cc:1048] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.417610  1287 raft_consensus.cc:493] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.418220  1287 raft_consensus.cc:515] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.420471  1287 leader_election.cc:290] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:37.421118  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bafca245ca284c719970f20afbcf2de5" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" is_pre_election: true
I20260709 12:57:37.421689  1238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bafca245ca284c719970f20afbcf2de5" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938" is_pre_election: true
I20260709 12:57:37.421792  1091 raft_consensus.cc:2468] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 0.
I20260709 12:57:37.422422  1238 raft_consensus.cc:2468] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 0.
I20260709 12:57:37.423031  1131 leader_election.cc:304] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:37.423804  1287 raft_consensus.cc:2804] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:37.424198  1287 raft_consensus.cc:493] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.424482  1287 raft_consensus.cc:3060] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.429664  1287 raft_consensus.cc:515] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.431345  1287 leader_election.cc:290] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 election: Requested vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:37.432241  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bafca245ca284c719970f20afbcf2de5" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
I20260709 12:57:37.432457  1238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bafca245ca284c719970f20afbcf2de5" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:37.432823  1091 raft_consensus.cc:3060] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.432984  1238 raft_consensus.cc:3060] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.438267  1238 raft_consensus.cc:2468] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 1.
I20260709 12:57:37.438275  1091 raft_consensus.cc:2468] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 1.
I20260709 12:57:37.439424  1131 leader_election.cc:304] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:37.440119  1287 raft_consensus.cc:2804] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.440522  1287 raft_consensus.cc:697] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Becoming Leader. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Running, Role: LEADER
I20260709 12:57:37.441285  1287 consensus_queue.cc:237] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.449275   989 catalog_manager.cc:5697] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a301f13fe144f5bb35909a905db00b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.461952  1287 raft_consensus.cc:493] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.462495  1287 raft_consensus.cc:515] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.464376  1287 leader_election.cc:290] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:37.465081  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d350dd137342dcb19629f2f098c97a" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" is_pre_election: true
I20260709 12:57:37.465372  1238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d350dd137342dcb19629f2f098c97a" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938" is_pre_election: true
I20260709 12:57:37.465674  1091 raft_consensus.cc:2468] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 0.
I20260709 12:57:37.465969  1238 raft_consensus.cc:2468] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 0.
I20260709 12:57:37.466765  1131 leader_election.cc:304] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:37.467520  1287 raft_consensus.cc:2804] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:37.467902  1287 raft_consensus.cc:493] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.468181  1287 raft_consensus.cc:3060] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.473857  1287 raft_consensus.cc:515] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.475458  1287 leader_election.cc:290] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 election: Requested vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:37.476361  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d350dd137342dcb19629f2f098c97a" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
I20260709 12:57:37.476445  1238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d350dd137342dcb19629f2f098c97a" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:37.476925  1091 raft_consensus.cc:3060] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.477020  1238 raft_consensus.cc:3060] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.482594  1238 raft_consensus.cc:2468] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 1.
I20260709 12:57:37.482667  1091 raft_consensus.cc:2468] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 1.
I20260709 12:57:37.483639  1131 leader_election.cc:304] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, 6081cc990e4c49909d2ebd83256f6938; no voters: 
I20260709 12:57:37.484338  1287 raft_consensus.cc:2804] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:37.484779  1287 raft_consensus.cc:697] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Becoming Leader. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Running, Role: LEADER
I20260709 12:57:37.485520  1287 consensus_queue.cc:237] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.492990   989 catalog_manager.cc:5697] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a301f13fe144f5bb35909a905db00b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.497303  1310 consensus_queue.cc:1048] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.506475  1238 raft_consensus.cc:3060] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.514421  1308 consensus_queue.cc:1048] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.518730  1308 consensus_queue.cc:1048] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.530586  1313 consensus_queue.cc:1048] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.543488  1313 consensus_queue.cc:1048] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.545023  1165 raft_consensus.cc:3060] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.553674  1313 consensus_queue.cc:1048] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.559877  1308 consensus_queue.cc:1048] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.574939  1309 consensus_queue.cc:1048] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.576743  1291 raft_consensus.cc:493] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.577316  1291 raft_consensus.cc:515] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.579589  1291 leader_election.cc:290] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215)
I20260709 12:57:37.580186  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44af6c9e5f84fa7adc2d6d66d61f8ba" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" is_pre_election: true
I20260709 12:57:37.580695  1165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44af6c9e5f84fa7adc2d6d66d61f8ba" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6" is_pre_election: true
I20260709 12:57:37.581015  1091 raft_consensus.cc:2393] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6081cc990e4c49909d2ebd83256f6938 in current term 1: Already voted for candidate 1a301f13fe144f5bb35909a905db00b6 in this term.
I20260709 12:57:37.582367  1205 leader_election.cc:304] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6081cc990e4c49909d2ebd83256f6938; no voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7
I20260709 12:57:37.583552  1291 raft_consensus.cc:3060] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.593938  1291 raft_consensus.cc:2749] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:37.608675  1291 raft_consensus.cc:493] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.609200  1291 raft_consensus.cc:515] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.611351  1291 leader_election.cc:290] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215)
I20260709 12:57:37.612170  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fd4266e26147578dce43c6a1d8845a" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" is_pre_election: true
I20260709 12:57:37.612417  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fd4266e26147578dce43c6a1d8845a" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a301f13fe144f5bb35909a905db00b6" is_pre_election: true
I20260709 12:57:37.612872  1091 raft_consensus.cc:2393] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6081cc990e4c49909d2ebd83256f6938 in current term 1: Already voted for candidate 1a301f13fe144f5bb35909a905db00b6 in this term.
I20260709 12:57:37.613788  1205 leader_election.cc:304] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6081cc990e4c49909d2ebd83256f6938; no voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7
I20260709 12:57:37.614519  1291 raft_consensus.cc:3060] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:37.619482  1291 raft_consensus.cc:2749] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:37.715682  1238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661"
dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
mode: GRACEFUL
new_leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
 from {username='slave'} at 127.0.0.1:57320
I20260709 12:57:37.716296  1238 raft_consensus.cc:606] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 1 LEADER]: Received request to transfer leadership to TS ec6fa7e59c2047b09a4ef741bc4f24f7
I20260709 12:57:37.721863  1238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d8172c7b4f744b8afef76aa5803bdb8"
dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
mode: GRACEFUL
new_leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
 from {username='slave'} at 127.0.0.1:57320
I20260709 12:57:37.722497  1238 raft_consensus.cc:606] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 1 LEADER]: Received request to transfer leadership to TS ec6fa7e59c2047b09a4ef741bc4f24f7
I20260709 12:57:37.739140  1287 consensus_queue.cc:1048] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.744846  1091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "311fcc470d1b454fbde9dc6962d12616"
dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
mode: GRACEFUL
new_leader_uuid: "1a301f13fe144f5bb35909a905db00b6"
 from {username='slave'} at 127.0.0.1:49514
I20260709 12:57:37.745429  1091 raft_consensus.cc:606] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Received request to transfer leadership to TS 1a301f13fe144f5bb35909a905db00b6
I20260709 12:57:37.758384  1337 consensus_queue.cc:1048] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.763309  1337 consensus_queue.cc:1048] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.770423  1166 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5fd4266e26147578dce43c6a1d8845a"
dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
mode: GRACEFUL
new_leader_uuid: "6081cc990e4c49909d2ebd83256f6938"
 from {username='slave'} at 127.0.0.1:38342
I20260709 12:57:37.771198  1166 raft_consensus.cc:606] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Received request to transfer leadership to TS 6081cc990e4c49909d2ebd83256f6938
I20260709 12:57:37.785090  1287 consensus_queue.cc:1048] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.800170  1363 raft_consensus.cc:993] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6: : Instructing follower 6081cc990e4c49909d2ebd83256f6938 to start an election
I20260709 12:57:37.800729  1363 raft_consensus.cc:1081] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Signalling peer 6081cc990e4c49909d2ebd83256f6938 to start an election
I20260709 12:57:37.802639  1238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5fd4266e26147578dce43c6a1d8845a"
dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
 from {username='slave'} at 127.0.0.1:53442
I20260709 12:57:37.803305  1238 raft_consensus.cc:493] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:37.803753  1238 raft_consensus.cc:3060] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:37.809243  1238 raft_consensus.cc:515] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.811591  1238 leader_election.cc:290] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 2 election: Requested vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215)
I20260709 12:57:37.812331  1090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fd4266e26147578dce43c6a1d8845a" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
I20260709 12:57:37.812740  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fd4266e26147578dce43c6a1d8845a" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:37.812994  1090 raft_consensus.cc:3060] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:37.813294  1166 raft_consensus.cc:3055] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:37.813637  1166 raft_consensus.cc:740] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Running, Role: LEADER
I20260709 12:57:37.814563  1166 consensus_queue.cc:260] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.815873  1166 raft_consensus.cc:3060] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:37.821215  1090 raft_consensus.cc:2468] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 2.
I20260709 12:57:37.822465  1205 leader_election.cc:304] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6081cc990e4c49909d2ebd83256f6938, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:37.823254  1291 raft_consensus.cc:2804] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:37.823561  1166 raft_consensus.cc:2468] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 2.
I20260709 12:57:37.823761  1291 raft_consensus.cc:697] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [term 2 LEADER]: Becoming Leader. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Running, Role: LEADER
I20260709 12:57:37.824733  1291 consensus_queue.cc:237] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.831117   987 catalog_manager.cc:5697] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 reported cstate change: term changed from 1 to 2, leader changed from 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194) to 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "6081cc990e4c49909d2ebd83256f6938" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:37.868819  1291 consensus_queue.cc:1048] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.877113  1366 raft_consensus.cc:993] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938: : Instructing follower ec6fa7e59c2047b09a4ef741bc4f24f7 to start an election
I20260709 12:57:37.883921  1367 raft_consensus.cc:1081] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 1 LEADER]: Signalling peer ec6fa7e59c2047b09a4ef741bc4f24f7 to start an election
I20260709 12:57:37.886910  1090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d8172c7b4f744b8afef76aa5803bdb8"
dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
 from {username='slave'} at 127.0.0.1:36700
I20260709 12:57:37.887564  1090 raft_consensus.cc:493] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:37.887933  1090 raft_consensus.cc:3060] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:37.896286  1307 consensus_queue.cc:1048] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:37.896382  1090 raft_consensus.cc:515] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.899637  1165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8172c7b4f744b8afef76aa5803bdb8" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:37.900368  1090 leader_election.cc:290] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 2 election: Requested vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:37.901270  1238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8172c7b4f744b8afef76aa5803bdb8" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:37.901886  1238 raft_consensus.cc:3055] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:37.902315  1238 raft_consensus.cc:740] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Running, Role: LEADER
I20260709 12:57:37.903168  1238 consensus_queue.cc:260] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.904129  1238 raft_consensus.cc:3060] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:37.911857  1238 raft_consensus.cc:2468] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 2.
I20260709 12:57:37.912895  1056 leader_election.cc:304] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6081cc990e4c49909d2ebd83256f6938, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 1a301f13fe144f5bb35909a905db00b6
I20260709 12:57:37.913792  1308 raft_consensus.cc:2804] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:37.914340  1308 raft_consensus.cc:697] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Becoming Leader. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:37.915215  1308 consensus_queue.cc:237] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:37.921936   989 catalog_manager.cc:5697] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 reported cstate change: term changed from 1 to 2, leader changed from 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195) to ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:37.957260  1363 consensus_queue.cc:1048] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:37.970623  1312 consensus_queue.cc:1048] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:38.018375  1368 raft_consensus.cc:993] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938: : Instructing follower ec6fa7e59c2047b09a4ef741bc4f24f7 to start an election
I20260709 12:57:38.018953  1307 raft_consensus.cc:1081] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 1 LEADER]: Signalling peer ec6fa7e59c2047b09a4ef741bc4f24f7 to start an election
I20260709 12:57:38.021042  1090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661"
dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
 from {username='slave'} at 127.0.0.1:36700
I20260709 12:57:38.022878  1090 raft_consensus.cc:493] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:38.023249  1090 raft_consensus.cc:3060] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:38.031726  1090 raft_consensus.cc:515] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:38.033911  1090 leader_election.cc:290] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 2 election: Requested vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:38.034699  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:38.035466  1166 raft_consensus.cc:3060] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:38.035625  1238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:38.036255  1238 raft_consensus.cc:3055] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:38.036593  1238 raft_consensus.cc:740] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Running, Role: LEADER
I20260709 12:57:38.037448  1238 consensus_queue.cc:260] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:38.038756  1238 raft_consensus.cc:3060] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:38.043263  1166 raft_consensus.cc:2468] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 2.
I20260709 12:57:38.044545  1054 leader_election.cc:304] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:38.044842  1312 consensus_queue.cc:1048] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:38.045394  1308 raft_consensus.cc:2804] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:38.045884  1308 raft_consensus.cc:697] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Becoming Leader. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:38.046310  1238 raft_consensus.cc:2468] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 2.
I20260709 12:57:38.046869  1308 consensus_queue.cc:237] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:38.054976   989 catalog_manager.cc:5697] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 reported cstate change: term changed from 1 to 2, leader changed from 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195) to ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:38.057139  1312 consensus_queue.cc:1048] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:38.141603  1309 raft_consensus.cc:993] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7: : Instructing follower 1a301f13fe144f5bb35909a905db00b6 to start an election
I20260709 12:57:38.142124  1309 raft_consensus.cc:1081] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Signalling peer 1a301f13fe144f5bb35909a905db00b6 to start an election
I20260709 12:57:38.143863  1166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "311fcc470d1b454fbde9dc6962d12616"
dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
 from {username='slave'} at 127.0.0.1:38650
I20260709 12:57:38.144402  1166 raft_consensus.cc:493] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:38.144726  1166 raft_consensus.cc:3060] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:38.149734  1166 raft_consensus.cc:515] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:38.151427  1166 leader_election.cc:290] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 2 election: Requested vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:38.152376  1090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311fcc470d1b454fbde9dc6962d12616" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
I20260709 12:57:38.152647  1238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311fcc470d1b454fbde9dc6962d12616" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:38.153061  1090 raft_consensus.cc:3055] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:38.153163  1238 raft_consensus.cc:3060] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:38.153445  1090 raft_consensus.cc:740] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:38.154392  1090 consensus_queue.cc:260] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:38.155651  1090 raft_consensus.cc:3060] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:38.160923  1238 raft_consensus.cc:2468] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 2.
I20260709 12:57:38.162437  1131 leader_election.cc:304] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, 6081cc990e4c49909d2ebd83256f6938; no voters: 
I20260709 12:57:38.163241  1090 raft_consensus.cc:2468] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 2.
I20260709 12:57:38.163285  1312 raft_consensus.cc:2804] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:38.163842  1312 raft_consensus.cc:697] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [term 2 LEADER]: Becoming Leader. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Running, Role: LEADER
I20260709 12:57:38.164721  1312 consensus_queue.cc:237] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:38.171420   987 catalog_manager.cc:5697] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 reported cstate change: term changed from 1 to 2, leader changed from ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193) to 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a301f13fe144f5bb35909a905db00b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:38.217548  1090 raft_consensus.cc:1275] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Refusing update from remote peer 6081cc990e4c49909d2ebd83256f6938: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:38.218853  1307 consensus_queue.cc:1048] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:38.227224  1166 raft_consensus.cc:1275] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Refusing update from remote peer 6081cc990e4c49909d2ebd83256f6938: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:38.228910  1367 consensus_queue.cc:1048] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:38.360574  1238 raft_consensus.cc:1275] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Refusing update from remote peer ec6fa7e59c2047b09a4ef741bc4f24f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:38.362032  1309 consensus_queue.cc:1048] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:38.371600  1166 raft_consensus.cc:3060] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:38.380510  1166 raft_consensus.cc:1275] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Refusing update from remote peer ec6fa7e59c2047b09a4ef741bc4f24f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:38.381667  1308 consensus_queue.cc:1048] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:38.444298  1238 raft_consensus.cc:1275] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Refusing update from remote peer ec6fa7e59c2047b09a4ef741bc4f24f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:38.445742  1308 consensus_queue.cc:1048] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:38.455852  1166 raft_consensus.cc:1275] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Refusing update from remote peer ec6fa7e59c2047b09a4ef741bc4f24f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:38.457604  1313 consensus_queue.cc:1048] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:38.571249  1090 raft_consensus.cc:1275] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Refusing update from remote peer 1a301f13fe144f5bb35909a905db00b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:38.572604  1312 consensus_queue.cc:1048] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:38.583165  1238 raft_consensus.cc:1275] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Refusing update from remote peer 1a301f13fe144f5bb35909a905db00b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:38.584669  1337 consensus_queue.cc:1048] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:40.804384   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:57:40.805172   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:40.821856  1090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c"
dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
mode: GRACEFUL
new_leader_uuid: "6081cc990e4c49909d2ebd83256f6938"
 from {username='slave'} at 127.0.0.1:49530
I20260709 12:57:40.822629  1090 raft_consensus.cc:606] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Received request to transfer leadership to TS 6081cc990e4c49909d2ebd83256f6938
I20260709 12:57:40.824875  1090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661"
dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
mode: GRACEFUL
new_leader_uuid: "6081cc990e4c49909d2ebd83256f6938"
 from {username='slave'} at 127.0.0.1:49530
I20260709 12:57:40.825356  1090 raft_consensus.cc:606] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Received request to transfer leadership to TS 6081cc990e4c49909d2ebd83256f6938
I20260709 12:57:40.826393   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:57:40.826846   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:41.115108  1380 raft_consensus.cc:993] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7: : Instructing follower 6081cc990e4c49909d2ebd83256f6938 to start an election
I20260709 12:57:41.116405  1384 raft_consensus.cc:1081] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Signalling peer 6081cc990e4c49909d2ebd83256f6938 to start an election
I20260709 12:57:41.118887  1240 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c"
dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
 from {username='slave'} at 127.0.0.1:53434
I20260709 12:57:41.119697  1240 raft_consensus.cc:493] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:41.120157  1240 raft_consensus.cc:3060] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:41.127274  1240 raft_consensus.cc:515] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:41.130977  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:41.130122  1240 leader_election.cc:290] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 2 election: Requested vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215)
I20260709 12:57:41.130873  1090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
I20260709 12:57:41.131856  1166 raft_consensus.cc:3060] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:41.132050  1090 raft_consensus.cc:3055] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:41.132418  1090 raft_consensus.cc:740] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:41.133491  1090 consensus_queue.cc:260] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:41.135103  1090 raft_consensus.cc:3060] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:41.141342  1166 raft_consensus.cc:2468] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 2.
I20260709 12:57:41.143254  1203 leader_election.cc:304] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, 6081cc990e4c49909d2ebd83256f6938; no voters: 
I20260709 12:57:41.144018  1384 raft_consensus.cc:993] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7: : Instructing follower 6081cc990e4c49909d2ebd83256f6938 to start an election
I20260709 12:57:41.144435  1367 raft_consensus.cc:2804] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:41.145045  1384 raft_consensus.cc:1081] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Signalling peer 6081cc990e4c49909d2ebd83256f6938 to start an election
I20260709 12:57:41.145061  1090 raft_consensus.cc:2468] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 2.
I20260709 12:57:41.148202  1240 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661"
dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
 from {username='slave'} at 127.0.0.1:53434
I20260709 12:57:41.148465  1367 raft_consensus.cc:697] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 2 LEADER]: Becoming Leader. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Running, Role: LEADER
I20260709 12:57:41.149040  1240 raft_consensus.cc:493] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:41.149501  1240 raft_consensus.cc:3060] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:41.150419  1367 consensus_queue.cc:237] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:41.156068  1240 raft_consensus.cc:515] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:41.158378  1240 leader_election.cc:290] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 3 election: Requested vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215)
I20260709 12:57:41.159190  1090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
I20260709 12:57:41.159564  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:41.159919  1090 raft_consensus.cc:3055] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:41.160187  1166 raft_consensus.cc:3060] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:41.160265  1090 raft_consensus.cc:740] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:41.160532   987 catalog_manager.cc:5697] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 reported cstate change: term changed from 1 to 2, leader changed from ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193) to 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "6081cc990e4c49909d2ebd83256f6938" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:41.161355  1090 consensus_queue.cc:260] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:41.162806  1090 raft_consensus.cc:3060] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:41.168952  1166 raft_consensus.cc:2468] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 3.
I20260709 12:57:41.170604  1203 leader_election.cc:304] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, 6081cc990e4c49909d2ebd83256f6938; no voters: 
I20260709 12:57:41.171414  1090 raft_consensus.cc:2468] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 3.
I20260709 12:57:41.171646  1367 raft_consensus.cc:2804] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:41.172350  1367 raft_consensus.cc:697] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 3 LEADER]: Becoming Leader. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Running, Role: LEADER
I20260709 12:57:41.173476  1367 consensus_queue.cc:237] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:41.182868   987 catalog_manager.cc:5697] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 reported cstate change: term changed from 2 to 3, leader changed from ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193) to 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "6081cc990e4c49909d2ebd83256f6938" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:41.538870  1166 raft_consensus.cc:1275] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Refusing update from remote peer 6081cc990e4c49909d2ebd83256f6938: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:41.540292  1367 consensus_queue.cc:1048] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:41.551674  1090 raft_consensus.cc:1275] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Refusing update from remote peer 6081cc990e4c49909d2ebd83256f6938: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:41.554029  1385 consensus_queue.cc:1048] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:41.567870  1166 raft_consensus.cc:1275] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 3 FOLLOWER]: Refusing update from remote peer 6081cc990e4c49909d2ebd83256f6938: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:41.569383  1367 consensus_queue.cc:1048] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:41.579950  1091 raft_consensus.cc:1275] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Refusing update from remote peer 6081cc990e4c49909d2ebd83256f6938: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:41.584175  1385 consensus_queue.cc:1048] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:41.827916   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:41.842799  1240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c"
dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
mode: GRACEFUL
new_leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
 from {username='slave'} at 127.0.0.1:57320
I20260709 12:57:41.843575  1240 raft_consensus.cc:606] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 2 LEADER]: Received request to transfer leadership to TS ec6fa7e59c2047b09a4ef741bc4f24f7
I20260709 12:57:41.851724  1240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661"
dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
mode: GRACEFUL
new_leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
 from {username='slave'} at 127.0.0.1:57320
I20260709 12:57:41.852305  1240 raft_consensus.cc:606] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 3 LEADER]: Received request to transfer leadership to TS ec6fa7e59c2047b09a4ef741bc4f24f7
I20260709 12:57:41.860013  1166 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83d350dd137342dcb19629f2f098c97a"
dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
mode: GRACEFUL
new_leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
 from {username='slave'} at 127.0.0.1:38342
I20260709 12:57:41.860502  1166 raft_consensus.cc:606] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Received request to transfer leadership to TS ec6fa7e59c2047b09a4ef741bc4f24f7
I20260709 12:57:41.865556  1166 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f44af6c9e5f84fa7adc2d6d66d61f8ba"
dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
mode: GRACEFUL
new_leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
 from {username='slave'} at 127.0.0.1:38342
I20260709 12:57:41.866019  1166 raft_consensus.cc:606] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Received request to transfer leadership to TS ec6fa7e59c2047b09a4ef741bc4f24f7
I20260709 12:57:41.870785  1166 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bafca245ca284c719970f20afbcf2de5"
dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
mode: GRACEFUL
new_leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
 from {username='slave'} at 127.0.0.1:38342
I20260709 12:57:41.871335  1166 raft_consensus.cc:606] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Received request to transfer leadership to TS ec6fa7e59c2047b09a4ef741bc4f24f7
I20260709 12:57:42.001827  1367 raft_consensus.cc:993] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938: : Instructing follower ec6fa7e59c2047b09a4ef741bc4f24f7 to start an election
I20260709 12:57:42.002398  1385 raft_consensus.cc:1081] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 2 LEADER]: Signalling peer ec6fa7e59c2047b09a4ef741bc4f24f7 to start an election
I20260709 12:57:42.004019  1091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c"
dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
 from {username='slave'} at 127.0.0.1:36700
I20260709 12:57:42.004585  1091 raft_consensus.cc:493] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:42.004979  1091 raft_consensus.cc:3060] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:42.012486  1091 raft_consensus.cc:515] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.012872  1400 raft_consensus.cc:993] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6: : Instructing follower ec6fa7e59c2047b09a4ef741bc4f24f7 to start an election
I20260709 12:57:42.013562  1378 raft_consensus.cc:1081] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Signalling peer ec6fa7e59c2047b09a4ef741bc4f24f7 to start an election
I20260709 12:57:42.014613  1091 leader_election.cc:290] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 3 election: Requested vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:42.015367  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:42.016008  1166 raft_consensus.cc:3060] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:42.015965  1090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83d350dd137342dcb19629f2f098c97a"
dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
 from {username='slave'} at 127.0.0.1:36710
I20260709 12:57:42.016222  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:42.016721  1090 raft_consensus.cc:493] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:42.016856  1240 raft_consensus.cc:3055] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:42.017127  1090 raft_consensus.cc:3060] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:42.017208  1240 raft_consensus.cc:740] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Running, Role: LEADER
I20260709 12:57:42.018230  1240 consensus_queue.cc:260] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.019579  1240 raft_consensus.cc:3060] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:42.021694  1166 raft_consensus.cc:2468] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 3.
I20260709 12:57:42.023106  1054 leader_election.cc:304] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:42.023839  1384 raft_consensus.cc:2804] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:42.025089  1384 raft_consensus.cc:697] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 LEADER]: Becoming Leader. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:42.025309  1090 raft_consensus.cc:515] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.026471  1384 consensus_queue.cc:237] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.027719  1090 leader_election.cc:290] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 2 election: Requested vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:42.028211  1240 raft_consensus.cc:2468] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 3.
I20260709 12:57:42.028525  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d350dd137342dcb19629f2f098c97a" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:42.029147  1166 raft_consensus.cc:3055] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:42.029448  1166 raft_consensus.cc:740] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Running, Role: LEADER
I20260709 12:57:42.030416  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d350dd137342dcb19629f2f098c97a" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:42.030189  1166 consensus_queue.cc:260] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.031497  1166 raft_consensus.cc:3060] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:42.035302   987 catalog_manager.cc:5697] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 reported cstate change: term changed from 2 to 3, leader changed from 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195) to ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:42.037696  1166 raft_consensus.cc:2468] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 2.
I20260709 12:57:42.038578  1240 raft_consensus.cc:3060] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:42.038808  1054 leader_election.cc:304] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:42.039644  1384 raft_consensus.cc:2804] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:42.040093  1384 raft_consensus.cc:697] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Becoming Leader. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:42.040939  1384 consensus_queue.cc:237] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.048363  1240 raft_consensus.cc:2468] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 2.
I20260709 12:57:42.053488  1367 raft_consensus.cc:993] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938: : Instructing follower ec6fa7e59c2047b09a4ef741bc4f24f7 to start an election
I20260709 12:57:42.053975  1385 raft_consensus.cc:1081] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 3 LEADER]: Signalling peer ec6fa7e59c2047b09a4ef741bc4f24f7 to start an election
I20260709 12:57:42.053898   987 catalog_manager.cc:5697] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 reported cstate change: term changed from 1 to 2, leader changed from 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194) to ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:42.055603  1090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661"
dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
 from {username='slave'} at 127.0.0.1:36700
I20260709 12:57:42.056087  1090 raft_consensus.cc:493] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:42.056406  1090 raft_consensus.cc:3060] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:42.063410  1090 raft_consensus.cc:515] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.065212  1090 leader_election.cc:290] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 4 election: Requested vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:42.066223  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:42.066847  1166 raft_consensus.cc:3060] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:42.066782  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9dc1a66a27b4a6b9c60f6695c43d661" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:42.067510  1240 raft_consensus.cc:3055] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:42.067937  1240 raft_consensus.cc:740] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Running, Role: LEADER
I20260709 12:57:42.068800  1240 consensus_queue.cc:260] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.070129  1240 raft_consensus.cc:3060] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:42.077575  1240 raft_consensus.cc:2468] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 4.
I20260709 12:57:42.077575  1166 raft_consensus.cc:2468] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 4.
I20260709 12:57:42.079062  1054 leader_election.cc:304] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:42.079838  1384 raft_consensus.cc:2804] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:42.080266  1384 raft_consensus.cc:697] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 4 LEADER]: Becoming Leader. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:42.080938  1384 consensus_queue.cc:237] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.087651   987 catalog_manager.cc:5697] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 reported cstate change: term changed from 3 to 4, leader changed from 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195) to ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:42.106638  1400 raft_consensus.cc:993] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6: : Instructing follower ec6fa7e59c2047b09a4ef741bc4f24f7 to start an election
I20260709 12:57:42.107115  1378 raft_consensus.cc:1081] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Signalling peer ec6fa7e59c2047b09a4ef741bc4f24f7 to start an election
I20260709 12:57:42.108477  1090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bafca245ca284c719970f20afbcf2de5"
dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
 from {username='slave'} at 127.0.0.1:36710
I20260709 12:57:42.108938  1090 raft_consensus.cc:493] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:42.109236  1090 raft_consensus.cc:3060] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:42.113962  1090 raft_consensus.cc:515] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.115357  1090 leader_election.cc:290] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 2 election: Requested vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:42.116240  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bafca245ca284c719970f20afbcf2de5" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:42.116364  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bafca245ca284c719970f20afbcf2de5" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:42.116832  1166 raft_consensus.cc:3055] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:42.116978  1240 raft_consensus.cc:3060] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:42.117120  1166 raft_consensus.cc:740] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Running, Role: LEADER
I20260709 12:57:42.117910  1166 consensus_queue.cc:260] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.118896  1166 raft_consensus.cc:3060] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:42.122313  1240 raft_consensus.cc:2468] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 2.
I20260709 12:57:42.123564  1166 raft_consensus.cc:2468] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 2.
I20260709 12:57:42.123600  1056 leader_election.cc:304] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6081cc990e4c49909d2ebd83256f6938, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:42.124512  1384 raft_consensus.cc:2804] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:42.124979  1384 raft_consensus.cc:697] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Becoming Leader. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:42.125679  1384 consensus_queue.cc:237] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.132833   987 catalog_manager.cc:5697] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 reported cstate change: term changed from 1 to 2, leader changed from 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194) to ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:42.267982  1400 raft_consensus.cc:993] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6: : Instructing follower ec6fa7e59c2047b09a4ef741bc4f24f7 to start an election
I20260709 12:57:42.268543  1378 raft_consensus.cc:1081] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Signalling peer ec6fa7e59c2047b09a4ef741bc4f24f7 to start an election
I20260709 12:57:42.270233  1090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f44af6c9e5f84fa7adc2d6d66d61f8ba"
dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
 from {username='slave'} at 127.0.0.1:36710
I20260709 12:57:42.270695  1090 raft_consensus.cc:493] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:42.270988  1090 raft_consensus.cc:3060] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:42.275960  1090 raft_consensus.cc:515] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.277508  1090 leader_election.cc:290] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 2 election: Requested vote from peers 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:42.278471  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44af6c9e5f84fa7adc2d6d66d61f8ba" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:42.278471  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44af6c9e5f84fa7adc2d6d66d61f8ba" candidate_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:42.279259  1240 raft_consensus.cc:3060] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:42.279448  1166 raft_consensus.cc:3055] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:42.279805  1166 raft_consensus.cc:740] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Running, Role: LEADER
I20260709 12:57:42.280469  1166 consensus_queue.cc:260] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.281406  1166 raft_consensus.cc:3060] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:42.284538  1240 raft_consensus.cc:2468] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 2.
I20260709 12:57:42.285609  1056 leader_election.cc:304] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6081cc990e4c49909d2ebd83256f6938, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:42.286373  1384 raft_consensus.cc:2804] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:42.286835  1384 raft_consensus.cc:697] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Becoming Leader. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:42.287324  1166 raft_consensus.cc:2468] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6fa7e59c2047b09a4ef741bc4f24f7 in term 2.
I20260709 12:57:42.287640  1384 consensus_queue.cc:237] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:42.295305   987 catalog_manager.cc:5697] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 reported cstate change: term changed from 1 to 2, leader changed from 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194) to ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:42.442479  1166 raft_consensus.cc:1275] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Refusing update from remote peer ec6fa7e59c2047b09a4ef741bc4f24f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:42.443538  1384 consensus_queue.cc:1048] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.455178  1240 raft_consensus.cc:1275] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Refusing update from remote peer ec6fa7e59c2047b09a4ef741bc4f24f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:42.457227  1384 consensus_queue.cc:1048] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.506878  1238 raft_consensus.cc:1275] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Refusing update from remote peer ec6fa7e59c2047b09a4ef741bc4f24f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:42.508172  1384 consensus_queue.cc:1048] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.518157  1166 raft_consensus.cc:1275] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Refusing update from remote peer ec6fa7e59c2047b09a4ef741bc4f24f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:42.519908  1401 consensus_queue.cc:1048] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:42.532318  1166 raft_consensus.cc:1275] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 3 FOLLOWER]: Refusing update from remote peer ec6fa7e59c2047b09a4ef741bc4f24f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:42.533483  1401 consensus_queue.cc:1048] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:42.540802  1238 raft_consensus.cc:1275] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 3 FOLLOWER]: Refusing update from remote peer ec6fa7e59c2047b09a4ef741bc4f24f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:42.542613  1411 consensus_queue.cc:1048] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:42.559741  1166 raft_consensus.cc:1275] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 4 FOLLOWER]: Refusing update from remote peer ec6fa7e59c2047b09a4ef741bc4f24f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:42.561195  1411 consensus_queue.cc:1048] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:42.569573  1238 raft_consensus.cc:1275] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 4 FOLLOWER]: Refusing update from remote peer ec6fa7e59c2047b09a4ef741bc4f24f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:42.571318  1401 consensus_queue.cc:1048] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:42.748136  1238 raft_consensus.cc:1275] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Refusing update from remote peer ec6fa7e59c2047b09a4ef741bc4f24f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:42.749532  1401 consensus_queue.cc:1048] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.759372  1166 raft_consensus.cc:1275] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Refusing update from remote peer ec6fa7e59c2047b09a4ef741bc4f24f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:42.760998  1411 consensus_queue.cc:1048] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:44.879019   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:44.890530  1090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09631d931dd142dabc34bab1070a5351"
dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
mode: GRACEFUL
new_leader_uuid: "6081cc990e4c49909d2ebd83256f6938"
 from {username='slave'} at 127.0.0.1:49530
I20260709 12:57:44.891189  1090 raft_consensus.cc:606] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Received request to transfer leadership to TS 6081cc990e4c49909d2ebd83256f6938
I20260709 12:57:44.893739  1090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83d350dd137342dcb19629f2f098c97a"
dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
mode: GRACEFUL
new_leader_uuid: "6081cc990e4c49909d2ebd83256f6938"
 from {username='slave'} at 127.0.0.1:49530
I20260709 12:57:44.894340  1090 raft_consensus.cc:606] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Received request to transfer leadership to TS 6081cc990e4c49909d2ebd83256f6938
I20260709 12:57:44.896832  1090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d8172c7b4f744b8afef76aa5803bdb8"
dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
mode: GRACEFUL
new_leader_uuid: "1a301f13fe144f5bb35909a905db00b6"
 from {username='slave'} at 127.0.0.1:49530
I20260709 12:57:44.897339  1090 raft_consensus.cc:606] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Received request to transfer leadership to TS 1a301f13fe144f5bb35909a905db00b6
I20260709 12:57:44.900904  1090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c"
dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
mode: GRACEFUL
new_leader_uuid: "1a301f13fe144f5bb35909a905db00b6"
 from {username='slave'} at 127.0.0.1:49530
I20260709 12:57:44.901511  1090 raft_consensus.cc:606] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 LEADER]: Received request to transfer leadership to TS 1a301f13fe144f5bb35909a905db00b6
I20260709 12:57:44.902680   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:57:44.903191   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:44.915127  1418 raft_consensus.cc:993] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7: : Instructing follower 6081cc990e4c49909d2ebd83256f6938 to start an election
I20260709 12:57:44.915732  1384 raft_consensus.cc:1081] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Signalling peer 6081cc990e4c49909d2ebd83256f6938 to start an election
I20260709 12:57:44.917202  1240 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83d350dd137342dcb19629f2f098c97a"
dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
 from {username='slave'} at 127.0.0.1:53434
I20260709 12:57:44.917726  1240 raft_consensus.cc:493] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:44.918022  1240 raft_consensus.cc:3060] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:44.924351  1240 raft_consensus.cc:515] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:44.926012  1240 leader_election.cc:290] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 3 election: Requested vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215)
I20260709 12:57:44.926870  1090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d350dd137342dcb19629f2f098c97a" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
I20260709 12:57:44.927165  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d350dd137342dcb19629f2f098c97a" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:44.927457  1090 raft_consensus.cc:3055] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:44.927690  1166 raft_consensus.cc:3060] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:44.927788  1090 raft_consensus.cc:740] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:44.928576  1090 consensus_queue.cc:260] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:44.929445  1090 raft_consensus.cc:3060] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:44.932408  1166 raft_consensus.cc:2468] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 3.
I20260709 12:57:44.933468  1203 leader_election.cc:304] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, 6081cc990e4c49909d2ebd83256f6938; no voters: 
I20260709 12:57:44.934224  1090 raft_consensus.cc:2468] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 3.
I20260709 12:57:44.934338  1385 raft_consensus.cc:2804] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:44.935367  1385 raft_consensus.cc:697] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 3 LEADER]: Becoming Leader. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Running, Role: LEADER
I20260709 12:57:44.936193  1385 consensus_queue.cc:237] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:44.943962   989 catalog_manager.cc:5697] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 reported cstate change: term changed from 2 to 3, leader changed from ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193) to 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "6081cc990e4c49909d2ebd83256f6938" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:45.110124  1418 raft_consensus.cc:993] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7: : Instructing follower 1a301f13fe144f5bb35909a905db00b6 to start an election
I20260709 12:57:45.110677  1384 raft_consensus.cc:1081] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Signalling peer 1a301f13fe144f5bb35909a905db00b6 to start an election
I20260709 12:57:45.112115  1166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d8172c7b4f744b8afef76aa5803bdb8"
dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
 from {username='slave'} at 127.0.0.1:38650
I20260709 12:57:45.112548  1166 raft_consensus.cc:493] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:45.112818  1166 raft_consensus.cc:3060] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:45.117219  1166 raft_consensus.cc:515] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:45.118687  1166 leader_election.cc:290] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 3 election: Requested vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:45.119663  1090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8172c7b4f744b8afef76aa5803bdb8" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
I20260709 12:57:45.119966  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8172c7b4f744b8afef76aa5803bdb8" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:45.120196  1090 raft_consensus.cc:3055] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:45.120523  1240 raft_consensus.cc:3060] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:45.120592  1090 raft_consensus.cc:740] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:45.121431  1090 consensus_queue.cc:260] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:45.122568  1090 raft_consensus.cc:3060] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:45.124261  1418 raft_consensus.cc:993] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7: : Instructing follower 6081cc990e4c49909d2ebd83256f6938 to start an election
I20260709 12:57:45.124737  1384 raft_consensus.cc:1081] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Signalling peer 6081cc990e4c49909d2ebd83256f6938 to start an election
I20260709 12:57:45.126322  1238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09631d931dd142dabc34bab1070a5351"
dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
 from {username='slave'} at 127.0.0.1:53434
I20260709 12:57:45.126834  1238 raft_consensus.cc:493] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:45.127174  1238 raft_consensus.cc:3060] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:45.127148  1240 raft_consensus.cc:2468] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 3.
I20260709 12:57:45.128628  1090 raft_consensus.cc:2468] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 3.
I20260709 12:57:45.128641  1131 leader_election.cc:304] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, 6081cc990e4c49909d2ebd83256f6938; no voters: 
I20260709 12:57:45.129643  1378 raft_consensus.cc:2804] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:45.131043  1378 raft_consensus.cc:697] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 3 LEADER]: Becoming Leader. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Running, Role: LEADER
I20260709 12:57:45.131910  1378 consensus_queue.cc:237] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:45.132985  1238 raft_consensus.cc:515] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:45.134663  1238 leader_election.cc:290] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 2 election: Requested vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215)
I20260709 12:57:45.135727  1090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09631d931dd142dabc34bab1070a5351" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
I20260709 12:57:45.136212  1090 raft_consensus.cc:3055] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:45.136091  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09631d931dd142dabc34bab1070a5351" candidate_uuid: "6081cc990e4c49909d2ebd83256f6938" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
I20260709 12:57:45.136551  1090 raft_consensus.cc:740] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:45.136807  1166 raft_consensus.cc:3060] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:45.137482  1090 consensus_queue.cc:260] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:45.138434  1090 raft_consensus.cc:3060] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:45.142014  1166 raft_consensus.cc:2468] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 2.
I20260709 12:57:45.142987  1090 raft_consensus.cc:2468] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6081cc990e4c49909d2ebd83256f6938 in term 2.
I20260709 12:57:45.143229  1203 leader_election.cc:304] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, 6081cc990e4c49909d2ebd83256f6938; no voters: 
I20260709 12:57:45.144150  1385 raft_consensus.cc:2804] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:45.144584  1385 raft_consensus.cc:697] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [term 2 LEADER]: Becoming Leader. State: Replica: 6081cc990e4c49909d2ebd83256f6938, State: Running, Role: LEADER
I20260709 12:57:45.145447  1385 consensus_queue.cc:237] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:45.147950   989 catalog_manager.cc:5697] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 reported cstate change: term changed from 2 to 3, leader changed from ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193) to 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1a301f13fe144f5bb35909a905db00b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:45.156459   987 catalog_manager.cc:5697] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 reported cstate change: term changed from 1 to 2, leader changed from ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193) to 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "6081cc990e4c49909d2ebd83256f6938" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:45.326426  1090 raft_consensus.cc:1275] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Refusing update from remote peer 6081cc990e4c49909d2ebd83256f6938: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:45.328544  1418 raft_consensus.cc:993] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7: : Instructing follower 1a301f13fe144f5bb35909a905db00b6 to start an election
I20260709 12:57:45.327883  1385 consensus_queue.cc:1048] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:45.329041  1384 raft_consensus.cc:1081] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 LEADER]: Signalling peer 1a301f13fe144f5bb35909a905db00b6 to start an election
I20260709 12:57:45.330668  1166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c"
dest_uuid: "1a301f13fe144f5bb35909a905db00b6"
 from {username='slave'} at 127.0.0.1:38650
I20260709 12:57:45.331280  1166 raft_consensus.cc:493] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:45.331694  1166 raft_consensus.cc:3060] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:45.338178  1166 raft_consensus.cc:515] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:45.341526  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7"
I20260709 12:57:45.342228  1091 raft_consensus.cc:3055] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:45.342568  1091 raft_consensus.cc:740] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ec6fa7e59c2047b09a4ef741bc4f24f7, State: Running, Role: LEADER
I20260709 12:57:45.343425  1091 consensus_queue.cc:260] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:45.344570  1091 raft_consensus.cc:3060] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:45.345250  1166 leader_election.cc:290] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 4 election: Requested vote from peers ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617), 6081cc990e4c49909d2ebd83256f6938 (127.0.107.195:34357)
I20260709 12:57:45.346390  1238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40cc14fa316476ab70337a1f490099c" candidate_uuid: "1a301f13fe144f5bb35909a905db00b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6081cc990e4c49909d2ebd83256f6938"
I20260709 12:57:45.346974  1238 raft_consensus.cc:3060] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:45.353863  1166 raft_consensus.cc:1275] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 3 FOLLOWER]: Refusing update from remote peer 6081cc990e4c49909d2ebd83256f6938: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:45.356081  1419 consensus_queue.cc:1048] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:45.401767  1238 raft_consensus.cc:2468] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 4.
I20260709 12:57:45.401744  1091 raft_consensus.cc:2468] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a301f13fe144f5bb35909a905db00b6 in term 4.
I20260709 12:57:45.403302  1131 leader_election.cc:304] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a301f13fe144f5bb35909a905db00b6, ec6fa7e59c2047b09a4ef741bc4f24f7; no voters: 
I20260709 12:57:45.404299  1378 raft_consensus.cc:2804] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:45.404938  1378 raft_consensus.cc:697] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 4 LEADER]: Becoming Leader. State: Replica: 1a301f13fe144f5bb35909a905db00b6, State: Running, Role: LEADER
I20260709 12:57:45.405985  1378 consensus_queue.cc:237] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } }
I20260709 12:57:45.414692   987 catalog_manager.cc:5697] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 reported cstate change: term changed from 3 to 4, leader changed from ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193) to 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "1a301f13fe144f5bb35909a905db00b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:45.635253  1238 raft_consensus.cc:1275] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 3 FOLLOWER]: Refusing update from remote peer 1a301f13fe144f5bb35909a905db00b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:45.636574  1378 consensus_queue.cc:1048] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:45.642369  1091 raft_consensus.cc:1275] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Refusing update from remote peer 1a301f13fe144f5bb35909a905db00b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:45.644459  1425 consensus_queue.cc:1048] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:45.707655  1166 raft_consensus.cc:1275] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Refusing update from remote peer 6081cc990e4c49909d2ebd83256f6938: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:45.709096  1419 consensus_queue.cc:1048] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a301f13fe144f5bb35909a905db00b6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:45.721532  1091 raft_consensus.cc:1275] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Refusing update from remote peer 6081cc990e4c49909d2ebd83256f6938: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:45.724465  1419 consensus_queue.cc:1048] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:45.958313  1238 raft_consensus.cc:1275] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 4 FOLLOWER]: Refusing update from remote peer 1a301f13fe144f5bb35909a905db00b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:45.959735  1425 consensus_queue.cc:1048] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6081cc990e4c49909d2ebd83256f6938" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:45.974960  1090 raft_consensus.cc:1275] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 4 FOLLOWER]: Refusing update from remote peer 1a301f13fe144f5bb35909a905db00b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:45.977290  1435 consensus_queue.cc:1048] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6fa7e59c2047b09a4ef741bc4f24f7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:46.010630   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:46.016969   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:57:46.048606   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:46.049549   431 tablet_replica.cc:333] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7: stopping tablet replica
I20260709 12:57:46.050341   431 raft_consensus.cc:2243] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.050822   431 raft_consensus.cc:2272] T 9d8172c7b4f744b8afef76aa5803bdb8 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.054658   431 tablet_replica.cc:333] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7: stopping tablet replica
I20260709 12:57:46.055399   431 raft_consensus.cc:2243] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:46.056192   431 raft_consensus.cc:2272] T bafca245ca284c719970f20afbcf2de5 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.058313   431 tablet_replica.cc:333] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7: stopping tablet replica
I20260709 12:57:46.058869   431 raft_consensus.cc:2243] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.059357   431 raft_consensus.cc:2272] T 311fcc470d1b454fbde9dc6962d12616 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.061158   431 tablet_replica.cc:333] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7: stopping tablet replica
I20260709 12:57:46.061655   431 raft_consensus.cc:2243] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.062114   431 raft_consensus.cc:2272] T 83d350dd137342dcb19629f2f098c97a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.064456   431 tablet_replica.cc:333] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7: stopping tablet replica
I20260709 12:57:46.065006   431 raft_consensus.cc:2243] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.065490   431 raft_consensus.cc:2272] T a5fd4266e26147578dce43c6a1d8845a P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.067390   431 tablet_replica.cc:333] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7: stopping tablet replica
I20260709 12:57:46.067960   431 raft_consensus.cc:2243] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:57:46.068763   431 raft_consensus.cc:2272] T b42f18d2dd3f45579c13f2665d2028f3 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.070755   431 tablet_replica.cc:333] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7: stopping tablet replica
I20260709 12:57:46.071390   431 raft_consensus.cc:2243] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.071991   431 raft_consensus.cc:2272] T a40cc14fa316476ab70337a1f490099c P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.074644   431 tablet_replica.cc:333] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7: stopping tablet replica
I20260709 12:57:46.075191   431 raft_consensus.cc:2243] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:57:46.075963   431 raft_consensus.cc:2272] T a9dc1a66a27b4a6b9c60f6695c43d661 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.077630   431 tablet_replica.cc:333] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7: stopping tablet replica
I20260709 12:57:46.078222   431 raft_consensus.cc:2243] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:46.078998   431 raft_consensus.cc:2272] T f44af6c9e5f84fa7adc2d6d66d61f8ba P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.080770   431 tablet_replica.cc:333] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7: stopping tablet replica
I20260709 12:57:46.081267   431 raft_consensus.cc:2243] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.081736   431 raft_consensus.cc:2272] T 09631d931dd142dabc34bab1070a5351 P ec6fa7e59c2047b09a4ef741bc4f24f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.108369   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:57:46.130339   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:57:46.156272   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:46.157207   431 tablet_replica.cc:333] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6: stopping tablet replica
I20260709 12:57:46.157990   431 raft_consensus.cc:2243] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:46.159126   431 raft_consensus.cc:2272] T 9d8172c7b4f744b8afef76aa5803bdb8 P 1a301f13fe144f5bb35909a905db00b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.162352   431 tablet_replica.cc:333] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6: stopping tablet replica
I20260709 12:57:46.162899   431 raft_consensus.cc:2243] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:46.163647   431 raft_consensus.cc:2272] T 311fcc470d1b454fbde9dc6962d12616 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.165489   431 tablet_replica.cc:333] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6: stopping tablet replica
I20260709 12:57:46.165964   431 raft_consensus.cc:2243] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.166414   431 raft_consensus.cc:2272] T 83d350dd137342dcb19629f2f098c97a P 1a301f13fe144f5bb35909a905db00b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.169366   431 tablet_replica.cc:333] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6: stopping tablet replica
I20260709 12:57:46.169919   431 raft_consensus.cc:2243] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.170379   431 raft_consensus.cc:2272] T bafca245ca284c719970f20afbcf2de5 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.172107   431 tablet_replica.cc:333] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6: stopping tablet replica
I20260709 12:57:46.172587   431 raft_consensus.cc:2243] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.172979   431 raft_consensus.cc:2272] T a9dc1a66a27b4a6b9c60f6695c43d661 P 1a301f13fe144f5bb35909a905db00b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.175189   431 tablet_replica.cc:333] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6: stopping tablet replica
I20260709 12:57:46.175807   431 raft_consensus.cc:2243] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.176258   431 raft_consensus.cc:2272] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.178153   431 tablet_replica.cc:333] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6: stopping tablet replica
I20260709 12:57:46.178982   431 raft_consensus.cc:2243] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.179605   431 raft_consensus.cc:2272] T 09631d931dd142dabc34bab1070a5351 P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:57:46.180576  1205 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34617: connect: Connection refused (error 111) [suppressed 2 similar messages]
I20260709 12:57:46.183132   431 tablet_replica.cc:333] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6: stopping tablet replica
I20260709 12:57:46.183974   431 raft_consensus.cc:2243] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.184473   431 raft_consensus.cc:2272] T a5fd4266e26147578dce43c6a1d8845a P 1a301f13fe144f5bb35909a905db00b6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:57:46.184902  1205 consensus_peers.cc:597] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 -> Peer ec6fa7e59c2047b09a4ef741bc4f24f7 (127.0.107.193:34617): Couldn't send request to peer ec6fa7e59c2047b09a4ef741bc4f24f7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:46.186560   431 tablet_replica.cc:333] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6: stopping tablet replica
I20260709 12:57:46.187101   431 raft_consensus.cc:2243] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:57:46.187871   431 raft_consensus.cc:2272] T a40cc14fa316476ab70337a1f490099c P 1a301f13fe144f5bb35909a905db00b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.190114   431 tablet_replica.cc:333] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6: stopping tablet replica
I20260709 12:57:46.190600   431 raft_consensus.cc:2243] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.191031   431 raft_consensus.cc:2272] T b42f18d2dd3f45579c13f2665d2028f3 P 1a301f13fe144f5bb35909a905db00b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.222491   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:57:46.244347   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:57:46.271536   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:57:46.272346   431 tablet_replica.cc:333] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938: stopping tablet replica
I20260709 12:57:46.273106   431 raft_consensus.cc:2243] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.273759   431 raft_consensus.cc:2272] T 9d8172c7b4f744b8afef76aa5803bdb8 P 6081cc990e4c49909d2ebd83256f6938 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.276480   431 tablet_replica.cc:333] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938: stopping tablet replica
I20260709 12:57:46.277148   431 raft_consensus.cc:2243] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.277637   431 raft_consensus.cc:2272] T bafca245ca284c719970f20afbcf2de5 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.279865   431 tablet_replica.cc:333] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938: stopping tablet replica
I20260709 12:57:46.280539   431 raft_consensus.cc:2243] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.280992   431 raft_consensus.cc:2272] T a40cc14fa316476ab70337a1f490099c P 6081cc990e4c49909d2ebd83256f6938 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.283627   431 tablet_replica.cc:333] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938: stopping tablet replica
I20260709 12:57:46.284370   431 raft_consensus.cc:2243] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.284947   431 raft_consensus.cc:2272] T b42f18d2dd3f45579c13f2665d2028f3 P 6081cc990e4c49909d2ebd83256f6938 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.287639   431 tablet_replica.cc:333] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938: stopping tablet replica
I20260709 12:57:46.288249   431 raft_consensus.cc:2243] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:46.289314   431 raft_consensus.cc:2272] T a5fd4266e26147578dce43c6a1d8845a P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:57:46.290598  1203 consensus_peers.cc:597] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 -> Peer 1a301f13fe144f5bb35909a905db00b6 (127.0.107.194:45215): Couldn't send request to peer 1a301f13fe144f5bb35909a905db00b6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:46.291697   431 tablet_replica.cc:333] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938: stopping tablet replica
I20260709 12:57:46.292373   431 raft_consensus.cc:2243] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:57:46.293159   431 raft_consensus.cc:2272] T 09631d931dd142dabc34bab1070a5351 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.295406   431 tablet_replica.cc:333] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938: stopping tablet replica
I20260709 12:57:46.295989   431 raft_consensus.cc:2243] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.296407   431 raft_consensus.cc:2272] T 311fcc470d1b454fbde9dc6962d12616 P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.298326   431 tablet_replica.cc:333] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938: stopping tablet replica
I20260709 12:57:46.298827   431 raft_consensus.cc:2243] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:57:46.299605   431 raft_consensus.cc:2272] T 83d350dd137342dcb19629f2f098c97a P 6081cc990e4c49909d2ebd83256f6938 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.301967   431 tablet_replica.cc:333] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938: stopping tablet replica
I20260709 12:57:46.302574   431 raft_consensus.cc:2243] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.303064   431 raft_consensus.cc:2272] T f44af6c9e5f84fa7adc2d6d66d61f8ba P 6081cc990e4c49909d2ebd83256f6938 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.304862   431 tablet_replica.cc:333] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938: stopping tablet replica
I20260709 12:57:46.305325   431 raft_consensus.cc:2243] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:46.305773   431 raft_consensus.cc:2272] T a9dc1a66a27b4a6b9c60f6695c43d661 P 6081cc990e4c49909d2ebd83256f6938 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.338907   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:57:46.363358   431 master.cc:562] Master@127.0.107.254:39997 shutting down...
I20260709 12:57:46.389585   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:57:46.390336   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:46.390744   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 112b2a2e31464c02a1507cc2c7d9fec7: stopping tablet replica
W20260709 12:57:46.772667  1020 debug-util.cc:398] Leaking SignalData structure 0x7b080004e2e0 after lost signal to thread 434
W20260709 12:57:47.409483   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1020)
W20260709 12:57:48.410159   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1020)
I20260709 12:57:49.331228   431 master.cc:584] Master@127.0.107.254:39997 shutdown complete.
1a301f13fe144f5bb35909a905db00b6  4
6081cc990e4c49909d2ebd83256f6938  1
ec6fa7e59c2047b09a4ef741bc4f24f7  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (13737 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:57:49.381685   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:33273
I20260709 12:57:49.383090   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:49.389729  1446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:49.389853  1445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:49.390960  1448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:49.392864   431 server_base.cc:1061] running on GCE node
I20260709 12:57:49.394025   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:49.394532   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:49.394836   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601869394793 us; error 0 us; skew 500 ppm
I20260709 12:57:49.395489   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:49.398756   431 webserver.cc:533] Webserver started at http://127.0.107.254:41733/ using document root <none> and password file <none>
I20260709 12:57:49.399416   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:49.399644   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:49.400003   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:49.401414   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/master-0-root/instance:
uuid: "b4fca1e1e7ea4cb985a4c9e3efed5179"
format_stamp: "Formatted at 2026-07-09 12:57:49 on dist-test-slave-zhdc"
I20260709 12:57:49.407429   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:57:49.411513  1453 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:49.412514   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:57:49.412784   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/master-0-root
uuid: "b4fca1e1e7ea4cb985a4c9e3efed5179"
format_stamp: "Formatted at 2026-07-09 12:57:49 on dist-test-slave-zhdc"
I20260709 12:57:49.413044   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:49.428256   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:49.429677   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:49.477062   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:33273
I20260709 12:57:49.477164  1504 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:33273 every 8 connection(s)
I20260709 12:57:49.481796  1505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:49.493465  1505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Bootstrap starting.
I20260709 12:57:49.498957  1505 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:49.503688  1505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: No bootstrap required, opened a new log
I20260709 12:57:49.506163  1505 raft_consensus.cc:359] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4fca1e1e7ea4cb985a4c9e3efed5179" member_type: VOTER }
I20260709 12:57:49.506585  1505 raft_consensus.cc:385] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:49.506770  1505 raft_consensus.cc:740] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4fca1e1e7ea4cb985a4c9e3efed5179, State: Initialized, Role: FOLLOWER
I20260709 12:57:49.507385  1505 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4fca1e1e7ea4cb985a4c9e3efed5179" member_type: VOTER }
I20260709 12:57:49.507870  1505 raft_consensus.cc:399] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:57:49.508073  1505 raft_consensus.cc:493] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:57:49.508288  1505 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:49.513033  1505 raft_consensus.cc:515] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4fca1e1e7ea4cb985a4c9e3efed5179" member_type: VOTER }
I20260709 12:57:49.513557  1505 leader_election.cc:304] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4fca1e1e7ea4cb985a4c9e3efed5179; no voters: 
I20260709 12:57:49.514984  1505 leader_election.cc:290] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:57:49.515512  1508 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:49.516933  1508 raft_consensus.cc:697] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [term 1 LEADER]: Becoming Leader. State: Replica: b4fca1e1e7ea4cb985a4c9e3efed5179, State: Running, Role: LEADER
I20260709 12:57:49.517656  1508 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4fca1e1e7ea4cb985a4c9e3efed5179" member_type: VOTER }
I20260709 12:57:49.518273  1505 sys_catalog.cc:565] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:57:49.522131  1510 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4fca1e1e7ea4cb985a4c9e3efed5179. Latest consensus state: current_term: 1 leader_uuid: "b4fca1e1e7ea4cb985a4c9e3efed5179" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4fca1e1e7ea4cb985a4c9e3efed5179" member_type: VOTER } }
I20260709 12:57:49.522799  1510 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:49.524017  1509 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4fca1e1e7ea4cb985a4c9e3efed5179" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4fca1e1e7ea4cb985a4c9e3efed5179" member_type: VOTER } }
I20260709 12:57:49.524772  1509 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:49.534912  1514 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:57:49.536127   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:57:49.540412  1514 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:57:49.550021  1514 catalog_manager.cc:1383] Generated new cluster ID: 20916507b2d34dc5983357d7367bab55
I20260709 12:57:49.550429  1514 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:57:49.567155  1514 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:57:49.568611  1514 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:57:49.587266  1514 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Generated new TSK 0
I20260709 12:57:49.588009  1514 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:57:49.603092   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:49.609643  1526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:49.611380  1527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:49.612550  1529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:49.613333   431 server_base.cc:1061] running on GCE node
I20260709 12:57:49.614288   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:49.614477   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:49.614696   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601869614673 us; error 0 us; skew 500 ppm
I20260709 12:57:49.615286   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:49.617887   431 webserver.cc:533] Webserver started at http://127.0.107.193:40729/ using document root <none> and password file <none>
I20260709 12:57:49.618458   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:49.618664   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:49.618943   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:49.620231   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/instance:
uuid: "338d817f94ee4c1bad162e9a5860b68a"
format_stamp: "Formatted at 2026-07-09 12:57:49 on dist-test-slave-zhdc"
I20260709 12:57:49.625833   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:57:49.629663  1534 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:49.630678   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:57:49.631062   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root
uuid: "338d817f94ee4c1bad162e9a5860b68a"
format_stamp: "Formatted at 2026-07-09 12:57:49 on dist-test-slave-zhdc"
I20260709 12:57:49.631445   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:49.652357   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:49.653898   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:49.655709   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:49.658506   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:49.658753   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:49.659040   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:49.659268   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:49.708789   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:45751
I20260709 12:57:49.708891  1596 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:45751 every 8 connection(s)
I20260709 12:57:49.715000   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:49.723384  1601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:49.723709  1602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:49.727228  1605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:49.727288   431 server_base.cc:1061] running on GCE node
I20260709 12:57:49.729125   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:49.729373   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:49.729583   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601869729559 us; error 0 us; skew 500 ppm
I20260709 12:57:49.730446   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:49.732926  1597 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33273
I20260709 12:57:49.733378  1597 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:49.733808   431 webserver.cc:533] Webserver started at http://127.0.107.194:42021/ using document root <none> and password file <none>
I20260709 12:57:49.734443   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:49.734364  1597 heartbeater.cc:507] Master 127.0.107.254:33273 requested a full tablet report, sending...
I20260709 12:57:49.734804   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:49.735126   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:49.736680   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/instance:
uuid: "a4be9cc90aca4dd4ad7db103062a7208"
format_stamp: "Formatted at 2026-07-09 12:57:49 on dist-test-slave-zhdc"
I20260709 12:57:49.737115  1470 ts_manager.cc:194] Registered new tserver with Master: 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 12:57:49.739890  1470 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58250
I20260709 12:57:49.743383   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:57:49.747329  1609 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:49.748188   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:57:49.748564   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root
uuid: "a4be9cc90aca4dd4ad7db103062a7208"
format_stamp: "Formatted at 2026-07-09 12:57:49 on dist-test-slave-zhdc"
I20260709 12:57:49.748880   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:49.763646   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:49.765061   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:49.767042   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:49.769567   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:49.769759   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:49.770103   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:49.770264   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:49.815593   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:45463
I20260709 12:57:49.815696  1671 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:45463 every 8 connection(s)
I20260709 12:57:49.821069   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:49.829689  1675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:49.831519  1676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:49.833107  1678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:49.835266  1672 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33273
I20260709 12:57:49.835768  1672 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:49.836257   431 server_base.cc:1061] running on GCE node
I20260709 12:57:49.837111   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:57:49.837136  1672 heartbeater.cc:507] Master 127.0.107.254:33273 requested a full tablet report, sending...
W20260709 12:57:49.837427   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:49.837671   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601869837655 us; error 0 us; skew 500 ppm
I20260709 12:57:49.838418   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:49.840031  1470 ts_manager.cc:194] Registered new tserver with Master: a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:49.841506   431 webserver.cc:533] Webserver started at http://127.0.107.195:35765/ using document root <none> and password file <none>
I20260709 12:57:49.842036  1470 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58252
I20260709 12:57:49.842227   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:49.842494   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:49.842824   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:49.844270   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/instance:
uuid: "66344ad7cd844754b2c81cc689a709b0"
format_stamp: "Formatted at 2026-07-09 12:57:49 on dist-test-slave-zhdc"
I20260709 12:57:49.849246   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:57:49.853211  1683 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:49.854171   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:57:49.854524   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root
uuid: "66344ad7cd844754b2c81cc689a709b0"
format_stamp: "Formatted at 2026-07-09 12:57:49 on dist-test-slave-zhdc"
I20260709 12:57:49.854848   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:49.876933   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:49.878448   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:49.880136   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:49.882611   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:49.882860   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:49.883117   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:49.883297   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:49.929211   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:43271
I20260709 12:57:49.929404  1745 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:43271 every 8 connection(s)
I20260709 12:57:49.947674  1746 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33273
I20260709 12:57:49.948120  1746 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:49.949050  1746 heartbeater.cc:507] Master 127.0.107.254:33273 requested a full tablet report, sending...
I20260709 12:57:49.951393  1470 ts_manager.cc:194] Registered new tserver with Master: 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:49.952308   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019206185s
I20260709 12:57:49.952962  1470 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58260
I20260709 12:57:49.981911  1470 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58266:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:57:49.988682  1470 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:57:50.203866  1560 tablet_service.cc:1511] Processing CreateTablet for tablet e93b49f668f7487dad07043590a5616f (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:57:50.205786  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93b49f668f7487dad07043590a5616f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.218179  1555 tablet_service.cc:1511] Processing CreateTablet for tablet cc8f7aca67ac4df5b6f0b4f41d538dfd (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:57:50.228000  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 4b724690541549b4be895303885a0998 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:57:50.228619  1555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8f7aca67ac4df5b6f0b4f41d538dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.211817  1556 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6fdab08a024ae6999ae0a520cd1cd0 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:57:50.229692  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b724690541549b4be895303885a0998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.230494  1556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6fdab08a024ae6999ae0a520cd1cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.207602  1562 tablet_service.cc:1511] Processing CreateTablet for tablet b7404e443f1f4264bb8ea4e04b8e8627 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:57:50.205430  1561 tablet_service.cc:1511] Processing CreateTablet for tablet 4b724690541549b4be895303885a0998 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:57:50.232887  1704 tablet_service.cc:1511] Processing CreateTablet for tablet cc8f7aca67ac4df5b6f0b4f41d538dfd (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:57:50.207481  1559 tablet_service.cc:1511] Processing CreateTablet for tablet bc72a09ffebe49218d3a2f9d4e0bcc45 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:57:50.210172  1558 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6b5add0ec94eccb0981a9bb10c79ef (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:57:50.221028  1554 tablet_service.cc:1511] Processing CreateTablet for tablet 691bccf09f2f475a98a7ab9cbbd1dd8d (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:57:50.212375  1557 tablet_service.cc:1511] Processing CreateTablet for tablet 2033b178bcb643fd84ac0d1ae7e6a64b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:57:50.223883  1553 tablet_service.cc:1511] Processing CreateTablet for tablet f4986d58f61a45638a1088287c2004d8 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:57:50.235025  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7404e443f1f4264bb8ea4e04b8e8627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.235304  1703 tablet_service.cc:1511] Processing CreateTablet for tablet 691bccf09f2f475a98a7ab9cbbd1dd8d (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:57:50.235833  1553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4986d58f61a45638a1088287c2004d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.236698  1554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691bccf09f2f475a98a7ab9cbbd1dd8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.237669  1702 tablet_service.cc:1511] Processing CreateTablet for tablet f4986d58f61a45638a1088287c2004d8 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:57:50.240826  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc72a09ffebe49218d3a2f9d4e0bcc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.228931  1707 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6b5add0ec94eccb0981a9bb10c79ef (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:57:50.231287  1709 tablet_service.cc:1511] Processing CreateTablet for tablet e93b49f668f7487dad07043590a5616f (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:57:50.231091  1706 tablet_service.cc:1511] Processing CreateTablet for tablet 2033b178bcb643fd84ac0d1ae7e6a64b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:57:50.242547  1708 tablet_service.cc:1511] Processing CreateTablet for tablet bc72a09ffebe49218d3a2f9d4e0bcc45 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:57:50.225967  1711 tablet_service.cc:1511] Processing CreateTablet for tablet b7404e443f1f4264bb8ea4e04b8e8627 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:57:50.240363  1705 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6fdab08a024ae6999ae0a520cd1cd0 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:57:50.246565  1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6b5add0ec94eccb0981a9bb10c79ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.247360  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8f7aca67ac4df5b6f0b4f41d538dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.248051  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93b49f668f7487dad07043590a5616f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.248819  1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc72a09ffebe49218d3a2f9d4e0bcc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.251039  1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691bccf09f2f475a98a7ab9cbbd1dd8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.251756  1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4986d58f61a45638a1088287c2004d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.254529  1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2033b178bcb643fd84ac0d1ae7e6a64b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.255429  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7404e443f1f4264bb8ea4e04b8e8627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.257572  1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6fdab08a024ae6999ae0a520cd1cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.260684  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b724690541549b4be895303885a0998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.262399  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2033b178bcb643fd84ac0d1ae7e6a64b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.263339  1558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6b5add0ec94eccb0981a9bb10c79ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.348045  1637 tablet_service.cc:1511] Processing CreateTablet for tablet b7404e443f1f4264bb8ea4e04b8e8627 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:57:50.349695  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7404e443f1f4264bb8ea4e04b8e8627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.352317  1636 tablet_service.cc:1511] Processing CreateTablet for tablet 4b724690541549b4be895303885a0998 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:57:50.353026  1635 tablet_service.cc:1511] Processing CreateTablet for tablet e93b49f668f7487dad07043590a5616f (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:57:50.354437  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b724690541549b4be895303885a0998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.356864  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93b49f668f7487dad07043590a5616f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.358100  1634 tablet_service.cc:1511] Processing CreateTablet for tablet bc72a09ffebe49218d3a2f9d4e0bcc45 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:57:50.359717  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc72a09ffebe49218d3a2f9d4e0bcc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.384789  1556 tablet_service.cc:1511] Processing CreateTablet for tablet ff20dea159284907b41e95b640800f50 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:57:50.379451  1632 tablet_service.cc:1511] Processing CreateTablet for tablet 2033b178bcb643fd84ac0d1ae7e6a64b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:57:50.387748  1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2033b178bcb643fd84ac0d1ae7e6a64b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.388002  1629 tablet_service.cc:1511] Processing CreateTablet for tablet 691bccf09f2f475a98a7ab9cbbd1dd8d (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:57:50.390987  1556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff20dea159284907b41e95b640800f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.392035  1631 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6fdab08a024ae6999ae0a520cd1cd0 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:57:50.396234  1711 tablet_service.cc:1511] Processing CreateTablet for tablet ff20dea159284907b41e95b640800f50 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:57:50.400028  1630 tablet_service.cc:1511] Processing CreateTablet for tablet cc8f7aca67ac4df5b6f0b4f41d538dfd (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:57:50.406958  1633 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6b5add0ec94eccb0981a9bb10c79ef (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:57:50.385263  1628 tablet_service.cc:1511] Processing CreateTablet for tablet f4986d58f61a45638a1088287c2004d8 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:57:50.422307  1761 tablet_bootstrap.cc:492] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:50.424556  1558 tablet_service.cc:1511] Processing CreateTablet for tablet 7133ad6a0a3449ad9f1b93e65653432d (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:57:50.428941  1558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7133ad6a0a3449ad9f1b93e65653432d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.433462  1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691bccf09f2f475a98a7ab9cbbd1dd8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.435199  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6b5add0ec94eccb0981a9bb10c79ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.436472  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff20dea159284907b41e95b640800f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.442570  1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6fdab08a024ae6999ae0a520cd1cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.444522  1709 tablet_service.cc:1511] Processing CreateTablet for tablet 7133ad6a0a3449ad9f1b93e65653432d (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:57:50.446640  1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4986d58f61a45638a1088287c2004d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.469743  1705 tablet_service.cc:1511] Processing CreateTablet for tablet b11fdc1931874b5389be76ef648b6ae1 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:57:50.471809  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7133ad6a0a3449ad9f1b93e65653432d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.487910  1708 tablet_service.cc:1511] Processing CreateTablet for tablet 5a129c637a374138850dc8acf679f4bd (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:57:50.491899  1706 tablet_service.cc:1511] Processing CreateTablet for tablet 25bf4151e41a48f3b21b94c95a02dcd4 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:57:50.493657  1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11fdc1931874b5389be76ef648b6ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.495013  1762 tablet_bootstrap.cc:492] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:50.495633  1559 tablet_service.cc:1511] Processing CreateTablet for tablet b11fdc1931874b5389be76ef648b6ae1 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:57:50.496076  1554 tablet_service.cc:1511] Processing CreateTablet for tablet 5a129c637a374138850dc8acf679f4bd (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:57:50.497225  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11fdc1931874b5389be76ef648b6ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.504062  1557 tablet_service.cc:1511] Processing CreateTablet for tablet e5316a1e4f014102b1770c3f8b08410b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:57:50.505780  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5316a1e4f014102b1770c3f8b08410b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.483201  1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8f7aca67ac4df5b6f0b4f41d538dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.508056  1562 tablet_service.cc:1511] Processing CreateTablet for tablet 25bf4151e41a48f3b21b94c95a02dcd4 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:57:50.477943  1761 tablet_bootstrap.cc:654] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:50.519831  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bf4151e41a48f3b21b94c95a02dcd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.521951  1763 tablet_bootstrap.cc:492] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:50.525043  1762 tablet_bootstrap.cc:654] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:50.524643  1560 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9c43e38d20461f85176d58e01fc7a1 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:57:50.526482  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9c43e38d20461f85176d58e01fc7a1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:50.531250  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:50.531725  1553 tablet_service.cc:1511] Processing CreateTablet for tablet beabe4568b4d481bac560939dd7f8258 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:57:50.527853  1704 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9c43e38d20461f85176d58e01fc7a1 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:57:50.528373  1710 tablet_service.cc:1511] Processing CreateTablet for tablet beabe4568b4d481bac560939dd7f8258 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:57:50.529788  1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a129c637a374138850dc8acf679f4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.534860  1553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beabe4568b4d481bac560939dd7f8258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.535892  1632 tablet_service.cc:1511] Processing CreateTablet for tablet ff20dea159284907b41e95b640800f50 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:57:50.537360  1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff20dea159284907b41e95b640800f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.539084  1707 tablet_service.cc:1511] Processing CreateTablet for tablet f283aa8c9b4a40729ec5fde1481234a1 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:57:50.541484  1554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a129c637a374138850dc8acf679f4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.551558  1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bf4151e41a48f3b21b94c95a02dcd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.518664  1702 tablet_service.cc:1511] Processing CreateTablet for tablet e5316a1e4f014102b1770c3f8b08410b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:57:50.561741  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beabe4568b4d481bac560939dd7f8258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.563603  1555 tablet_service.cc:1511] Processing CreateTablet for tablet f283aa8c9b4a40729ec5fde1481234a1 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:57:50.591048  1556 tablet_service.cc:1511] Processing CreateTablet for tablet 8b24c881516c4da087ee25ab3682886b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:57:50.591890  1555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f283aa8c9b4a40729ec5fde1481234a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.598143  1637 tablet_service.cc:1511] Processing CreateTablet for tablet e5316a1e4f014102b1770c3f8b08410b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:57:50.599655  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5316a1e4f014102b1770c3f8b08410b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:50.583379  1455 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 48119.4us
I20260709 12:57:50.576666  1629 tablet_service.cc:1511] Processing CreateTablet for tablet 7133ad6a0a3449ad9f1b93e65653432d (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:57:50.590523  1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5316a1e4f014102b1770c3f8b08410b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.602746  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 5a129c637a374138850dc8acf679f4bd (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:57:50.590539  1703 tablet_service.cc:1511] Processing CreateTablet for tablet daf4ad4ac54a4a228481863e56e53d54 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:57:50.612751  1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f283aa8c9b4a40729ec5fde1481234a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.607856  1556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b24c881516c4da087ee25ab3682886b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.597424  1558 tablet_service.cc:1511] Processing CreateTablet for tablet 17d2c95439be4ced872760603b0ae02b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:57:50.585915  1763 tablet_bootstrap.cc:654] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:50.616358  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9c43e38d20461f85176d58e01fc7a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.621470  1558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d2c95439be4ced872760603b0ae02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.622773  1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf4ad4ac54a4a228481863e56e53d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.624081  1635 tablet_service.cc:1511] Processing CreateTablet for tablet b11fdc1931874b5389be76ef648b6ae1 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:57:50.627537  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a129c637a374138850dc8acf679f4bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.631028  1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7133ad6a0a3449ad9f1b93e65653432d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.644505  1762 tablet_bootstrap.cc:492] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:50.645159  1762 ts_tablet_manager.cc:1403] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.151s	user 0.012s	sys 0.011s
I20260709 12:57:50.582310  1561 tablet_service.cc:1511] Processing CreateTablet for tablet daf4ad4ac54a4a228481863e56e53d54 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:57:50.663750  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf4ad4ac54a4a228481863e56e53d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.644534  1628 tablet_service.cc:1511] Processing CreateTablet for tablet 25bf4151e41a48f3b21b94c95a02dcd4 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:57:50.671746  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11fdc1931874b5389be76ef648b6ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.682179  1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bf4151e41a48f3b21b94c95a02dcd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.671386  1762 raft_consensus.cc:359] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:50.689622  1762 raft_consensus.cc:385] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:50.689996  1762 raft_consensus.cc:740] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:50.694173  1557 tablet_service.cc:1511] Processing CreateTablet for tablet e0a2b0ee304d42d18cbe5fa6ca66804b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:57:50.723403  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a2b0ee304d42d18cbe5fa6ca66804b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.734804  1559 tablet_service.cc:1511] Processing CreateTablet for tablet e13ac9e112d84ff79c9ea7f4762a82ab (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:57:50.736737  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e13ac9e112d84ff79c9ea7f4762a82ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.702221  1762 consensus_queue.cc:260] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:50.739233  1562 tablet_service.cc:1511] Processing CreateTablet for tablet 4759b34f9b3e4074a8a1cffa7efc8ff7 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:57:50.740876  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4759b34f9b3e4074a8a1cffa7efc8ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.740552  1631 tablet_service.cc:1511] Processing CreateTablet for tablet beabe4568b4d481bac560939dd7f8258 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:57:50.742111  1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beabe4568b4d481bac560939dd7f8258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.743382  1597 heartbeater.cc:499] Master 127.0.107.254:33273 was elected leader, sending a full tablet report...
I20260709 12:57:50.745743  1709 tablet_service.cc:1511] Processing CreateTablet for tablet 8b24c881516c4da087ee25ab3682886b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:57:50.781250  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b24c881516c4da087ee25ab3682886b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.760216  1636 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9c43e38d20461f85176d58e01fc7a1 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:57:50.790333  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9c43e38d20461f85176d58e01fc7a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.757686  1711 tablet_service.cc:1511] Processing CreateTablet for tablet 17d2c95439be4ced872760603b0ae02b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:57:50.766804  1761 tablet_bootstrap.cc:492] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:50.777777  1710 tablet_service.cc:1511] Processing CreateTablet for tablet e0a2b0ee304d42d18cbe5fa6ca66804b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:57:50.745749  1554 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd7e524e66b45d5a5c823f1a5224351 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:57:50.773872  1560 tablet_service.cc:1511] Processing CreateTablet for tablet cbe76ebe20be4546bed4f95e2ee090bd (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:57:50.805035  1761 ts_tablet_manager.cc:1403] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.383s	user 0.018s	sys 0.017s
I20260709 12:57:50.805035  1763 tablet_bootstrap.cc:492] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:50.805994  1763 ts_tablet_manager.cc:1403] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.284s	user 0.022s	sys 0.034s
I20260709 12:57:50.805472  1554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd7e524e66b45d5a5c823f1a5224351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.808312  1761 raft_consensus.cc:359] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:50.809103  1761 raft_consensus.cc:385] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:50.809424  1761 raft_consensus.cc:740] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:50.815078  1763 raft_consensus.cc:359] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:50.820075  1763 raft_consensus.cc:385] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:50.820550  1763 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:50.825462  1763 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:50.833249  1767 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.818486  1553 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca192f35fd14bb58ebd0766d7a202f8 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:57:50.833853  1767 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:50.834939  1553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca192f35fd14bb58ebd0766d7a202f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.826022  1555 tablet_service.cc:1511] Processing CreateTablet for tablet 5c79f18b2f4247348564b91d430d6124 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:57:50.827548  1561 tablet_service.cc:1511] Processing CreateTablet for tablet eae5b8a8b4f14989a2565077fe8be235 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:57:50.817358  1633 tablet_service.cc:1511] Processing CreateTablet for tablet daf4ad4ac54a4a228481863e56e53d54 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:57:50.826320  1761 consensus_queue.cc:260] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:50.844091  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a2b0ee304d42d18cbe5fa6ca66804b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.844271  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe76ebe20be4546bed4f95e2ee090bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.845058  1672 heartbeater.cc:499] Master 127.0.107.254:33273 was elected leader, sending a full tablet report...
I20260709 12:57:50.846927  1704 tablet_service.cc:1511] Processing CreateTablet for tablet 4759b34f9b3e4074a8a1cffa7efc8ff7 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:57:50.849785  1703 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd7e524e66b45d5a5c823f1a5224351 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:57:50.850908  1632 tablet_service.cc:1511] Processing CreateTablet for tablet f283aa8c9b4a40729ec5fde1481234a1 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:57:50.852123  1767 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:50.858950  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf4ad4ac54a4a228481863e56e53d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.877271  1705 tablet_service.cc:1511] Processing CreateTablet for tablet e13ac9e112d84ff79c9ea7f4762a82ab (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:57:50.878790  1762 ts_tablet_manager.cc:1434] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.233s	user 0.013s	sys 0.000s
I20260709 12:57:50.880043  1762 tablet_bootstrap.cc:492] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:50.882112  1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f283aa8c9b4a40729ec5fde1481234a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.884189  1708 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca192f35fd14bb58ebd0766d7a202f8 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:57:50.873700  1702 tablet_service.cc:1511] Processing CreateTablet for tablet cbe76ebe20be4546bed4f95e2ee090bd (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:57:50.903537  1629 tablet_service.cc:1511] Processing CreateTablet for tablet 8b24c881516c4da087ee25ab3682886b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:57:50.898587  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d2c95439be4ced872760603b0ae02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.908360  1555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c79f18b2f4247348564b91d430d6124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.921263  1557 tablet_service.cc:1511] Processing CreateTablet for tablet 71dad2e408414d2fa4f055c6eccf5b92 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:57:50.924343  1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b24c881516c4da087ee25ab3682886b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.852123  1558 tablet_service.cc:1511] Processing CreateTablet for tablet 61b3acddedfe43b6b7d1a8f74c050925 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:57:50.942483  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae5b8a8b4f14989a2565077fe8be235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.943980  1628 tablet_service.cc:1511] Processing CreateTablet for tablet e13ac9e112d84ff79c9ea7f4762a82ab (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:57:50.945124  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71dad2e408414d2fa4f055c6eccf5b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.921263  1637 tablet_service.cc:1511] Processing CreateTablet for tablet 17d2c95439be4ced872760603b0ae02b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:57:50.950570  1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e13ac9e112d84ff79c9ea7f4762a82ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.953521  1558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b3acddedfe43b6b7d1a8f74c050925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.952898  1635 tablet_service.cc:1511] Processing CreateTablet for tablet 4759b34f9b3e4074a8a1cffa7efc8ff7 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:57:50.954928  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4759b34f9b3e4074a8a1cffa7efc8ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.955082  1630 tablet_service.cc:1511] Processing CreateTablet for tablet e0a2b0ee304d42d18cbe5fa6ca66804b (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:57:50.955880  1746 heartbeater.cc:499] Master 127.0.107.254:33273 was elected leader, sending a full tablet report...
I20260709 12:57:50.931587  1556 tablet_service.cc:1511] Processing CreateTablet for tablet 41d3057239d54d6183db91d2b176c2dd (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:57:50.956499  1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a2b0ee304d42d18cbe5fa6ca66804b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.957028  1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca192f35fd14bb58ebd0766d7a202f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.958420  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4759b34f9b3e4074a8a1cffa7efc8ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.958739  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d2c95439be4ced872760603b0ae02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.959438  1562 tablet_service.cc:1511] Processing CreateTablet for tablet a186179c799f4e53a8adf725dfd98a58 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:57:50.960386  1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd7e524e66b45d5a5c823f1a5224351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.960804  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a186179c799f4e53a8adf725dfd98a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.962648  1768 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.963233  1768 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:50.964589  1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e13ac9e112d84ff79c9ea7f4762a82ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.966033  1763 ts_tablet_manager.cc:1434] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.160s	user 0.018s	sys 0.003s
I20260709 12:57:50.968433  1768 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:50.990556  1556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d3057239d54d6183db91d2b176c2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.991618  1763 tablet_bootstrap.cc:492] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:50.977283  1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe76ebe20be4546bed4f95e2ee090bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.004091  1706 tablet_service.cc:1511] Processing CreateTablet for tablet 5c79f18b2f4247348564b91d430d6124 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:57:51.004156  1633 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd7e524e66b45d5a5c823f1a5224351 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:57:51.016464  1707 tablet_service.cc:1511] Processing CreateTablet for tablet eae5b8a8b4f14989a2565077fe8be235 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:57:51.020053  1709 tablet_service.cc:1511] Processing CreateTablet for tablet a186179c799f4e53a8adf725dfd98a58 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:57:51.031173  1761 ts_tablet_manager.cc:1434] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.226s	user 0.000s	sys 0.021s
I20260709 12:57:51.078969  1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c79f18b2f4247348564b91d430d6124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.126269  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd7e524e66b45d5a5c823f1a5224351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.140602  1762 tablet_bootstrap.cc:654] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:51.158265  1631 tablet_service.cc:1511] Processing CreateTablet for tablet cbe76ebe20be4546bed4f95e2ee090bd (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:57:51.161268  1763 tablet_bootstrap.cc:654] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:51.161345  1636 tablet_service.cc:1511] Processing CreateTablet for tablet 61b3acddedfe43b6b7d1a8f74c050925 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:57:51.182195  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b3acddedfe43b6b7d1a8f74c050925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.188809  1772 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.189463  1772 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:51.180058  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca192f35fd14bb58ebd0766d7a202f8 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:57:51.191759  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca192f35fd14bb58ebd0766d7a202f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.201434  1772 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:51.205493  1762 tablet_bootstrap.cc:492] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:51.206173  1762 ts_tablet_manager.cc:1403] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.326s	user 0.017s	sys 0.002s
I20260709 12:57:51.246551  1629 tablet_service.cc:1511] Processing CreateTablet for tablet 5c79f18b2f4247348564b91d430d6124 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:57:51.264222  1630 tablet_service.cc:1511] Processing CreateTablet for tablet eae5b8a8b4f14989a2565077fe8be235 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:57:51.282195  1637 tablet_service.cc:1511] Processing CreateTablet for tablet 71dad2e408414d2fa4f055c6eccf5b92 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:57:51.283152  1632 tablet_service.cc:1511] Processing CreateTablet for tablet a186179c799f4e53a8adf725dfd98a58 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:57:51.208259  1708 tablet_service.cc:1511] Processing CreateTablet for tablet 71dad2e408414d2fa4f055c6eccf5b92 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:57:51.294595  1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71dad2e408414d2fa4f055c6eccf5b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.299117  1703 tablet_service.cc:1511] Processing CreateTablet for tablet 41d3057239d54d6183db91d2b176c2dd (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:57:51.249892  1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c79f18b2f4247348564b91d430d6124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.304692  1553 tablet_service.cc:1511] Processing CreateTablet for tablet b8c2c21bc6aa4835b68933c89735091f (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:57:51.303268  1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d3057239d54d6183db91d2b176c2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.310639  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71dad2e408414d2fa4f055c6eccf5b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.314531  1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae5b8a8b4f14989a2565077fe8be235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.315776  1702 tablet_service.cc:1511] Processing CreateTablet for tablet b8c2c21bc6aa4835b68933c89735091f (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:57:51.317613  1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c2c21bc6aa4835b68933c89735091f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.318959  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 61b3acddedfe43b6b7d1a8f74c050925 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:57:51.320933  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b3acddedfe43b6b7d1a8f74c050925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.334756  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:57:51.339324  1611 leader_election.cc:343] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:51.340585  1761 tablet_bootstrap.cc:492] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:51.341061  1711 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60074 (request call id 21) took 1016 ms. Trace:
I20260709 12:57:51.341693  1711 rpcz_store.cc:276] 0709 12:57:50.324549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.717081 (+392532us) service_pool.cc:224] Handling call
0709 12:57:50.843193 (+126112us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:50.845219 (+  2026us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.160679 (+315460us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.333105 (+172426us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.340790 (+  7685us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.344273  1704 tablet_service.cc:1511] Processing CreateTablet for tablet 31e1751f20084c868e4ad6251ca38954 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:57:51.346335  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e1751f20084c868e4ad6251ca38954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.210917  1762 raft_consensus.cc:359] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:51.347434  1762 raft_consensus.cc:385] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:51.347926  1762 raft_consensus.cc:740] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:51.349445  1763 tablet_bootstrap.cc:492] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:51.349164  1762 consensus_queue.cc:260] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:51.306751  1553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c2c21bc6aa4835b68933c89735091f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.362253  1763 ts_tablet_manager.cc:1403] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.386s	user 0.015s	sys 0.009s
I20260709 12:57:51.370955  1635 tablet_service.cc:1511] Processing CreateTablet for tablet 41d3057239d54d6183db91d2b176c2dd (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:57:51.372212  1628 tablet_service.cc:1511] Processing CreateTablet for tablet b8c2c21bc6aa4835b68933c89735091f (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:57:51.379598  1558 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 30) took 1047 ms. Trace:
I20260709 12:57:51.391644  1762 ts_tablet_manager.cc:1434] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.185s	user 0.006s	sys 0.004s
I20260709 12:57:51.381417  1558 rpcz_store.cc:276] 0709 12:57:50.332267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.851182 (+518915us) service_pool.cc:224] Handling call
0709 12:57:50.952962 (+101780us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:50.953084 (+   122us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.081100 (+128016us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.378457 (+297357us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.379328 (+   871us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.422156  1763 raft_consensus.cc:359] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:51.423369  1763 raft_consensus.cc:385] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:51.423751  1763 raft_consensus.cc:740] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:51.424819  1763 consensus_queue.cc:260] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:51.433987  1762 tablet_bootstrap.cc:492] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:51.480160  1558 tablet_service.cc:1511] Processing CreateTablet for tablet 31e1751f20084c868e4ad6251ca38954 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:57:51.525358  1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 32) took 1180 ms. Trace:
I20260709 12:57:51.529827  1555 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 28) took 1207 ms. Trace:
I20260709 12:57:51.530390  1555 rpcz_store.cc:276] 0709 12:57:50.322439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.825018 (+502579us) service_pool.cc:224] Handling call
0709 12:57:50.844571 (+ 19553us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:50.844681 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.519240 (+674559us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.528950 (+  9710us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.529569 (+   619us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.525844  1562 rpcz_store.cc:276] 0709 12:57:50.344672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.927200 (+582528us) service_pool.cc:224] Handling call
0709 12:57:50.960333 (+ 33133us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:50.960442 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.380841 (+420399us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.524543 (+143702us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.525122 (+   579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.533814  1555 tablet_service.cc:1511] Processing CreateTablet for tablet e28f3d3a9bc24be6b8fc4d90754cdfac (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:57:51.535130  1562 tablet_service.cc:1511] Processing CreateTablet for tablet b968f124f3854f20bff4af609192c41a (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 12:57:51.547132  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:51.542933  1557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 31) took 1201 ms. Trace:
I20260709 12:57:51.544217  1553 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 34) took 1044 ms. Trace:
I20260709 12:57:51.557451  1553 rpcz_store.cc:276] 0709 12:57:50.500150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.302668 (+802518us) service_pool.cc:224] Handling call
0709 12:57:51.305821 (+  3153us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.306041 (+   220us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.529453 (+223412us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.543520 (+ 14067us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.544099 (+   579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.556111  1557 rpcz_store.cc:276] 0709 12:57:50.340974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.920142 (+579168us) service_pool.cc:224] Handling call
0709 12:57:50.940358 (+ 20216us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:50.944594 (+  4236us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.088086 (+143492us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.541951 (+453865us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.542713 (+   762us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.562834  1557 tablet_service.cc:1511] Processing CreateTablet for tablet 36627e4c13c74e8a9fd501f26c7aff53 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:57:51.560298  1553 tablet_service.cc:1511] Processing CreateTablet for tablet 478c3696a6364c18a8ebef13ff075bfa (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:57:51.580905  1560 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 26) took 1269 ms. Trace:
I20260709 12:57:51.581423  1560 rpcz_store.cc:276] 0709 12:57:50.311650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.772580 (+460930us) service_pool.cc:224] Handling call
0709 12:57:50.843813 (+ 71233us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:50.843903 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.570713 (+726810us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.580039 (+  9326us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.580655 (+   616us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.582433  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:51.583395  1572 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:51.583981  1560 tablet_service.cc:1511] Processing CreateTablet for tablet c55d053b55024621933828292867f0e6 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:57:51.586989  1686 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:51.589725  1556 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 33) took 1159 ms. Trace:
I20260709 12:57:51.590307  1556 rpcz_store.cc:276] 0709 12:57:50.429966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.929664 (+499698us) service_pool.cc:224] Handling call
0709 12:57:50.973750 (+ 44086us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:50.977026 (+  3276us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.566550 (+589524us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.588849 (+ 22299us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.589515 (+   666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.593148  1556 tablet_service.cc:1511] Processing CreateTablet for tablet a4b97ee9bb5742b6a7bfc576360314c5 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:57:51.602829  1705 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60074 (request call id 23) took 1277 ms. Trace:
W20260709 12:57:51.604034  1554 consensus_meta.cc:287] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.771s	user 0.021s	sys 0.004s
I20260709 12:57:51.605108  1705 rpcz_store.cc:276] 0709 12:57:50.325473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.797924 (+472451us) service_pool.cc:224] Handling call
0709 12:57:50.886174 (+ 88250us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:50.886305 (+   131us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.190038 (+303733us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.309413 (+119375us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.602592 (+293179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.619853  1705 tablet_service.cc:1511] Processing CreateTablet for tablet 478c3696a6364c18a8ebef13ff075bfa (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:57:51.621589  1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 478c3696a6364c18a8ebef13ff075bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.605736  1554 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 25) took 1299 ms. Trace:
I20260709 12:57:51.630865  1554 rpcz_store.cc:276] 0709 12:57:50.306550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.738265 (+431715us) service_pool.cc:224] Handling call
0709 12:57:50.804932 (+ 66667us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:50.805052 (+   120us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:50.832825 (+ 27773us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.604937 (+772112us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.605660 (+   723us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.632599  1636 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 30) took 1172 ms. Trace:
I20260709 12:57:51.633118  1636 rpcz_store.cc:276] 0709 12:57:50.460426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.160222 (+699796us) service_pool.cc:224] Handling call
0709 12:57:51.181559 (+ 21337us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.181681 (+   122us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.621897 (+440216us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.631792 (+  9895us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.632384 (+   592us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.635962  1636 tablet_service.cc:1511] Processing CreateTablet for tablet 31e1751f20084c868e4ad6251ca38954 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:57:51.643118  1767 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.643776  1767 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:51.648366  1637 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 31) took 1187 ms. Trace:
I20260709 12:57:51.648851  1637 rpcz_store.cc:276] 0709 12:57:50.460726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.280369 (+819643us) service_pool.cc:224] Handling call
0709 12:57:51.283370 (+  3001us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.283575 (+   205us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.626170 (+342595us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.647715 (+ 21545us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.648290 (+   575us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.651937  1763 ts_tablet_manager.cc:1434] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.281s	user 0.004s	sys 0.013s
I20260709 12:57:51.653441  1763 tablet_bootstrap.cc:492] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:51.654368  1767 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:51.660003  1637 tablet_service.cc:1511] Processing CreateTablet for tablet e28f3d3a9bc24be6b8fc4d90754cdfac (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:57:51.662186  1705 tablet_service.cc:1511] Processing CreateTablet for tablet 36627e4c13c74e8a9fd501f26c7aff53 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:57:51.663764  1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36627e4c13c74e8a9fd501f26c7aff53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.681036  1633 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 25) took 1222 ms. Trace:
I20260709 12:57:51.690714  1633 rpcz_store.cc:276] 0709 12:57:50.458841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.003072 (+544231us) service_pool.cc:224] Handling call
0709 12:57:51.104269 (+101197us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.114678 (+ 10409us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.281596 (+166918us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.327201 (+ 45605us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.680787 (+353586us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.685674  1711 tablet_service.cc:1511] Processing CreateTablet for tablet e28f3d3a9bc24be6b8fc4d90754cdfac (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:57:51.699323  1761 tablet_bootstrap.cc:654] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:51.699657  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28f3d3a9bc24be6b8fc4d90754cdfac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.693445  1633 tablet_service.cc:1511] Processing CreateTablet for tablet b968f124f3854f20bff4af609192c41a (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:57:51.709919  1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a186179c799f4e53a8adf725dfd98a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.713932  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d3057239d54d6183db91d2b176c2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.715487  1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c2c21bc6aa4835b68933c89735091f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.688035  1705 tablet_service.cc:1511] Processing CreateTablet for tablet c55d053b55024621933828292867f0e6 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:57:51.718092  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e1751f20084c868e4ad6251ca38954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.719038  1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c55d053b55024621933828292867f0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.720322  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28f3d3a9bc24be6b8fc4d90754cdfac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.722344  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b968f124f3854f20bff4af609192c41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.741835  1554 tablet_service.cc:1511] Processing CreateTablet for tablet b719a12d310b46bf978e160558e7d6f5 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:57:51.749118  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a186179c799f4e53a8adf725dfd98a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.750118  1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae5b8a8b4f14989a2565077fe8be235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.750901  1561 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 29) took 1423 ms. Trace:
I20260709 12:57:51.751372  1561 rpcz_store.cc:276] 0709 12:57:50.327628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.826560 (+498932us) service_pool.cc:224] Handling call
0709 12:57:50.871541 (+ 44981us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:50.875378 (+  3837us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.665900 (+790522us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.729907 (+ 64007us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.750632 (+ 20725us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.764551  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:51.765300  1721 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
W20260709 12:57:51.767041  1559 consensus_meta.cc:287] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.824s	user 0.012s	sys 0.008s
I20260709 12:57:51.768288  1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 23) took 1467 ms. Trace:
I20260709 12:57:51.768666  1559 rpcz_store.cc:276] 0709 12:57:50.301015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.707399 (+406384us) service_pool.cc:224] Handling call
0709 12:57:50.736036 (+ 28637us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:50.736227 (+   191us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:50.943027 (+206800us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.767661 (+824634us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.768213 (+   552us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.769375  1630 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 29) took 1309 ms. Trace:
I20260709 12:57:51.769775  1630 rpcz_store.cc:276] 0709 12:57:50.460130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.262394 (+802264us) service_pool.cc:224] Handling call
0709 12:57:51.265614 (+  3220us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.265821 (+   207us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.715081 (+449260us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.768822 (+ 53741us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.769313 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.772014  1630 tablet_service.cc:1511] Processing CreateTablet for tablet 478c3696a6364c18a8ebef13ff075bfa (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:57:51.773444  1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 478c3696a6364c18a8ebef13ff075bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.778242  1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe76ebe20be4546bed4f95e2ee090bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.782706  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:51.783650  1767 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:51.784006  1767 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:51.784319  1767 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:51.784960  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:51.788460  1634 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 27) took 1328 ms. Trace:
I20260709 12:57:51.794454  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:51.806494  1554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b719a12d310b46bf978e160558e7d6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.808531  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36627e4c13c74e8a9fd501f26c7aff53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.808880  1772 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:51.809342  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c55d053b55024621933828292867f0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.810163  1555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28f3d3a9bc24be6b8fc4d90754cdfac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:51.810269  1706 consensus_meta.cc:287] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.008s
I20260709 12:57:51.811712  1706 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60074 (request call id 28) took 1433 ms. Trace:
I20260709 12:57:51.809311  1772 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:51.812317  1772 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:51.802325  1711 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60074 (request call id 36) took 1100 ms. Trace:
I20260709 12:57:51.826284  1553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 478c3696a6364c18a8ebef13ff075bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.827683  1767 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:51.812107  1706 rpcz_store.cc:276] 0709 12:57:50.378019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.002482 (+624463us) service_pool.cc:224] Handling call
0709 12:57:51.078250 (+ 75768us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.078418 (+   168us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.201342 (+122924us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.810969 (+609627us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.811640 (+   671us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.845196  1706 tablet_service.cc:1511] Processing CreateTablet for tablet a4b97ee9bb5742b6a7bfc576360314c5 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:57:51.845765  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:51.837852  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b968f124f3854f20bff4af609192c41a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:51.830492  1536 leader_election.cc:343] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:51.847872  1685 leader_election.cc:343] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:51.838342  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:51.852567  1558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e1751f20084c868e4ad6251ca38954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.829639  1702 tablet_service.cc:1511] Processing CreateTablet for tablet b968f124f3854f20bff4af609192c41a (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:57:51.837353  1763 tablet_bootstrap.cc:654] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:51.860242  1536 leader_election.cc:343] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:51.868786  1702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b968f124f3854f20bff4af609192c41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.862556  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:51.878232  1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b97ee9bb5742b6a7bfc576360314c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.879098  1772 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:51.882591  1762 tablet_bootstrap.cc:654] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:51.830045  1767 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:51.887058  1767 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:51.890393  1556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b97ee9bb5742b6a7bfc576360314c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.892608  1708 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60074 (request call id 31) took 1429 ms. Trace:
I20260709 12:57:51.893054  1708 rpcz_store.cc:276] 0709 12:57:50.462998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.207163 (+744165us) service_pool.cc:224] Handling call
0709 12:57:51.292571 (+ 85408us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.293014 (+   443us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.804882 (+511868us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.891963 (+ 87081us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.892531 (+   568us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.792904  1634 rpcz_store.cc:276] 0709 12:57:50.459516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.178930 (+719414us) service_pool.cc:224] Handling call
0709 12:57:51.190773 (+ 11843us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.190916 (+   143us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.706361 (+515445us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.787672 (+ 81311us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.788246 (+   574us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.818512  1711 rpcz_store.cc:276] 0709 12:57:50.701805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.358452 (+656647us) service_pool.cc:224] Handling call
0709 12:57:51.699013 (+340561us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.699156 (+   143us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.753849 (+ 54693us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.779775 (+ 25926us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.801837 (+ 22062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.900604  1711 tablet_service.cc:1511] Processing CreateTablet for tablet b719a12d310b46bf978e160558e7d6f5 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:57:51.902273  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b719a12d310b46bf978e160558e7d6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.902952  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 36627e4c13c74e8a9fd501f26c7aff53 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:57:51.909152  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:51.910038  1572 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:57:51.905375  1636 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 35) took 1293 ms. Trace:
I20260709 12:57:51.913024  1636 rpcz_store.cc:276] 0709 12:57:50.611934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.634639 (+1022705us) service_pool.cc:224] Handling call
0709 12:57:51.636940 (+  2301us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.637066 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.768539 (+131473us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.904797 (+136258us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.905307 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.916342  1710 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60074 (request call id 30) took 1454 ms. Trace:
I20260709 12:57:51.916814  1710 rpcz_store.cc:276] 0709 12:57:50.461864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.203993 (+742129us) service_pool.cc:224] Handling call
0709 12:57:51.320158 (+116165us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.320389 (+   231us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.799981 (+479592us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.915721 (+115740us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.916263 (+   542us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.919004  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:57:51.920760  1685 leader_election.cc:343] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:51.921218  1709 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60074 (request call id 32) took 1457 ms. Trace:
I20260709 12:57:51.921247  1685 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:51.911765  1772 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:51.922567  1772 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:51.931057  1633 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 37) took 1203 ms. Trace:
I20260709 12:57:51.931535  1633 rpcz_store.cc:276] 0709 12:57:50.728593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.692199 (+963606us) service_pool.cc:224] Handling call
0709 12:57:51.710661 (+ 18462us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.710792 (+   131us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.762991 (+ 52199us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.930389 (+167398us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.930960 (+   571us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.933343  1559 tablet_service.cc:1511] Processing CreateTablet for tablet a2e78d031c384616a01064318cb24f28 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:57:51.935375  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e78d031c384616a01064318cb24f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.936671  1629 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 28) took 1476 ms. Trace:
I20260709 12:57:51.936775  1632 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 32) took 1475 ms. Trace:
I20260709 12:57:51.938905  1763 tablet_bootstrap.cc:492] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:51.954886  1763 ts_tablet_manager.cc:1403] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.302s	user 0.009s	sys 0.015s
I20260709 12:57:51.933593  1633 tablet_service.cc:1511] Processing CreateTablet for tablet a4b97ee9bb5742b6a7bfc576360314c5 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:57:51.924048  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36627e4c13c74e8a9fd501f26c7aff53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.967542  1628 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 34) took 1432 ms. Trace:
I20260709 12:57:51.968217  1628 rpcz_store.cc:276] 0709 12:57:50.534789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.370800 (+836011us) service_pool.cc:224] Handling call
0709 12:57:51.373238 (+  2438us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.373377 (+   139us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.838779 (+465402us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.966922 (+128143us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.967465 (+   543us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.939252  1629 rpcz_store.cc:276] 0709 12:57:50.459830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.244684 (+784854us) service_pool.cc:224] Handling call
0709 12:57:51.248662 (+  3978us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.249006 (+   344us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.748892 (+499886us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.936046 (+187154us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.936585 (+   539us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.970897  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b97ee9bb5742b6a7bfc576360314c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.972775  1629 tablet_service.cc:1511] Processing CreateTablet for tablet a2e78d031c384616a01064318cb24f28 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:57:51.974416  1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e78d031c384616a01064318cb24f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.939761  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58252 (request call id 2) took 1043 ms. Trace:
I20260709 12:57:51.978523  1561 tablet_service.cc:1511] Processing CreateTablet for tablet 016c9143ad3147438e814f92f2090928 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:57:51.978662  1469 rpcz_store.cc:276] 0709 12:57:50.896511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.896720 (+   209us) service_pool.cc:224] Handling call
0709 12:57:51.939503 (+1042783us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":286070,"reported_tablets":10}
I20260709 12:57:51.941949  1632 rpcz_store.cc:276] 0709 12:57:50.461033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.281676 (+820643us) service_pool.cc:224] Handling call
0709 12:57:51.285137 (+  3461us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.357797 (+ 72660us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.785570 (+427773us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.936180 (+150610us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.936710 (+   530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:51.980224  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016c9143ad3147438e814f92f2090928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.921690  1709 rpcz_store.cc:276] 0709 12:57:50.463365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.018996 (+555631us) service_pool.cc:224] Handling call
0709 12:57:51.748022 (+729026us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22cc831 00007f18d22a9ac3 00007f18d2258400 00007f18cb6ddaf4 00007f18cb6dda82 00007f18cb6dd9b1
0709 12:57:51.748297 (+   275us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.748431 (+   134us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.844203 (+ 95772us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.920620 (+ 76417us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.921154 (+   534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9085824}
W20260709 12:57:51.977321  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 115010us
I20260709 12:57:51.984632  1635 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 33) took 1447 ms. Trace:
I20260709 12:57:51.991066  1555 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 36) took 1337 ms. Trace:
I20260709 12:57:51.994809  1636 tablet_service.cc:1511] Processing CreateTablet for tablet c55d053b55024621933828292867f0e6 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:57:51.996888  1763 raft_consensus.cc:359] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:51.989688  1553 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 38) took 1167 ms. Trace:
I20260709 12:57:52.006531  1761 tablet_bootstrap.cc:492] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:52.006867  1560 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 40) took 1047 ms. Trace:
I20260709 12:57:52.006619  1628 tablet_service.cc:1511] Processing CreateTablet for tablet b719a12d310b46bf978e160558e7d6f5 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:57:52.010301  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c55d053b55024621933828292867f0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.010107  1637 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 36) took 1308 ms. Trace:
I20260709 12:57:52.010145  1632 tablet_service.cc:1511] Processing CreateTablet for tablet 016c9143ad3147438e814f92f2090928 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:57:52.015407  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:52.033756  1628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b719a12d310b46bf978e160558e7d6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.018641  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:52.034982  1721 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 1: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:57:52.019102  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:52.036592  1703 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60074 (request call id 33) took 1528 ms. Trace:
I20260709 12:57:52.019495  1704 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60074 (request call id 35) took 1337 ms. Trace:
I20260709 12:57:52.036989  1703 rpcz_store.cc:276] 0709 12:57:50.508808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.292911 (+784103us) service_pool.cc:224] Handling call
0709 12:57:51.300324 (+  7413us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.300480 (+   156us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.840552 (+540072us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:52.035998 (+195446us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.036528 (+   530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.037442  1704 rpcz_store.cc:276] 0709 12:57:50.682260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.324933 (+642673us) service_pool.cc:224] Handling call
0709 12:57:51.345591 (+ 20658us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.345732 (+   141us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.824427 (+478695us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:52.018178 (+193751us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.019424 (+  1246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28544}
I20260709 12:57:52.038455  1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016c9143ad3147438e814f92f2090928. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:52.019783  1536 leader_election.cc:343] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.020205  1763 raft_consensus.cc:385] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:51.999903  1635 rpcz_store.cc:276] 0709 12:57:50.534384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.361770 (+827386us) service_pool.cc:224] Handling call
0709 12:57:51.372085 (+ 10315us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.372195 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.885799 (+513604us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.969849 (+ 84050us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.981471 (+ 11622us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.026505  1560 rpcz_store.cc:276] 0709 12:57:50.959670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.582683 (+623013us) service_pool.cc:224] Handling call
0709 12:57:51.584978 (+  2295us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.585096 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.931738 (+346642us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:52.005633 (+ 73895us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.006799 (+  1166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.028492  1761 ts_tablet_manager.cc:1403] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.689s	user 0.022s	sys 0.010s
I20260709 12:57:52.042963  1560 tablet_service.cc:1511] Processing CreateTablet for tablet a6e5957876f24a868f3f2c49fcf5e759 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:57:52.044346  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e5957876f24a868f3f2c49fcf5e759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.045322  1761 raft_consensus.cc:359] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } }
W20260709 12:57:52.044431  1536 leader_election.cc:343] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.046515  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:52.012456  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58250 (request call id 2) took 1089 ms. Trace:
W20260709 12:57:52.043247  1612 leader_election.cc:343] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.053777  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:52.040004  1763 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.025460  1553 rpcz_store.cc:276] 0709 12:57:50.822352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.558853 (+736501us) service_pool.cc:224] Handling call
0709 12:57:51.564135 (+  5282us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.564276 (+   141us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.929520 (+365244us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.989075 (+ 59555us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.989602 (+   527us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.054993  1763 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.057706  1470 rpcz_store.cc:276] 0709 12:57:50.876192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.882181 (+  5989us) service_pool.cc:224] Handling call
0709 12:57:51.965823 (+1083642us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47394,"reported_tablets":17}
I20260709 12:57:52.030220  1637 rpcz_store.cc:276] 0709 12:57:50.701640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.650006 (+948366us) service_pool.cc:224] Handling call
0709 12:57:51.662286 (+ 12280us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.662363 (+    77us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.780267 (+117904us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.975232 (+194965us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.009992 (+ 34760us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.001271  1555 rpcz_store.cc:276] 0709 12:57:50.653586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.532040 (+878454us) service_pool.cc:224] Handling call
0709 12:57:51.534890 (+  2850us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.535000 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.972610 (+437610us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:51.990413 (+ 17803us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:51.990996 (+   583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.059795  1761 raft_consensus.cc:385] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.069232  1784 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:52.052966  1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 37) took 1354 ms. Trace:
W20260709 12:57:52.025605  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 104901us
I20260709 12:57:52.074311  1762 tablet_bootstrap.cc:492] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:52.074914  1762 ts_tablet_manager.cc:1403] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.682s	user 0.013s	sys 0.025s
I20260709 12:57:52.077267  1630 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 38) took 1232 ms. Trace:
I20260709 12:57:52.077720  1630 rpcz_store.cc:276] 0709 12:57:50.844901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.770779 (+925878us) service_pool.cc:224] Handling call
0709 12:57:51.772896 (+  2117us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.773003 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.975078 (+202075us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:52.076646 (+101568us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.077192 (+   546us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.086792  1707 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60074 (request call id 29) took 1637 ms. Trace:
I20260709 12:57:52.087530  1763 ts_tablet_manager.cc:1434] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.132s	user 0.006s	sys 0.004s
I20260709 12:57:52.091666  1763 tablet_bootstrap.cc:492] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:52.071579  1562 rpcz_store.cc:276] 0709 12:57:50.698272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.533198 (+834926us) service_pool.cc:224] Handling call
0709 12:57:51.545312 (+ 12114us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.545426 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:52.028405 (+482979us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:52.052322 (+ 23917us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.052888 (+   566us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.101279  1704 tablet_service.cc:1511] Processing CreateTablet for tablet a2e78d031c384616a01064318cb24f28 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:57:52.102918  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e78d031c384616a01064318cb24f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.103093  1703 tablet_service.cc:1511] Processing CreateTablet for tablet 016c9143ad3147438e814f92f2090928 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:57:52.104434  1703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016c9143ad3147438e814f92f2090928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.104785  1709 tablet_service.cc:1511] Processing CreateTablet for tablet a6e5957876f24a868f3f2c49fcf5e759 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:57:52.101464  1637 tablet_service.cc:1511] Processing CreateTablet for tablet a6e5957876f24a868f3f2c49fcf5e759 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:57:52.106670  1789 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:52.106843  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e5957876f24a868f3f2c49fcf5e759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.106014  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e5957876f24a868f3f2c49fcf5e759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.065563  1761 raft_consensus.cc:740] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.118908  1761 consensus_queue.cc:260] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } }
I20260709 12:57:52.121486  1761 ts_tablet_manager.cc:1434] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.079s	user 0.004s	sys 0.001s
I20260709 12:57:52.125451  1762 raft_consensus.cc:359] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.126369  1762 raft_consensus.cc:385] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.126696  1762 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.127504  1762 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.087462  1707 rpcz_store.cc:276] 0709 12:57:50.449136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.015212 (+566076us) service_pool.cc:224] Handling call
0709 12:57:51.721643 (+706431us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22cc831 00007f18d22a9ac3 00007f18d2258400 00007f18cb6ddaf4 00007f18cb6dda82 00007f18cb6dd9b1
0709 12:57:51.721842 (+   199us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.721970 (+   128us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.924433 (+202463us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:52.071459 (+147026us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.086691 (+ 15232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40887552}
I20260709 12:57:52.141342  1557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 39) took 1304 ms. Trace:
I20260709 12:57:52.141534  1631 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 26) took 1682 ms. Trace:
I20260709 12:57:52.160408  1706 tablet_service.cc:1511] Processing CreateTablet for tablet 289133b3cbb949f4967bbf24c6b14e19 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:57:52.163900  1784 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.143872  1762 ts_tablet_manager.cc:1434] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.001s
I20260709 12:57:52.164625  1784 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.165536  1762 tablet_bootstrap.cc:492] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:52.165725  1560 tablet_service.cc:1511] Processing CreateTablet for tablet bfbaf6c33e5b45ea9c75342b1011f209 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:57:52.167165  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfbaf6c33e5b45ea9c75342b1011f209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.167035  1784 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:52.145100  1763 tablet_bootstrap.cc:654] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.141952  1631 rpcz_store.cc:276] 0709 12:57:50.459131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.156947 (+697816us) service_pool.cc:224] Handling call
0709 12:57:51.531000 (+374053us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800002d98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22cc831 00007f18d22a9ac3 00007f18d2258400 00007f18cb6ddaf4 00007f18cb6dda82 00007f18cb6dd9b1
0709 12:57:51.531231 (+   231us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.531372 (+   141us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:52.056027 (+524655us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:52.140972 (+ 84945us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.141460 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3385088}
I20260709 12:57:52.154351  1702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60074 (request call id 37) took 1361 ms. Trace:
I20260709 12:57:52.167621  1558 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 35) took 1599 ms. Trace:
I20260709 12:57:52.171876  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:52.171504  1702 rpcz_store.cc:276] 0709 12:57:50.793055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.359848 (+566793us) service_pool.cc:224] Handling call
0709 12:57:51.856037 (+496189us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.859763 (+  3726us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:52.047252 (+187489us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:52.133716 (+ 86464us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.154273 (+ 20557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.171671  1558 rpcz_store.cc:276] 0709 12:57:50.568609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.465561 (+896952us) service_pool.cc:224] Handling call
0709 12:57:51.481480 (+ 15919us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.481641 (+   161us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:52.051127 (+569486us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:52.167094 (+115967us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.167555 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.168751  1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289133b3cbb949f4967bbf24c6b14e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.173811  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:52.156291  1761 tablet_bootstrap.cc:492] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:52.175627  1556 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46620 (request call id 41) took 1106 ms. Trace:
I20260709 12:57:52.176060  1556 rpcz_store.cc:276] 0709 12:57:51.064546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.591852 (+527306us) service_pool.cc:224] Handling call
0709 12:57:51.594234 (+  2382us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.594378 (+   144us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:52.078328 (+483950us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:52.170177 (+ 91849us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.170640 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:52.178426  1536 leader_election.cc:343] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:52.179296  1536 leader_election.cc:343] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.179818  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:52.182965  1762 tablet_bootstrap.cc:654] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.184283  1784 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:52.184624  1634 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 39) took 1281 ms. Trace:
I20260709 12:57:52.185041  1634 rpcz_store.cc:276] 0709 12:57:50.903289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.897302 (+994013us) service_pool.cc:224] Handling call
0709 12:57:51.912362 (+ 15060us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.922903 (+ 10541us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:52.114612 (+191709us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:52.183993 (+ 69381us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.184551 (+   558us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.186442  1636 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36684 (request call id 40) took 1175 ms. Trace:
I20260709 12:57:52.194317  1636 rpcz_store.cc:276] 0709 12:57:51.011422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.914097 (+902675us) service_pool.cc:224] Handling call
0709 12:57:52.009674 (+ 95577us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:52.009788 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:52.137597 (+127809us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:52.161952 (+ 24355us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.186375 (+ 24423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.191444  1762 tablet_bootstrap.cc:492] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:52.195820  1762 ts_tablet_manager.cc:1403] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.002s
I20260709 12:57:52.196385  1761 tablet_bootstrap.cc:654] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.156046  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 289133b3cbb949f4967bbf24c6b14e19 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:57:52.141780  1557 rpcz_store.cc:276] 0709 12:57:50.837493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.561601 (+724108us) service_pool.cc:224] Handling call
0709 12:57:51.563674 (+  2073us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.563797 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.912998 (+349201us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:52.140839 (+227841us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.141280 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:52.158267  1632 tablet_service.cc:1511] Processing CreateTablet for tablet 289133b3cbb949f4967bbf24c6b14e19 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:57:52.199803  1762 raft_consensus.cc:359] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.201208  1762 raft_consensus.cc:385] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.201615  1762 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.202431  1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289133b3cbb949f4967bbf24c6b14e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.202600  1762 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.205312  1762 ts_tablet_manager.cc:1434] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:57:52.208257  1561 tablet_service.cc:1511] Processing CreateTablet for tablet e519a89ee28c45f98d4fe9c4bfea4baf (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:57:52.146903  1788 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.210459  1763 tablet_bootstrap.cc:492] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:52.211126  1763 ts_tablet_manager.cc:1403] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.120s	user 0.013s	sys 0.002s
I20260709 12:57:52.210757  1788 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.213914  1788 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:52.215374  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:57:52.217196  1611 leader_election.cc:343] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.202028  1629 tablet_service.cc:1511] Processing CreateTablet for tablet bfbaf6c33e5b45ea9c75342b1011f209 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:57:52.202821  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289133b3cbb949f4967bbf24c6b14e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.213793  1704 tablet_service.cc:1511] Processing CreateTablet for tablet bfbaf6c33e5b45ea9c75342b1011f209 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:57:52.220201  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfbaf6c33e5b45ea9c75342b1011f209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.220851  1709 tablet_service.cc:1511] Processing CreateTablet for tablet e519a89ee28c45f98d4fe9c4bfea4baf (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:57:52.222322  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e519a89ee28c45f98d4fe9c4bfea4baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.222491  1557 tablet_service.cc:1511] Processing CreateTablet for tablet 02b66b7be226499cbd9e020d381c72b2 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:57:52.223313  1762 tablet_bootstrap.cc:492] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:52.226328  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:52.228267  1612 leader_election.cc:343] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.228477  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 02b66b7be226499cbd9e020d381c72b2 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:57:52.228804  1612 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:52.229877  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b66b7be226499cbd9e020d381c72b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.230316  1788 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:52.224475  1637 tablet_service.cc:1511] Processing CreateTablet for tablet e519a89ee28c45f98d4fe9c4bfea4baf (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:57:52.233129  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e519a89ee28c45f98d4fe9c4bfea4baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.236560  1762 tablet_bootstrap.cc:654] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.240576  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b66b7be226499cbd9e020d381c72b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.251111  1761 tablet_bootstrap.cc:492] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:52.251679  1761 ts_tablet_manager.cc:1403] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.096s	user 0.006s	sys 0.015s
I20260709 12:57:52.224720  1763 raft_consensus.cc:359] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.254297  1763 raft_consensus.cc:385] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.254662  1763 raft_consensus.cc:740] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.250658  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e519a89ee28c45f98d4fe9c4bfea4baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.256085  1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfbaf6c33e5b45ea9c75342b1011f209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.257951  1761 raft_consensus.cc:359] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.258809  1761 raft_consensus.cc:385] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.258364  1763 consensus_queue.cc:260] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.261432  1704 tablet_service.cc:1511] Processing CreateTablet for tablet 02b66b7be226499cbd9e020d381c72b2 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:57:52.259142  1761 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.263154  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b66b7be226499cbd9e020d381c72b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.263360  1761 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.265961  1763 ts_tablet_manager.cc:1434] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.054s	user 0.003s	sys 0.005s
I20260709 12:57:52.267333  1763 tablet_bootstrap.cc:492] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:52.273708  1761 ts_tablet_manager.cc:1434] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:57:52.275086  1761 tablet_bootstrap.cc:492] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:52.276405  1560 tablet_service.cc:1511] Processing CreateTablet for tablet ac93f5a09723490eaf799683a1582480 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:57:52.277753  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac93f5a09723490eaf799683a1582480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.282836  1762 tablet_bootstrap.cc:492] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:52.283440  1762 ts_tablet_manager.cc:1403] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.001s
I20260709 12:57:52.287111  1762 raft_consensus.cc:359] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } }
I20260709 12:57:52.287923  1762 raft_consensus.cc:385] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.288249  1762 raft_consensus.cc:740] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.289049  1762 consensus_queue.cc:260] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } }
I20260709 12:57:52.303174  1761 tablet_bootstrap.cc:654] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.304342  1636 tablet_service.cc:1511] Processing CreateTablet for tablet ac93f5a09723490eaf799683a1582480 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:57:52.307188  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac93f5a09723490eaf799683a1582480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.307868  1762 ts_tablet_manager.cc:1434] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 12:57:52.308785  1763 tablet_bootstrap.cc:654] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.318570  1556 tablet_service.cc:1511] Processing CreateTablet for tablet 95165be2dd8c456fb98e088711372ce3 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:57:52.319321  1709 tablet_service.cc:1511] Processing CreateTablet for tablet ac93f5a09723490eaf799683a1582480 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:57:52.320767  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac93f5a09723490eaf799683a1582480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.324373  1556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95165be2dd8c456fb98e088711372ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.325874  1631 tablet_service.cc:1511] Processing CreateTablet for tablet 95165be2dd8c456fb98e088711372ce3 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:57:52.327494  1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95165be2dd8c456fb98e088711372ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.335216  1762 tablet_bootstrap.cc:492] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:52.347671  1762 tablet_bootstrap.cc:654] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.353267  1706 tablet_service.cc:1511] Processing CreateTablet for tablet 95165be2dd8c456fb98e088711372ce3 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:57:52.354929  1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95165be2dd8c456fb98e088711372ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.358978  1763 tablet_bootstrap.cc:492] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:52.359695  1763 ts_tablet_manager.cc:1403] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.093s	user 0.035s	sys 0.018s
I20260709 12:57:52.363480  1763 raft_consensus.cc:359] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } }
I20260709 12:57:52.365895  1557 tablet_service.cc:1511] Processing CreateTablet for tablet 36a0e244d11c4ffe96ee4a663e2c69c8 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:57:52.367764  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a0e244d11c4ffe96ee4a663e2c69c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.375398  1629 tablet_service.cc:1511] Processing CreateTablet for tablet 36a0e244d11c4ffe96ee4a663e2c69c8 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:57:52.378860  1761 tablet_bootstrap.cc:492] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:52.392314  1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a0e244d11c4ffe96ee4a663e2c69c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.364424  1763 raft_consensus.cc:385] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.384497  1762 tablet_bootstrap.cc:492] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:52.385542  1787 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.393357  1763 raft_consensus.cc:740] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.394042  1787 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } }
I20260709 12:57:52.394618  1763 consensus_queue.cc:260] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } }
I20260709 12:57:52.396531  1787 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:52.397446  1763 ts_tablet_manager.cc:1434] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:57:52.397655  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:52.398305  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:52.398444  1572 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:52.398722  1763 tablet_bootstrap.cc:492] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:52.399745  1646 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:52.400597  1686 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:52.401494  1762 ts_tablet_manager.cc:1403] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.004s
I20260709 12:57:52.402925  1557 tablet_service.cc:1511] Processing CreateTablet for tablet a057e47a0fca4295957540c192996970 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:57:52.386637  1704 tablet_service.cc:1511] Processing CreateTablet for tablet 36a0e244d11c4ffe96ee4a663e2c69c8 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:57:52.404363  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a057e47a0fca4295957540c192996970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.404666  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a0e244d11c4ffe96ee4a663e2c69c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.392084  1761 ts_tablet_manager.cc:1403] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.003s
I20260709 12:57:52.407759  1787 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:52.408201  1787 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.408592  1787 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.409134  1761 raft_consensus.cc:359] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.413822  1788 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.414491  1788 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.416394  1761 raft_consensus.cc:385] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.416548  1762 raft_consensus.cc:359] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.417325  1762 raft_consensus.cc:385] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.417028  1761 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.417634  1762 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.419857  1761 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.424985  1788 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:52.418948  1762 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.425683  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:52.436086  1762 ts_tablet_manager.cc:1434] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.005s
W20260709 12:57:52.437350  1612 leader_election.cc:343] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.426151  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:52.438388  1721 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:52.439954  1611 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:57:52.440747  1788 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:52.441174  1788 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.441569  1788 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.427673  1636 tablet_service.cc:1511] Processing CreateTablet for tablet a057e47a0fca4295957540c192996970 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:57:52.431396  1706 tablet_service.cc:1511] Processing CreateTablet for tablet a057e47a0fca4295957540c192996970 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:57:52.443434  1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a057e47a0fca4295957540c192996970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.446535  1761 ts_tablet_manager.cc:1434] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.006s
I20260709 12:57:52.448558  1761 tablet_bootstrap.cc:492] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:52.432164  1763 tablet_bootstrap.cc:654] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.449813  1788 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.453361  1788 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:52.454540  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:52.455051  1762 tablet_bootstrap.cc:492] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
W20260709 12:57:52.456103  1612 leader_election.cc:343] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.457679  1761 tablet_bootstrap.cc:654] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.459770  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:52.460397  1721 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.465096  1762 tablet_bootstrap.cc:654] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.466856  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a057e47a0fca4295957540c192996970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.470577  1761 tablet_bootstrap.cc:492] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:52.471217  1761 ts_tablet_manager.cc:1403] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.011s
I20260709 12:57:52.472837  1721 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:57:52.474102  1611 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:57:52.475124  1761 raft_consensus.cc:359] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:52.475734  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08001199c0 after lost signal to thread 434
I20260709 12:57:52.476851  1761 raft_consensus.cc:385] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.477205  1761 raft_consensus.cc:740] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
W20260709 12:57:52.477680  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08001180e0 after lost signal to thread 1504
I20260709 12:57:52.477993  1761 consensus_queue.cc:260] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:52.479040  1593 debug-util.cc:398] Leaking SignalData structure 0x7b0800099ca0 after lost signal to thread 1596
W20260709 12:57:52.480624  1593 debug-util.cc:398] Leaking SignalData structure 0x7b080020c5a0 after lost signal to thread 1671
W20260709 12:57:52.481946  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08001437a0 after lost signal to thread 1745
I20260709 12:57:52.485812  1788 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:52.486789  1788 raft_consensus.cc:697] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:57:52.487913  1788 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.492945  1761 ts_tablet_manager.cc:1434] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:57:52.500386  1761 tablet_bootstrap.cc:492] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:52.493953  1557 tablet_service.cc:1511] Processing CreateTablet for tablet 59f8a3d26bbd4c18a7d64b7584debff6 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:57:52.503696  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f8a3d26bbd4c18a7d64b7584debff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.504791  1629 tablet_service.cc:1511] Processing CreateTablet for tablet 59f8a3d26bbd4c18a7d64b7584debff6 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:57:52.506186  1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f8a3d26bbd4c18a7d64b7584debff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.510390  1784 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.510959  1784 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.496791  1787 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } }
I20260709 12:57:52.498602  1763 tablet_bootstrap.cc:492] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:52.521510  1763 ts_tablet_manager.cc:1403] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.012s
I20260709 12:57:52.522907  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:52.523613  1646 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:52.523725  1704 tablet_service.cc:1511] Processing CreateTablet for tablet 59f8a3d26bbd4c18a7d64b7584debff6 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:57:52.525007  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f8a3d26bbd4c18a7d64b7584debff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.525139  1536 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:52.525585  1761 tablet_bootstrap.cc:654] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.527752  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:52.528411  1572 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.528039  1556 tablet_service.cc:1511] Processing CreateTablet for tablet 681b2518696f44d99824827761c9c9f1 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:57:52.524870  1763 raft_consensus.cc:359] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.534224  1784 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:52.529309  1763 raft_consensus.cc:385] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.535034  1763 raft_consensus.cc:740] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.535989  1763 consensus_queue.cc:260] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.538147  1787 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:52.538903  1556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681b2518696f44d99824827761c9c9f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.540091  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:52.540705  1646 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.542572  1784 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:52.542739  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:52.543005  1784 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.543392  1784 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:52.544375  1536 leader_election.cc:343] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:52.550179  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:52.556559  1709 tablet_service.cc:1511] Processing CreateTablet for tablet 681b2518696f44d99824827761c9c9f1 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:57:52.558090  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681b2518696f44d99824827761c9c9f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.558557  1646 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:52.560159  1685 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:52.561146  1787 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:52.561908  1787 raft_consensus.cc:697] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:57:52.562688  1763 ts_tablet_manager.cc:1434] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.005s
I20260709 12:57:52.562906  1787 consensus_queue.cc:237] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } }
I20260709 12:57:52.568055  1763 tablet_bootstrap.cc:492] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:52.561697  1784 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.572664  1762 tablet_bootstrap.cc:492] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:52.574301  1761 tablet_bootstrap.cc:492] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:52.580088  1762 ts_tablet_manager.cc:1403] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.125s	user 0.022s	sys 0.009s
I20260709 12:57:52.580180  1761 ts_tablet_manager.cc:1403] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.006s
I20260709 12:57:52.583428  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:52.584091  1646 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.584295  1761 raft_consensus.cc:359] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.584699  1762 raft_consensus.cc:359] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.577744  1801 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.579002  1629 tablet_service.cc:1511] Processing CreateTablet for tablet 681b2518696f44d99824827761c9c9f1 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:57:52.578305  1572 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:52.586439  1629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681b2518696f44d99824827761c9c9f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.586731  1762 raft_consensus.cc:385] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.587056  1762 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.586221  1801 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.588081  1557 tablet_service.cc:1511] Processing CreateTablet for tablet b47cff236bac4d2fae5f94a61502aec7 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:57:52.589349  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b47cff236bac4d2fae5f94a61502aec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.589466  1784 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:52.590868  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:52.592590  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:57:52.593829  1536 leader_election.cc:343] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.587797  1762 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.596169  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:52.596508  1763 tablet_bootstrap.cc:654] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:52.597743  1536 leader_election.cc:343] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.598269  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:52.599339  1784 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:52.599413  1801 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:52.600371  1646 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:52.601732  1536 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:52.596457  1762 ts_tablet_manager.cc:1434] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:57:52.602744  1801 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:52.603354  1801 raft_consensus.cc:697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:52.604128  1762 tablet_bootstrap.cc:492] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:52.604261  1801 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.585090  1761 raft_consensus.cc:385] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.615679  1636 tablet_service.cc:1511] Processing CreateTablet for tablet b47cff236bac4d2fae5f94a61502aec7 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:57:52.607954  1761 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.618242  1761 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.619328  1721 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.617653  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b47cff236bac4d2fae5f94a61502aec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.624913  1709 tablet_service.cc:1511] Processing CreateTablet for tablet b47cff236bac4d2fae5f94a61502aec7 (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:57:52.626929  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b47cff236bac4d2fae5f94a61502aec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.627832  1631 tablet_service.cc:1511] Processing CreateTablet for tablet 72ddc5b6631d45ffb9776db2cc41447d (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:57:52.629846  1631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72ddc5b6631d45ffb9776db2cc41447d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.620813  1468 catalog_manager.cc:5697] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:52.641731  1470 catalog_manager.cc:5697] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:52.642488  1721 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:52.645848  1557 tablet_service.cc:1511] Processing CreateTablet for tablet 72ddc5b6631d45ffb9776db2cc41447d (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:57:52.652244  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72ddc5b6631d45ffb9776db2cc41447d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.654022  1762 tablet_bootstrap.cc:654] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.654420  1788 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.655079  1788 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.657949  1787 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.659339  1788 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:52.661496  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:52.662443  1572 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:57:52.664343  1761 ts_tablet_manager.cc:1434] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.084s	user 0.010s	sys 0.000s
I20260709 12:57:52.665467  1761 tablet_bootstrap.cc:492] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:52.667030  1787 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.667729  1704 tablet_service.cc:1511] Processing CreateTablet for tablet 72ddc5b6631d45ffb9776db2cc41447d (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:57:52.669005  1704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72ddc5b6631d45ffb9776db2cc41447d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.671584  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:52.672438  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:52.673115  1646 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
W20260709 12:57:52.673275  1686 leader_election.cc:343] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.669888  1787 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:52.674551  1685 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:57:52.676455  1787 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:52.678234  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:52.680819  1721 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 1: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:57:52.679919  1787 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.682145  1787 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.682271  1611 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:52.683557  1788 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.685357  1636 tablet_service.cc:1511] Processing CreateTablet for tablet 681214f01c5b4fc6a0aa493b2382c01f (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:57:52.686643  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681214f01c5b4fc6a0aa493b2382c01f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.690577  1763 tablet_bootstrap.cc:492] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:52.691196  1763 ts_tablet_manager.cc:1403] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.123s	user 0.019s	sys 0.017s
I20260709 12:57:52.693249  1706 tablet_service.cc:1511] Processing CreateTablet for tablet 681214f01c5b4fc6a0aa493b2382c01f (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:57:52.693879  1788 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:52.694806  1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681214f01c5b4fc6a0aa493b2382c01f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.704466  1557 tablet_service.cc:1511] Processing CreateTablet for tablet 681214f01c5b4fc6a0aa493b2382c01f (DEFAULT_TABLE table=test-workload [id=459c0b6405d34fddb511baae1d126fe5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:57:52.704854  1787 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.705854  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681214f01c5b4fc6a0aa493b2382c01f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.710959  1761 tablet_bootstrap.cc:654] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.717407  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:57:52.719336  1686 leader_election.cc:343] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.722188  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:52.737589  1646 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.706781  1763 raft_consensus.cc:359] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.738833  1763 raft_consensus.cc:385] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.739212  1763 raft_consensus.cc:740] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.726624  1787 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:52.740839  1762 tablet_bootstrap.cc:492] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:52.741367  1762 ts_tablet_manager.cc:1403] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.137s	user 0.008s	sys 0.019s
I20260709 12:57:52.741236  1763 consensus_queue.cc:260] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.744596  1761 tablet_bootstrap.cc:492] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:52.745157  1761 ts_tablet_manager.cc:1403] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.000s
I20260709 12:57:52.748329  1646 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:52.748629  1761 raft_consensus.cc:359] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.749410  1761 raft_consensus.cc:385] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.750340  1685 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:57:52.749755  1761 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.751680  1787 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:52.752521  1787 raft_consensus.cc:697] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:57:52.753037  1763 ts_tablet_manager.cc:1434] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.062s	user 0.011s	sys 0.003s
I20260709 12:57:52.754518  1763 tablet_bootstrap.cc:492] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:52.751713  1761 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.753692  1787 consensus_queue.cc:237] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.745904  1762 raft_consensus.cc:359] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.759879  1762 raft_consensus.cc:385] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.760321  1762 raft_consensus.cc:740] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.762347  1761 ts_tablet_manager.cc:1434] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 12:57:52.763662  1761 tablet_bootstrap.cc:492] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:52.764259  1763 tablet_bootstrap.cc:654] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.761168  1762 consensus_queue.cc:260] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.775138  1762 ts_tablet_manager.cc:1434] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.003s
I20260709 12:57:52.777382  1761 tablet_bootstrap.cc:654] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.781682  1762 tablet_bootstrap.cc:492] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:52.799227  1763 tablet_bootstrap.cc:492] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:52.799873  1763 ts_tablet_manager.cc:1403] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.035s
I20260709 12:57:52.800370  1762 tablet_bootstrap.cc:654] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.804032  1763 raft_consensus.cc:359] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.805102  1763 raft_consensus.cc:385] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.805465  1763 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.806494  1763 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.798596  1469 catalog_manager.cc:5697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:52.810042  1763 ts_tablet_manager.cc:1434] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:57:52.811512  1763 tablet_bootstrap.cc:492] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:52.817912  1787 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.818706  1787 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.820436  1763 tablet_bootstrap.cc:654] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.822516  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:52.823297  1572 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:52.825023  1686 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:52.826097  1772 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:52.826489  1772 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.826845  1772 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.836148  1763 tablet_bootstrap.cc:492] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:52.836242  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:52.837083  1763 ts_tablet_manager.cc:1403] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.002s
W20260709 12:57:52.838452  1685 leader_election.cc:343] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.839248  1787 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:52.846405  1763 raft_consensus.cc:359] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.847244  1763 raft_consensus.cc:385] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.847527  1763 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.848510  1763 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.851692  1763 ts_tablet_manager.cc:1434] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:57:52.852845  1763 tablet_bootstrap.cc:492] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:52.853884  1772 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.855406  1468 catalog_manager.cc:5697] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:52.874670  1763 tablet_bootstrap.cc:654] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.880084  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:52.880884  1572 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.892385  1572 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:52.893559  1763 tablet_bootstrap.cc:492] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:52.899315  1571 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.900094  1763 ts_tablet_manager.cc:1403] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.007s
I20260709 12:57:52.895040  1772 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:52.896622  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:52.902503  1788 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.903223  1788 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.905010  1686 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:52.906101  1788 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:52.909032  1763 raft_consensus.cc:359] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.909996  1763 raft_consensus.cc:385] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.910360  1763 raft_consensus.cc:740] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
W20260709 12:57:52.911597  1685 leader_election.cc:343] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.911257  1763 consensus_queue.cc:260] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.913019  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:52.914564  1763 ts_tablet_manager.cc:1434] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
W20260709 12:57:52.915755  1611 leader_election.cc:343] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.916561  1763 tablet_bootstrap.cc:492] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:52.917263  1762 tablet_bootstrap.cc:492] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:52.917739  1762 ts_tablet_manager.cc:1403] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.136s	user 0.044s	sys 0.056s
I20260709 12:57:52.920756  1762 raft_consensus.cc:359] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.897051  1787 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.922080  1787 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.924659  1763 tablet_bootstrap.cc:654] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.926105  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:52.926950  1570 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:52.928592  1686 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:52.921502  1762 raft_consensus.cc:385] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.932691  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:52.933216  1762 raft_consensus.cc:740] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.933454  1646 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:52.934916  1787 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:52.936051  1787 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:52.936662  1787 raft_consensus.cc:697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:57:52.937769  1787 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.939143  1762 consensus_queue.cc:260] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.945753  1762 ts_tablet_manager.cc:1434] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 12:57:52.947314  1762 tablet_bootstrap.cc:492] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:52.939167  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:52.942006  1763 tablet_bootstrap.cc:492] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:52.942737  1772 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:52.948872  1763 ts_tablet_manager.cc:1403] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.013s
I20260709 12:57:52.949548  1772 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.950565  1788 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:52.948494  1801 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.952466  1801 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:52.955060  1612 leader_election.cc:343] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.955785  1612 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:52.957063  1788 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:52.961854  1801 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:52.963557  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:52.965358  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:52.965529  1646 raft_consensus.cc:2393] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 1: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:57:52.953841  1772 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.967887  1536 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:52.968789  1788 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.969493  1788 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.972914  1762 tablet_bootstrap.cc:654] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.975052  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:57:52.977830  1611 leader_election.cc:343] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.978456  1788 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:52.978695  1801 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.980093  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:52.979540  1763 raft_consensus.cc:359] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.981295  1763 raft_consensus.cc:385] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.981714  1763 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.983136  1763 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:52.981068  1571 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:52.989702  1612 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:52.992487  1763 ts_tablet_manager.cc:1434] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 12:57:52.991539  1468 catalog_manager.cc:5697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:52.993641  1763 tablet_bootstrap.cc:492] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:52.994380  1788 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:52.994788  1788 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.995132  1788 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.003525  1761 tablet_bootstrap.cc:492] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:53.004106  1761 ts_tablet_manager.cc:1403] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.241s	user 0.014s	sys 0.023s
I20260709 12:57:53.007256  1761 raft_consensus.cc:359] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.008073  1761 raft_consensus.cc:385] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.008368  1761 raft_consensus.cc:740] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.009101  1761 consensus_queue.cc:260] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.010480  1763 tablet_bootstrap.cc:654] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.016167  1761 ts_tablet_manager.cc:1434] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:57:53.020519  1801 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:53.026561  1784 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.021710  1761 tablet_bootstrap.cc:492] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:53.021188  1821 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:57:53.027349  1784 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.034727  1784 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.036957  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:53.039143  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:53.040048  1646 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:53.043646  1762 tablet_bootstrap.cc:492] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:53.044152  1762 ts_tablet_manager.cc:1403] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.097s	user 0.016s	sys 0.006s
I20260709 12:57:53.044991  1772 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.042414  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:53.050104  1784 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:53.055203  1784 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.055826  1784 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.057770  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:53.058702  1647 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.063812  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:53.064476  1571 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.064867  1772 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:57:53.050258  1536 leader_election.cc:343] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.069118  1762 raft_consensus.cc:359] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.060789  1788 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.070611  1762 raft_consensus.cc:385] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.071118  1762 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.072221  1762 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.082917  1647 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:53.079361  1762 ts_tablet_manager.cc:1434] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 12:57:53.085213  1762 tablet_bootstrap.cc:492] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:53.085875  1685 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:53.087734  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:53.088240  1772 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:53.089200  1772 raft_consensus.cc:697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:57:53.089617  1788 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.090168  1772 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:53.093147  1611 leader_election.cc:343] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.097263  1763 tablet_bootstrap.cc:492] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:53.097846  1763 ts_tablet_manager.cc:1403] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.104s	user 0.014s	sys 0.006s
I20260709 12:57:53.097651  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:53.098361  1572 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.104115  1761 tablet_bootstrap.cc:654] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.105167  1821 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.106648  1571 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:53.109375  1763 raft_consensus.cc:359] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.110170  1763 raft_consensus.cc:385] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.110442  1763 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.085770  1784 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.114702  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:53.115381  1647 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.118685  1763 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.123507  1763 ts_tablet_manager.cc:1434] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.006s
I20260709 12:57:53.118878  1788 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:53.127295  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:53.125164  1784 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:57:53.129029  1536 leader_election.cc:343] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.133380  1762 tablet_bootstrap.cc:654] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.138134  1763 tablet_bootstrap.cc:492] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:53.137813  1784 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.145743  1784 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.148691  1784 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.153754  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:53.154304  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:53.154712  1645 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:53.159655  1784 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:53.141811  1572 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
W20260709 12:57:53.174846  1536 leader_election.cc:343] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.175244  1762 tablet_bootstrap.cc:492] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:53.175771  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:53.175791  1762 ts_tablet_manager.cc:1403] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.003s
I20260709 12:57:53.175763  1829 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.180419  1829 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.182487  1761 tablet_bootstrap.cc:492] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:53.183492  1761 ts_tablet_manager.cc:1403] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.162s	user 0.026s	sys 0.007s
I20260709 12:57:53.184315  1762 raft_consensus.cc:359] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.184731  1829 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.185101  1762 raft_consensus.cc:385] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.185418  1762 raft_consensus.cc:740] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.186233  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:53.190526  1762 consensus_queue.cc:260] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.178211  1784 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:57:53.192698  1611 leader_election.cc:343] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.196796  1470 catalog_manager.cc:5697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:53.192188  1784 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.197628  1647 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:53.198828  1784 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.198945  1788 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.209492  1612 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:53.210784  1829 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:53.211346  1829 raft_consensus.cc:697] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:57:53.211083  1788 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.212255  1829 consensus_queue.cc:237] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.213474  1788 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.221109  1762 ts_tablet_manager.cc:1434] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 12:57:53.222317  1762 tablet_bootstrap.cc:492] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:53.222981  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:53.223372  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:53.225718  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:53.226488  1801 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:53.227236  1572 raft_consensus.cc:2393] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 1: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:57:53.227797  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:53.234706  1821 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:53.234933  1612 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:57:53.236641  1612 leader_election.cc:343] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.237498  1788 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.238646  1800 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:53.241438  1763 tablet_bootstrap.cc:654] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.242331  1612 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:53.254552  1789 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:53.247449  1801 raft_consensus.cc:697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:53.256704  1821 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:53.257732  1801 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.258836  1761 raft_consensus.cc:359] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.259425  1763 tablet_bootstrap.cc:492] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:53.262759  1788 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:53.271860  1763 ts_tablet_manager.cc:1403] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.134s	user 0.018s	sys 0.000s
I20260709 12:57:53.271492  1761 raft_consensus.cc:385] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.279738  1761 raft_consensus.cc:740] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.272634  1762 tablet_bootstrap.cc:654] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.263507  1784 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.281243  1761 consensus_queue.cc:260] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.275738  1468 catalog_manager.cc:5697] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.283030  1763 raft_consensus.cc:359] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.286522  1763 raft_consensus.cc:385] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.286852  1763 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.287544  1761 ts_tablet_manager.cc:1434] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.003s
I20260709 12:57:53.287554  1763 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.294386  1763 ts_tablet_manager.cc:1434] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:57:53.302248  1784 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.303673  1761 tablet_bootstrap.cc:492] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:53.305172  1763 tablet_bootstrap.cc:492] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:53.306480  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:53.324134  1787 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.324920  1787 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:53.327713  1536 leader_election.cc:343] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.326589  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:53.330114  1646 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.331188  1787 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:53.331774  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:53.333866  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:53.334565  1470 catalog_manager.cc:5697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.335734  1572 raft_consensus.cc:2393] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 1: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:57:53.342398  1686 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:53.343713  1787 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.342331  1646 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:53.357085  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:53.358400  1801 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:53.359005  1801 raft_consensus.cc:697] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:53.360060  1801 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.362989  1847 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.364727  1761 tablet_bootstrap.cc:654] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.363529  1847 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.384279  1847 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:53.385290  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:53.386155  1572 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:53.387778  1686 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:53.393002  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:53.393801  1645 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:53.405649  1847 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:57:53.411262  1762 tablet_bootstrap.cc:492] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:53.412830  1762 ts_tablet_manager.cc:1403] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.191s	user 0.021s	sys 0.015s
I20260709 12:57:53.414928  1787 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:53.416293  1763 tablet_bootstrap.cc:654] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.416198  1762 raft_consensus.cc:359] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.416921  1762 raft_consensus.cc:385] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.417162  1762 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.398401  1821 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:53.418907  1762 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.417783  1821 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.420137  1821 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.423605  1847 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.428520  1762 ts_tablet_manager.cc:1434] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:57:53.429625  1762 tablet_bootstrap.cc:492] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:53.432315  1761 tablet_bootstrap.cc:492] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:53.432762  1761 ts_tablet_manager.cc:1403] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.022s
I20260709 12:57:53.437856  1468 catalog_manager.cc:5697] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.441962  1761 raft_consensus.cc:359] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.442749  1761 raft_consensus.cc:385] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.443096  1761 raft_consensus.cc:740] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.443706  1761 consensus_queue.cc:260] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.451833  1763 tablet_bootstrap.cc:492] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:53.452165  1761 ts_tablet_manager.cc:1434] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 12:57:53.452407  1763 ts_tablet_manager.cc:1403] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.147s	user 0.014s	sys 0.016s
I20260709 12:57:53.453246  1761 tablet_bootstrap.cc:492] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:53.459612  1821 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.461833  1821 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:53.463613  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:53.474520  1647 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.476322  1761 tablet_bootstrap.cc:654] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.465310  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:53.466856  1763 raft_consensus.cc:359] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.472321  1762 tablet_bootstrap.cc:654] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.482411  1763 raft_consensus.cc:385] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.483325  1571 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.483645  1763 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.484509  1763 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.486764  1763 ts_tablet_manager.cc:1434] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.004s
I20260709 12:57:53.487877  1763 tablet_bootstrap.cc:492] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:53.489732  1761 tablet_bootstrap.cc:492] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:53.490346  1761 ts_tablet_manager.cc:1403] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.002s
I20260709 12:57:53.493949  1761 raft_consensus.cc:359] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.494760  1761 raft_consensus.cc:385] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.495035  1761 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.496001  1571 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:53.497396  1686 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:53.501519  1821 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:53.503012  1761 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.504040  1821 raft_consensus.cc:697] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:57:53.507274  1761 ts_tablet_manager.cc:1434] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:57:53.508482  1761 tablet_bootstrap.cc:492] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:53.512275  1647 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:53.518214  1762 tablet_bootstrap.cc:492] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:53.518864  1762 ts_tablet_manager.cc:1403] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.090s	user 0.021s	sys 0.006s
I20260709 12:57:53.519207  1821 consensus_queue.cc:237] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.521903  1787 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:53.523010  1763 tablet_bootstrap.cc:654] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.527890  1761 tablet_bootstrap.cc:654] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.522006  1762 raft_consensus.cc:359] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.530274  1762 raft_consensus.cc:385] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.530617  1762 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.531390  1762 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.533033  1787 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:53.534024  1762 ts_tablet_manager.cc:1434] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 12:57:53.535173  1762 tablet_bootstrap.cc:492] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
W20260709 12:57:53.555658  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:53.563858  1761 tablet_bootstrap.cc:492] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:53.564149  1762 tablet_bootstrap.cc:654] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.564437  1761 ts_tablet_manager.cc:1403] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.004s
I20260709 12:57:53.570844  1761 raft_consensus.cc:359] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.571890  1761 raft_consensus.cc:385] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.572238  1761 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.573127  1761 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.576610  1761 ts_tablet_manager.cc:1434] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:57:53.577811  1761 tablet_bootstrap.cc:492] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:53.581084  1763 tablet_bootstrap.cc:492] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:53.581825  1763 ts_tablet_manager.cc:1403] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.094s	user 0.025s	sys 0.008s
I20260709 12:57:53.583726  1801 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.584280  1801 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.587428  1801 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.590541  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:53.590723  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:53.591391  1721 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:53.591391  1647 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:53.593127  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:53.595465  1801 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:53.596064  1801 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.596597  1801 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.608314  1763 raft_consensus.cc:359] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.609189  1763 raft_consensus.cc:385] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.609457  1763 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.611896  1763 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.613758  1784 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.614253  1784 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.616405  1763 ts_tablet_manager.cc:1434] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 12:57:53.617328  1784 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.619643  1763 tablet_bootstrap.cc:492] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:53.619704  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:53.620800  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:53.621444  1721 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:53.620846  1647 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:53.623157  1761 tablet_bootstrap.cc:654] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.624148  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:53.625284  1784 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:53.625738  1784 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.626106  1784 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.627074  1789 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.627575  1789 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.637094  1468 catalog_manager.cc:5697] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:53.643656  1801 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.644248  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:53.645869  1762 tablet_bootstrap.cc:492] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:53.645941  1801 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.646612  1762 ts_tablet_manager.cc:1403] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.112s	user 0.021s	sys 0.008s
W20260709 12:57:53.648964  1611 leader_election.cc:343] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.650148  1762 raft_consensus.cc:359] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.650749  1762 raft_consensus.cc:385] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.651146  1762 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.651798  1762 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.655405  1762 ts_tablet_manager.cc:1434] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:57:53.656366  1762 tablet_bootstrap.cc:492] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:53.657799  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:53.658455  1647 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.659529  1821 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.660030  1821 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.661669  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:53.662273  1720 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.663923  1821 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:53.664595  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:53.665563  1645 raft_consensus.cc:2393] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:57:53.667347  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:53.669354  1612 leader_election.cc:343] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.669865  1612 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:53.671962  1762 tablet_bootstrap.cc:654] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.672282  1829 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:53.674696  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:53.677181  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:53.678083  1821 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.647512  1789 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.679075  1720 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:53.683743  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:53.686013  1801 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:53.687675  1801 raft_consensus.cc:697] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:53.688930  1801 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.692795  1784 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.695405  1647 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:53.700898  1821 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:53.704479  1761 tablet_bootstrap.cc:492] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:53.705073  1761 ts_tablet_manager.cc:1403] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.011s
I20260709 12:57:53.710427  1821 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.711122  1821 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.713200  1763 tablet_bootstrap.cc:654] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.713543  1761 raft_consensus.cc:359] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.714373  1761 raft_consensus.cc:385] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.714599  1761 raft_consensus.cc:740] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.715224  1761 consensus_queue.cc:260] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.716384  1821 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:53.716739  1784 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.715960  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:53.718410  1761 ts_tablet_manager.cc:1434] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 12:57:53.718570  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:53.722995  1761 tablet_bootstrap.cc:492] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:53.726037  1647 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:57:53.727716  1685 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:53.729965  1787 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.731644  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:53.732368  1647 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.732349  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:53.733145  1720 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:53.742195  1787 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:53.749491  1762 tablet_bootstrap.cc:492] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:53.749837  1761 tablet_bootstrap.cc:654] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.750077  1762 ts_tablet_manager.cc:1403] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.094s	user 0.023s	sys 0.018s
I20260709 12:57:53.750691  1763 tablet_bootstrap.cc:492] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:53.762970  1763 ts_tablet_manager.cc:1403] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.144s	user 0.008s	sys 0.017s
I20260709 12:57:53.753391  1762 raft_consensus.cc:359] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.766870  1762 raft_consensus.cc:385] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.746730  1720 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:57:53.751631  1468 catalog_manager.cc:5697] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.754297  1784 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:57:53.768499  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:53.767205  1762 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.769649  1784 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:53.770386  1784 raft_consensus.cc:697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:53.771339  1784 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.773345  1762 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.779521  1762 ts_tablet_manager.cc:1434] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.003s
I20260709 12:57:53.780946  1762 tablet_bootstrap.cc:492] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:53.784827  1789 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.785640  1789 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.757853  1647 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:57:53.791494  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:53.791788  1789 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.792260  1570 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:53.793931  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:53.796859  1829 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:53.797331  1763 raft_consensus.cc:359] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.798238  1763 raft_consensus.cc:385] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.798535  1763 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.798667  1801 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.799211  1801 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.799455  1763 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.797353  1829 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.801069  1829 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.801621  1801 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.801972  1763 ts_tablet_manager.cc:1434] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:57:53.804595  1763 tablet_bootstrap.cc:492] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:53.811650  1468 catalog_manager.cc:5697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 2, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.813688  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:53.813690  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:53.805820  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:57:53.820448  1536 leader_election.cc:343] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:53.825754  1611 leader_election.cc:343] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.828931  1647 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:53.829816  1784 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.823971  1788 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:57:53.836905  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:53.838712  1784 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:53.839030  1788 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.839285  1784 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.843693  1784 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.852818  1762 tablet_bootstrap.cc:654] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.856891  1788 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.852876  1800 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:57:53.857442  1788 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.867491  1788 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.868693  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:53.869007  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:53.871682  1611 leader_election.cc:343] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.875347  1763 tablet_bootstrap.cc:654] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.879786  1801 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:57:53.869685  1572 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:53.821624  1829 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.891896  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:53.920717  1784 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.918977  1789 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:53.928018  1789 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.931145  1789 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.952593  1784 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:53.954231  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:53.956835  1829 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:57:53.957118  1536 leader_election.cc:343] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.957630  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:53.959513  1761 tablet_bootstrap.cc:492] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
W20260709 12:57:53.959877  1611 leader_election.cc:343] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.960055  1761 ts_tablet_manager.cc:1403] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.237s	user 0.024s	sys 0.050s
I20260709 12:57:53.984002  1761 raft_consensus.cc:359] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.988883  1761 raft_consensus.cc:385] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.989252  1761 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.990682  1761 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:53.994587  1761 ts_tablet_manager.cc:1434] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 12:57:53.997061  1761 tablet_bootstrap.cc:492] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:54.016914  1763 tablet_bootstrap.cc:492] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:54.016772  1762 tablet_bootstrap.cc:492] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:54.017629  1763 ts_tablet_manager.cc:1403] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.215s	user 0.022s	sys 0.014s
I20260709 12:57:54.017745  1762 ts_tablet_manager.cc:1403] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.237s	user 0.019s	sys 0.009s
W20260709 12:57:54.018174  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 82194.3us
I20260709 12:57:54.022472  1787 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.023481  1787 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.024121  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:54.025357  1570 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:54.027235  1789 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.027923  1787 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:54.028475  1761 tablet_bootstrap.cc:654] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:54.029616  1789 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:54.030128  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:54.032289  1686 leader_election.cc:343] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:54.033550  1762 raft_consensus.cc:359] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.034233  1762 raft_consensus.cc:385] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:54.034523  1762 raft_consensus.cc:740] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:54.034725  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:57:54.036095  1611 leader_election.cc:343] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:54.035537  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:54.036999  1645 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:54.036697  1763 raft_consensus.cc:359] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.037977  1763 raft_consensus.cc:385] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:54.038349  1762 consensus_queue.cc:260] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.043541  1762 ts_tablet_manager.cc:1434] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 12:57:54.044539  1762 tablet_bootstrap.cc:492] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:54.046623  1570 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
W20260709 12:57:54.039178  1598 tablet.cc:2406] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:57:54.039776  1763 raft_consensus.cc:740] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:54.050307  1763 consensus_queue.cc:260] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.053658  1763 ts_tablet_manager.cc:1434] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.003s
I20260709 12:57:54.059303  1645 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:54.084327  1763 tablet_bootstrap.cc:492] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:54.104799  1762 tablet_bootstrap.cc:654] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:54.114017  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:54.115263  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:54.116042  1645 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:54.117050  1829 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:54.117571  1829 raft_consensus.cc:697] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:57:54.118511  1829 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.124706  1685 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:57:54.125730  1787 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:54.126156  1787 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.126528  1787 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:54.133008  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:54.134223  1789 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.134789  1789 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.138000  1787 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.138382  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:54.138955  1789 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:54.142553  1784 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:54.143908  1761 tablet_bootstrap.cc:492] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:54.145809  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:54.146471  1570 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:54.147131  1611 leader_election.cc:343] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:54.147737  1761 ts_tablet_manager.cc:1403] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.149s	user 0.023s	sys 0.016s
I20260709 12:57:54.152246  1800 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:54.153620  1784 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:54.154462  1761 raft_consensus.cc:359] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.154593  1784 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.155385  1761 raft_consensus.cc:385] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:54.156893  1761 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:54.157621  1761 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.155650  1787 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:54.156562  1763 tablet_bootstrap.cc:654] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:54.170146  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:54.170899  1787 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:57:54.172098  1686 leader_election.cc:343] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:54.174453  1470 catalog_manager.cc:5697] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:54.197625  1763 tablet_bootstrap.cc:492] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:54.199753  1763 ts_tablet_manager.cc:1403] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.116s	user 0.013s	sys 0.005s
I20260709 12:57:54.210382  1763 raft_consensus.cc:359] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.211182  1763 raft_consensus.cc:385] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:54.211021  1718 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:57:54.211728  1763 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:54.212582  1763 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.213243  1872 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:54.214749  1763 ts_tablet_manager.cc:1434] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:57:54.215901  1763 tablet_bootstrap.cc:492] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:54.224116  1470 catalog_manager.cc:5697] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:54.224833  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:54.235005  1763 tablet_bootstrap.cc:654] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:54.260075  1763 tablet_bootstrap.cc:492] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:54.260582  1763 ts_tablet_manager.cc:1403] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.000s
W20260709 12:57:54.266630  1612 leader_election.cc:343] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:54.267347  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:54.267470  1763 raft_consensus.cc:359] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.268234  1763 raft_consensus.cc:385] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:54.268529  1763 raft_consensus.cc:740] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:54.268702  1829 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:54.271232  1763 consensus_queue.cc:260] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.273371  1763 ts_tablet_manager.cc:1434] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:57:54.276180  1570 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:57:54.283948  1763 tablet_bootstrap.cc:492] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:54.286628  1784 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.287424  1784 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.295111  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:54.295887  1645 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:54.322959  1761 ts_tablet_manager.cc:1434] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.175s	user 0.026s	sys 0.059s
I20260709 12:57:54.324546  1761 tablet_bootstrap.cc:492] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:54.334116  1761 tablet_bootstrap.cc:654] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:54.334285  1762 tablet_bootstrap.cc:492] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:54.334818  1762 ts_tablet_manager.cc:1403] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.290s	user 0.052s	sys 0.056s
I20260709 12:57:54.336023  1644 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:57:54.337039  1880 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:54.341745  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:54.343781  1645 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:54.345605  1829 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:54.346423  1763 tablet_bootstrap.cc:654] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:54.346354  1829 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:57:54.347702  1829 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.354842  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:54.356199  1647 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:54.356089  1762 raft_consensus.cc:359] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.358028  1877 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.358464  1762 raft_consensus.cc:385] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:54.358798  1762 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:54.358616  1877 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.360560  1762 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.361135  1685 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:57:54.372426  1762 ts_tablet_manager.cc:1434] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.004s
I20260709 12:57:54.379680  1761 tablet_bootstrap.cc:492] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:54.380511  1761 ts_tablet_manager.cc:1403] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.056s	user 0.022s	sys 0.008s
I20260709 12:57:54.366567  1877 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:54.366190  1784 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:54.453948  1762 tablet_bootstrap.cc:492] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:54.458475  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:54.459321  1572 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:54.463356  1784 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:54.465044  1784 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:54.466594  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:54.472434  1470 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:54.472491  1872 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:54.476281  1872 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.476686  1872 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:54.521875  1612 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:54.523265  1789 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:54.528891  1789 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.529299  1789 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:54.523952  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 162886us
I20260709 12:57:54.536983  1821 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.534530  1894 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:54.542975  1821 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.544085  1895 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.544555  1895 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.547610  1821 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:54.548219  1895 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:54.548532  1894 raft_consensus.cc:697] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:57:54.553382  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:54.554365  1718 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:54.555622  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:54.540426  1872 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.560201  1872 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:54.568794  1761 raft_consensus.cc:359] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.569597  1761 raft_consensus.cc:385] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:54.569883  1761 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:54.571768  1763 tablet_bootstrap.cc:492] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:54.571995  1761 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.575522  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:54.576253  1763 ts_tablet_manager.cc:1403] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.298s	user 0.022s	sys 0.013s
I20260709 12:57:54.580401  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:54.581048  1644 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:54.582572  1762 tablet_bootstrap.cc:654] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:54.550854  1789 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.585031  1761 ts_tablet_manager.cc:1434] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.204s	user 0.022s	sys 0.018s
I20260709 12:57:54.584195  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:54.561026  1894 consensus_queue.cc:237] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.587489  1643 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:57:54.588622  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:54.589757  1572 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:54.592682  1761 tablet_bootstrap.cc:492] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:54.594023  1763 raft_consensus.cc:359] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.595098  1763 raft_consensus.cc:385] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:54.595323  1763 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:54.595862  1763 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.597026  1789 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:54.600829  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:54.601220  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:54.601522  1720 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:54.602172  1643 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 1: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:57:54.606127  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:54.606698  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:54.608410  1572 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:54.608992  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:54.612301  1685 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:54.614260  1895 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:54.628566  1763 ts_tablet_manager.cc:1434] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.001s
I20260709 12:57:54.613943  1720 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:57:54.634729  1763 tablet_bootstrap.cc:492] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
W20260709 12:57:54.616156  1536 leader_election.cc:343] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:54.636364  1821 raft_consensus.cc:2764] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:57:54.658215  1762 tablet_bootstrap.cc:492] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:54.664155  1572 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:57:54.665769  1895 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:54.676388  1762 ts_tablet_manager.cc:1403] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.223s	user 0.020s	sys 0.035s
I20260709 12:57:54.668272  1644 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:54.683264  1611 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:54.684437  1829 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:54.685163  1829 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:57:54.686033  1829 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:54.669085  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:57:54.692695  1536 leader_election.cc:343] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:54.696122  1762 raft_consensus.cc:359] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.696969  1762 raft_consensus.cc:385] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:54.697256  1762 raft_consensus.cc:740] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:54.698046  1762 consensus_queue.cc:260] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.701411  1763 tablet_bootstrap.cc:654] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:54.702553  1611 consensus_peers.cc:597] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:54.703783  1762 ts_tablet_manager.cc:1434] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.027s	user 0.012s	sys 0.004s
I20260709 12:57:54.704725  1761 tablet_bootstrap.cc:654] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:54.704787  1762 tablet_bootstrap.cc:492] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:54.714080  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:54.722833  1784 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:54.723430  1784 raft_consensus.cc:697] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:54.724427  1784 consensus_queue.cc:237] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.728632  1877 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:54.721879  1470 catalog_manager.cc:5697] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:54.747730  1761 tablet_bootstrap.cc:492] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:54.748282  1761 ts_tablet_manager.cc:1403] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.161s	user 0.014s	sys 0.013s
I20260709 12:57:54.752317  1761 raft_consensus.cc:359] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.753122  1761 raft_consensus.cc:385] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:54.753429  1761 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:54.754186  1761 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.757730  1762 tablet_bootstrap.cc:654] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:54.767150  1761 ts_tablet_manager.cc:1434] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.005s
I20260709 12:57:54.829519  1761 tablet_bootstrap.cc:492] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:54.757347  1467 catalog_manager.cc:5697] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:54.832821  1763 tablet_bootstrap.cc:492] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:54.833334  1763 ts_tablet_manager.cc:1403] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.199s	user 0.007s	sys 0.030s
I20260709 12:57:54.838743  1906 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.839275  1906 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.837599  1763 raft_consensus.cc:359] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.840338  1763 raft_consensus.cc:385] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:54.840734  1763 raft_consensus.cc:740] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:54.838219  1470 catalog_manager.cc:5697] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:54.840380  1872 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:57:54.847283  1906 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:54.848178  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:54.849108  1784 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:57:54.850869  1611 leader_election.cc:343] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:54.846989  1763 consensus_queue.cc:260] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.869093  1763 ts_tablet_manager.cc:1434] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.002s
I20260709 12:57:54.870293  1763 tablet_bootstrap.cc:492] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:54.876754  1761 tablet_bootstrap.cc:654] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:54.879587  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:54.891601  1612 leader_election.cc:343] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:54.892166  1612 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:54.893396  1906 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:54.898794  1762 tablet_bootstrap.cc:492] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:54.900027  1762 ts_tablet_manager.cc:1403] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.195s	user 0.036s	sys 0.057s
I20260709 12:57:54.899955  1906 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:54.903896  1906 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.904486  1906 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.906579  1906 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:54.907907  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:57:54.909529  1611 leader_election.cc:343] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:54.917346  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:54.921518  1612 leader_election.cc:343] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:54.922300  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:54.923336  1829 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:54.924962  1762 raft_consensus.cc:359] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.925684  1762 raft_consensus.cc:385] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:54.928650  1895 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.928788  1763 tablet_bootstrap.cc:654] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:54.929199  1895 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.925935  1762 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:54.931694  1762 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:54.934238  1611 consensus_peers.cc:597] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:54.934831  1895 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:54.934749  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:54.937000  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:54.937795  1762 ts_tablet_manager.cc:1434] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 12:57:54.938519  1685 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:54.938910  1762 tablet_bootstrap.cc:492] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:54.941862  1895 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:54.944679  1761 tablet_bootstrap.cc:492] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:54.944638  1801 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.945267  1761 ts_tablet_manager.cc:1403] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.116s	user 0.004s	sys 0.011s
I20260709 12:57:54.944900  1895 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.945675  1801 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.945892  1895 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.947912  1801 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:54.948282  1761 raft_consensus.cc:359] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.949007  1761 raft_consensus.cc:385] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:54.949333  1761 raft_consensus.cc:740] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:54.950026  1761 consensus_queue.cc:260] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.956176  1761 ts_tablet_manager.cc:1434] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.006s
I20260709 12:57:54.957683  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:54.959309  1761 tablet_bootstrap.cc:492] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:54.959064  1572 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:54.962688  1895 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:54.969224  1762 tablet_bootstrap.cc:654] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:54.974678  1686 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:54.976967  1787 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:54.977419  1787 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.977746  1787 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:54.984606  1763 tablet_bootstrap.cc:492] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:54.985203  1763 ts_tablet_manager.cc:1403] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.010s
I20260709 12:57:54.986335  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:54.986820  1572 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:54.987210  1646 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 1: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:57:54.989104  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:54.992467  1787 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.992558  1763 raft_consensus.cc:359] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.995749  1763 raft_consensus.cc:385] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:54.996040  1763 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:54.998759  1763 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:54.998384  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:55.000197  1569 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.010016  1569 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:55.019228  1686 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:55.012418  1763 ts_tablet_manager.cc:1434] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.005s
I20260709 12:57:55.012749  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:55.020640  1646 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:55.021814  1895 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:55.023839  1895 raft_consensus.cc:697] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:57:55.025178  1895 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.013554  1761 tablet_bootstrap.cc:654] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.015570  1787 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:55.015933  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:55.032639  1763 tablet_bootstrap.cc:492] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:55.040169  1801 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:55.042541  1880 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:55.044171  1763 tablet_bootstrap.cc:654] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.055038  1829 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.055763  1829 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.059626  1829 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:55.060891  1761 tablet_bootstrap.cc:492] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:55.061480  1761 ts_tablet_manager.cc:1403] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.006s
I20260709 12:57:55.067577  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:55.068041  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:55.068382  1646 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:55.071993  1611 leader_election.cc:343] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.076624  1763 tablet_bootstrap.cc:492] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:55.077219  1763 ts_tablet_manager.cc:1403] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.045s	user 0.004s	sys 0.011s
I20260709 12:57:55.079160  1761 raft_consensus.cc:359] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.080403  1761 raft_consensus.cc:385] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.080673  1761 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.081569  1761 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.083338  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:55.084924  1612 leader_election.cc:343] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.085700  1761 ts_tablet_manager.cc:1434] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 12:57:55.088826  1646 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:55.088958  1763 raft_consensus.cc:359] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.089643  1763 raft_consensus.cc:385] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.089864  1763 raft_consensus.cc:740] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.090545  1763 consensus_queue.cc:260] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.093514  1763 ts_tablet_manager.cc:1434] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:57:55.095118  1763 tablet_bootstrap.cc:492] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:55.096261  1761 tablet_bootstrap.cc:492] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:55.099117  1762 tablet_bootstrap.cc:492] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:55.099642  1762 ts_tablet_manager.cc:1403] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.161s	user 0.020s	sys 0.047s
I20260709 12:57:55.103716  1762 raft_consensus.cc:359] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.104456  1762 raft_consensus.cc:385] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.104728  1762 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.105398  1762 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.113842  1470 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:55.118414  1762 ts_tablet_manager.cc:1434] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.002s
I20260709 12:57:55.085455  1612 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:55.127727  1762 tablet_bootstrap.cc:492] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:55.130085  1895 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.130667  1895 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:55.133313  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 48432.7us
I20260709 12:57:55.139279  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:55.133088  1829 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:55.138501  1761 tablet_bootstrap.cc:654] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.147480  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:55.149711  1762 tablet_bootstrap.cc:654] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.138518  1895 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:55.150774  1895 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:55.153872  1685 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:55.154418  1763 tablet_bootstrap.cc:654] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.154860  1880 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:55.159782  1829 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:55.161127  1762 tablet_bootstrap.cc:492] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:55.161671  1762 ts_tablet_manager.cc:1403] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.006s
I20260709 12:57:55.165530  1762 raft_consensus.cc:359] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.166612  1762 raft_consensus.cc:385] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.166904  1762 raft_consensus.cc:740] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.167584  1762 consensus_queue.cc:260] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.169844  1762 ts_tablet_manager.cc:1434] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:57:55.170481  1719 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.171211  1762 tablet_bootstrap.cc:492] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:55.179477  1762 tablet_bootstrap.cc:654] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.183064  1763 tablet_bootstrap.cc:492] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:55.183735  1763 ts_tablet_manager.cc:1403] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.089s	user 0.025s	sys 0.008s
I20260709 12:57:55.184895  1784 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.185434  1784 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.187678  1763 raft_consensus.cc:359] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.188416  1763 raft_consensus.cc:385] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.188699  1763 raft_consensus.cc:740] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.189680  1784 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:55.189379  1763 consensus_queue.cc:260] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.191812  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:55.200939  1763 ts_tablet_manager.cc:1434] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
W20260709 12:57:55.200901  1536 leader_election.cc:343] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.202950  1763 tablet_bootstrap.cc:492] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:55.210969  1829 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:55.212471  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:55.213428  1646 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:55.220121  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:55.221791  1784 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:55.222203  1784 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.222548  1784 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.232347  1762 tablet_bootstrap.cc:492] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:55.233038  1762 ts_tablet_manager.cc:1403] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.022s
I20260709 12:57:55.232180  1801 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:55.235263  1763 tablet_bootstrap.cc:654] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.238993  1761 tablet_bootstrap.cc:492] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:55.239573  1761 ts_tablet_manager.cc:1403] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.024s
I20260709 12:57:55.250888  1761 raft_consensus.cc:359] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.251731  1761 raft_consensus.cc:385] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.252039  1761 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.243780  1784 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.257688  1784 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:55.259531  1761 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.259133  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:55.263818  1720 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.264247  1762 raft_consensus.cc:359] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.264958  1762 raft_consensus.cc:385] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.265277  1762 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.282027  1761 ts_tablet_manager.cc:1434] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 12:57:55.287935  1720 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:55.291079  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:55.289674  1762 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.291792  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:55.292872  1761 tablet_bootstrap.cc:492] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:55.293332  1872 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:55.293788  1872 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:55.294919  1872 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.291792  1646 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.299155  1762 ts_tablet_manager.cc:1434] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.066s	user 0.003s	sys 0.004s
I20260709 12:57:55.300411  1762 tablet_bootstrap.cc:492] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:55.309109  1646 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:55.311045  1763 tablet_bootstrap.cc:492] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:55.311800  1763 ts_tablet_manager.cc:1403] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.010s
I20260709 12:57:55.312496  1718 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.314873  1761 tablet_bootstrap.cc:654] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.316221  1763 raft_consensus.cc:359] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.318903  1763 raft_consensus.cc:385] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.319993  1763 raft_consensus.cc:740] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.321455  1763 consensus_queue.cc:260] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.342733  1872 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:55.344679  1467 catalog_manager.cc:5697] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:55.341970  1763 ts_tablet_manager.cc:1434] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 12:57:55.347244  1762 tablet_bootstrap.cc:654] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.348083  1763 tablet_bootstrap.cc:492] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:55.352910  1761 tablet_bootstrap.cc:492] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:55.353562  1761 ts_tablet_manager.cc:1403] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.016s
I20260709 12:57:55.361279  1906 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.362574  1906 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.363694  1761 raft_consensus.cc:359] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.364663  1761 raft_consensus.cc:385] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.365017  1761 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.367161  1761 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.372805  1763 tablet_bootstrap.cc:654] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.408732  1761 ts_tablet_manager.cc:1434] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.055s	user 0.002s	sys 0.006s
I20260709 12:57:55.405063  1906 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:55.412571  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:57:55.415405  1611 leader_election.cc:343] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.415378  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:55.417506  1612 leader_election.cc:343] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.418022  1612 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:55.418980  1829 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:55.408360  1877 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.424597  1877 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.427049  1877 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:55.429173  1761 tablet_bootstrap.cc:492] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:55.429425  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:55.430258  1572 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:55.431960  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:55.435199  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:57:55.435854  1611 leader_election.cc:343] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.436170  1877 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:55.436614  1877 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.436980  1877 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.457669  1763 tablet_bootstrap.cc:492] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:55.458319  1763 ts_tablet_manager.cc:1403] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.011s
I20260709 12:57:55.459147  1762 tablet_bootstrap.cc:492] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:55.461675  1762 ts_tablet_manager.cc:1403] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.161s	user 0.023s	sys 0.030s
I20260709 12:57:55.465312  1763 raft_consensus.cc:359] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.466849  1763 raft_consensus.cc:385] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.467119  1763 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.467813  1763 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.469069  1761 tablet_bootstrap.cc:654] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.469736  1763 ts_tablet_manager.cc:1434] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:57:55.470752  1718 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.471169  1763 tablet_bootstrap.cc:492] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:55.477437  1763 tablet_bootstrap.cc:654] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.478468  1877 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.483826  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:55.484633  1572 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.484733  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:57:55.489343  1611 leader_election.cc:343] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.482111  1877 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:55.497649  1880 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:55.498499  1895 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:55.498965  1572 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:57:55.501755  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:55.502676  1906 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:55.503177  1906 raft_consensus.cc:697] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:57:55.505827  1906 consensus_queue.cc:237] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.511754  1763 tablet_bootstrap.cc:492] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:55.512494  1763 ts_tablet_manager.cc:1403] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.024s
I20260709 12:57:55.519645  1761 tablet_bootstrap.cc:492] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:55.520219  1761 ts_tablet_manager.cc:1403] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.091s	user 0.012s	sys 0.004s
I20260709 12:57:55.524536  1906 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.525254  1906 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.529733  1762 raft_consensus.cc:359] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.530560  1762 raft_consensus.cc:385] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.530830  1762 raft_consensus.cc:740] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.532529  1930 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.532470  1762 consensus_queue.cc:260] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.531036  1468 catalog_manager.cc:5697] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:55.536216  1930 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.537343  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:57:55.539090  1611 leader_election.cc:343] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.539454  1930 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:55.540337  1763 raft_consensus.cc:359] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.541086  1763 raft_consensus.cc:385] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.541386  1763 raft_consensus.cc:740] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.542243  1763 consensus_queue.cc:260] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.543638  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:55.544090  1762 ts_tablet_manager.cc:1434] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 12:57:55.544657  1763 ts_tablet_manager.cc:1434] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 12:57:55.545109  1762 tablet_bootstrap.cc:492] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:55.544945  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:55.545655  1763 tablet_bootstrap.cc:492] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:55.545567  1720 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
W20260709 12:57:55.551940  1612 leader_election.cc:343] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.552712  1612 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:55.556067  1877 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:55.533805  1906 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:55.590883  1761 raft_consensus.cc:359] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.591869  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:55.594419  1646 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:55.591802  1761 raft_consensus.cc:385] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.595657  1761 raft_consensus.cc:740] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.596500  1761 consensus_queue.cc:260] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.598217  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:55.599097  1801 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:55.600553  1801 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.600878  1801 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.618757  1761 ts_tablet_manager.cc:1434] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.015s
I20260709 12:57:55.620018  1761 tablet_bootstrap.cc:492] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:55.633096  1801 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.637470  1762 tablet_bootstrap.cc:654] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.638947  1761 tablet_bootstrap.cc:654] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.642540  1763 tablet_bootstrap.cc:654] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.641400  1906 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.643199  1906 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.644726  1906 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:55.646085  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:55.646590  1801 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:57:55.648000  1611 leader_election.cc:343] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.648141  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:55.648867  1646 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.657385  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:55.661948  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:55.662704  1718 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.672021  1906 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:55.673300  1612 leader_election.cc:343] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.673833  1612 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:55.674881  1877 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:55.672610  1906 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.684396  1906 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:55.684548  1761 tablet_bootstrap.cc:492] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:55.685180  1761 ts_tablet_manager.cc:1403] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.014s
I20260709 12:57:55.689900  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:55.691903  1646 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
W20260709 12:57:55.694722  1611 leader_election.cc:343] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.696983  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:55.697923  1784 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:55.698453  1784 raft_consensus.cc:697] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:55.698704  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:55.700673  1612 leader_election.cc:343] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.701197  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:55.699373  1784 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.702623  1763 tablet_bootstrap.cc:492] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:55.702719  1718 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:55.703238  1763 ts_tablet_manager.cc:1403] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.158s	user 0.022s	sys 0.022s
I20260709 12:57:55.705782  1906 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:55.710966  1801 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:55.711884  1763 raft_consensus.cc:359] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.712610  1763 raft_consensus.cc:385] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.712908  1763 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.713617  1763 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.720516  1761 raft_consensus.cc:359] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.721280  1761 raft_consensus.cc:385] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.721544  1761 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.722262  1761 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.727458  1763 ts_tablet_manager.cc:1434] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.004s
I20260709 12:57:55.729301  1762 tablet_bootstrap.cc:492] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:55.729840  1762 ts_tablet_manager.cc:1403] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.185s	user 0.017s	sys 0.010s
I20260709 12:57:55.730615  1761 ts_tablet_manager.cc:1434] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:57:55.733707  1763 tablet_bootstrap.cc:492] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:55.732028  1468 catalog_manager.cc:5697] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:55.735692  1761 tablet_bootstrap.cc:492] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:55.748548  1801 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:55.777153  1762 raft_consensus.cc:359] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.778888  1762 raft_consensus.cc:385] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.779156  1762 raft_consensus.cc:740] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.780241  1762 consensus_queue.cc:260] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.794653  1761 tablet_bootstrap.cc:654] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.802779  1787 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.803406  1787 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.805516  1787 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:55.808807  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:55.809631  1643 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:55.812381  1685 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:55.813621  1787 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:55.816007  1763 tablet_bootstrap.cc:654] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.814042  1787 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.826212  1762 ts_tablet_manager.cc:1434] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.002s
I20260709 12:57:55.827335  1762 tablet_bootstrap.cc:492] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:55.828678  1801 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.829185  1801 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.827366  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:55.835654  1572 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:55.823336  1787 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.841295  1801 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:55.843693  1761 tablet_bootstrap.cc:492] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:55.844311  1761 ts_tablet_manager.cc:1403] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.001s
I20260709 12:57:55.845242  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:55.845980  1643 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:55.860569  1787 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.864513  1787 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:55.861371  1761 raft_consensus.cc:359] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.866321  1761 raft_consensus.cc:385] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.866614  1761 raft_consensus.cc:740] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.869473  1761 consensus_queue.cc:260] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.872821  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:55.876343  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:55.877086  1643 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.874670  1930 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:55.881386  1930 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.881768  1930 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.887436  1643 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:55.889098  1685 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:55.890729  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:55.891518  1572 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.892448  1787 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:55.892390  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:55.893332  1787 raft_consensus.cc:697] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:57:55.894315  1787 consensus_queue.cc:237] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.897259  1762 tablet_bootstrap.cc:654] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.898411  1761 ts_tablet_manager.cc:1434] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
W20260709 12:57:55.899734  1536 leader_election.cc:343] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.905397  1761 tablet_bootstrap.cc:492] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:55.909629  1763 tablet_bootstrap.cc:492] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:55.910317  1763 ts_tablet_manager.cc:1403] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.178s	user 0.023s	sys 0.019s
W20260709 12:57:55.913757  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:55.913523  1930 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.914402  1763 raft_consensus.cc:359] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.915177  1763 raft_consensus.cc:385] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.915477  1763 raft_consensus.cc:740] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.916227  1763 consensus_queue.cc:260] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.916771  1930 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:55.917891  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:55.918536  1646 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:55.927704  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:55.930572  1763 ts_tablet_manager.cc:1434] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
W20260709 12:57:55.931367  1536 leader_election.cc:343] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:55.931797  1763 tablet_bootstrap.cc:492] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
W20260709 12:57:55.932789  1611 consensus_peers.cc:597] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:55.934309  1572 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:55.944144  1762 tablet_bootstrap.cc:492] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:55.954142  1762 ts_tablet_manager.cc:1403] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.127s	user 0.014s	sys 0.014s
I20260709 12:57:55.940447  1646 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:55.965955  1762 raft_consensus.cc:359] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.966821  1762 raft_consensus.cc:385] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:55.967082  1762 raft_consensus.cc:740] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:55.966938  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:55.968150  1930 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:55.967922  1762 consensus_queue.cc:260] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.968657  1930 raft_consensus.cc:697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:55.969543  1930 consensus_queue.cc:237] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:55.970081  1762 ts_tablet_manager.cc:1434] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.004s
I20260709 12:57:55.971136  1762 tablet_bootstrap.cc:492] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:55.974984  1470 catalog_manager.cc:5697] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:55.981492  1761 tablet_bootstrap.cc:654] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.981637  1763 tablet_bootstrap.cc:654] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:55.995245  1762 tablet_bootstrap.cc:654] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.005625  1906 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:56.016366  1467 catalog_manager.cc:5697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:56.040565  1829 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.041203  1829 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.043694  1829 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:56.045217  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:57:56.047122  1611 leader_election.cc:343] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.048926  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:56.056784  1763 tablet_bootstrap.cc:492] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:56.057379  1763 ts_tablet_manager.cc:1403] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.007s
W20260709 12:57:56.066874  1612 leader_election.cc:343] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.067024  1763 raft_consensus.cc:359] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.068250  1612 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:56.068575  1763 raft_consensus.cc:385] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.069200  1763 raft_consensus.cc:740] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:56.069443  1877 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:56.070030  1763 consensus_queue.cc:260] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.074120  1763 ts_tablet_manager.cc:1434] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.003s
I20260709 12:57:56.075640  1763 tablet_bootstrap.cc:492] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:56.083748  1763 tablet_bootstrap.cc:654] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.092820  1762 tablet_bootstrap.cc:492] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:56.093374  1762 ts_tablet_manager.cc:1403] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.122s	user 0.024s	sys 0.026s
I20260709 12:57:56.097082  1762 raft_consensus.cc:359] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.097805  1762 raft_consensus.cc:385] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.098006  1761 tablet_bootstrap.cc:492] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:56.098101  1762 raft_consensus.cc:740] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:56.098733  1761 ts_tablet_manager.cc:1403] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.194s	user 0.035s	sys 0.050s
I20260709 12:57:56.099016  1762 consensus_queue.cc:260] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.101456  1762 ts_tablet_manager.cc:1434] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 12:57:56.102468  1762 tablet_bootstrap.cc:492] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:56.102205  1761 raft_consensus.cc:359] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.102922  1761 raft_consensus.cc:385] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.103204  1761 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:56.103895  1761 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.105960  1761 ts_tablet_manager.cc:1434] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:57:56.107193  1761 tablet_bootstrap.cc:492] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:56.109805  1763 tablet_bootstrap.cc:492] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:56.110342  1763 ts_tablet_manager.cc:1403] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.003s
I20260709 12:57:56.116091  1762 tablet_bootstrap.cc:654] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.114534  1763 raft_consensus.cc:359] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.116731  1763 raft_consensus.cc:385] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.117026  1763 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:56.117662  1763 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.119859  1763 ts_tablet_manager.cc:1434] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:57:56.120893  1763 tablet_bootstrap.cc:492] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:56.127274  1761 tablet_bootstrap.cc:654] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.127615  1763 tablet_bootstrap.cc:654] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.156697  1761 tablet_bootstrap.cc:492] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:56.157450  1761 ts_tablet_manager.cc:1403] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.006s
I20260709 12:57:56.156783  1762 tablet_bootstrap.cc:492] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:56.158440  1762 ts_tablet_manager.cc:1403] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.017s
I20260709 12:57:56.162186  1877 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.161895  1762 raft_consensus.cc:359] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.162619  1762 raft_consensus.cc:385] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.162971  1762 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:56.162663  1877 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.163640  1762 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.164834  1877 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:56.165938  1762 ts_tablet_manager.cc:1434] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:57:56.166646  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:56.161480  1761 raft_consensus.cc:359] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.166883  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:56.167179  1761 raft_consensus.cc:385] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.167488  1761 raft_consensus.cc:740] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
W20260709 12:57:56.168195  1611 leader_election.cc:343] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.168244  1761 consensus_queue.cc:260] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:56.169034  1612 leader_election.cc:343] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.169463  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:56.170601  1877 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:56.170725  1761 ts_tablet_manager.cc:1434] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:57:56.172823  1762 tablet_bootstrap.cc:492] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:56.173626  1763 tablet_bootstrap.cc:492] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:56.174576  1763 ts_tablet_manager.cc:1403] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.009s
I20260709 12:57:56.179523  1763 raft_consensus.cc:359] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.180289  1763 raft_consensus.cc:385] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.180569  1763 raft_consensus.cc:740] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:56.171953  1761 tablet_bootstrap.cc:492] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:56.181222  1763 consensus_queue.cc:260] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.183809  1763 ts_tablet_manager.cc:1434] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:57:56.186712  1872 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:56.188160  1763 tablet_bootstrap.cc:492] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:56.195009  1761 tablet_bootstrap.cc:654] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.209546  1787 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.210052  1787 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.213301  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:56.217162  1686 leader_election.cc:343] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.224972  1763 tablet_bootstrap.cc:654] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.225252  1787 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:56.231169  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:56.232013  1646 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:56.233453  1762 tablet_bootstrap.cc:654] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.234732  1685 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:57:56.236049  1787 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:56.236440  1787 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.236706  1787 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:56.242038  1872 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:56.243472  1787 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.245977  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:57:56.247712  1686 leader_election.cc:343] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.248654  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:56.249253  1646 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:56.259467  1646 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:56.259941  1762 tablet_bootstrap.cc:492] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:56.260444  1762 ts_tablet_manager.cc:1403] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.005s
I20260709 12:57:56.260665  1685 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:57:56.261584  1880 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:56.262279  1880 raft_consensus.cc:697] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:57:56.262974  1763 tablet_bootstrap.cc:492] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:56.263556  1763 ts_tablet_manager.cc:1403] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.076s	user 0.008s	sys 0.009s
I20260709 12:57:56.263088  1880 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.265409  1787 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:56.270573  1763 raft_consensus.cc:359] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.271390  1763 raft_consensus.cc:385] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.271670  1763 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:56.280054  1761 tablet_bootstrap.cc:492] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:56.281622  1763 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.284808  1763 ts_tablet_manager.cc:1434] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:57:56.285789  1763 tablet_bootstrap.cc:492] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:56.286201  1761 ts_tablet_manager.cc:1403] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.010s
I20260709 12:57:56.286960  1762 raft_consensus.cc:359] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.287708  1762 raft_consensus.cc:385] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.287947  1762 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:56.288561  1762 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.294428  1761 raft_consensus.cc:359] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.295194  1761 raft_consensus.cc:385] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.295454  1761 raft_consensus.cc:740] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:56.296139  1761 consensus_queue.cc:260] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.301700  1762 ts_tablet_manager.cc:1434] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.003s
I20260709 12:57:56.305521  1761 ts_tablet_manager.cc:1434] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:57:56.306779  1761 tablet_bootstrap.cc:492] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:56.307379  1762 tablet_bootstrap.cc:492] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:56.307605  1890 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.308192  1890 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.312639  1787 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:56.320675  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:56.323714  1890 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:56.333057  1787 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.334360  1787 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.336907  1763 tablet_bootstrap.cc:654] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.337044  1787 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:56.338790  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:56.339562  1572 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:56.340790  1686 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:56.342195  1967 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:56.342818  1761 tablet_bootstrap.cc:654] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.342767  1967 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.343344  1967 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:56.346259  1762 tablet_bootstrap.cc:654] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.350718  1787 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.351456  1787 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.355270  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:56.357664  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 48319.5us
I20260709 12:57:56.365250  1470 catalog_manager.cc:5697] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:56.370442  1787 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:56.372938  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:56.374269  1643 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:57:56.379613  1762 tablet_bootstrap.cc:492] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:56.386374  1762 ts_tablet_manager.cc:1403] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.002s
I20260709 12:57:56.387063  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:56.387897  1646 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:56.389807  1762 raft_consensus.cc:359] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.390573  1762 raft_consensus.cc:385] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.390861  1762 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:56.391572  1762 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.393983  1762 ts_tablet_manager.cc:1434] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:57:56.396931  1762 tablet_bootstrap.cc:492] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:56.403956  1762 tablet_bootstrap.cc:654] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.405198  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:56.405375  1906 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.406015  1906 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.410686  1877 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.411334  1877 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.413964  1877 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:56.429056  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:56.429301  1930 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.442178  1930 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.445449  1872 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.446004  1872 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.448122  1872 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:56.450026  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:56.415035  1685 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:56.450945  1646 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
W20260709 12:57:56.452355  1612 leader_election.cc:343] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.452450  1890 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:56.453536  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:56.454279  1646 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:56.455615  1763 tablet_bootstrap.cc:492] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:56.456112  1763 ts_tablet_manager.cc:1403] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.170s	user 0.043s	sys 0.052s
I20260709 12:57:56.459347  1930 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:56.459235  1763 raft_consensus.cc:359] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.460009  1763 raft_consensus.cc:385] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.460300  1763 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:56.461241  1763 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.426829  1761 tablet_bootstrap.cc:492] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:56.462728  1761 ts_tablet_manager.cc:1403] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.156s	user 0.010s	sys 0.011s
I20260709 12:57:56.462792  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:56.459260  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:56.438982  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:56.463783  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 48868.5us
I20260709 12:57:56.464197  1536 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:56.463207  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:56.466588  1890 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:56.466868  1872 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:56.435217  1906 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:56.467320  1872 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.467844  1872 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:56.468647  1761 raft_consensus.cc:359] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:56.468472  1612 leader_election.cc:343] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.469365  1761 raft_consensus.cc:385] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.469764  1930 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:56.469911  1761 raft_consensus.cc:740] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:56.470243  1930 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.471410  1763 ts_tablet_manager.cc:1434] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:57:56.471037  1761 consensus_queue.cc:260] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.470610  1967 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.472572  1763 tablet_bootstrap.cc:492] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:56.473371  1761 ts_tablet_manager.cc:1434] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
W20260709 12:57:56.474913  1536 leader_election.cc:343] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.476339  1761 tablet_bootstrap.cc:492] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:56.476028  1930 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:56.476238  1536 leader_election.cc:343] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.483062  1685 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:56.483356  1967 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:56.484306  1784 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.493877  1784 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.494380  1872 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.495437  1761 tablet_bootstrap.cc:654] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.496351  1784 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:56.484894  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:56.492703  1763 tablet_bootstrap.cc:654] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.503907  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:56.517804  1646 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:56.510571  1572 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:56.518118  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:56.497164  1967 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:56.522711  1761 tablet_bootstrap.cc:492] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:56.523365  1761 ts_tablet_manager.cc:1403] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.005s
W20260709 12:57:56.512476  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 96813us
I20260709 12:57:56.536826  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:56.510628  1880 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:57:56.537503  1645 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:56.536641  1611 leader_election.cc:343] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.539896  1611 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:56.500010  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:56.502630  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:56.500559  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:56.543535  1643 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:56.496404  1872 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:57:56.545858  1536 leader_election.cc:343] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:56.547075  1536 leader_election.cc:343] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.547897  1536 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:56.558764  1801 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:56.559239  1801 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.559571  1801 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:56.569310  1572 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:56.588053  1801 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.590620  1973 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:57:56.634567  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 105783us
I20260709 12:57:56.636118  1930 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.636837  1646 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:56.637049  1801 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:56.638123  1762 tablet_bootstrap.cc:492] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:56.638733  1762 ts_tablet_manager.cc:1403] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.242s	user 0.053s	sys 0.093s
I20260709 12:57:56.634835  1645 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:56.647413  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:56.640355  1801 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.649225  1761 raft_consensus.cc:359] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.649969  1761 raft_consensus.cc:385] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.650280  1761 raft_consensus.cc:740] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:56.650962  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:56.651127  1761 consensus_queue.cc:260] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.651595  1643 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:56.661811  1536 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:56.655750  1646 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:56.669632  1787 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.670274  1787 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.649225  1801 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.674448  1787 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:56.678007  1784 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:56.679870  1784 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:56.668851  1930 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:56.680308  1784 raft_consensus.cc:697] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:56.687803  1763 tablet_bootstrap.cc:492] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:56.687742  1801 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:56.689736  1643 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:56.689558  1762 raft_consensus.cc:359] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.702185  1762 raft_consensus.cc:385] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.701119  1763 ts_tablet_manager.cc:1403] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.229s	user 0.015s	sys 0.017s
I20260709 12:57:56.702505  1762 raft_consensus.cc:740] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:56.703845  1761 ts_tablet_manager.cc:1434] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.180s	user 0.018s	sys 0.027s
I20260709 12:57:56.705037  1761 tablet_bootstrap.cc:492] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:56.704676  1762 consensus_queue.cc:260] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.709465  1763 raft_consensus.cc:359] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.710325  1763 raft_consensus.cc:385] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:56.711396  1763 raft_consensus.cc:740] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
W20260709 12:57:56.711913  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 50255.2us
I20260709 12:57:56.714578  1762 ts_tablet_manager.cc:1434] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.000s
I20260709 12:57:56.715946  1762 tablet_bootstrap.cc:492] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:56.716894  1646 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:56.724887  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:56.726177  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:56.726222  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:56.726954  1643 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:56.709517  1784 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.732848  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:56.722447  1763 consensus_queue.cc:260] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.736968  1536 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:56.739853  1763 ts_tablet_manager.cc:1434] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.002s
I20260709 12:57:56.738793  1801 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.740296  1981 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:57:56.740527  1801 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.741303  1983 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:56.741811  1983 raft_consensus.cc:697] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:56.742738  1983 consensus_queue.cc:237] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.745343  1763 tablet_bootstrap.cc:492] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:56.739259  1872 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:57:56.751567  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 116053us
I20260709 12:57:56.752712  1536 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:56.742738  1801 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:56.758566  1872 raft_consensus.cc:697] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:56.761596  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:57:56.798182  1536 leader_election.cc:343] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:56.802407  1536 leader_election.cc:343] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.802165  1872 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.799662  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:56.801160  1686 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:56.807961  1982 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:56.808233  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:56.808516  1982 raft_consensus.cc:697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:57:56.759683  1981 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:56.810324  1981 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.810712  1981 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:56.814555  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:56.815276  1716 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:56.759538  1973 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.819641  1973 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:56.821696  1536 leader_election.cc:343] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.819162  1761 tablet_bootstrap.cc:654] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.813506  1982 consensus_queue.cc:237] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:56.819202  1686 leader_election.cc:343] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.837421  1973 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:56.845971  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:56.846820  1571 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:56.847700  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:57:56.848919  1983 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:56.849308  1983 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.849725  1983 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:56.863036  1715 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:56.872089  1686 consensus_peers.cc:597] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:56.875061  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:56.893728  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:56.894550  1646 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:56.897898  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:56.905133  1906 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:56.932139  1762 tablet_bootstrap.cc:654] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:56.939466  1763 tablet_bootstrap.cc:654] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:56.940029  1685 leader_election.cc:343] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.940490  1685 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:56.946264  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:56.947048  1716 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:56.930483  1906 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.952255  1787 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:56.954245  1906 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:56.972169  1980 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:57:56.981948  1611 leader_election.cc:343] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:56.961782  1983 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:56.985527  1611 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:56.987098  1468 catalog_manager.cc:5697] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:56.995934  1468 catalog_manager.cc:5697] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:57.008765  1761 tablet_bootstrap.cc:492] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:57.009654  1761 ts_tablet_manager.cc:1403] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.305s	user 0.021s	sys 0.027s
I20260709 12:57:57.022099  1829 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:57.024927  1983 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:56.984572  1981 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.028306  1981 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:57.027910  1761 raft_consensus.cc:359] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.029150  1761 raft_consensus.cc:385] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.029549  1761 raft_consensus.cc:740] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
W20260709 12:57:57.042999  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 61080.8us
I20260709 12:57:57.050730  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:57.056516  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:57.057693  1721 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.064039  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:57.064859  1641 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.067384  1761 consensus_queue.cc:260] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.090644  1761 ts_tablet_manager.cc:1434] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.002s
W20260709 12:57:57.108855  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:57.111937  1763 tablet_bootstrap.cc:492] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:57.112984  1763 ts_tablet_manager.cc:1403] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.368s	user 0.019s	sys 0.012s
I20260709 12:57:57.113065  1761 tablet_bootstrap.cc:492] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:57.112816  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:57:57.113554  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 69308.2us
I20260709 12:57:57.138813  1890 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.140053  1890 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.184461  1890 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:57.187069  1761 tablet_bootstrap.cc:654] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:57.188983  1536 leader_election.cc:343] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.185935  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:57.198419  1761 tablet_bootstrap.cc:492] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:57.198887  1761 ts_tablet_manager.cc:1403] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.005s
I20260709 12:57:57.204807  1906 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.209940  1762 tablet_bootstrap.cc:492] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:57.211374  1762 ts_tablet_manager.cc:1403] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.496s	user 0.023s	sys 0.018s
I20260709 12:57:57.210412  1646 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 1: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:57:57.210566  1763 raft_consensus.cc:359] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.214044  1763 raft_consensus.cc:385] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.214489  1763 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.216048  1763 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.217820  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:57.218158  1762 raft_consensus.cc:359] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.218889  1762 raft_consensus.cc:385] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.222141  1568 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:57:57.208849  1906 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:57.219156  1762 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.203435  1721 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:57.223205  1763 ts_tablet_manager.cc:1434] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.110s	user 0.009s	sys 0.005s
I20260709 12:57:57.231485  1763 tablet_bootstrap.cc:492] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:57.229161  1762 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.224014  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:57.234550  1642 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:57.227592  1801 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 12:57:57.226260  1686 leader_election.cc:343] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.239642  1641 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:57.239467  1685 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:57:57.241743  1967 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:57.241822  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:57.242276  1967 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.242646  1967 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.242956  1715 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:57:57.240809  1536 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:57.248600  1761 raft_consensus.cc:359] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.249548  1761 raft_consensus.cc:385] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.249917  1761 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.252303  1979 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:57.249747  1967 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.253336  1979 raft_consensus.cc:697] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:57.253793  1762 ts_tablet_manager.cc:1434] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.003s
I20260709 12:57:57.255599  1761 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.254786  1979 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.261411  1762 tablet_bootstrap.cc:492] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:57.266194  1981 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:57.268733  1611 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:57.270113  1906 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:57:57.274964  1536 consensus_peers.cc:597] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:57.277205  1761 ts_tablet_manager.cc:1434] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.001s
I20260709 12:57:57.278780  1761 tablet_bootstrap.cc:492] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:57.281318  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:57.282753  1801 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:57.283244  1801 raft_consensus.cc:697] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:57.284112  1801 consensus_queue.cc:237] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:57.288753  1536 consensus_peers.cc:597] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:57.301122  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:57.301934  1640 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.302987  1763 tablet_bootstrap.cc:654] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.304214  1979 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:57.284135  1967 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:57.333544  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:57:57.340286  1686 leader_election.cc:343] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.341365  1982 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:57:57.362551  1467 catalog_manager.cc:5697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:57.376871  1981 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.377480  1981 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.391147  1762 tablet_bootstrap.cc:654] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.386256  1981 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:57.394898  1982 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.397045  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:57.397419  1982 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:57.400261  1536 leader_election.cc:343] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.400946  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:57.401569  1715 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:57.404160  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:57.405438  1890 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:57:57.407678  1686 leader_election.cc:343] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.408121  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:57.412261  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:57.412041  1468 catalog_manager.cc:5697] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:57.413551  1685 leader_election.cc:343] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.413985  1685 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:57.414301  1468 catalog_manager.cc:5697] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:57.404608  1982 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:57.418838  1763 tablet_bootstrap.cc:492] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:57.415922  1979 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:57.419212  1979 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.419379  1763 ts_tablet_manager.cc:1403] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.188s	user 0.010s	sys 0.017s
I20260709 12:57:57.419576  1979 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.416101  1890 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:57.418177  1468 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:57.435732  1536 consensus_peers.cc:597] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:57.452504  1979 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.459085  1763 raft_consensus.cc:359] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.459937  1763 raft_consensus.cc:385] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.460244  1763 raft_consensus.cc:740] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.460871  1761 tablet_bootstrap.cc:654] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.445386  1640 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:57:57.461764  1763 consensus_queue.cc:260] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.463737  1685 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:57:57.473042  1763 ts_tablet_manager.cc:1434] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.001s
I20260709 12:57:57.467036  1982 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:57.477321  1763 tablet_bootstrap.cc:492] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:57.478267  1979 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:57.478932  1982 raft_consensus.cc:697] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:57:57.479491  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:57.480903  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:57.480814  1982 consensus_queue.cc:237] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.481578  1715 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:57.483121  1536 leader_election.cc:343] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.487608  1762 tablet_bootstrap.cc:492] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:57.488230  1762 ts_tablet_manager.cc:1403] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.227s	user 0.022s	sys 0.005s
I20260709 12:57:57.513615  1762 raft_consensus.cc:359] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.516937  1715 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:57.514479  1762 raft_consensus.cc:385] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.518307  1762 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.518610  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:57.519160  1762 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.519976  1946 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:57.520494  1946 raft_consensus.cc:697] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:57.521359  1946 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.523008  1763 tablet_bootstrap.cc:654] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.539776  1470 catalog_manager.cc:5697] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:57.548158  1763 tablet_bootstrap.cc:492] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:57.548740  1763 ts_tablet_manager.cc:1403] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.002s
I20260709 12:57:57.550563  1762 ts_tablet_manager.cc:1434] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 12:57:57.551679  1762 tablet_bootstrap.cc:492] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:57.552757  1763 raft_consensus.cc:359] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.553845  1763 raft_consensus.cc:385] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.554162  1763 raft_consensus.cc:740] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.564508  1761 tablet_bootstrap.cc:492] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:57.565861  1761 ts_tablet_manager.cc:1403] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.287s	user 0.012s	sys 0.035s
I20260709 12:57:57.566485  1762 tablet_bootstrap.cc:654] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.569146  1761 raft_consensus.cc:359] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.570851  1761 raft_consensus.cc:385] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.571305  1761 raft_consensus.cc:740] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.572453  1761 consensus_queue.cc:260] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.575889  1761 ts_tablet_manager.cc:1434] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:57:57.576903  1761 tablet_bootstrap.cc:492] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:57.577256  1763 consensus_queue.cc:260] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.584340  1761 tablet_bootstrap.cc:654] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.599807  1467 catalog_manager.cc:5697] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:57.602397  1761 tablet_bootstrap.cc:492] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:57.602421  1763 ts_tablet_manager.cc:1434] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:57:57.610195  1761 ts_tablet_manager.cc:1403] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.001s
I20260709 12:57:57.611588  1762 tablet_bootstrap.cc:492] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:57.612107  1762 ts_tablet_manager.cc:1403] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.003s
I20260709 12:57:57.614333  1761 raft_consensus.cc:359] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.615279  1761 raft_consensus.cc:385] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.615363  1763 tablet_bootstrap.cc:492] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:57.615693  1761 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.615491  1762 raft_consensus.cc:359] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.616268  1762 raft_consensus.cc:385] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.616549  1762 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.616691  1761 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.619269  1761 ts_tablet_manager.cc:1434] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:57:57.617311  1762 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.620674  1761 tablet_bootstrap.cc:492] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:57.624776  1762 ts_tablet_manager.cc:1434] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:57:57.625877  1762 tablet_bootstrap.cc:492] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:57.629463  1761 tablet_bootstrap.cc:654] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.631314  1890 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.631882  1890 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.636484  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:57.638163  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:57:57.639443  1686 leader_election.cc:343] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:57.640272  1685 leader_election.cc:343] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.640815  1685 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:57.641804  1978 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:57.643136  1890 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:57.648795  1763 tablet_bootstrap.cc:654] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.655150  1761 tablet_bootstrap.cc:492] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:57.655764  1761 ts_tablet_manager.cc:1403] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.003s
I20260709 12:57:57.660207  1761 raft_consensus.cc:359] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.661942  1761 raft_consensus.cc:385] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.662338  1761 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.663035  1761 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.665160  1763 tablet_bootstrap.cc:492] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:57.665828  1763 ts_tablet_manager.cc:1403] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.006s
I20260709 12:57:57.666115  1761 ts_tablet_manager.cc:1434] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:57:57.667407  1761 tablet_bootstrap.cc:492] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:57.669739  1973 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.670650  1762 tablet_bootstrap.cc:654] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.670289  1973 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.670387  1763 raft_consensus.cc:359] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.671348  1763 raft_consensus.cc:385] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.671754  1763 raft_consensus.cc:740] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.673323  1763 consensus_queue.cc:260] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.674659  1761 tablet_bootstrap.cc:654] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.674480  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:57.675127  1568 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:57.676864  1612 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:57.677848  1906 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:57.678411  1906 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.678817  1906 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.676028  1763 ts_tablet_manager.cc:1434] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:57:57.682361  1973 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:57.683821  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:57:57.685806  1611 leader_election.cc:343] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.682137  1763 tablet_bootstrap.cc:492] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:57.703130  1946 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.703775  1946 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.725287  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:57.730800  1890 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.731411  1890 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.734020  1890 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:57.735579  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:57.739838  1686 leader_election.cc:343] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.741585  1763 tablet_bootstrap.cc:654] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:57.743793  1536 consensus_peers.cc:597] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:57.749166  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:57.754045  1762 tablet_bootstrap.cc:492] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:57.755337  1762 ts_tablet_manager.cc:1403] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.018s
W20260709 12:57:57.755872  1685 leader_election.cc:343] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.756390  1685 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:57.757207  1946 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:57.757859  1890 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:57.759137  1762 raft_consensus.cc:359] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.759863  1762 raft_consensus.cc:385] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.760145  1762 raft_consensus.cc:740] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.760097  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:57.760743  1568 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.760974  1762 consensus_queue.cc:260] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.761842  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:57.764066  1762 ts_tablet_manager.cc:1434] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:57:57.764552  1973 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.765062  1762 tablet_bootstrap.cc:492] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:57.765019  1973 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.767448  1973 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:57.769253  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:57.770183  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:57.770560  1611 leader_election.cc:343] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.774619  1761 tablet_bootstrap.cc:492] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:57.775157  1761 ts_tablet_manager.cc:1403] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.108s	user 0.017s	sys 0.030s
W20260709 12:57:57.774645  1612 leader_election.cc:343] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.776160  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:57.777647  1973 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:57.783583  1763 tablet_bootstrap.cc:492] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:57.784138  1763 ts_tablet_manager.cc:1403] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.004s
I20260709 12:57:57.785585  1762 tablet_bootstrap.cc:654] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.721035  1906 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.788614  1763 raft_consensus.cc:359] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.789371  1763 raft_consensus.cc:385] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.789692  1763 raft_consensus.cc:740] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.791005  1763 consensus_queue.cc:260] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.793126  1906 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:57.794485  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:57:57.796262  1611 leader_election.cc:343] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.797817  1763 ts_tablet_manager.cc:1434] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:57:57.799255  1763 tablet_bootstrap.cc:492] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:57.802778  1762 tablet_bootstrap.cc:492] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:57.803381  1762 ts_tablet_manager.cc:1403] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.005s
I20260709 12:57:57.807577  1946 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:57.810112  1763 tablet_bootstrap.cc:654] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.807020  1762 raft_consensus.cc:359] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.810808  1762 raft_consensus.cc:385] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.811241  1762 raft_consensus.cc:740] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.812014  1762 consensus_queue.cc:260] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.814463  1762 ts_tablet_manager.cc:1434] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:57:57.815482  1762 tablet_bootstrap.cc:492] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:57.817451  1763 tablet_bootstrap.cc:492] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:57.817960  1763 ts_tablet_manager.cc:1403] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:57:57.821712  1763 raft_consensus.cc:359] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.822527  1763 raft_consensus.cc:385] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.822855  1763 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.823132  1762 tablet_bootstrap.cc:654] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.823825  1763 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.825598  1763 ts_tablet_manager.cc:1434] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:57:57.826642  1763 tablet_bootstrap.cc:492] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:57.836440  1763 tablet_bootstrap.cc:654] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.839224  1906 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.840634  1906 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.844624  1762 tablet_bootstrap.cc:492] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:57.845234  1762 ts_tablet_manager.cc:1403] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.005s
I20260709 12:57:57.845669  1906 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:57.848398  1762 raft_consensus.cc:359] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.849243  1762 raft_consensus.cc:385] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.849519  1762 raft_consensus.cc:740] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.850541  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:57.851322  1715 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:57.852783  1611 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:57.854110  1906 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:57.854513  1906 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.854876  1906 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.857108  1762 consensus_queue.cc:260] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.859915  1762 ts_tablet_manager.cc:1434] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:57:57.860983  1762 tablet_bootstrap.cc:492] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:57.878901  1906 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.881950  1906 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:57.882938  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:57.883643  1715 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.884298  1716 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.886327  1762 tablet_bootstrap.cc:654] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.888881  1973 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.889413  1973 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.890007  1761 raft_consensus.cc:359] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.890938  1761 raft_consensus.cc:385] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.891774  1761 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.892869  1761 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.893276  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:57.895941  1721 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:57.896521  1761 ts_tablet_manager.cc:1434] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 12:57:57.897557  1611 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:57.888065  1906 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.900753  1906 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.902000  1761 tablet_bootstrap.cc:492] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:57.903720  1906 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:57.904381  1906 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:57.904798  1906 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.905236  1906 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.893708  1715 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:57:57.891789  1973 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:57.910020  1761 tablet_bootstrap.cc:654] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.916029  1763 tablet_bootstrap.cc:492] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:57.916549  1763 ts_tablet_manager.cc:1403] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.039s
I20260709 12:57:57.919337  1763 raft_consensus.cc:359] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.920114  1763 raft_consensus.cc:385] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.920394  1763 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.921301  1762 tablet_bootstrap.cc:492] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:57.921060  1763 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.923385  1906 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.923867  1763 ts_tablet_manager.cc:1434] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:57:57.925272  1763 tablet_bootstrap.cc:492] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:57.930819  1906 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:57.933917  1763 tablet_bootstrap.cc:654] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:57.934579  1762 ts_tablet_manager.cc:1403] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.008s
I20260709 12:57:57.937526  1906 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.938319  1906 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.943102  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:57.944028  1568 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.946432  1762 raft_consensus.cc:359] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.947306  1762 raft_consensus.cc:385] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:57.951436  1569 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.947682  1762 raft_consensus.cc:740] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:57.952955  1762 consensus_queue.cc:260] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.956383  1568 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:57:57.957902  1762 ts_tablet_manager.cc:1434] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
W20260709 12:57:57.959221  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 61788.3us
I20260709 12:57:57.962582  1611 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:57.963698  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:57.964473  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:57.967145  1721 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.967227  1973 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:57.965204  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:57:57.975595  1611 leader_election.cc:343] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.975925  1983 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:57.976758  1611 leader_election.cc:343] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:57.976572  1983 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.978811  1983 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:57.959259  1762 tablet_bootstrap.cc:492] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:57.988114  1761 tablet_bootstrap.cc:492] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:57.988008  1721 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:57:57.988760  1761 ts_tablet_manager.cc:1403] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.087s	user 0.019s	sys 0.031s
I20260709 12:57:57.990864  1611 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:57.991732  2034 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:57.992228  2034 raft_consensus.cc:697] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:57:57.992467  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:57.992703  1967 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:57.993294  1568 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:57.993155  2034 consensus_queue.cc:237] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:57.994825  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:57.997411  1568 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:57.997977  1890 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:57.998138  1761 raft_consensus.cc:359] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.001116  1761 raft_consensus.cc:385] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.001489  1761 raft_consensus.cc:740] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.003667  1761 consensus_queue.cc:260] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.005505  1762 tablet_bootstrap.cc:654] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.019253  1568 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:57:58.021157  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:58.007773  1761 ts_tablet_manager.cc:1434] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:57:58.024292  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:58.025753  1973 raft_consensus.cc:697] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:57:58.028990  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:58.036875  1761 tablet_bootstrap.cc:492] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:57.943147  1906 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:58.049041  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:58.049397  1762 tablet_bootstrap.cc:492] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:58.050323  1762 ts_tablet_manager.cc:1403] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.091s	user 0.012s	sys 0.003s
I20260709 12:57:58.056051  1612 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:58.062611  1644 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.058632  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:58.049973  1715 raft_consensus.cc:2393] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 1: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:57:58.086442  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:58.087067  1946 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:58.083920  1985 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.091302  1985 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.094149  1985 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:58.046780  1569 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:58.071036  2039 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:58.116336  1721 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.119499  2039 raft_consensus.cc:697] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:57:58.140208  1762 raft_consensus.cc:359] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.141287  1762 raft_consensus.cc:385] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.141633  1762 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.142505  1762 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:58.151564  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 66547.7us
I20260709 12:57:58.153709  1762 ts_tablet_manager.cc:1434] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.103s	user 0.002s	sys 0.007s
I20260709 12:57:58.155097  1762 tablet_bootstrap.cc:492] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
W20260709 12:57:58.138412  2037 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:57:58.120389  1973 consensus_queue.cc:237] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.172832  1763 tablet_bootstrap.cc:492] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:58.183743  1763 ts_tablet_manager.cc:1403] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.259s	user 0.042s	sys 0.081s
W20260709 12:57:58.195986  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 138120us
I20260709 12:57:58.173168  1967 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:58.197443  1612 leader_election.cc:343] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.199815  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:58.175240  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:57:58.207582  1612 leader_election.cc:343] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.208277  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:58.204800  1973 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:58.169875  2039 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.216006  2051 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:58.201551  1967 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.236150  1761 tablet_bootstrap.cc:654] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:58.266623  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 51882.7us
I20260709 12:57:58.267779  1536 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:58.272001  1763 raft_consensus.cc:359] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.273180  1763 raft_consensus.cc:385] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.273531  1763 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.265170  1872 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
W20260709 12:57:58.274216  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 63194.5us
I20260709 12:57:58.274554  1763 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.364609  1762 tablet_bootstrap.cc:654] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:58.339380  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 62636.9us
I20260709 12:57:58.433542  1763 ts_tablet_manager.cc:1434] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.247s	user 0.009s	sys 0.001s
W20260709 12:57:58.381793  2049 log.cc:927] Time spent T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 12:57:58.438043  1536 leader_election.cc:343] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:58.303617  2040 log.cc:927] Time spent T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:57:58.274178  2042 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.303134  1967 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:58.379392  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:58.311236  2048 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.284198  2046 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:58.456151  1763 tablet_bootstrap.cc:492] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:58.359193  2050 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.101s
I20260709 12:57:58.419318  1985 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 12:57:58.456143  1643 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:58.478472  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:58.457755  2042 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.474920  2048 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:58.536357  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 93636.5us
I20260709 12:57:58.563923  1761 tablet_bootstrap.cc:492] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:58.564554  1761 ts_tablet_manager.cc:1403] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.529s	user 0.023s	sys 0.025s
I20260709 12:57:58.538010  1890 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:57:58.537953  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:58.541778  2034 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.573500  1762 tablet_bootstrap.cc:492] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:58.574306  1762 ts_tablet_manager.cc:1403] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.419s	user 0.018s	sys 0.003s
I20260709 12:57:58.565923  2050 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 12:57:58.593204  2051 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.624018  2048 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:58.579154  1890 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.625650  1761 raft_consensus.cc:359] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.627997  1761 raft_consensus.cc:385] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.628258  1761 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.582890  2034 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.631259  1761 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.634462  1979 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.641628  1761 ts_tablet_manager.cc:1434] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.001s
I20260709 12:57:58.626722  2051 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.650293  2051 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:57:58.653601  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:58.655541  2034 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:58.656332  1763 tablet_bootstrap.cc:654] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.658630  1762 raft_consensus.cc:359] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.659224  1762 raft_consensus.cc:385] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.659469  1762 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.661891  1762 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.637418  1979 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.669023  1685 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:58.675045  1762 ts_tablet_manager.cc:1434] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.000s
I20260709 12:57:58.676968  1762 tablet_bootstrap.cc:492] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:58.677239  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:58.678570  2056 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:58.681078  1872 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:58.683153  1872 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.683521  1872 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.701274  1761 tablet_bootstrap.cc:492] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:57:58.704660  2058 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.705513  2058 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.712379  1762 tablet_bootstrap.cc:654] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.713759  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:58.720743  1872 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.724670  1872 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:58.703732  1469 catalog_manager.cc:5697] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:58.733647  1721 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.733856  1979 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:57:58.737035  1612 leader_election.cc:343] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.751694  2052 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:58.717253  2058 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:58.776575  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:58.781522  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:58.783185  1565 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:57:58.788532  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:58.790413  2051 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:58.791491  2051 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.791757  2051 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.799088  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:58.799263  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:58.781975  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:58.802429  1639 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.802558  1716 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
W20260709 12:57:58.807861  1536 leader_election.cc:343] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.830708  1763 tablet_bootstrap.cc:492] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:58.831378  1763 ts_tablet_manager.cc:1403] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.376s	user 0.020s	sys 0.037s
I20260709 12:57:58.834651  1715 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.844249  1761 tablet_bootstrap.cc:654] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:58.845597  2052 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.846796  2052 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:57:58.851996  2061 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.353s	user 0.011s	sys 0.000s
I20260709 12:57:58.853046  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:58.856323  2042 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:58.880396  1762 tablet_bootstrap.cc:492] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:58.881208  1762 ts_tablet_manager.cc:1403] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.205s	user 0.021s	sys 0.009s
I20260709 12:57:58.861979  2052 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:58.868954  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:58.886801  1567 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.880288  1639 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:58.914810  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:58.918697  1890 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:58.919245  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:57:58.920632  1611 leader_election.cc:343] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.920892  2052 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:58.920662  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:58.923405  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:58.927760  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:57:58.930020  1612 leader_election.cc:343] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:58.934281  1536 leader_election.cc:343] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:58.936288  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:58.935469  1536 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:58.938539  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:58.942831  1685 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:58.943667  1946 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:58.944094  1946 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.944449  1946 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:58.915778  2051 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.953824  1763 raft_consensus.cc:359] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.953078  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:58.955484  1763 raft_consensus.cc:385] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.962128  1686 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:57:58.962327  2051 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:58.963176  1978 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:58.962142  1763 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.966158  1762 raft_consensus.cc:359] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.970863  1762 raft_consensus.cc:385] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:58.971575  1762 raft_consensus.cc:740] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:58.971464  1763 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:58.975098  2039 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:58.970476  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:58.982671  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:57:59.000813  1570 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:58.980808  1611 consensus_peers.cc:597] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:57:59.015851  1611 leader_election.cc:343] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:59.015745  2052 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:59.018697  1611 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:58.981391  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:57:59.021193  2081 log.cc:927] Time spent T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:57:59.021936  2051 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:59.024228  1946 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.027974  1763 ts_tablet_manager.cc:1434] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.196s	user 0.010s	sys 0.000s
I20260709 12:57:59.039775  1763 tablet_bootstrap.cc:492] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
W20260709 12:57:59.042728  1611 leader_election.cc:343] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:59.043699  1611 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:59.050451  1762 consensus_queue.cc:260] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.057615  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:59.059352  1762 ts_tablet_manager.cc:1434] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.178s	user 0.008s	sys 0.008s
I20260709 12:57:59.061025  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:59.051568  2052 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:59.064704  2034 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:59.071709  2042 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:59.085047  1979 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.085697  1979 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.077775  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:59.088567  1979 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:59.066027  2046 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:59.090251  2046 raft_consensus.cc:697] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:57:59.090519  1570 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:57:59.094363  1946 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:57:59.105346  1611 leader_election.cc:343] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:59.091521  2046 consensus_queue.cc:237] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.117368  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:59.120090  1763 tablet_bootstrap.cc:654] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:59.122433  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:57:59.124992  1712 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:59.121851  1762 tablet_bootstrap.cc:492] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
W20260709 12:57:59.135123  1536 leader_election.cc:343] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:59.268953  1761 tablet_bootstrap.cc:492] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:57:59.269621  1761 ts_tablet_manager.cc:1403] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.569s	user 0.012s	sys 0.018s
I20260709 12:57:59.313199  1712 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:59.330226  1967 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:59.426695  1763 tablet_bootstrap.cc:492] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:59.427414  1763 ts_tablet_manager.cc:1403] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.398s	user 0.018s	sys 0.021s
I20260709 12:57:59.578622  2052 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.580533  2052 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.583036  2052 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:59.583783  1763 raft_consensus.cc:359] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.584645  1763 raft_consensus.cc:385] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:59.584452  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:57:59.584942  1763 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:59.542906  2091 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.587955  2091 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.585680  1763 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.603688  1762 tablet_bootstrap.cc:654] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:59.641034  1763 ts_tablet_manager.cc:1434] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.213s	user 0.009s	sys 0.001s
I20260709 12:57:59.642902  1763 tablet_bootstrap.cc:492] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:59.682731  2091 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:59.686930  1762 tablet_bootstrap.cc:492] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:59.687412  1763 tablet_bootstrap.cc:654] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:59.687966  1762 ts_tablet_manager.cc:1403] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.566s	user 0.027s	sys 0.004s
I20260709 12:57:59.691152  1762 raft_consensus.cc:359] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.691927  1762 raft_consensus.cc:385] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:59.692353  1762 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:59.693080  1762 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.695020  1762 ts_tablet_manager.cc:1434] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:59.695941  1762 tablet_bootstrap.cc:492] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:59.702387  1762 tablet_bootstrap.cc:654] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:59.708721  1762 tablet_bootstrap.cc:492] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:57:59.709436  1762 ts_tablet_manager.cc:1403] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.008s
I20260709 12:57:59.712430  1762 raft_consensus.cc:359] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.713223  1762 raft_consensus.cc:385] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:59.713500  1762 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:57:59.714154  1763 tablet_bootstrap.cc:492] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:57:59.714200  1762 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.714900  1763 ts_tablet_manager.cc:1403] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.006s
I20260709 12:57:59.716360  1762 ts_tablet_manager.cc:1434] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:57:59.717312  1762 tablet_bootstrap.cc:492] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:57:59.718161  1763 raft_consensus.cc:359] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.719133  1763 raft_consensus.cc:385] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:59.720885  1763 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:57:59.722185  1763 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.726563  1890 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.726649  1763 ts_tablet_manager.cc:1434] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:57:59.727276  1890 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.728572  1762 tablet_bootstrap.cc:654] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:59.859721  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.016s	sys 0.015s
W20260709 12:57:59.860106  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.016s	sys 0.015s
W20260709 12:57:59.860386  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 797472us
I20260709 12:57:59.861161  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:59.862722  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:57:59.863900  2052 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:59.866941  2052 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:59.867628  2052 raft_consensus.cc:697] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:57:59.868777  2052 consensus_queue.cc:237] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.729841  1890 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:57:59.897151  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:59.897511  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:57:59.898253  1639 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:57:59.898226  2108 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:57:59.898226  1646 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 0.
I20260709 12:57:59.899283  2108 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.900660  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:57:59.901306  1645 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:59.901700  2108 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:59.898360  2109 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:57:59.902334  2109 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.904491  2109 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:57:59.915575  1685 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:57:59.917305  2070 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:59.917918  2070 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:59.918382  2070 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:59.734664  1763 tablet_bootstrap.cc:492] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:57:59.932590  1645 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:57:59.940179  2108 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.962114  2108 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.964527  2108 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:57:59.953326  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 65839.4us
I20260709 12:57:59.968727  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:57:59.971834  1763 tablet_bootstrap.cc:654] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:59.974717  1686 leader_election.cc:343] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:59.982188  2070 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:57:59.985314  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:57:59.986902  1686 leader_election.cc:343] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:59.987995  2070 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:00.001092  1763 tablet_bootstrap.cc:492] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:58:00.002362  1763 ts_tablet_manager.cc:1403] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.275s	user 0.009s	sys 0.020s
I20260709 12:58:00.005892  1763 raft_consensus.cc:359] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.006965  1763 raft_consensus.cc:385] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:00.007325  1763 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:58:00.008006  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:00.008271  1763 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.010710  1763 ts_tablet_manager.cc:1434] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:58:00.013705  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:00.011864  1763 tablet_bootstrap.cc:492] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:58:00.023736  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:00.030974  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:00.031672  1644 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:00.035777  1761 raft_consensus.cc:359] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.036562  1761 raft_consensus.cc:385] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:00.036825  1761 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:00.037515  1761 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.041397  1644 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:00.042193  1761 ts_tablet_manager.cc:1434] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.772s	user 0.012s	sys 0.000s
W20260709 12:58:00.042528  1761 ts_tablet_manager.cc:1467] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: Tablet startup took 772ms
I20260709 12:58:00.043267  1763 tablet_bootstrap.cc:654] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:00.048833  1611 leader_election.cc:343] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.047624  2072 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.051769  2072 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.053969  2072 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.055891  1685 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:00.057554  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 156) took 1231 ms. Trace:
I20260709 12:58:00.058157  1715 rpcz_store.cc:276] 0709 12:57:58.826606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.831407 (+  4801us) service_pool.cc:224] Handling call
0709 12:57:58.834460 (+  3053us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:58.951898 (+117438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:58.952543 (+   645us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:58.981770 (+ 29227us) log.cc:844] Serialized 26 byte log entry
0709 12:57:59.255683 (+273913us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:59.306322 (+ 50639us) log.cc:844] Serialized 14 byte log entry
0709 12:57:59.320742 (+ 14420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.326748 (+  6006us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:00.053922 (+727174us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b5400085320. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd20ddbe 00007f18cd218930 00007f18cd2188d8 00007f18cd218858 00007f18cd218813 00007f18cd217a9c 00007f18d3103626 00007f18d30fddd8 00007f18cd2547cb 00007f18cd2572c0
0709 12:58:00.056067 (+  2145us) raft_consensus.cc:1685] finished
0709 12:58:00.057245 (+  1178us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:00.057442 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":739736,"prepare.queue_time_us":30703,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":11887,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":2421,"spinlock_wait_cycles":8026368,"thread_start_us":177009,"threads_started":2,"wal-append.queue_time_us":303389}
I20260709 12:58:00.061388  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.063665  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:00.043256  1761 ts_tablet_manager.cc:1469] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: Trace:
0709 12:57:50.682260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.324933 (+642673us) service_pool.cc:224] Handling call
0709 12:57:51.345591 (+ 20658us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:57:51.345732 (+   141us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:57:51.824427 (+478695us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:52.018178 (+193751us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:52.019424 (+  1246us) inbound_call.cc:177] Queueing success response
0709 12:57:58.700765 (+6681341us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:57:59.269846 (+569081us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:58:00.029295 (+759449us) tablet_replica.cc:261] Starting instrumentation
0709 12:58:00.029860 (+   565us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":699150,"raft.queue_time_us":504,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":28544,"tablet-open.queue_time_us":6681412}
I20260709 12:58:00.072429  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.078716  1717 raft_consensus.cc:2393] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 1: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:00.083704  1967 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:00.084309  1967 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:00.085315  1967 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.077893  1712 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:58:00.091375  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.092665  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.092834  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.096791  1611 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:00.103266  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:00.104053  2042 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:00.104530  2042 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:00.104933  2042 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:00.107991  2105 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.117362  1763 tablet_bootstrap.cc:492] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:58:00.117940  1763 ts_tablet_manager.cc:1403] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.017s
I20260709 12:58:00.108716  2105 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.124289  1763 raft_consensus.cc:359] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.125099  1763 raft_consensus.cc:385] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:00.125370  1763 raft_consensus.cc:740] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:58:00.126492  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:00.128221  1763 consensus_queue.cc:260] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.122342  2105 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:00.136054  1611 leader_election.cc:343] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.136673  1763 ts_tablet_manager.cc:1434] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:58:00.137735  1763 tablet_bootstrap.cc:492] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:58:00.133142  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58252 (request call id 97) took 1659 ms. Trace:
W20260709 12:58:00.165545  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 73033.9us
I20260709 12:58:00.170907  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.171636  1761 tablet_bootstrap.cc:492] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:00.176389  1762 tablet_bootstrap.cc:492] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:00.176898  1762 ts_tablet_manager.cc:1403] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.460s	user 0.017s	sys 0.010s
I20260709 12:58:00.174386  2046 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:00.178807  2046 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:00.179195  2046 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:00.177729  1536 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:00.185319  2073 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:00.191231  2073 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:00.191481  1762 raft_consensus.cc:359] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.192250  1762 raft_consensus.cc:385] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:00.192662  1762 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:00.192220  2073 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.193338  1762 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.195637  1763 tablet_bootstrap.cc:654] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:00.201713  1762 ts_tablet_manager.cc:1434] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:58:00.203336  1762 tablet_bootstrap.cc:492] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:00.203744  2042 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.144292  1469 rpcz_store.cc:276] 0709 12:57:58.482931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.487948 (+  5017us) service_pool.cc:224] Handling call
0709 12:58:00.130010 (+1642062us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:58.878936 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:58.930144 (+ 51208us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:58.930487 (+   343us) write_op.cc:435] Acquired schema lock
0709 12:57:58.935251 (+  4764us) tablet.cc:662] Decoding operations
0709 12:57:58.956435 (+ 21184us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:58.956516 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:58.956557 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:57:58.956796 (+   239us) tablet.cc:701] Row locks acquired
0709 12:57:58.956819 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:57:58.956977 (+   158us) write_op.cc:270] Start()
0709 12:57:58.957098 (+   121us) write_op.cc:276] Timestamp: P: 1783601878956932 usec, L: 0
0709 12:57:58.957121 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:57:58.957879 (+   758us) log.cc:844] Serialized 540 byte log entry
0709 12:57:59.679735 (+721856us) op_driver.cc:464] REPLICATION: finished
0709 12:57:59.706394 (+ 26659us) write_op.cc:301] APPLY: starting
0709 12:57:59.706488 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:59.706575 (+    87us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:59.706696 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:59.706931 (+   235us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:59.707052 (+   121us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:57:59.707083 (+    31us) write_op.cc:312] APPLY: finished
0709 12:57:59.707257 (+   174us) log.cc:844] Serialized 22 byte log entry
0709 12:57:59.707502 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:59.707600 (+    98us) write_op.cc:454] Released schema lock
0709 12:57:59.707637 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:59.708033 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:59.708058 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":26074,"apply.run_cpu_time_us":1548,"apply.run_wall_time_us":1669,"num_ops":1,"prepare.queue_time_us":99296,"prepare.run_cpu_time_us":32931,"prepare.run_wall_time_us":425015,"raft.queue_time_us":349533,"raft.run_cpu_time_us":15169,"raft.run_wall_time_us":32476,"replication_time_us":719105,"thread_start_us":695500,"threads_started":4,"wal-append.queue_time_us":362907}]]}
I20260709 12:58:00.216965  2042 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.212498  2053 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:58:00.223903  2042 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.224465  2042 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.225445  2052 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.225940  2052 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.227910  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:00.228629  1715 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:00.229226  2042 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.231743  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:00.228037  2052 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.236349  1762 tablet_bootstrap.cc:654] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:00.250784  1467 catalog_manager.cc:5697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:58:00.242159  1715 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:00.244361  1761 tablet_bootstrap.cc:654] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:00.246814  2046 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.264626  2046 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.264922  1762 tablet_bootstrap.cc:492] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
W20260709 12:58:00.265501  1611 leader_election.cc:343] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.265625  1762 ts_tablet_manager.cc:1403] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.002s
I20260709 12:58:00.266320  1611 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:00.234001  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:00.270489  1611 leader_election.cc:343] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:00.236001  2117 log.cc:927] Time spent T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.087s	user 0.003s	sys 0.000s
I20260709 12:58:00.271183  2052 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:00.280083  1761 tablet_bootstrap.cc:492] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:00.280833  1761 ts_tablet_manager.cc:1403] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.109s	user 0.008s	sys 0.004s
I20260709 12:58:00.285192  1761 raft_consensus.cc:359] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.286310  1761 raft_consensus.cc:385] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:00.286679  1761 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:00.289490  1762 raft_consensus.cc:359] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.290854  1762 raft_consensus.cc:385] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:00.291123  1762 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:00.276010  2052 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:00.289224  1761 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.291994  1762 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.294750  1761 ts_tablet_manager.cc:1434] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 12:58:00.296188  1762 ts_tablet_manager.cc:1434] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:58:00.296088  1761 tablet_bootstrap.cc:492] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:00.297186  1762 tablet_bootstrap.cc:492] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:00.295202  2052 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.299937  2042 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:00.300546  2042 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.303993  2042 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.304176  1763 tablet_bootstrap.cc:492] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:58:00.305091  1763 ts_tablet_manager.cc:1403] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.168s	user 0.026s	sys 0.014s
I20260709 12:58:00.306039  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:00.319211  1763 raft_consensus.cc:359] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.322000  1763 raft_consensus.cc:385] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:00.322379  1763 raft_consensus.cc:740] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:58:00.323401  1763 consensus_queue.cc:260] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.332170  2046 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:00.339659  1612 leader_election.cc:343] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.340220  2046 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.342861  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:00.349119  1612 leader_election.cc:343] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.349615  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.351467  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:00.342939  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:00.353771  1761 tablet_bootstrap.cc:654] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:00.353338  1563 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:00.362181  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.354472  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.362936  1565 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:58:00.364238  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.367076  1612 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.367771  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:00.359691  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:00.368880  2042 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:00.369026  1712 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:58:00.346944  2109 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:00.369984  1612 leader_election.cc:343] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.370021  2109 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.370558  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.371368  2091 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:00.371742  1612 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.372416  2109 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.372615  2091 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:00.359447  2034 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:00.377161  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:00.378865  1611 leader_election.cc:343] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.382762  2046 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.385198  1762 tablet_bootstrap.cc:654] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:00.375175  1612 leader_election.cc:343] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.386714  1612 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.387085  1763 ts_tablet_manager.cc:1434] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.082s	user 0.011s	sys 0.001s
I20260709 12:58:00.388372  1763 tablet_bootstrap.cc:492] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:58:00.390378  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:00.393039  1536 consensus_peers.cc:597] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:00.396683  1612 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.397760  1612 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:00.398624  1612 leader_election.cc:343] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.399025  1612 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.401434  2034 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:00.393756  1536 leader_election.cc:343] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.415798  1536 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:58:00.421885  1536 leader_election.cc:343] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.402948  2042 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:00.432492  2052 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:00.417217  2109 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:00.428457  2118 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:00.447801  2109 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:00.449649  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:00.460413  2118 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:00.473690  2118 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:00.473733  1611 consensus_peers.cc:597] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:00.467615  2109 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:00.475047  1563 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:00.508934  2124 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.509856  2124 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.487699  2110 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.525951  1567 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:00.528635  1761 tablet_bootstrap.cc:492] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:00.532989  1761 ts_tablet_manager.cc:1403] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.237s	user 0.029s	sys 0.021s
I20260709 12:58:00.528415  2110 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.542265  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:00.542991  1644 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:00.543483  2110 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.545748  1719 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:00.546550  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.549414  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:00.550459  2124 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:00.551964  1611 leader_election.cc:343] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.555124  1763 tablet_bootstrap.cc:654] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:00.562475  2124 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.563164  2124 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.576247  2052 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:00.577032  2052 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.586647  2124 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.602619  1762 tablet_bootstrap.cc:492] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:00.603292  1762 ts_tablet_manager.cc:1403] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.306s	user 0.021s	sys 0.024s
I20260709 12:58:00.609151  2118 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:00.624775  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 173532us
I20260709 12:58:00.626080  1761 raft_consensus.cc:359] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.627449  1761 raft_consensus.cc:385] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:00.627786  1761 raft_consensus.cc:740] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:00.628583  1761 consensus_queue.cc:260] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:00.633499  1612 leader_election.cc:343] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.634220  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.637462  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.640410  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.641322  2034 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:00.643668  2122 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.644276  2122 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.649703  2122 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.650427  2052 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.651355  1571 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:00.659711  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:00.653688  2110 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:00.662974  1762 raft_consensus.cc:359] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.663903  1762 raft_consensus.cc:385] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:00.664240  1762 raft_consensus.cc:740] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:00.665093  1762 consensus_queue.cc:260] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.620391  1644 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:00.656508  2118 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.671890  1761 ts_tablet_manager.cc:1434] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.138s	user 0.006s	sys 0.002s
I20260709 12:58:00.674099  1978 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:58:00.678397  2118 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.678983  2118 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.682960  1762 ts_tablet_manager.cc:1434] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.002s
I20260709 12:58:00.684491  1762 tablet_bootstrap.cc:492] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
W20260709 12:58:00.688594  1536 leader_election.cc:343] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.691174  2140 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.703605  2109 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.705189  1639 raft_consensus.cc:2393] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 1: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:00.714686  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:00.721416  1967 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.722746  1967 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.724459  1762 tablet_bootstrap.cc:654] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:00.691803  2140 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:00.735504  1536 leader_election.cc:343] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:00.737903  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08000626c0 after lost signal to thread 434
W20260709 12:58:00.747224  1668 debug-util.cc:398] Leaking SignalData structure 0x7b0800158760 after lost signal to thread 1504
I20260709 12:58:00.737998  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:00.744509  1763 tablet_bootstrap.cc:492] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:58:00.748386  1763 ts_tablet_manager.cc:1403] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.360s	user 0.003s	sys 0.022s
I20260709 12:58:00.740590  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:00.763315  1967 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:00.756188  2141 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:00.780944  1982 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:00.783787  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58250 (request call id 83) took 1649 ms. Trace:
I20260709 12:58:00.785518  1470 rpcz_store.cc:276] 0709 12:57:59.133105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.133303 (+   198us) service_pool.cc:224] Handling call
0709 12:57:59.313109 (+179806us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54004254d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd202090 00007f18cd2a0f3a 00007f18d30571cc 00007f18d315537e 00007f18d16162a4 00007f18d1616232 00007f18d1616161 00007f18d16160dc 00007f18d1615392 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:00.782399 (+1469290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52115,"reported_tablets":6,"spinlock_wait_cycles":369526016}
I20260709 12:58:00.789582  2118 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.790480  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:00.792367  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:00.738517  1718 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:00.797766  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:00.798133  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:00.800410  1536 leader_election.cc:343] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:00.800524  1611 leader_election.cc:343] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.785108  1714 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:00.802690  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:00.795923  1982 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.806906  1982 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:00.781874  2110 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.808313  1761 tablet_bootstrap.cc:492] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:00.790364  2109 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.787412  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:00.782953  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:00.819263  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.814289  2110 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.799515  2053 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:58:00.823334  1638 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:58:00.827796  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:00.808192  2140 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.801779  2141 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:00.811076  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08000abf00 after lost signal to thread 1596
I20260709 12:58:00.833096  2140 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:00.835428  1763 raft_consensus.cc:359] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.823570  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:00.838148  2110 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.838493  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.840215  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:00.843655  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.845512  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:00.848735  1763 raft_consensus.cc:385] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:00.850863  2140 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:00.858897  1763 raft_consensus.cc:740] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:58:00.862519  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:00.866722  1763 consensus_queue.cc:260] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.867720  1536 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:00.869007  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:00.866336  2140 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:00.870579  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:00.871938  2073 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:00.872089  1570 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:00.874169  1946 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:00.875026  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:00.875764  2118 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:00.876266  2118 raft_consensus.cc:697] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:00.878328  2118 consensus_queue.cc:237] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:00.881454  1668 debug-util.cc:398] Leaking SignalData structure 0x7b080021dc40 after lost signal to thread 1671
I20260709 12:58:00.887748  1763 ts_tablet_manager.cc:1434] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.139s	user 0.002s	sys 0.007s
I20260709 12:58:00.890174  1763 tablet_bootstrap.cc:492] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
W20260709 12:58:00.891124  1612 leader_election.cc:343] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:00.892107  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.885501  1469 catalog_manager.cc:5697] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:00.886042  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08001e58c0 after lost signal to thread 1745
I20260709 12:58:00.883145  1645 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:00.905009  1570 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:00.905140  2140 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.882792  1643 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:58:00.909072  2130 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:00.908383  1469 catalog_manager.cc:5697] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:00.913937  1612 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.901598  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:00.917966  1762 tablet_bootstrap.cc:492] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:00.918525  1762 ts_tablet_manager.cc:1403] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.234s	user 0.033s	sys 0.034s
I20260709 12:58:00.915197  2034 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:00.922019  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.926731  2140 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:00.920346  2110 consensus_queue.cc:1059] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:58:00.931208  2110 raft_consensus.cc:3055] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:00.931588  2110 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:00.917053  2091 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:00.935847  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:00.937853  1612 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.933142  2110 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.944585  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.942559  1721 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:00.947283  1536 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.949656  2091 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:00.951625  1762 raft_consensus.cc:359] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.953357  1762 raft_consensus.cc:385] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:00.953652  1762 raft_consensus.cc:740] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:00.954332  1761 tablet_bootstrap.cc:654] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:00.956100  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:00.952119  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:00.969743  1762 consensus_queue.cc:260] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.950666  2073 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:00.965597  2091 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:00.976315  2091 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:00.978540  1565 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:00.980449  2123 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:00.969344  1946 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:00.980933  2123 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:00.981073  1946 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:00.981385  2123 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:00.981551  1946 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:00.982008  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:00.991199  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:00.974421  2073 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:00.999873  1762 ts_tablet_manager.cc:1434] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 12:58:01.006451  1762 tablet_bootstrap.cc:492] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:01.007653  2073 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:01.000957  2141 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:01.031901  1685 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:01.037648  1611 leader_election.cc:343] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:01.035208  1967 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:01.047684  2151 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:58:01.040587  1982 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:58:01.053332  1721 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:01.057185  1713 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:01.065235  2110 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:01.079969  1946 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.082098  1571 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:01.096112  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:01.093878  2052 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:58:01.093353  1872 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:58:01.103163  1763 tablet_bootstrap.cc:654] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:01.108677  1946 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:01.109701  1761 tablet_bootstrap.cc:492] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:01.110699  1761 ts_tablet_manager.cc:1403] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.303s	user 0.013s	sys 0.011s
I20260709 12:58:01.105036  2091 raft_consensus.cc:3055] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:01.111941  2091 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:01.112818  2091 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.114023  2091 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:01.120756  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:01.121490  1644 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:01.126171  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 87352.9us
W20260709 12:58:01.126408  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 86207.9us
I20260709 12:58:01.127532  1685 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:01.128805  2071 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:01.128927  1685 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:01.129745  2071 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:01.086287  2073 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.085944  2123 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.140232  1569 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:01.148849  2123 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:01.152690  1762 tablet_bootstrap.cc:654] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:01.167963  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:01.178453  1761 raft_consensus.cc:359] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.181349  1761 raft_consensus.cc:385] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:01.181393  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:01.181782  1761 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:01.182533  1761 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.183769  2108 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:01.191946  1761 ts_tablet_manager.cc:1434] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.081s	user 0.003s	sys 0.005s
I20260709 12:58:01.278448  1763 tablet_bootstrap.cc:492] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
W20260709 12:58:01.208789  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:01.335776  1763 ts_tablet_manager.cc:1403] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.446s	user 0.036s	sys 0.015s
I20260709 12:58:01.183919  2123 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.184626  1872 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:01.341871  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:01.189857  2109 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.197499  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:01.299202  2141 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.285142  2073 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:01.355863  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 164100us
I20260709 12:58:01.190107  1982 consensus_queue.cc:1059] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.161s
I20260709 12:58:01.361912  1643 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:01.354444  2109 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.341908  2123 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.381704  1763 raft_consensus.cc:359] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.382488  1763 raft_consensus.cc:385] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:01.382838  1763 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:58:01.383736  1763 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.390364  1763 ts_tablet_manager.cc:1434] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 12:58:01.363757  2141 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.387133  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:01.387562  1872 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:01.446787  1762 tablet_bootstrap.cc:492] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:01.447439  1762 ts_tablet_manager.cc:1403] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.445s	user 0.020s	sys 0.005s
I20260709 12:58:01.453212  2109 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:01.473456  2109 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:01.473994  2161 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:58:01.478309  2141 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:01.491936  1644 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:01.493146  1762 raft_consensus.cc:359] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.494984  1762 raft_consensus.cc:385] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:01.495512  1762 raft_consensus.cc:740] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:01.496447  1762 consensus_queue.cc:260] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.489876  2123 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:01.500406  1639 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:58:01.502588  1978 raft_consensus.cc:3055] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:01.483820  2109 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.502956  1978 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:01.509593  1762 ts_tablet_manager.cc:1434] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:58:01.511960  1761 tablet_bootstrap.cc:492] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:01.512059  1762 tablet_bootstrap.cc:492] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:01.479224  1872 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.510654  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:01.525928  1978 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.533906  2109 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:01.532473  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:01.536682  2108 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:01.539497  1763 tablet_bootstrap.cc:492] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:58:01.541010  1978 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:01.602809  1643 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:01.614951  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:01.616850  1565 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:58:01.618144  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:01.621533  1646 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:01.626444  1717 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:01.626705  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:01.656427  1763 tablet_bootstrap.cc:654] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:01.657502  1762 tablet_bootstrap.cc:654] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:01.657667  1761 tablet_bootstrap.cc:654] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:01.666397  1611 leader_election.cc:343] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:01.667438  1611 leader_election.cc:343] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:01.668361  1611 consensus_peers.cc:597] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:01.689704  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:01.720993  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:01.734033  1536 leader_election.cc:343] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:01.695683  1469 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:01.748399  1763 tablet_bootstrap.cc:492] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:58:01.754477  1763 ts_tablet_manager.cc:1403] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.216s	user 0.018s	sys 0.001s
I20260709 12:58:01.757093  1469 catalog_manager.cc:5697] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:58:01.755707  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:01.763099  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:01.764034  1645 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:58:01.760636  1469 catalog_manager.cc:5697] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:58:01.769016  1763 raft_consensus.cc:359] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.770016  1763 raft_consensus.cc:385] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:01.770458  1763 raft_consensus.cc:740] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:58:01.773288  2140 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:01.773862  2140 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:01.774986  2140 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.772482  1763 consensus_queue.cc:260] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.779927  1762 tablet_bootstrap.cc:492] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:01.780692  1762 ts_tablet_manager.cc:1403] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.269s	user 0.011s	sys 0.007s
I20260709 12:58:01.787588  1763 ts_tablet_manager.cc:1434] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.004s
I20260709 12:58:01.793473  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:01.796113  1762 raft_consensus.cc:359] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.797307  1762 raft_consensus.cc:385] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:01.797664  1762 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:01.798472  1762 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.802273  1762 ts_tablet_manager.cc:1434] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.002s
I20260709 12:58:01.804157  1762 tablet_bootstrap.cc:492] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:01.811405  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:01.812764  1763 tablet_bootstrap.cc:492] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
W20260709 12:58:01.827668  1536 leader_election.cc:343] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:01.842360  1536 consensus_peers.cc:597] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:01.843562  1761 tablet_bootstrap.cc:492] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:01.848152  1761 ts_tablet_manager.cc:1403] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.336s	user 0.015s	sys 0.020s
I20260709 12:58:01.850739  1685 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:01.852934  2141 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:01.850841  1536 leader_election.cc:343] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:01.861057  1762 tablet_bootstrap.cc:654] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:01.864902  1761 raft_consensus.cc:359] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.865805  1763 tablet_bootstrap.cc:654] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:01.865767  1761 raft_consensus.cc:385] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:01.866696  1761 raft_consensus.cc:740] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:01.870858  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:01.873821  1761 consensus_queue.cc:260] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.877351  2108 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:01.880565  2108 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.881004  2108 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:01.875545  2171 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:58:01.891237  1761 ts_tablet_manager.cc:1434] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:58:01.890276  2108 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.897250  1761 tablet_bootstrap.cc:492] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
W20260709 12:58:01.901000  1612 leader_election.cc:343] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:01.901458  1536 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:01.901503  1612 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:01.904938  1763 tablet_bootstrap.cc:492] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:58:01.905485  1763 ts_tablet_manager.cc:1403] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.093s	user 0.005s	sys 0.012s
I20260709 12:58:01.906097  2171 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:01.907639  2108 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:01.909229  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:01.910580  2170 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:01.911125  2170 raft_consensus.cc:697] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:01.911336  1762 tablet_bootstrap.cc:492] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:01.913100  1762 ts_tablet_manager.cc:1403] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.005s
W20260709 12:58:01.914439  1611 leader_election.cc:343] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:01.912166  2170 consensus_queue.cc:237] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.919258  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:01.920805  1763 raft_consensus.cc:359] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.924578  1763 raft_consensus.cc:385] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:01.925017  1763 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:58:01.930269  2140 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:01.931039  2140 raft_consensus.cc:697] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:01.932206  2140 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.933360  1761 tablet_bootstrap.cc:654] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:01.938165  1467 catalog_manager.cc:5697] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:01.946733  1467 catalog_manager.cc:5697] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:01.955945  1763 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.958204  2108 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.958741  2108 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.962785  1536 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:01.962260  1762 raft_consensus.cc:359] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.965869  1762 raft_consensus.cc:385] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:01.966579  1762 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:01.967499  1763 ts_tablet_manager.cc:1434] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.003s
I20260709 12:58:01.969501  2169 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:01.970026  2169 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.970458  2169 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:01.971359  1762 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:01.979413  2130 consensus_queue.cc:1048] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:01.990042  1763 tablet_bootstrap.cc:492] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:58:01.983467  2108 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:01.993173  1762 ts_tablet_manager.cc:1434] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.080s	user 0.010s	sys 0.000s
I20260709 12:58:01.990320  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:01.998504  1611 leader_election.cc:343] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:02.013338  1762 tablet_bootstrap.cc:492] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:02.022691  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:02.023525  1563 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:02.029922  2053 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.030097  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:02.030649  2053 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.046892  2053 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:02.061288  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:02.083443  1536 leader_election.cc:343] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:02.063585  1612 leader_election.cc:343] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:02.084163  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:02.068946  1641 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:58:02.065054  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:02.095893  1642 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:58:02.095932  2034 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:02.095013  1641 pending_rounds.cc:85] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 0
I20260709 12:58:02.098421  1641 pending_rounds.cc:107] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:58:02.098776  1641 raft_consensus.cc:2889] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:02.101850  2187 log.cc:927] Time spent T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:58:02.069053  1713 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:02.117477  1762 tablet_bootstrap.cc:654] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:02.118626  1763 tablet_bootstrap.cc:654] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:02.119902  1536 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:02.122561  2053 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:02.122991  2053 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.123384  2053 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:02.123843  2170 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:02.125347  1761 tablet_bootstrap.cc:492] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:02.113814  1563 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:02.129884  1761 ts_tablet_manager.cc:1403] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.233s	user 0.020s	sys 0.009s
I20260709 12:58:02.064375  2169 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.133940  2169 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:02.140013  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:58:02.143296  1536 leader_election.cc:343] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:02.148195  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:02.149014  1646 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:02.155925  1715 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:02.156049  1470 catalog_manager.cc:5697] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:02.156759  2141 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:02.158322  2141 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.160809  2169 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:02.162123  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:02.152890  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:02.162998  1563 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:02.163357  2034 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:02.163849  2034 raft_consensus.cc:697] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:02.164784  2034 consensus_queue.cc:237] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.167104  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:02.167829  1642 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:02.161177  2141 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:02.187762  1646 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:02.191711  1685 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:02.191581  1761 raft_consensus.cc:359] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.195127  1761 raft_consensus.cc:385] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:02.195523  1761 raft_consensus.cc:740] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:02.197531  1536 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:02.199914  1967 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:02.200373  1967 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:02.200773  1967 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:02.204061  2169 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:02.204664  2169 raft_consensus.cc:697] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:02.189721  2053 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.207752  2169 consensus_queue.cc:237] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.214219  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:02.214639  1762 tablet_bootstrap.cc:492] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:02.214993  1639 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:02.215202  1762 ts_tablet_manager.cc:1403] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.208s	user 0.020s	sys 0.012s
I20260709 12:58:02.218780  1761 consensus_queue.cc:260] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.225328  2053 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:02.231362  1967 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.239231  1761 ts_tablet_manager.cc:1434] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.000s
I20260709 12:58:02.241246  1761 tablet_bootstrap.cc:492] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:02.242230  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:58:02.245510  1536 leader_election.cc:343] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:02.250886  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:02.251879  1565 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:02.264964  2034 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.265661  2034 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.269516  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:02.271580  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:02.272781  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:58:02.274643  1611 leader_election.cc:343] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:02.274150  1469 catalog_manager.cc:5697] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 2, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
W20260709 12:58:02.275131  1612 leader_election.cc:343] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:02.275557  1612 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:02.276064  1469 catalog_manager.cc:5697] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:02.277251  2034 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:02.283257  1639 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:02.285924  2108 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:02.310863  1762 raft_consensus.cc:359] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.335501  1762 raft_consensus.cc:385] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:02.319370  1761 tablet_bootstrap.cc:654] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:02.276201  1967 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:02.335870  1762 raft_consensus.cc:740] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:02.340718  1762 consensus_queue.cc:260] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.343535  1762 ts_tablet_manager.cc:1434] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.128s	user 0.008s	sys 0.004s
I20260709 12:58:02.339479  1763 tablet_bootstrap.cc:492] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:58:02.344240  1763 ts_tablet_manager.cc:1403] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.363s	user 0.011s	sys 0.021s
I20260709 12:58:02.350988  1763 raft_consensus.cc:359] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.351910  1763 raft_consensus.cc:385] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:02.352236  1763 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:58:02.283766  2046 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.358040  2046 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.360929  2046 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:02.354617  1763 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.364667  1763 ts_tablet_manager.cc:1434] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:58:02.355381  1762 tablet_bootstrap.cc:492] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:02.333938  1646 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:02.367654  1685 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:02.368261  1536 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:02.370028  2053 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:02.374558  2141 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:02.375231  2141 raft_consensus.cc:697] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:02.376341  2141 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.370712  2053 raft_consensus.cc:697] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:02.379340  1761 tablet_bootstrap.cc:492] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:02.379037  2053 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.381341  1763 tablet_bootstrap.cc:492] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:58:02.382560  1761 ts_tablet_manager.cc:1403] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.142s	user 0.018s	sys 0.007s
I20260709 12:58:02.389856  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:02.390187  1713 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:02.399787  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:02.401751  1646 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:58:02.406868  1713 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:02.406140  1536 leader_election.cc:343] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:02.440649  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:02.448735  2170 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:02.450227  1762 tablet_bootstrap.cc:654] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:02.454134  1763 tablet_bootstrap.cc:654] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:02.436005  1639 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:02.466804  1761 raft_consensus.cc:359] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.467917  1761 raft_consensus.cc:385] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:02.468271  1761 raft_consensus.cc:740] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:02.469316  1761 consensus_queue.cc:260] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.477756  1761 ts_tablet_manager.cc:1434] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.000s
I20260709 12:58:02.483415  2166 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:02.484011  2166 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.486037  2166 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:02.491199  2108 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.492020  2108 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.496138  2108 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:02.500917  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:02.502862  1611 leader_election.cc:343] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:02.521276  1469 catalog_manager.cc:5697] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:02.524070  1469 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 1 to 2, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:02.529496  1469 catalog_manager.cc:5697] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:02.540954  1761 tablet_bootstrap.cc:492] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:02.545578  1469 catalog_manager.cc:5697] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:02.552935  2204 log.cc:927] Time spent T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:58:02.544375  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:02.561797  1571 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:58:02.562958  2070 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.563560  2070 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.572265  2034 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.573047  2034 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.574991  1470 catalog_manager.cc:5697] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 2, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:02.539664  2169 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 12:58:02.577826  2070 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:02.577865  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:02.582747  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:02.583060  1611 leader_election.cc:343] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:02.582325  2034 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:02.592895  1536 consensus_peers.cc:597] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:02.597507  1872 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:58:02.610129  1762 tablet_bootstrap.cc:492] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:02.609900  1612 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:02.616830  1763 tablet_bootstrap.cc:492] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:58:02.617515  1763 ts_tablet_manager.cc:1403] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.246s	user 0.018s	sys 0.026s
I20260709 12:58:02.625265  2108 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:02.625891  2108 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.626341  2108 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:02.630386  1762 ts_tablet_manager.cc:1403] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.275s	user 0.027s	sys 0.029s
I20260709 12:58:02.595197  2166 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.647985  2140 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:02.648029  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:02.650122  2140 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:02.650868  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:02.651580  1639 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:02.654657  1761 tablet_bootstrap.cc:654] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:02.657310  1685 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:58:02.657562  1611 consensus_peers.cc:597] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:02.660089  1715 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:02.660091  2070 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:02.662736  2070 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:02.663154  2070 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:02.679082  2108 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.681092  1763 raft_consensus.cc:359] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.688202  2209 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.689215  2034 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:02.693575  1763 raft_consensus.cc:385] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:02.696067  1763 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:58:02.696807  1763 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.698694  2209 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.702064  2169 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.702659  2169 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.704918  2209 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:02.716589  1763 ts_tablet_manager.cc:1434] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.005s
I20260709 12:58:02.719501  1762 raft_consensus.cc:359] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.761538  1762 raft_consensus.cc:385] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:02.761845  1762 raft_consensus.cc:740] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:02.718184  2108 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:02.766629  1762 consensus_queue.cc:260] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.770188  1761 tablet_bootstrap.cc:492] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:02.770502  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:02.770776  1761 ts_tablet_manager.cc:1403] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.254s	user 0.014s	sys 0.002s
I20260709 12:58:02.771122  1567 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:02.722313  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:02.704973  2169 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:02.765300  1470 catalog_manager.cc:5697] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:02.783665  1571 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:58:02.785780  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:02.786805  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:02.757364  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:02.732183  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:02.734091  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:02.795399  2166 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:02.799044  1761 raft_consensus.cc:359] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.820725  1761 raft_consensus.cc:385] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:02.799144  1762 ts_tablet_manager.cc:1434] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.168s	user 0.012s	sys 0.002s
I20260709 12:58:02.819876  1763 tablet_bootstrap.cc:492] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:58:02.821033  1761 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:02.823184  1762 tablet_bootstrap.cc:492] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:02.824666  1645 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
W20260709 12:58:02.832772  1611 leader_election.cc:343] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:02.834745  1761 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.867432  2070 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:02.878657  1714 raft_consensus.cc:1240] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:02.834003  1641 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:02.910344  1567 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:02.931896  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:02.940929  1536 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:02.959605  1612 leader_election.cc:343] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:02.960278  1612 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:02.963235  1761 ts_tablet_manager.cc:1434] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.192s	user 0.011s	sys 0.005s
I20260709 12:58:02.952711  1641 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:02.948964  2169 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:02.969889  2169 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.970463  2169 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:02.959756  1611 leader_election.cc:343] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:02.979686  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:02.980531  1761 tablet_bootstrap.cc:492] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:02.979499  2034 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:03.014977  2070 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:03.036094  2070 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.039994  2070 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.040036  2135 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:03.043839  2070 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:03.043906  2135 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:03.034736  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 55144.1us
I20260709 12:58:03.049613  2135 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:03.050316  1612 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:03.054905  2221 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:03.055605  2221 raft_consensus.cc:697] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:03.062012  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:03.056654  2221 consensus_queue.cc:237] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.063169  1646 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
W20260709 12:58:03.064910  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 48921.2us
I20260709 12:58:03.066118  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:58:03.075521  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 73042us
I20260709 12:58:03.090591  1639 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:03.093063  1717 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:03.096167  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:03.093274  1761 tablet_bootstrap.cc:654] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:03.107010  1536 leader_election.cc:343] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:03.120533  2046 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:58:03.126040  1872 consensus_queue.cc:1059] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:58:03.133680  2046 raft_consensus.cc:3055] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:03.134274  2046 raft_consensus.cc:740] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 12:58:03.141793  1536 consensus_peers.cc:597] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:03.150379  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:03.157052  2169 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.162408  1762 tablet_bootstrap.cc:654] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:03.166710  2046 consensus_queue.cc:260] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.190873  2046 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:03.195905  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:03.197186  2130 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:03.197856  2130 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:03.199046  2130 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:03.171159  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:03.178637  2053 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:03.184935  1571 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:03.185966  2169 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:03.234758  1763 tablet_bootstrap.cc:654] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:03.238312  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:03.267629  1685 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:03.275504  1685 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:03.276058  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 43849.6us
I20260709 12:58:03.289623  2229 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.290355  2229 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.292786  2229 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:03.293962  2157 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:03.294437  2157 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:03.294857  2157 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:03.294965  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:03.296367  1611 leader_election.cc:343] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:03.302950  1761 tablet_bootstrap.cc:492] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:03.303906  1761 ts_tablet_manager.cc:1403] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.325s	user 0.023s	sys 0.056s
I20260709 12:58:03.281793  2070 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:58:03.319567  2217 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:03.320461  2224 consensus_queue.cc:1059] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:03.321544  2224 raft_consensus.cc:3055] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:03.321938  2224 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:03.322912  2224 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.278512  2135 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.324178  2224 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:03.334811  1762 tablet_bootstrap.cc:492] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:03.335388  1762 ts_tablet_manager.cc:1403] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.512s	user 0.018s	sys 0.035s
I20260709 12:58:03.341177  1761 raft_consensus.cc:359] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.342042  1761 raft_consensus.cc:385] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:03.344524  1761 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:03.345386  1761 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.348578  1761 ts_tablet_manager.cc:1434] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 12:58:03.349511  1761 tablet_bootstrap.cc:492] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:03.353224  2157 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.329059  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:58:03.374166  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:03.376096  2157 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:03.378473  2233 log.cc:927] Time spent T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.068s	user 0.000s	sys 0.002s
I20260709 12:58:03.345357  2135 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:03.397195  1762 raft_consensus.cc:359] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.398272  1762 raft_consensus.cc:385] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:03.387970  1638 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:03.398712  1762 raft_consensus.cc:740] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:03.399761  1762 consensus_queue.cc:260] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.411659  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:03.425410  1762 ts_tablet_manager.cc:1434] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.002s
I20260709 12:58:03.429625  2219 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:03.442516  1638 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:03.442868  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:58:03.445577  1611 leader_election.cc:343] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:03.447758  1646 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:03.447188  1467 catalog_manager.cc:5697] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:03.446321  2219 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.454178  1763 tablet_bootstrap.cc:492] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:58:03.454770  1763 ts_tablet_manager.cc:1403] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.646s	user 0.042s	sys 0.066s
I20260709 12:58:03.455515  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:03.445228  1469 catalog_manager.cc:5697] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:03.459522  2238 log.cc:927] Time spent T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 12:58:03.463240  2141 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.463965  1762 tablet_bootstrap.cc:492] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:03.463827  2141 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:03.466112  2232 log.cc:927] Time spent T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:58:03.468616  1686 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:03.471220  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:03.467167  2141 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:03.472205  2157 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:03.473400  2219 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:03.479677  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:03.479988  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:03.483301  1685 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:03.488874  2140 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:03.488914  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:03.495863  2130 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.497656  2130 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.499954  2130 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:03.505028  1685 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:03.510583  2157 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:03.506458  2217 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:03.507176  1763 raft_consensus.cc:359] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.511662  1763 raft_consensus.cc:385] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:03.512639  1536 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:03.513331  1763 raft_consensus.cc:740] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:58:03.513540  2140 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:03.515668  2140 raft_consensus.cc:697] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 3 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:03.516855  2140 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.520093  1761 tablet_bootstrap.cc:654] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:03.522652  1763 consensus_queue.cc:260] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.526630  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:03.527555  1762 tablet_bootstrap.cc:654] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:03.538970  1763 ts_tablet_manager.cc:1434] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.001s
I20260709 12:58:03.544266  1763 tablet_bootstrap.cc:492] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
W20260709 12:58:03.555397  1612 leader_election.cc:343] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:03.558386  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:03.564764  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:03.564967  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:03.565804  1638 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:58:03.547254  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:03.571364  2227 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:03.568711  1571 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:03.605271  1536 leader_election.cc:343] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:03.628436  1763 tablet_bootstrap.cc:654] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:03.615198  1571 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:03.642197  1717 raft_consensus.cc:1240] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:03.643421  1715 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:03.645790  1762 tablet_bootstrap.cc:492] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:03.646867  1762 ts_tablet_manager.cc:1403] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.183s	user 0.032s	sys 0.010s
I20260709 12:58:03.648132  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:03.654939  2130 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:03.660331  2130 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:03.660753  2130 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:03.660961  1761 tablet_bootstrap.cc:492] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:03.661482  1761 ts_tablet_manager.cc:1403] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.312s	user 0.025s	sys 0.009s
I20260709 12:58:03.665666  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:03.685132  2140 consensus_queue.cc:1059] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:03.689693  2135 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:03.689778  1762 raft_consensus.cc:359] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.690589  2140 raft_consensus.cc:3055] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:03.691004  1762 raft_consensus.cc:385] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:03.691035  2140 raft_consensus.cc:740] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:03.691414  1762 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:03.692065  2140 consensus_queue.cc:260] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.692215  1762 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.693574  2140 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:03.708153  1762 ts_tablet_manager.cc:1434] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
W20260709 12:58:03.708806  1611 consensus_peers.cc:597] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:03.709506  2135 raft_consensus.cc:697] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:03.710908  2135 consensus_queue.cc:237] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.715783  2208 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:03.726136  1762 tablet_bootstrap.cc:492] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:03.732589  1761 raft_consensus.cc:359] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.718930  2130 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.740577  1761 raft_consensus.cc:385] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:03.743387  1761 raft_consensus.cc:740] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:03.745838  2130 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:03.748001  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:03.748731  1645 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:03.758276  1761 consensus_queue.cc:260] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.771829  1763 tablet_bootstrap.cc:492] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:58:03.739322  2221 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:03.772420  1763 ts_tablet_manager.cc:1403] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.231s	user 0.014s	sys 0.011s
I20260709 12:58:03.780684  1763 raft_consensus.cc:359] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.781499  1763 raft_consensus.cc:385] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:03.781805  1763 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:58:03.793627  1763 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.798887  1762 tablet_bootstrap.cc:654] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:03.788728  1761 ts_tablet_manager.cc:1434] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.127s	user 0.005s	sys 0.005s
I20260709 12:58:03.809921  1763 ts_tablet_manager.cc:1434] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 12:58:03.818109  1763 tablet_bootstrap.cc:492] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:58:03.828186  1713 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:03.835887  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:03.841336  1645 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:03.848201  1761 tablet_bootstrap.cc:492] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:03.848161  2209 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.855890  2209 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.858088  2209 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:03.859517  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:03.861048  1761 tablet_bootstrap.cc:654] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:03.861200  1611 leader_election.cc:343] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:03.868217  2209 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.868903  2209 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.873391  2209 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:03.887722  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:03.889393  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:03.889878  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:03.897135  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:03.905635  1762 tablet_bootstrap.cc:492] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:03.906276  1762 ts_tablet_manager.cc:1403] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.180s	user 0.032s	sys 0.019s
I20260709 12:58:03.913120  2234 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:03.913879  2234 raft_consensus.cc:697] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:03.914913  2234 consensus_queue.cc:237] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:03.920827  1611 leader_election.cc:343] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:03.928808  1612 leader_election.cc:343] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:03.932899  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:03.930258  1469 catalog_manager.cc:5697] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 2 to 3, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 3 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:03.939188  1536 leader_election.cc:343] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:03.939819  1612 leader_election.cc:343] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:03.940636  1612 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:03.937897  2135 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:03.943830  2227 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:03.943140  1536 consensus_peers.cc:597] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:03.950274  1763 tablet_bootstrap.cc:654] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:03.958504  1647 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:03.956466  1762 raft_consensus.cc:359] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.964219  1762 raft_consensus.cc:385] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:03.964537  1762 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:03.971688  2046 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:03.979444  1762 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.981516  2209 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.982973  2209 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:03.999313  2209 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:04.004340  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:04.006152  1611 leader_election.cc:343] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.012010  1761 tablet_bootstrap.cc:492] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:04.012701  1761 ts_tablet_manager.cc:1403] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.021s
I20260709 12:58:04.014961  1467 catalog_manager.cc:5697] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:04.021818  1761 raft_consensus.cc:359] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.022805  1761 raft_consensus.cc:385] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.023142  1761 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.024020  1761 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.026423  1761 ts_tablet_manager.cc:1434] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:58:04.028097  1761 tablet_bootstrap.cc:492] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:04.032230  1762 ts_tablet_manager.cc:1434] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.126s	user 0.005s	sys 0.004s
I20260709 12:58:04.033190  2124 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.034475  1762 tablet_bootstrap.cc:492] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:04.036720  2124 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.034386  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:04.040670  1570 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:58:04.040750  2124 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:04.045117  1715 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:04.045552  1715 pending_rounds.cc:85] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 1
I20260709 12:58:04.045774  1715 pending_rounds.cc:107] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:04.046012  1715 raft_consensus.cc:2889] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:04.053296  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:04.054965  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:04.055656  1646 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:58:04.056272  1763 tablet_bootstrap.cc:492] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:58:04.056821  1763 ts_tablet_manager.cc:1403] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.241s	user 0.018s	sys 0.000s
I20260709 12:58:04.056951  2221 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:04.057324  2221 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.057721  2221 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.059512  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:04.062788  2157 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.059155  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:04.063355  2157 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:04.067979  1536 leader_election.cc:343] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.059123  1469 catalog_manager.cc:5697] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:04.069288  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:04.067737  2140 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:04.069319  2046 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:58:04.070876  2140 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.071231  2140 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.071527  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:04.069397  2157 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:04.073319  1763 raft_consensus.cc:359] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.074002  1763 raft_consensus.cc:385] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.075592  1763 raft_consensus.cc:740] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.076275  1763 consensus_queue.cc:260] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.083791  1763 ts_tablet_manager.cc:1434] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 12:58:04.088095  1686 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:04.090968  1761 tablet_bootstrap.cc:654] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.092207  2157 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:04.095474  2221 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.100522  1762 tablet_bootstrap.cc:654] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.107744  2140 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.107820  1763 tablet_bootstrap.cc:492] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 12:58:04.115279  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:04.116186  1570 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:04.141113  2140 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:04.150173  2221 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:04.127806  2234 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.205065  2234 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.211699  1761 tablet_bootstrap.cc:492] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:04.214413  1761 ts_tablet_manager.cc:1403] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.187s	user 0.017s	sys 0.007s
I20260709 12:58:04.214767  2234 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:04.212253  1762 tablet_bootstrap.cc:492] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:04.212306  1763 tablet_bootstrap.cc:654] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.217564  1762 ts_tablet_manager.cc:1403] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.183s	user 0.014s	sys 0.009s
I20260709 12:58:04.220960  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:04.222826  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:04.223670  1643 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 1: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:04.233552  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:04.234335  1643 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:58:04.235530  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:04.238495  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:04.241850  1536 leader_election.cc:343] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.242326  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:04.243371  2124 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:58:04.243625  1536 leader_election.cc:343] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.247575  2221 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.248128  2221 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.250490  2221 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:04.251797  1611 leader_election.cc:343] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.252388  1611 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:04.253239  2221 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:04.245540  1761 raft_consensus.cc:359] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.259418  1761 raft_consensus.cc:385] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.261796  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:04.259894  1761 raft_consensus.cc:740] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.266115  1761 consensus_queue.cc:260] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.271621  1761 ts_tablet_manager.cc:1434] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 12:58:04.287614  1761 tablet_bootstrap.cc:492] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:04.238294  1762 raft_consensus.cc:359] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:04.263597  1611 leader_election.cc:343] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.280516  1536 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:04.290112  1872 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:04.290481  1872 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.290788  1872 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.284369  1763 tablet_bootstrap.cc:492] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208: No bootstrap required, opened a new log
I20260709 12:58:04.293195  1763 ts_tablet_manager.cc:1403] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.191s	user 0.025s	sys 0.005s
I20260709 12:58:04.296330  1763 raft_consensus.cc:359] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.297060  1763 raft_consensus.cc:385] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.297335  1763 raft_consensus.cc:740] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.302189  1761 tablet_bootstrap.cc:654] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.298969  1872 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.308759  1762 raft_consensus.cc:385] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.320545  1762 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.313081  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:04.313947  1763 consensus_queue.cc:260] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.375635  1761 tablet_bootstrap.cc:492] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:04.383761  1761 ts_tablet_manager.cc:1403] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.011s
I20260709 12:58:04.385234  1763 ts_tablet_manager.cc:1434] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.000s
W20260709 12:58:04.386236  1611 consensus_peers.cc:597] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:04.386373  1761 raft_consensus.cc:359] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.387086  1761 raft_consensus.cc:385] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.387387  1761 raft_consensus.cc:740] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.388094  1761 consensus_queue.cc:260] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.377050  1762 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:04.372664  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 52620.4us
I20260709 12:58:04.392335  1762 ts_tablet_manager.cc:1434] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.173s	user 0.006s	sys 0.002s
I20260709 12:58:04.393388  1762 tablet_bootstrap.cc:492] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:04.380580  1872 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:04.394836  1761 ts_tablet_manager.cc:1434] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:58:04.400966  1761 tablet_bootstrap.cc:492] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:04.404095  1715 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.414204  2135 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.417922  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:04.418001  2135 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.424504  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:04.421710  2135 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:04.426348  1611 leader_election.cc:343] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.429524  2135 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:04.446715  1762 tablet_bootstrap.cc:654] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:04.447602  1612 leader_election.cc:343] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.443333  1761 tablet_bootstrap.cc:654] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.448233  1612 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:04.450299  2209 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:04.457527  1536 leader_election.cc:343] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.473341  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:04.476420  1612 leader_election.cc:343] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.477018  1612 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:04.484400  2227 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:04.498769  1712 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.507591  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:04.508368  1640 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:04.536520  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:04.543800  1640 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:04.545655  2046 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:04.559978  1536 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:04.561336  2124 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:04.561913  2124 raft_consensus.cc:697] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:04.562963  2124 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.566440  1715 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.567234  2135 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:04.575714  2135 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.587105  1761 tablet_bootstrap.cc:492] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:04.587755  1761 ts_tablet_manager.cc:1403] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.187s	user 0.016s	sys 0.012s
I20260709 12:58:04.587288  2135 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:04.599896  1761 raft_consensus.cc:359] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.606356  1761 raft_consensus.cc:385] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.606698  1761 raft_consensus.cc:740] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.604815  1762 tablet_bootstrap.cc:492] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:04.593547  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:04.607620  1762 ts_tablet_manager.cc:1403] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.214s	user 0.016s	sys 0.026s
I20260709 12:58:04.608785  1761 consensus_queue.cc:260] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.596624  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:04.616243  1569 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:04.623876  1761 ts_tablet_manager.cc:1434] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.001s
I20260709 12:58:04.623970  2275 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.626430  1717 raft_consensus.cc:2393] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:04.625784  2275 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.626947  1762 raft_consensus.cc:359] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.631613  2275 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:04.632496  1762 raft_consensus.cc:385] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.633164  1762 raft_consensus.cc:740] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.635355  1762 consensus_queue.cc:260] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.654385  1761 tablet_bootstrap.cc:492] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:04.649143  2141 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.674373  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:04.674212  2141 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.724932  1762 ts_tablet_manager.cc:1434] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.117s	user 0.013s	sys 0.000s
I20260709 12:58:04.734434  1762 tablet_bootstrap.cc:492] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:04.726801  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:04.754662  2135 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:04.759239  2135 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:04.759650  2135 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:04.761494  2278 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:58:04.777607  1761 tablet_bootstrap.cc:654] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.795914  2141 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:04.804333  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:04.808182  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:04.811890  1686 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:04.830583  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:04.833514  2280 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:04.810289  2046 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.839203  2170 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.845084  1470 catalog_manager.cc:5697] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:04.845757  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 64927.1us
I20260709 12:58:04.849156  2170 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.856364  2170 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:04.864425  2135 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.867024  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:04.869499  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:04.870664  1716 raft_consensus.cc:2393] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:04.867090  2135 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:04.874748  1716 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.863643  1762 tablet_bootstrap.cc:654] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.847832  2046 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:04.877624  1536 leader_election.cc:343] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.905164  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:04.905867  1646 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:58:04.904892  2277 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.917819  2046 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:04.918344  2277 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.922977  1685 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:04.940616  2280 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:04.954674  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:04.955541  1571 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:04.955626  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:04.958573  1686 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:04.948346  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:04.964318  1761 tablet_bootstrap.cc:492] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:04.964872  1761 ts_tablet_manager.cc:1403] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.311s	user 0.022s	sys 0.014s
I20260709 12:58:04.969033  1761 raft_consensus.cc:359] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.970358  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:04.971108  1639 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:04.965585  2277 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:04.977727  2280 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:04.978370  2280 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.978719  2280 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:04.969831  1761 raft_consensus.cc:385] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.985071  1761 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.989756  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:04.988083  1563 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:04.992849  1645 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:58:04.996192  1761 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:04.998889  1761 ts_tablet_manager.cc:1434] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.002s
W20260709 12:58:05.003450  1536 leader_election.cc:343] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:05.004055  1761 tablet_bootstrap.cc:492] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:05.005096  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:05.009495  2046 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:05.011188  2046 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.015077  2046 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.020308  1762 tablet_bootstrap.cc:492] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:05.020918  1762 ts_tablet_manager.cc:1403] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.294s	user 0.029s	sys 0.019s
I20260709 12:58:05.024586  1762 raft_consensus.cc:359] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.025279  1762 raft_consensus.cc:385] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.025530  1762 raft_consensus.cc:740] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.026619  1762 consensus_queue.cc:260] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.033787  1536 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:05.041181  1761 tablet_bootstrap.cc:654] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.037755  2278 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:05.049104  1762 ts_tablet_manager.cc:1434] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:58:05.052209  1762 tablet_bootstrap.cc:492] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:05.054939  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:05.049880  2278 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.060985  2278 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.061137  2292 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:05.039604  2280 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.073112  2292 raft_consensus.cc:697] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:05.085623  2280 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:05.089198  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:05.090607  1565 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.107249  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:05.120216  2170 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:58:05.127278  2292 consensus_queue.cc:237] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.185371  2046 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.188948  2220 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:05.194974  2220 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:05.192752  1536 consensus_peers.cc:597] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:05.186197  1761 tablet_bootstrap.cc:492] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:05.192965  1565 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:05.199088  1761 ts_tablet_manager.cc:1403] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.195s	user 0.018s	sys 0.018s
I20260709 12:58:05.189772  1762 tablet_bootstrap.cc:654] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.199903  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:05.200783  1716 raft_consensus.cc:2393] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:05.201699  1686 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:05.203529  2277 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:05.203979  2220 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:05.204030  2277 raft_consensus.cc:697] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:05.206632  2277 consensus_queue.cc:237] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.193449  2278 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.212464  2278 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:05.222806  1470 catalog_manager.cc:5697] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 2, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.212589  1761 raft_consensus.cc:359] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.233714  1761 raft_consensus.cc:385] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.234190  1761 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.234956  1761 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.242785  1761 ts_tablet_manager.cc:1434] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.003s
I20260709 12:58:05.246869  2280 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.247519  2280 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.247849  2046 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:05.249857  2280 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:05.257709  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:05.261147  1761 tablet_bootstrap.cc:492] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:05.263501  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:05.268780  1712 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.269304  1467 catalog_manager.cc:5697] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 2 to 3, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.285241  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:05.289347  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:05.290246  1565 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:05.309578  2280 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.310328  2280 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.312486  2280 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:05.319429  1762 tablet_bootstrap.cc:492] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:05.320143  1762 ts_tablet_manager.cc:1403] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.268s	user 0.049s	sys 0.045s
I20260709 12:58:05.323796  1685 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:05.326017  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:05.327186  1647 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.329831  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:05.330576  1565 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:05.337287  1762 raft_consensus.cc:359] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.341195  1762 raft_consensus.cc:385] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.341528  1762 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.342211  1762 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.343133  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:05.343814  1638 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.344492  1686 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:05.345355  2277 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:05.345709  2277 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.346020  2277 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.353892  2277 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.356387  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:05.360004  1762 ts_tablet_manager.cc:1434] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.003s
I20260709 12:58:05.364817  1762 tablet_bootstrap.cc:492] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a: Bootstrap starting.
I20260709 12:58:05.361521  2280 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:05.373936  1536 leader_election.cc:343] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:05.376852  1761 tablet_bootstrap.cc:654] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.379297  1762 tablet_bootstrap.cc:654] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.382155  2277 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:05.382797  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:05.390493  1565 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.353582  1638 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:05.394411  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:05.398305  2292 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:05.398741  2292 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:05.399101  2292 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.384093  1647 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:05.403128  1762 tablet_bootstrap.cc:492] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a: No bootstrap required, opened a new log
I20260709 12:58:05.403676  1762 ts_tablet_manager.cc:1403] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.000s
I20260709 12:58:05.404772  1565 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:05.405413  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:05.385598  1536 leader_election.cc:343] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:05.406666  1762 raft_consensus.cc:359] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.407222  1686 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:05.407485  1762 raft_consensus.cc:385] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.407851  1762 raft_consensus.cc:740] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.408107  2277 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:05.408974  2277 raft_consensus.cc:697] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:05.408546  1762 consensus_queue.cc:260] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.410523  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:05.411589  1762 ts_tablet_manager.cc:1434] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:58:05.409917  2277 consensus_queue.cc:237] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.418493  2292 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.416127  1761 tablet_bootstrap.cc:492] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:05.420295  1761 ts_tablet_manager.cc:1403] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.159s	user 0.012s	sys 0.002s
I20260709 12:58:05.422972  1761 raft_consensus.cc:359] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.423880  1761 raft_consensus.cc:385] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.424175  1761 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.424917  1761 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.427148  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:05.428064  2285 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:05.429499  2285 raft_consensus.cc:697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:05.427367  1761 ts_tablet_manager.cc:1434] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:05.432343  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:05.432263  2285 consensus_queue.cc:237] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.433526  1761 tablet_bootstrap.cc:492] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:05.429787  1638 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:05.428427  1536 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:05.443626  2170 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:05.431221  2292 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:05.509045  1467 catalog_manager.cc:5697] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.472620  2284 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.592808  2284 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.497370  2274 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.594878  2274 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.489063  2170 raft_consensus.cc:697] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:05.562091  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:05.580305  2217 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.653523  1568 raft_consensus.cc:2368] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3.
I20260709 12:58:05.633227  2217 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:05.681035  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:05.686636  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:05.689610  1646 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:58:05.700596  1612 leader_election.cc:400] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3.
I20260709 12:58:05.701028  1612 leader_election.cc:403] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:58:05.664150  2170 consensus_queue.cc:237] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.694113  2284 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:05.709082  2046 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.738565  2046 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:05.748011  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 54293.5us
I20260709 12:58:05.715631  2220 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.767884  2217 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:05.759992  2135 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.776536  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:05.746417  2046 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:05.778373  2135 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.760402  2140 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.789085  2140 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.788322  2135 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:05.767925  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:05.803220  1716 raft_consensus.cc:1240] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:05.808948  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:05.811882  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:05.824030  1611 leader_election.cc:343] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:05.825250  2282 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:05.828581  2323 consensus_queue.cc:1059] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:58:05.838718  2323 consensus_queue.cc:1243] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:58:05.839274  2323 raft_consensus.cc:3055] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:05.839588  2323 raft_consensus.cc:740] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:05.842856  1563 raft_consensus.cc:1240] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:05.844307  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:05.845009  1638 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:58:05.855365  2274 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:05.857649  2140 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:05.826272  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:05.862941  1568 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:05.841238  2323 consensus_queue.cc:260] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:05.868546  2323 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:05.865907  1570 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:05.833958  2282 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.879521  2282 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.832762  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:05.883001  1641 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 1: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:05.885174  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:05.906042  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 77148.9us
W20260709 12:58:05.906955  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 50595.8us
I20260709 12:58:05.886169  1570 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 0.
I20260709 12:58:05.906554  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:05.900027  2220 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3.
I20260709 12:58:05.933519  1761 tablet_bootstrap.cc:654] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.926826  2283 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:05.946465  2283 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.946875  2283 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.954648  1686 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:05.956938  1469 catalog_manager.cc:5697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:05.959286  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 48810.6us
I20260709 12:58:05.960515  1612 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:05.961140  1469 catalog_manager.cc:5697] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.967741  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:05.963383  2220 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:05.968487  1647 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 0.
I20260709 12:58:05.968676  2220 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.969089  2220 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.959334  2321 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:05.988394  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:05.998988  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:05.978811  2217 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:58:06.004956  1571 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:05.969115  2282 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.009611  2282 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:06.015180  2220 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.022375  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:06.030580  2220 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:06.017765  2283 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.047406  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:06.063937  2283 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:06.064215  1716 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:06.067467  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:06.068179  1643 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:06.070307  1611 leader_election.cc:343] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:06.069980  1685 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:06.071566  2329 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:06.069700  1761 tablet_bootstrap.cc:492] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:06.073251  1761 ts_tablet_manager.cc:1403] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.640s	user 0.034s	sys 0.027s
I20260709 12:58:06.075621  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:06.071578  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:06.081789  1638 raft_consensus.cc:2393] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 1: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:06.090231  2329 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:06.090919  1642 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:06.092435  1638 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:06.092854  1638 pending_rounds.cc:85] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 1
I20260709 12:58:06.093111  1638 pending_rounds.cc:107] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:06.093372  1638 raft_consensus.cc:2889] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:06.093540  1761 raft_consensus.cc:359] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.094383  1761 raft_consensus.cc:385] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:06.094676  1761 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:06.085302  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:06.097101  2282 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:06.083498  2284 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:06.099689  2284 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:06.100085  2284 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:06.102762  1643 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:06.104828  2314 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.109071  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:06.109181  2314 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.113193  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:06.114866  2283 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:06.115567  2283 raft_consensus.cc:697] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:06.116456  2283 consensus_queue.cc:237] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.107795  1761 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.135988  1761 ts_tablet_manager.cc:1434] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.001s
W20260709 12:58:06.139848  1536 leader_election.cc:343] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:06.143399  1536 leader_election.cc:343] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:06.154280  2326 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:06.160967  1761 tablet_bootstrap.cc:492] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
W20260709 12:58:06.301249  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 136256us
I20260709 12:58:06.120267  2284 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.321646  2284 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:06.324750  1536 leader_election.cc:343] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:06.329754  2332 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.330386  2332 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.331116  2170 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.331631  2170 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.332607  2332 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:06.334707  2170 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:06.339834  1536 leader_election.cc:343] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:06.342248  1536 leader_election.cc:343] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:06.342815  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:06.345479  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:06.346385  1720 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:06.349925  2324 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:58:06.351419  1536 consensus_peers.cc:597] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:06.362444  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:06.363471  1565 raft_consensus.cc:2393] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:06.374440  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:06.376542  1571 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:06.377732  1761 tablet_bootstrap.cc:654] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:06.374636  1611 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:06.381150  2332 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:06.381557  2332 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:06.381896  2332 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.386096  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:06.391983  2332 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.402257  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:06.402706  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:06.403198  1716 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:06.403352  1643 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:06.412750  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:06.413743  1640 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:06.430660  1643 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:06.431010  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:06.432971  1712 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.431612  2332 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:06.432066  1612 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:06.438086  2292 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:06.440353  1761 tablet_bootstrap.cc:492] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:06.440886  1761 ts_tablet_manager.cc:1403] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.280s	user 0.016s	sys 0.008s
I20260709 12:58:06.446453  1761 raft_consensus.cc:359] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.447203  1761 raft_consensus.cc:385] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:06.447472  1761 raft_consensus.cc:740] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:06.448174  1761 consensus_queue.cc:260] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.451383  1761 ts_tablet_manager.cc:1434] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 12:58:06.452486  1761 tablet_bootstrap.cc:492] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:06.466022  1712 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:06.467003  2280 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.467800  1761 tablet_bootstrap.cc:654] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:06.467730  2280 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.467820  1611 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:06.469035  2292 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:06.469563  2292 raft_consensus.cc:697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:06.471608  2280 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:06.471225  2292 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.481175  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:06.484799  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:06.486814  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:06.487263  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:06.494379  2324 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:58:06.496917  1536 leader_election.cc:343] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:06.488924  2274 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:06.495167  2324 raft_consensus.cc:697] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:06.500324  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:06.505563  2318 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:06.520076  2318 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:06.520546  2318 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.528160  2324 consensus_queue.cc:237] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.546233  1467 catalog_manager.cc:5697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 0 to 2, leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:06.550904  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 47896.4us
I20260709 12:58:06.551870  1761 tablet_bootstrap.cc:492] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:06.552490  1761 ts_tablet_manager.cc:1403] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.100s	user 0.029s	sys 0.032s
I20260709 12:58:06.553913  2318 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.555665  1761 raft_consensus.cc:359] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.556214  2318 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:06.556504  1761 raft_consensus.cc:385] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:06.556856  1761 raft_consensus.cc:740] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:06.557623  1761 consensus_queue.cc:260] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.560062  1761 ts_tablet_manager.cc:1434] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:06.561170  1761 tablet_bootstrap.cc:492] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:06.568801  1712 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:06.574337  1761 tablet_bootstrap.cc:654] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:06.592180  1712 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:06.633409  2217 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.634248  2217 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.640021  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:06.645088  2217 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:06.646342  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:06.647580  1643 raft_consensus.cc:2393] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:06.658164  1685 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:06.659920  2217 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:06.702539  1761 tablet_bootstrap.cc:492] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:06.703120  1761 ts_tablet_manager.cc:1403] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.142s	user 0.024s	sys 0.053s
I20260709 12:58:06.703328  2274 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.703861  2274 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.706192  2274 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:06.707607  1761 raft_consensus.cc:359] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.707966  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:06.708614  1761 raft_consensus.cc:385] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:06.708942  1761 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:06.709648  1761 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.710490  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:06.711210  1641 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:06.712013  1761 ts_tablet_manager.cc:1434] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:58:06.713100  1761 tablet_bootstrap.cc:492] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0: Bootstrap starting.
I20260709 12:58:06.715471  1470 catalog_manager.cc:5697] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:06.719841  1761 tablet_bootstrap.cc:654] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:06.724992  1685 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:06.728968  2274 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:06.729454  2274 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:06.729805  2274 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.734709  1761 tablet_bootstrap.cc:492] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0: No bootstrap required, opened a new log
I20260709 12:58:06.735283  1761 ts_tablet_manager.cc:1403] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 12:58:06.739257  2315 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.739872  2315 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.742328  2315 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:06.743583  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:06.744455  1571 raft_consensus.cc:2393] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:06.742215  2274 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.749056  1761 raft_consensus.cc:359] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.749902  1761 raft_consensus.cc:385] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:06.750211  1761 raft_consensus.cc:740] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Initialized, Role: FOLLOWER
I20260709 12:58:06.750994  1761 consensus_queue.cc:260] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.752002  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:06.753029  2274 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:06.756554  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:06.757418  1643 raft_consensus.cc:2393] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 1: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:06.758435  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:06.759331  1568 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:06.755486  1761 ts_tablet_manager.cc:1434] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:58:06.763903  1685 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:06.771341  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:06.781275  1712 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:06.782766  2274 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:06.787040  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:06.787855  1642 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.796367  1642 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:06.796993  2274 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:06.773068  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:06.780387  2217 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:06.810765  1685 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:06.811642  2217 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:06.812733  2217 raft_consensus.cc:697] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:06.814141  2217 consensus_queue.cc:237] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.816128  2324 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:06.824329  2318 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:06.826023  2311 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:06.830543  2274 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.831161  2274 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.832533  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:06.833448  2274 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:06.834038  2283 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:06.835093  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:06.835857  2283 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:06.838198  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:06.839129  1641 raft_consensus.cc:2393] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 1: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:06.840591  1685 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:06.844560  2274 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:06.856590  1717 raft_consensus.cc:1240] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:58:06.862017  1641 raft_consensus.cc:1240] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:58:06.876056  1470 catalog_manager.cc:5697] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 1, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:06.887799  2351 consensus_queue.cc:1059] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:06.889684  2351 consensus_queue.cc:1243] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:58:06.890185  2311 raft_consensus.cc:3055] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:06.890545  2311 raft_consensus.cc:740] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:06.891412  2311 consensus_queue.cc:260] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:06.892858  2311 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.894747  2274 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:06.938978  1719 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:06.936412  1470 catalog_manager.cc:5697] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 2, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:06.951694  2332 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:58:06.969306  1518 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:07.025547  1570 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:07.028662  2292 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:07.056089  2316 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:07.081748  2324 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:07.298396  1641 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:07.300896  2217 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:07.312687  1570 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:58:07.313112  1570 pending_rounds.cc:85] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 0
I20260709 12:58:07.313328  1570 pending_rounds.cc:107] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:58:07.313544  1570 raft_consensus.cc:2889] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:07.315524  2217 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:08.010660  2316 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.011336  2316 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:08.014575  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:08.013810  2316 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:08.015379  1642 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:08.018582  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:08.021632  2316 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:08.022009  2316 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.022356  2316 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:08.031708  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:08.032539  1717 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:08.035466  2316 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:08.038400  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:08.038935  2316 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:08.039045  1642 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:08.042434  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:08.043111  1716 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:08.047967  1642 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:08.049804  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:08.050853  1716 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:08.050908  2316 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:08.054227  2316 raft_consensus.cc:697] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:08.055285  2316 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:08.086619  1467 catalog_manager.cc:5697] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 0 to 2, leader changed from <none> to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:08.631925  1641 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:08.633704  2372 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:08.667551  1716 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:08.686460  2046 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:09.948819   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:10.113682  2386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:10.142109  2387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:10.150151  2398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:10.161267   431 server_base.cc:1061] running on GCE node
I20260709 12:58:10.165470   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:10.165875   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:10.166189   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601890166167 us; error 0 us; skew 500 ppm
I20260709 12:58:10.182305   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:10.200917   431 webserver.cc:533] Webserver started at http://127.0.107.196:41037/ using document root <none> and password file <none>
I20260709 12:58:10.205597   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:10.206501   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:10.207082   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:10.209519   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-3-root/instance:
uuid: "6f381117554e49bb816791ab0a10f2b8"
format_stamp: "Formatted at 2026-07-09 12:58:10 on dist-test-slave-zhdc"
I20260709 12:58:10.230036   431 fs_manager.cc:696] Time spent creating directory manager: real 0.019s	user 0.011s	sys 0.001s
I20260709 12:58:10.247051  2403 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:10.250969   431 fs_manager.cc:730] Time spent opening block manager: real 0.017s	user 0.009s	sys 0.001s
I20260709 12:58:10.251964   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-3-root
uuid: "6f381117554e49bb816791ab0a10f2b8"
format_stamp: "Formatted at 2026-07-09 12:58:10 on dist-test-slave-zhdc"
I20260709 12:58:10.252528   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:10.418951   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:10.421279   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:10.430015   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:10.440728   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:10.441090   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:10.441460   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:10.441721   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:12.225047   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:39297
I20260709 12:58:12.225186  2477 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:39297 every 8 connection(s)
I20260709 12:58:12.273702   431 auto_leader_rebalancer-test.cc:384] add a tserver: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:12.312081  2478 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33273
I20260709 12:58:12.312726  2478 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:12.313982  2478 heartbeater.cc:507] Master 127.0.107.254:33273 requested a full tablet report, sending...
I20260709 12:58:12.316825  1467 ts_manager.cc:194] Registered new tserver with Master: 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:12.319084  1467 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60766
I20260709 12:58:13.324276  2478 heartbeater.cc:499] Master 127.0.107.254:33273 was elected leader, sending a full tablet report...
W20260709 12:58:13.415222  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 105291us
I20260709 12:58:13.483654  1571 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:13.521034  1717 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:13.525615  1639 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:13.529830  2397 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:13.531440  2454 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:13.575587  2454 raft_consensus.cc:2955] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:13.579792  1640 raft_consensus.cc:2955] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:13.585984  1712 raft_consensus.cc:2955] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 12:58:13.588203  1537 consensus_peers.cc:597] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2033b178bcb643fd84ac0d1ae7e6a64b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:13.622255  1467 catalog_manager.cc:5697] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:13.632341  1568 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
W20260709 12:58:13.658872  1537 consensus_peers.cc:597] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41d3057239d54d6183db91d2b176c2dd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:13.659675  1719 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:13.662583  1639 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:13.662669  2454 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:13.670186  2394 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:13.703359  2394 raft_consensus.cc:2955] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:13.704741  1712 raft_consensus.cc:2955] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:13.722860  1639 raft_consensus.cc:2955] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:13.786125  1469 catalog_manager.cc:5697] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index -1 to 3, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:13.809538  1712 consensus_queue.cc:237] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:13.836094  1641 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:13.889338  1571 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:13.896555  2445 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:58:13.908016  2328 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:13.927084  1639 raft_consensus.cc:2955] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 12:58:13.947921  1686 consensus_peers.cc:597] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 016c9143ad3147438e814f92f2090928. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:13.966403  2503 raft_consensus.cc:2955] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:13.968814  1469 catalog_manager.cc:5697] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 3, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:14.021310  1721 consensus_queue.cc:237] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:14.062445  1565 raft_consensus.cc:2955] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:14.078474  1568 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:14.080133  2503 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:14.088486  1641 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:58:14.089704  1686 consensus_peers.cc:597] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b47cff236bac4d2fae5f94a61502aec7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:14.096309  2445 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:14.103628  2505 ts_tablet_manager.cc:933] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 12:58:14.123139  2503 raft_consensus.cc:2955] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:14.127347  1568 raft_consensus.cc:2955] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:14.148512  2505 tablet_copy_client.cc:323] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 12:58:14.217165  1469 catalog_manager.cc:5697] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:14.244508  1582 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet 2033b178bcb643fd84ac0d1ae7e6a64b from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 12:58:14.245229  1582 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet 2033b178bcb643fd84ac0d1ae7e6a64b from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-2033b178bcb643fd84ac0d1ae7e6a64b
I20260709 12:58:14.251296  2513 ts_tablet_manager.cc:933] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 12:58:14.252066  1641 raft_consensus.cc:2955] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:14.274601  1582 tablet_copy_source_session.cc:215] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:14.295794  2513 tablet_copy_client.cc:323] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 12:58:14.310257  2505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2033b178bcb643fd84ac0d1ae7e6a64b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.346342  1582 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet 41d3057239d54d6183db91d2b176c2dd from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 12:58:14.347071  1582 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet 41d3057239d54d6183db91d2b176c2dd from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-41d3057239d54d6183db91d2b176c2dd
I20260709 12:58:14.359556  1582 tablet_copy_source_session.cc:215] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:14.371793  2513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d3057239d54d6183db91d2b176c2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.384716  2505 tablet_copy_client.cc:806] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:14.387830  2505 tablet_copy_client.cc:670] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:14.399380  2505 tablet_copy_client.cc:538] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:14.416168  2517 ts_tablet_manager.cc:933] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:14.427160  2505 tablet_bootstrap.cc:492] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:14.441813  2513 tablet_copy_client.cc:806] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:14.444540  2517 tablet_copy_client.cc:323] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 12:58:14.443554  2513 tablet_copy_client.cc:670] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:14.468665  2513 tablet_copy_client.cc:538] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:14.526381  2521 ts_tablet_manager.cc:933] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:14.541124  1731 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet 016c9143ad3147438e814f92f2090928 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 12:58:14.541837  1731 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet 016c9143ad3147438e814f92f2090928 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-016c9143ad3147438e814f92f2090928
I20260709 12:58:14.562011  2521 tablet_copy_client.cc:323] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 12:58:14.563338  2513 tablet_bootstrap.cc:492] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:14.564512  2505 tablet_bootstrap.cc:492] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:14.574095  2505 tablet_bootstrap.cc:492] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:14.575076  2505 ts_tablet_manager.cc:1403] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.152s	user 0.025s	sys 0.013s
I20260709 12:58:14.572660  1731 tablet_copy_source_session.cc:215] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:14.568377  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet b47cff236bac4d2fae5f94a61502aec7 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 12:58:14.577360  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet b47cff236bac4d2fae5f94a61502aec7 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-b47cff236bac4d2fae5f94a61502aec7
I20260709 12:58:14.589625  2505 raft_consensus.cc:359] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:14.590711  2505 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:14.591549  2505 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:14.596657  1730 tablet_copy_source_session.cc:215] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:14.612004  2517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016c9143ad3147438e814f92f2090928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.621136  2521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b47cff236bac4d2fae5f94a61502aec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.708036  2505 ts_tablet_manager.cc:1434] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.132s	user 0.061s	sys 0.025s
I20260709 12:58:14.710573  1582 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-2033b178bcb643fd84ac0d1ae7e6a64b received from {username='slave'} at 127.0.0.1:38394
I20260709 12:58:14.711215  1582 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-2033b178bcb643fd84ac0d1ae7e6a64b on tablet 2033b178bcb643fd84ac0d1ae7e6a64b with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:14.726410  2513 tablet_bootstrap.cc:492] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:14.727972  2513 tablet_bootstrap.cc:492] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:14.730196  2513 ts_tablet_manager.cc:1403] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.170s	user 0.031s	sys 0.010s
I20260709 12:58:14.734274  2513 raft_consensus.cc:359] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:14.735337  2513 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:14.741322  2513 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:14.744232  2513 ts_tablet_manager.cc:1434] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.006s
I20260709 12:58:14.746299  1582 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-41d3057239d54d6183db91d2b176c2dd received from {username='slave'} at 127.0.0.1:38394
I20260709 12:58:14.746861  1582 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-41d3057239d54d6183db91d2b176c2dd on tablet 41d3057239d54d6183db91d2b176c2dd with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:14.772210  2521 tablet_copy_client.cc:806] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:14.773015  2521 tablet_copy_client.cc:670] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:14.783388  2521 tablet_copy_client.cc:538] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:14.793788  2517 tablet_copy_client.cc:806] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:14.794763  2517 tablet_copy_client.cc:670] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:14.804370  2517 tablet_copy_client.cc:538] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:14.810618  2521 tablet_bootstrap.cc:492] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:14.845001  2517 tablet_bootstrap.cc:492] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:14.919047  2521 tablet_bootstrap.cc:492] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:14.922147  2521 tablet_bootstrap.cc:492] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:14.923506  2521 ts_tablet_manager.cc:1403] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.113s	user 0.020s	sys 0.007s
I20260709 12:58:14.922572  2517 tablet_bootstrap.cc:492] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:14.927716  2517 tablet_bootstrap.cc:492] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:14.929632  2517 ts_tablet_manager.cc:1403] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.085s	user 0.022s	sys 0.008s
I20260709 12:58:14.933291  2521 raft_consensus.cc:359] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:14.936533  2521 raft_consensus.cc:740] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:14.937409  2521 consensus_queue.cc:260] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:14.940129  2521 ts_tablet_manager.cc:1434] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:58:14.935521  2517 raft_consensus.cc:359] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:14.941351  2517 raft_consensus.cc:740] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:14.942252  2517 consensus_queue.cc:260] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:14.945271  2517 ts_tablet_manager.cc:1434] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:58:14.948261  1731 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-016c9143ad3147438e814f92f2090928 received from {username='slave'} at 127.0.0.1:54412
I20260709 12:58:14.948776  1731 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-016c9143ad3147438e814f92f2090928 on tablet 016c9143ad3147438e814f92f2090928 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:14.950088  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-b47cff236bac4d2fae5f94a61502aec7 received from {username='slave'} at 127.0.0.1:54412
I20260709 12:58:14.950570  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-b47cff236bac4d2fae5f94a61502aec7 on tablet b47cff236bac4d2fae5f94a61502aec7 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:15.092048  2448 raft_consensus.cc:1217] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:58:15.165143  2448 raft_consensus.cc:1217] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:15.184514  2448 raft_consensus.cc:1217] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:58:15.343889  2448 raft_consensus.cc:1217] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
W20260709 12:58:15.468487  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 59243.5us
W20260709 12:58:15.588548  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 56126.5us
I20260709 12:58:15.604589  2530 raft_consensus.cc:1064] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:15.608340  2530 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:15.645742  2527 raft_consensus.cc:1064] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:15.649140  2527 consensus_queue.cc:237] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:15.661814  2448 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:15.663821  2439 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:15.680842  2447 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:15.681793  1565 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:15.685580  2528 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:15.692155  1640 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:15.707330  2516 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:15.708847  2527 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:15.753134  1720 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:15.756765  2527 raft_consensus.cc:2955] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:15.764882  1640 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:15.771688  2447 raft_consensus.cc:2955] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:15.786121  2514 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:15.790452  1640 raft_consensus.cc:2955] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:15.796263  1469 catalog_manager.cc:5697] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:15.800583  1568 raft_consensus.cc:2955] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:15.857645  2530 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:15.879896  2527 raft_consensus.cc:1064] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:15.924564  2527 consensus_queue.cc:237] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:15.935039  2530 raft_consensus.cc:1064] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:15.969492  2530 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:16.009049  2454 raft_consensus.cc:2955] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.134302  2447 raft_consensus.cc:2955] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.163897  2448 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:16.166604  2529 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:16.167477  2448 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:16.182093  1647 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:16.183156  1570 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:16.220247  1719 raft_consensus.cc:2955] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.243396  1716 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:16.239559  1467 catalog_manager.cc:5697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.241946  1721 consensus_queue.cc:237] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:16.266299  2549 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:16.292857  2549 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:16.295692  2448 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:16.311580  2555 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:58:16.332605  2528 raft_consensus.cc:2955] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.337673  2530 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:16.339844  2447 raft_consensus.cc:2955] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.348186  1647 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:16.358278  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b47cff236bac4d2fae5f94a61502aec7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:16.376168  1641 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:16.387836  2528 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:16.399756  2445 raft_consensus.cc:2955] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.406144  2448 raft_consensus.cc:2955] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.464493  2532 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:58:16.467218  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 70311.9us
I20260709 12:58:16.469215  1467 catalog_manager.cc:5697] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New cstate: current_term: 2 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.486832  2445 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:16.496495  1565 raft_consensus.cc:2955] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.498723  2532 raft_consensus.cc:2955] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.530339  1557 tablet_service.cc:1558] Processing DeleteTablet for tablet b47cff236bac4d2fae5f94a61502aec7 with delete_type TABLET_DATA_TOMBSTONED (TS 338d817f94ee4c1bad162e9a5860b68a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46620
I20260709 12:58:16.534617  2446 raft_consensus.cc:2955] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.549847  1568 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:16.561028  1639 raft_consensus.cc:2955] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 12:58:16.572428  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 54477.8us
I20260709 12:58:16.573364  1719 raft_consensus.cc:2955] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.552397  1470 catalog_manager.cc:5697] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:16.570724  2447 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:16.589720  1638 raft_consensus.cc:2955] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.642717  2530 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:58:16.650715  2564 tablet_replica.cc:333] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 12:58:16.652081  2564 raft_consensus.cc:2243] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:16.657918  1643 raft_consensus.cc:2955] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.659989  2564 raft_consensus.cc:2272] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:16.675393  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 75320.1us
I20260709 12:58:16.671468  2448 raft_consensus.cc:2955] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.693580  2564 ts_tablet_manager.cc:1916] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:16.680684  2514 raft_consensus.cc:2955] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.699700  1639 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:16.701568  1467 catalog_manager.cc:5697] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.774195  2546 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:16.803192  1467 catalog_manager.cc:5697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.810742  1638 raft_consensus.cc:2955] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.819796  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2033b178bcb643fd84ac0d1ae7e6a64b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:16.827739  2564 ts_tablet_manager.cc:1929] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:58:16.827891  1568 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:16.829630  2564 log.cc:1199] T b47cff236bac4d2fae5f94a61502aec7 P 338d817f94ee4c1bad162e9a5860b68a: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/wals/b47cff236bac4d2fae5f94a61502aec7
I20260709 12:58:16.829895  1641 raft_consensus.cc:2955] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.841521  2448 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:16.847661  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet 2033b178bcb643fd84ac0d1ae7e6a64b with delete_type TABLET_DATA_TOMBSTONED (TS 66344ad7cd844754b2c81cc689a709b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60074
I20260709 12:58:16.850896  1713 consensus_queue.cc:237] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:16.863134  1456 catalog_manager.cc:5028] TS 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): tablet b47cff236bac4d2fae5f94a61502aec7 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:16.864802  2448 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:16.865787  2570 tablet_replica.cc:333] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 12:58:16.868026  1638 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:16.868538  2527 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:16.869647  2567 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:16.872910  2527 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:16.886927  2555 raft_consensus.cc:2955] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.889751  2448 raft_consensus.cc:2955] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.892616  1645 raft_consensus.cc:2955] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.909037  2550 raft_consensus.cc:2955] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.917589  1467 catalog_manager.cc:5697] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 4 to 5, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.918001  2446 raft_consensus.cc:2955] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.928637  1720 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:16.931986  1557 tablet_service.cc:1558] Processing DeleteTablet for tablet 016c9143ad3147438e814f92f2090928 with delete_type TABLET_DATA_TOMBSTONED (TS 338d817f94ee4c1bad162e9a5860b68a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:46620
I20260709 12:58:16.938365  2564 tablet_replica.cc:333] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 12:58:16.953361  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 016c9143ad3147438e814f92f2090928 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:16.959000  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 41d3057239d54d6183db91d2b176c2dd with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:16.991252  1470 catalog_manager.cc:5697] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 4 to 5, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 3 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:16.997411  2550 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:17.016577  1636 tablet_service.cc:1558] Processing DeleteTablet for tablet 41d3057239d54d6183db91d2b176c2dd with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36684
I20260709 12:58:17.058144  1716 raft_consensus.cc:2955] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:17.084091  2570 raft_consensus.cc:2243] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:17.085150  2570 raft_consensus.cc:2272] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:17.088068  2571 tablet_replica.cc:333] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 12:58:17.090610  2571 raft_consensus.cc:2243] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:17.091375  2570 ts_tablet_manager.cc:1916] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:17.099892  2564 raft_consensus.cc:2243] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:17.106994  2571 raft_consensus.cc:2272] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:17.107132  2564 raft_consensus.cc:2272] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:17.113641  2564 ts_tablet_manager.cc:1916] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:17.114997  2571 ts_tablet_manager.cc:1916] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:17.141575  2564 ts_tablet_manager.cc:1929] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:58:17.147657  2564 log.cc:1199] T 016c9143ad3147438e814f92f2090928 P 338d817f94ee4c1bad162e9a5860b68a: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/wals/016c9143ad3147438e814f92f2090928
I20260709 12:58:17.149652  1456 catalog_manager.cc:5028] TS 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): tablet 016c9143ad3147438e814f92f2090928 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:17.149885  2571 ts_tablet_manager.cc:1929] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:58:17.150532  2571 log.cc:1199] T 41d3057239d54d6183db91d2b176c2dd P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/41d3057239d54d6183db91d2b176c2dd
I20260709 12:58:17.152567  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet 41d3057239d54d6183db91d2b176c2dd (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:17.155071  2570 ts_tablet_manager.cc:1929] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:17.155680  2570 log.cc:1199] T 2033b178bcb643fd84ac0d1ae7e6a64b P 66344ad7cd844754b2c81cc689a709b0: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/wals/2033b178bcb643fd84ac0d1ae7e6a64b
I20260709 12:58:17.157831  1455 catalog_manager.cc:5028] TS 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): tablet 2033b178bcb643fd84ac0d1ae7e6a64b (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:18.093501  1647 consensus_queue.cc:237] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:18.105211  1717 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:18.107545  2575 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:18.109527  1569 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:18.111191  2569 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:18.117297  2542 raft_consensus.cc:2955] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:18.124215  1717 raft_consensus.cc:2955] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 12:58:18.127313  1612 consensus_peers.cc:597] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 02b66b7be226499cbd9e020d381c72b2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:18.129220  1571 raft_consensus.cc:2955] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:18.142726  1569 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
W20260709 12:58:18.152455  1537 consensus_peers.cc:597] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b24c881516c4da087ee25ab3682886b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:18.153652  1717 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:18.153759  1647 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:18.155997  2576 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:18.156525  1467 catalog_manager.cc:5697] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:18.157456  2572 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:18.183022  2576 raft_consensus.cc:2955] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:18.186966  1645 raft_consensus.cc:2955] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:18.201471  1717 raft_consensus.cc:2955] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:18.203106  1713 consensus_queue.cc:237] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:18.214994  1470 catalog_manager.cc:5697] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:18.225127  1645 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:18.227176  1569 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:18.227098  2555 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:58:18.233451  1686 consensus_peers.cc:597] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a4b97ee9bb5742b6a7bfc576360314c5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:18.235927  2555 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:18.239297  2516 raft_consensus.cc:2955] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:18.240844  1645 raft_consensus.cc:2955] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:18.247954  1571 raft_consensus.cc:2955] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:18.266706  1717 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:18.277699  1645 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:18.273106  1467 catalog_manager.cc:5697] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 3, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 12:58:18.279726  1686 consensus_peers.cc:597] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8dd7e524e66b45d5a5c823f1a5224351. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:18.279966  2555 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:18.285527  1571 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:18.289785  2555 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:18.310510  1645 raft_consensus.cc:2955] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:18.314726  1571 raft_consensus.cc:2955] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:18.310444  2578 raft_consensus.cc:2955] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:18.334175  1468 catalog_manager.cc:5697] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:18.563097  2601 ts_tablet_manager.cc:933] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 12:58:18.579092  2601 tablet_copy_client.cc:323] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 12:58:18.581048  1582 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet 8b24c881516c4da087ee25ab3682886b from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 12:58:18.581616  1582 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet 8b24c881516c4da087ee25ab3682886b from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-8b24c881516c4da087ee25ab3682886b
I20260709 12:58:18.589414  1582 tablet_copy_source_session.cc:215] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:18.594096  2601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b24c881516c4da087ee25ab3682886b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:18.609357  2601 tablet_copy_client.cc:806] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:18.610006  2601 tablet_copy_client.cc:670] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:18.614122  2601 tablet_copy_client.cc:538] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:18.626140  2601 tablet_bootstrap.cc:492] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:18.651185  2601 tablet_bootstrap.cc:492] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:18.652128  2601 tablet_bootstrap.cc:492] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:18.652762  2601 ts_tablet_manager.cc:1403] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.004s
I20260709 12:58:18.655256  2601 raft_consensus.cc:359] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:18.655929  2601 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:18.656490  2601 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:18.659970  2601 ts_tablet_manager.cc:1434] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 12:58:18.661861  1582 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-8b24c881516c4da087ee25ab3682886b received from {username='slave'} at 127.0.0.1:38394
I20260709 12:58:18.662357  1582 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-8b24c881516c4da087ee25ab3682886b on tablet 8b24c881516c4da087ee25ab3682886b with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:18.664002  2605 ts_tablet_manager.cc:933] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:18.666009  2605 tablet_copy_client.cc:323] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 12:58:18.667900  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet a4b97ee9bb5742b6a7bfc576360314c5 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 12:58:18.668444  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet a4b97ee9bb5742b6a7bfc576360314c5 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-a4b97ee9bb5742b6a7bfc576360314c5
I20260709 12:58:18.676800  1730 tablet_copy_source_session.cc:215] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:18.682870  2605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b97ee9bb5742b6a7bfc576360314c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:18.691094  2601 ts_tablet_manager.cc:933] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:18.693071  2601 tablet_copy_client.cc:323] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:45463
I20260709 12:58:18.709441  2605 tablet_copy_client.cc:806] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:18.710242  2605 tablet_copy_client.cc:670] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:18.714900  2605 tablet_copy_client.cc:538] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:18.719944  1657 tablet_copy_service.cc:140] P a4be9cc90aca4dd4ad7db103062a7208: Received BeginTabletCopySession request for tablet 02b66b7be226499cbd9e020d381c72b2 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38584)
I20260709 12:58:18.720708  1657 tablet_copy_service.cc:161] P a4be9cc90aca4dd4ad7db103062a7208: Beginning new tablet copy session on tablet 02b66b7be226499cbd9e020d381c72b2 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38584: session id = 6f381117554e49bb816791ab0a10f2b8-02b66b7be226499cbd9e020d381c72b2
I20260709 12:58:18.726828  2605 tablet_bootstrap.cc:492] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:18.729342  1657 tablet_copy_source_session.cc:215] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:18.737668  2601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b66b7be226499cbd9e020d381c72b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:18.739447  2610 ts_tablet_manager.cc:933] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:18.771533  2601 tablet_copy_client.cc:806] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:18.772718  2601 tablet_copy_client.cc:670] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:18.779251  2601 tablet_copy_client.cc:538] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:18.785575  2610 tablet_copy_client.cc:323] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 12:58:18.789625  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet 8dd7e524e66b45d5a5c823f1a5224351 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 12:58:18.790226  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet 8dd7e524e66b45d5a5c823f1a5224351 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-8dd7e524e66b45d5a5c823f1a5224351
I20260709 12:58:18.794018  2601 tablet_bootstrap.cc:492] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:18.798631  2605 tablet_bootstrap.cc:492] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:18.800201  1730 tablet_copy_source_session.cc:215] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:18.800868  2605 tablet_bootstrap.cc:492] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:18.801743  2605 ts_tablet_manager.cc:1403] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.075s	user 0.020s	sys 0.008s
I20260709 12:58:18.805893  2610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd7e524e66b45d5a5c823f1a5224351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:18.806417  2605 raft_consensus.cc:359] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:18.807392  2605 raft_consensus.cc:740] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:18.808213  2605 consensus_queue.cc:260] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:18.817927  2605 ts_tablet_manager.cc:1434] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:58:18.819882  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-a4b97ee9bb5742b6a7bfc576360314c5 received from {username='slave'} at 127.0.0.1:54412
I20260709 12:58:18.820382  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-a4b97ee9bb5742b6a7bfc576360314c5 on tablet a4b97ee9bb5742b6a7bfc576360314c5 with peer 6f381117554e49bb816791ab0a10f2b8
W20260709 12:58:18.819932  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08000e13a0 after lost signal to thread 434
W20260709 12:58:18.826680  1668 debug-util.cc:398] Leaking SignalData structure 0x7b0800098a80 after lost signal to thread 1504
W20260709 12:58:18.828105  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08001a6620 after lost signal to thread 1596
W20260709 12:58:18.834817  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08001505c0 after lost signal to thread 1671
W20260709 12:58:18.836272  1668 debug-util.cc:398] Leaking SignalData structure 0x7b0800324100 after lost signal to thread 1745
I20260709 12:58:18.848789  2610 tablet_copy_client.cc:806] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:18.849552  2610 tablet_copy_client.cc:670] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:18.863183  2610 tablet_copy_client.cc:538] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:18.880945  2610 tablet_bootstrap.cc:492] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:18.915424  2601 tablet_bootstrap.cc:492] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:18.916846  2601 tablet_bootstrap.cc:492] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:18.917759  2601 ts_tablet_manager.cc:1403] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.124s	user 0.024s	sys 0.010s
I20260709 12:58:18.921743  2601 raft_consensus.cc:359] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:18.922869  2601 raft_consensus.cc:740] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:18.923271  2610 tablet_bootstrap.cc:492] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:18.936249  2610 tablet_bootstrap.cc:492] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:18.937036  2610 ts_tablet_manager.cc:1403] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.020s
I20260709 12:58:18.924975  2601 consensus_queue.cc:260] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:18.944432  2601 ts_tablet_manager.cc:1434] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:58:18.953805  2610 raft_consensus.cc:359] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:18.954936  2610 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:18.956382  2610 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:18.959139  2610 ts_tablet_manager.cc:1434] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 12:58:18.962921  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-8dd7e524e66b45d5a5c823f1a5224351 received from {username='slave'} at 127.0.0.1:54412
I20260709 12:58:18.963434  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-8dd7e524e66b45d5a5c823f1a5224351 on tablet 8dd7e524e66b45d5a5c823f1a5224351 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:18.967258  1657 tablet_copy_service.cc:342] P a4be9cc90aca4dd4ad7db103062a7208: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-02b66b7be226499cbd9e020d381c72b2 received from {username='slave'} at 127.0.0.1:38584
I20260709 12:58:18.967854  1657 tablet_copy_service.cc:434] P a4be9cc90aca4dd4ad7db103062a7208: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-02b66b7be226499cbd9e020d381c72b2 on tablet 02b66b7be226499cbd9e020d381c72b2 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:19.121547  2448 raft_consensus.cc:1217] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:19.237396  2448 raft_consensus.cc:1217] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:58:19.246968  2448 raft_consensus.cc:1217] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:19.330804  2448 raft_consensus.cc:1217] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:19.627867  2620 raft_consensus.cc:1064] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:19.630885  2620 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:19.689046  2621 raft_consensus.cc:1064] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:19.693648  2621 consensus_queue.cc:237] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:19.743611  1565 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:19.745316  2448 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:19.747609  1565 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:19.749333  2580 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:19.751437  2580 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:19.753551  2580 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:19.754588  2619 raft_consensus.cc:1064] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:19.760744  1645 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:19.761014  1641 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:19.762624  2448 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:58:19.764235  2555 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:19.766335  2555 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:19.769282  2619 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:19.776458  2617 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:19.845296  2447 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:19.848119  1717 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:19.850116  2577 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:19.858263  2615 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:19.897030  2620 raft_consensus.cc:2955] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:19.908078  2580 raft_consensus.cc:2955] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:19.912003  1645 raft_consensus.cc:2955] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:19.918072  2447 raft_consensus.cc:2955] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:19.946398  1647 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:19.952957  2448 raft_consensus.cc:2955] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:19.985577  1468 catalog_manager.cc:5697] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:19.985559  1565 raft_consensus.cc:2955] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.007524  2577 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:20.016340  1568 raft_consensus.cc:2955] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.032339  1647 raft_consensus.cc:2955] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.056334  1470 catalog_manager.cc:5697] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 3 to 4, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.073156  2618 raft_consensus.cc:1064] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
W20260709 12:58:20.082625  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 51072.3us
I20260709 12:58:20.095743  2618 consensus_queue.cc:237] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:20.117271  2631 raft_consensus.cc:2955] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.141574  2447 raft_consensus.cc:2955] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.151489  1719 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:20.151640  1717 raft_consensus.cc:2955] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.164086  2644 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:20.169293  1467 catalog_manager.cc:5697] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:20.205561  1719 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:20.212105  1713 consensus_queue.cc:237] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:20.214892  1571 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:20.216619  1570 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:20.219732  2448 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:20.221645  2580 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:20.224248  2447 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:20.229471  2448 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:20.237263  2621 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:20.237543  1717 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:20.238490  2447 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:20.241019  2638 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:20.241744  2620 raft_consensus.cc:2955] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.242777  2619 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:20.250859  1570 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:20.252687  2631 raft_consensus.cc:2955] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.252869  2444 raft_consensus.cc:2955] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.262243  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8dd7e524e66b45d5a5c823f1a5224351 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:20.265730  1717 raft_consensus.cc:2955] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.267477  2620 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:20.268263  2448 raft_consensus.cc:2955] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.276296  2621 raft_consensus.cc:2955] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.290874  2446 raft_consensus.cc:2955] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.279290  1570 raft_consensus.cc:2955] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.299099  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b24c881516c4da087ee25ab3682886b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:20.308642  1470 catalog_manager.cc:5697] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:20.322691  1636 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b24c881516c4da087ee25ab3682886b with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36684
I20260709 12:58:20.326009  1469 catalog_manager.cc:5697] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.338375  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a4b97ee9bb5742b6a7bfc576360314c5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:20.348902  2618 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:58:20.371670  1629 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dd7e524e66b45d5a5c823f1a5224351 with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36684
I20260709 12:58:20.384454  2644 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:20.385735  1638 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:20.408346  2620 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:20.421921  2648 tablet_replica.cc:333] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 12:58:20.423249  2648 raft_consensus.cc:2243] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:20.423825  2648 pending_rounds.cc:70] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Trying to abort 1 pending ops.
I20260709 12:58:20.424089  2648 pending_rounds.cc:77] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305633381399515136 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "8b24c881516c4da087ee25ab3682886b" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } } }
I20260709 12:58:20.425426  2648 raft_consensus.cc:2917] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:58:20.430675  1645 raft_consensus.cc:2955] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.447607  2618 raft_consensus.cc:2955] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.425873  2648 raft_consensus.cc:2889] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:58:20.454632  2648 raft_consensus.cc:2272] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:20.447222  1467 catalog_manager.cc:5697] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index 4 to 5, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:20.463220  2448 raft_consensus.cc:2955] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.472332  1570 raft_consensus.cc:2955] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.492712  1717 raft_consensus.cc:2955] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.497171  2648 ts_tablet_manager.cc:1916] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:20.530232  1557 tablet_service.cc:1558] Processing DeleteTablet for tablet a4b97ee9bb5742b6a7bfc576360314c5 with delete_type TABLET_DATA_TOMBSTONED (TS 338d817f94ee4c1bad162e9a5860b68a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:46620
I20260709 12:58:20.536019  1468 catalog_manager.cc:5697] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.558569  2648 ts_tablet_manager.cc:1929] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:20.559193  2648 log.cc:1199] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/8b24c881516c4da087ee25ab3682886b
I20260709 12:58:20.561143  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet 8b24c881516c4da087ee25ab3682886b (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:20.566486  2648 tablet_replica.cc:333] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 12:58:20.575565  2648 raft_consensus.cc:2243] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:20.582780  2648 raft_consensus.cc:2272] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:20.594347  1638 consensus_queue.cc:237] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:20.606236  2448 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:20.610430  2652 tablet_replica.cc:333] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 12:58:20.610162  2642 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:20.589924  2648 ts_tablet_manager.cc:1916] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:20.617492  2652 raft_consensus.cc:2243] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:20.619722  2644 raft_consensus.cc:2955] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.621871  2448 raft_consensus.cc:2955] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.618369  2652 raft_consensus.cc:2272] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:20.633705  2652 ts_tablet_manager.cc:1916] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:20.637296  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 02b66b7be226499cbd9e020d381c72b2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:20.644435  1470 catalog_manager.cc:5697] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.649874  1568 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:20.659250  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet 02b66b7be226499cbd9e020d381c72b2 with delete_type TABLET_DATA_TOMBSTONED (TS 66344ad7cd844754b2c81cc689a709b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60074
I20260709 12:58:20.678268  2618 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:20.699940  1570 raft_consensus.cc:2955] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:20.690322  2653 tablet_replica.cc:333] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 12:58:20.702591  2653 raft_consensus.cc:2243] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:20.703457  2653 raft_consensus.cc:2272] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:20.709995  2648 ts_tablet_manager.cc:1929] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:20.712168  2648 log.cc:1199] T 8dd7e524e66b45d5a5c823f1a5224351 P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/8dd7e524e66b45d5a5c823f1a5224351
I20260709 12:58:20.714774  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet 8dd7e524e66b45d5a5c823f1a5224351 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:20.717383  2652 ts_tablet_manager.cc:1929] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:58:20.717934  2652 log.cc:1199] T a4b97ee9bb5742b6a7bfc576360314c5 P 338d817f94ee4c1bad162e9a5860b68a: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/wals/a4b97ee9bb5742b6a7bfc576360314c5
I20260709 12:58:20.721312  1456 catalog_manager.cc:5028] TS 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): tablet a4b97ee9bb5742b6a7bfc576360314c5 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:20.721692  2653 ts_tablet_manager.cc:1916] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:20.741151  2653 ts_tablet_manager.cc:1929] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:20.741631  2653 log.cc:1199] T 02b66b7be226499cbd9e020d381c72b2 P 66344ad7cd844754b2c81cc689a709b0: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/wals/02b66b7be226499cbd9e020d381c72b2
I20260709 12:58:20.744199  1455 catalog_manager.cc:5028] TS 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): tablet 02b66b7be226499cbd9e020d381c72b2 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:21.780467  1645 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:21.787612  1713 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:21.788049  1570 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:21.789089  2654 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:58:21.793190  1612 consensus_peers.cc:597] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e5316a1e4f014102b1770c3f8b08410b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:21.794255  2654 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:21.798241  2644 raft_consensus.cc:2955] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:21.800271  1713 raft_consensus.cc:2955] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:21.818012  1570 raft_consensus.cc:2955] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:21.825536  1470 catalog_manager.cc:5697] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:21.839097  1713 consensus_queue.cc:237] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:21.847962  1645 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:21.850021  2621 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:21.851204  1686 consensus_peers.cc:597] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b724690541549b4be895303885a0998. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:21.860146  2649 raft_consensus.cc:2955] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:21.916217  1645 raft_consensus.cc:2955] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:21.975575  1570 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:21.992360  2668 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:22.022779  1570 raft_consensus.cc:2955] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:22.041900  1568 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:22.044909  1469 catalog_manager.cc:5697] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 12:58:22.094470  1537 consensus_peers.cc:597] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7133ad6a0a3449ad9f1b93e65653432d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:22.130453  1719 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:22.135808  1643 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:22.140053  2672 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:22.152925  2669 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:22.176753  2672 raft_consensus.cc:2955] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:22.183053  1717 raft_consensus.cc:2955] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:22.183512  1641 raft_consensus.cc:2955] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:22.209967  1466 catalog_manager.cc:5697] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:22.220461  1568 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:22.232999  2676 ts_tablet_manager.cc:933] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:22.234884  1537 consensus_peers.cc:597] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a057e47a0fca4295957540c192996970. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:22.233063  1717 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:22.236914  1641 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:22.239555  2666 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:22.242306  2619 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:22.257210  2676 tablet_copy_client.cc:323] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:45463
I20260709 12:58:22.262579  1657 tablet_copy_service.cc:140] P a4be9cc90aca4dd4ad7db103062a7208: Received BeginTabletCopySession request for tablet e5316a1e4f014102b1770c3f8b08410b from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38584)
I20260709 12:58:22.263463  1657 tablet_copy_service.cc:161] P a4be9cc90aca4dd4ad7db103062a7208: Beginning new tablet copy session on tablet e5316a1e4f014102b1770c3f8b08410b from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38584: session id = 6f381117554e49bb816791ab0a10f2b8-e5316a1e4f014102b1770c3f8b08410b
I20260709 12:58:22.269584  2666 raft_consensus.cc:2955] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:22.271991  1716 raft_consensus.cc:2955] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:22.287343  1657 tablet_copy_source_session.cc:215] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:22.293356  2676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5316a1e4f014102b1770c3f8b08410b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:22.298228  1470 catalog_manager.cc:5697] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:22.306438  1641 raft_consensus.cc:2955] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:22.318414  2676 tablet_copy_client.cc:806] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:22.319357  2676 tablet_copy_client.cc:670] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:22.324118  2676 tablet_copy_client.cc:538] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:22.335556  2676 tablet_bootstrap.cc:492] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:22.367636  2676 tablet_bootstrap.cc:492] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:22.368737  2676 tablet_bootstrap.cc:492] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:22.369494  2676 ts_tablet_manager.cc:1403] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.012s
I20260709 12:58:22.373175  2676 raft_consensus.cc:359] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:22.373910  2676 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:22.374640  2676 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:22.379179  2676 ts_tablet_manager.cc:1434] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.004s
I20260709 12:58:22.382241  1657 tablet_copy_service.cc:342] P a4be9cc90aca4dd4ad7db103062a7208: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-e5316a1e4f014102b1770c3f8b08410b received from {username='slave'} at 127.0.0.1:38584
I20260709 12:58:22.382752  1657 tablet_copy_service.cc:434] P a4be9cc90aca4dd4ad7db103062a7208: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-e5316a1e4f014102b1770c3f8b08410b on tablet e5316a1e4f014102b1770c3f8b08410b with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:22.472018  2676 ts_tablet_manager.cc:933] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:22.473836  2676 tablet_copy_client.cc:323] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 12:58:22.476161  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet 4b724690541549b4be895303885a0998 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 12:58:22.476802  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet 4b724690541549b4be895303885a0998 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-4b724690541549b4be895303885a0998
I20260709 12:58:22.485773  1730 tablet_copy_source_session.cc:215] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:22.489750  2676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b724690541549b4be895303885a0998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:22.508404  2676 tablet_copy_client.cc:806] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:22.509042  2676 tablet_copy_client.cc:670] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:22.513762  2676 tablet_copy_client.cc:538] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:22.522593  2676 tablet_bootstrap.cc:492] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:22.547013  2676 tablet_bootstrap.cc:492] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:22.548004  2676 tablet_bootstrap.cc:492] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:22.548674  2676 ts_tablet_manager.cc:1403] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.006s
I20260709 12:58:22.551424  2676 raft_consensus.cc:359] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:22.552071  2676 raft_consensus.cc:740] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:22.552692  2676 consensus_queue.cc:260] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:22.556233  2676 ts_tablet_manager.cc:1434] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:58:22.561684  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-4b724690541549b4be895303885a0998 received from {username='slave'} at 127.0.0.1:54412
I20260709 12:58:22.562227  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-4b724690541549b4be895303885a0998 on tablet 4b724690541549b4be895303885a0998 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:22.665661  2676 ts_tablet_manager.cc:933] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 12:58:22.667505  2676 tablet_copy_client.cc:323] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 12:58:22.669591  1582 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet 7133ad6a0a3449ad9f1b93e65653432d from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 12:58:22.670233  1582 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet 7133ad6a0a3449ad9f1b93e65653432d from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-7133ad6a0a3449ad9f1b93e65653432d
I20260709 12:58:22.680552  1582 tablet_copy_source_session.cc:215] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:22.690928  2676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7133ad6a0a3449ad9f1b93e65653432d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:22.709864  2676 tablet_copy_client.cc:806] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:22.710547  2676 tablet_copy_client.cc:670] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:22.744724  2676 tablet_copy_client.cc:538] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:22.760509  2688 ts_tablet_manager.cc:933] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 12:58:22.763509  2676 tablet_bootstrap.cc:492] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:22.777892  2688 tablet_copy_client.cc:323] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 12:58:22.777894  2446 raft_consensus.cc:1217] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:22.781158  1582 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet a057e47a0fca4295957540c192996970 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 12:58:22.781749  1582 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet a057e47a0fca4295957540c192996970 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-a057e47a0fca4295957540c192996970
I20260709 12:58:22.797005  1582 tablet_copy_source_session.cc:215] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:22.800565  2688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a057e47a0fca4295957540c192996970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:22.843358  2676 tablet_bootstrap.cc:492] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:22.844553  2676 tablet_bootstrap.cc:492] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:22.846421  2676 ts_tablet_manager.cc:1403] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.009s
I20260709 12:58:22.846755  2688 tablet_copy_client.cc:806] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:22.847401  2688 tablet_copy_client.cc:670] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:22.869860  2688 tablet_copy_client.cc:538] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:22.870221  2676 raft_consensus.cc:359] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:22.872407  2676 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:22.873162  2676 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:22.877162  2676 ts_tablet_manager.cc:1434] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:58:22.884553  2688 tablet_bootstrap.cc:492] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:22.911720  1582 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-7133ad6a0a3449ad9f1b93e65653432d received from {username='slave'} at 127.0.0.1:38394
I20260709 12:58:22.912348  1582 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-7133ad6a0a3449ad9f1b93e65653432d on tablet 7133ad6a0a3449ad9f1b93e65653432d with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:22.927593  2688 tablet_bootstrap.cc:492] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:22.928498  2688 tablet_bootstrap.cc:492] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:22.929219  2688 ts_tablet_manager.cc:1403] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.013s
I20260709 12:58:22.940044  2688 raft_consensus.cc:359] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:22.940783  2688 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:22.941509  2688 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:22.946327  2688 ts_tablet_manager.cc:1434] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 12:58:22.948354  1582 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-a057e47a0fca4295957540c192996970 received from {username='slave'} at 127.0.0.1:38394
I20260709 12:58:22.948820  1582 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-a057e47a0fca4295957540c192996970 on tablet a057e47a0fca4295957540c192996970 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:23.085269  2446 raft_consensus.cc:1217] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:23.269170  2690 raft_consensus.cc:1064] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:23.273275  2690 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:23.278008  2444 raft_consensus.cc:1217] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:23.297601  2444 raft_consensus.cc:1217] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:23.297860  1716 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.301474  2655 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:23.313292  2444 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.315341  1568 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.320799  2691 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:23.326310  2691 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:23.338958  2690 raft_consensus.cc:2955] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.341322  1568 raft_consensus.cc:2955] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.354708  1716 raft_consensus.cc:2955] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.355957  2444 raft_consensus.cc:2955] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.364886  1469 catalog_manager.cc:5697] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:23.411012  1641 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:23.425885  2444 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:23.428471  2655 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:23.431782  1568 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:23.433779  2655 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:23.445662  2654 raft_consensus.cc:2955] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.458797  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e5316a1e4f014102b1770c3f8b08410b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:23.462257  1568 raft_consensus.cc:2955] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.456302  2444 raft_consensus.cc:2955] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.469070  1466 catalog_manager.cc:5697] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:23.493067  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet e5316a1e4f014102b1770c3f8b08410b with delete_type TABLET_DATA_TOMBSTONED (TS 66344ad7cd844754b2c81cc689a709b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60074
I20260709 12:58:23.513510  2702 tablet_replica.cc:333] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 12:58:23.515057  2702 raft_consensus.cc:2243] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:23.516055  2702 raft_consensus.cc:2272] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:23.525103  2702 ts_tablet_manager.cc:1916] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:23.547045  2702 ts_tablet_manager.cc:1929] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:23.547581  2702 log.cc:1199] T e5316a1e4f014102b1770c3f8b08410b P 66344ad7cd844754b2c81cc689a709b0: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/wals/e5316a1e4f014102b1770c3f8b08410b
I20260709 12:58:23.549476  1455 catalog_manager.cc:5028] TS 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): tablet e5316a1e4f014102b1770c3f8b08410b (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:23.562098  2621 raft_consensus.cc:1064] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:23.564368  2621 consensus_queue.cc:237] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:23.572649  1638 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.572872  1568 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.574743  2621 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.575531  2444 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.576267  2668 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.580027  2668 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.602902  2649 raft_consensus.cc:2955] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.606298  1568 raft_consensus.cc:2955] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.610877  1638 raft_consensus.cc:2955] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.632190  1466 catalog_manager.cc:5697] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.643608  2444 raft_consensus.cc:2955] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.677536  2666 raft_consensus.cc:1064] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:23.677623  1719 consensus_queue.cc:237] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:23.680578  2666 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:23.684912  2446 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:23.684899  1641 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:23.687440  2621 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:23.689852  2649 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:23.697225  2621 raft_consensus.cc:2955] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.698390  1641 raft_consensus.cc:2955] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.706923  2444 raft_consensus.cc:2955] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.712073  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4b724690541549b4be895303885a0998 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:23.713622  2446 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.715785  1719 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.715893  2572 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:23.717933  2672 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.731590  1467 catalog_manager.cc:5697] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.747381  1557 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b724690541549b4be895303885a0998 with delete_type TABLET_DATA_TOMBSTONED (TS 338d817f94ee4c1bad162e9a5860b68a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46620
I20260709 12:58:23.756450  1638 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.770124  2672 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:23.775621  2710 tablet_replica.cc:333] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 12:58:23.777235  2572 raft_consensus.cc:2955] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.785658  1719 raft_consensus.cc:2955] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.809406  2710 raft_consensus.cc:2243] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:23.810832  2444 raft_consensus.cc:2955] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.821378  2710 raft_consensus.cc:2272] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:23.823956  1641 raft_consensus.cc:2955] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.827172  2710 ts_tablet_manager.cc:1916] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:23.825881  1467 catalog_manager.cc:5697] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.838344  2619 raft_consensus.cc:1064] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:23.841023  2619 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:23.871728  2444 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.871829  1716 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.873107  1641 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:23.873672  2666 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:23.874953  2708 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:23.877506  2708 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.881942  2710 ts_tablet_manager.cc:1929] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:23.882675  2710 log.cc:1199] T 4b724690541549b4be895303885a0998 P 338d817f94ee4c1bad162e9a5860b68a: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/wals/4b724690541549b4be895303885a0998
I20260709 12:58:23.884732  1456 catalog_manager.cc:5028] TS 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): tablet 4b724690541549b4be895303885a0998 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:23.897787  1569 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:23.902707  2619 raft_consensus.cc:2955] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.904824  1716 raft_consensus.cc:2955] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.910305  2444 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:23.913632  1638 raft_consensus.cc:2955] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.915256  2708 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:58:23.928150  2708 raft_consensus.cc:2955] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.930692  1645 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:23.930148  2446 raft_consensus.cc:2955] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.942759  2572 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:23.941072  1466 catalog_manager.cc:5697] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.952219  2444 raft_consensus.cc:2955] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.964576  1641 raft_consensus.cc:2955] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.965605  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a057e47a0fca4295957540c192996970 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:23.972470  1467 catalog_manager.cc:5697] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:23.990775  1569 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:23.992424  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet a057e47a0fca4295957540c192996970 with delete_type TABLET_DATA_TOMBSTONED (TS 66344ad7cd844754b2c81cc689a709b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60074
I20260709 12:58:23.994081  2702 tablet_replica.cc:333] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 12:58:23.995697  2702 raft_consensus.cc:2243] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:23.996506  2702 raft_consensus.cc:2272] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.000658  2702 ts_tablet_manager.cc:1916] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:24.020053  2446 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:24.026943  2619 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:58:24.034689  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 52652.7us
I20260709 12:58:24.050593  1716 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:24.059834  2702 ts_tablet_manager.cc:1929] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:24.060585  2702 log.cc:1199] T a057e47a0fca4295957540c192996970 P 66344ad7cd844754b2c81cc689a709b0: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/wals/a057e47a0fca4295957540c192996970
I20260709 12:58:24.063309  1455 catalog_manager.cc:5028] TS 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): tablet a057e47a0fca4295957540c192996970 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:24.060958  2446 raft_consensus.cc:2955] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:24.068318  2666 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:24.057245  2572 raft_consensus.cc:2955] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:24.083096  1716 raft_consensus.cc:2955] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:24.085389  1470 catalog_manager.cc:5697] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:24.100615  1636 tablet_service.cc:1558] Processing DeleteTablet for tablet 7133ad6a0a3449ad9f1b93e65653432d with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36684
I20260709 12:58:24.103184  2718 tablet_replica.cc:333] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 12:58:24.104480  2718 raft_consensus.cc:2243] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.105367  2718 raft_consensus.cc:2272] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.108839  2718 ts_tablet_manager.cc:1916] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:24.119961  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7133ad6a0a3449ad9f1b93e65653432d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:24.127140  1467 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 7133ad6a0a3449ad9f1b93e65653432d with cas_config_opid_index 3: aborting the task: latest config opid_index 4; task opid_index 3
I20260709 12:58:24.131736  2718 ts_tablet_manager.cc:1929] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:24.132270  2718 log.cc:1199] T 7133ad6a0a3449ad9f1b93e65653432d P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/7133ad6a0a3449ad9f1b93e65653432d
I20260709 12:58:24.133898  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet 7133ad6a0a3449ad9f1b93e65653432d (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:25.181576  1568 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:25.190014  1719 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:25.190328  1638 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:58:25.190593  1537 consensus_peers.cc:597] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc72a09ffebe49218d3a2f9d4e0bcc45. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:25.191864  2719 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:25.192663  2672 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:25.201036  2672 raft_consensus.cc:2955] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.203408  1719 raft_consensus.cc:2955] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.214299  1638 raft_consensus.cc:2955] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.220445  1568 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:25.230830  1470 catalog_manager.cc:5697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.243775  1719 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:25.244057  1537 consensus_peers.cc:597] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b11fdc1931874b5389be76ef648b6ae1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:25.245322  1638 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:25.245390  2719 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:58:25.251407  2725 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:25.265647  2719 raft_consensus.cc:2955] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.268183  1719 raft_consensus.cc:2955] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.276497  1641 raft_consensus.cc:2955] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.294744  1716 consensus_queue.cc:237] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:25.318804  1469 catalog_manager.cc:5697] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.325392  1568 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:25.326942  1686 consensus_peers.cc:597] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4986d58f61a45638a1088287c2004d8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:25.327598  1638 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:25.329216  2621 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:25.335958  2721 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:25.344954  2621 raft_consensus.cc:2955] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.352101  1641 raft_consensus.cc:2955] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.369953  1569 raft_consensus.cc:2955] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.372139  1571 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
W20260709 12:58:25.381466  1537 consensus_peers.cc:597] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 691bccf09f2f475a98a7ab9cbbd1dd8d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:25.382614  1638 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:25.383656  1716 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:25.386861  1469 catalog_manager.cc:5697] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.388859  2733 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:25.393268  2733 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:25.422868  2725 raft_consensus.cc:2955] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.424320  1641 raft_consensus.cc:2955] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.428156  1719 raft_consensus.cc:2955] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:25.451918  1469 catalog_manager.cc:5697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.679196  2740 ts_tablet_manager.cc:933] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 12:58:25.681740  2740 tablet_copy_client.cc:323] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 12:58:25.684331  1582 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet bc72a09ffebe49218d3a2f9d4e0bcc45 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 12:58:25.684926  1582 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet bc72a09ffebe49218d3a2f9d4e0bcc45 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-bc72a09ffebe49218d3a2f9d4e0bcc45
I20260709 12:58:25.694875  1582 tablet_copy_source_session.cc:215] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:25.699120  2740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc72a09ffebe49218d3a2f9d4e0bcc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.717145  2740 tablet_copy_client.cc:806] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:25.717860  2740 tablet_copy_client.cc:670] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:25.722944  2740 tablet_copy_client.cc:538] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:25.736326  2740 tablet_bootstrap.cc:492] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:25.761516  2743 ts_tablet_manager.cc:933] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 12:58:25.781788  2740 tablet_bootstrap.cc:492] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:25.782908  2740 tablet_bootstrap.cc:492] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:25.783671  2740 ts_tablet_manager.cc:1403] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.011s
I20260709 12:58:25.786449  2745 ts_tablet_manager.cc:933] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:25.787267  2740 raft_consensus.cc:359] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:25.788209  2740 raft_consensus.cc:740] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:25.788894  2740 consensus_queue.cc:260] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:25.790427  2743 tablet_copy_client.cc:323] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 12:58:25.794566  1582 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet b11fdc1931874b5389be76ef648b6ae1 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 12:58:25.795279  1582 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet b11fdc1931874b5389be76ef648b6ae1 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-b11fdc1931874b5389be76ef648b6ae1
I20260709 12:58:25.796506  2745 tablet_copy_client.cc:323] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 12:58:25.798688  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet f4986d58f61a45638a1088287c2004d8 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 12:58:25.799263  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet f4986d58f61a45638a1088287c2004d8 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-f4986d58f61a45638a1088287c2004d8
I20260709 12:58:25.811561  2748 ts_tablet_manager.cc:933] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 12:58:25.817850  1582 tablet_copy_source_session.cc:215] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:25.818670  1730 tablet_copy_source_session.cc:215] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:25.822993  2745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4986d58f61a45638a1088287c2004d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.824047  2740 ts_tablet_manager.cc:1434] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.040s	user 0.012s	sys 0.000s
I20260709 12:58:25.824162  2743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11fdc1931874b5389be76ef648b6ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.843041  2745 tablet_copy_client.cc:806] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:25.843740  2745 tablet_copy_client.cc:670] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:25.848294  2745 tablet_copy_client.cc:538] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:25.861232  2748 tablet_copy_client.cc:323] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 12:58:25.862504  1582 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-bc72a09ffebe49218d3a2f9d4e0bcc45 received from {username='slave'} at 127.0.0.1:38394
I20260709 12:58:25.863068  1582 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-bc72a09ffebe49218d3a2f9d4e0bcc45 on tablet bc72a09ffebe49218d3a2f9d4e0bcc45 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:25.866791  2745 tablet_bootstrap.cc:492] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:25.866916  1582 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet 691bccf09f2f475a98a7ab9cbbd1dd8d from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 12:58:25.867607  1582 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet 691bccf09f2f475a98a7ab9cbbd1dd8d from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-691bccf09f2f475a98a7ab9cbbd1dd8d
I20260709 12:58:25.881671  2743 tablet_copy_client.cc:806] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:25.882507  2743 tablet_copy_client.cc:670] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:25.883602  1582 tablet_copy_source_session.cc:215] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:25.887480  2748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691bccf09f2f475a98a7ab9cbbd1dd8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.894147  2743 tablet_copy_client.cc:538] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:25.915336  2745 tablet_bootstrap.cc:492] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:25.916478  2745 tablet_bootstrap.cc:492] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:25.916661  2743 tablet_bootstrap.cc:492] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:25.917207  2745 ts_tablet_manager.cc:1403] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.007s
I20260709 12:58:25.920644  2745 raft_consensus.cc:359] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:25.922399  2745 raft_consensus.cc:740] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:25.923225  2745 consensus_queue.cc:260] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:25.926124  2745 ts_tablet_manager.cc:1434] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.001s
I20260709 12:58:25.928612  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-f4986d58f61a45638a1088287c2004d8 received from {username='slave'} at 127.0.0.1:54412
I20260709 12:58:25.929158  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-f4986d58f61a45638a1088287c2004d8 on tablet f4986d58f61a45638a1088287c2004d8 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:25.930823  2748 tablet_copy_client.cc:806] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:25.931589  2748 tablet_copy_client.cc:670] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:25.940062  2748 tablet_copy_client.cc:538] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:25.963152  2743 tablet_bootstrap.cc:492] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:25.964258  2743 tablet_bootstrap.cc:492] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:25.965094  2743 ts_tablet_manager.cc:1403] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.022s
I20260709 12:58:25.966113  2748 tablet_bootstrap.cc:492] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:25.973086  2743 raft_consensus.cc:359] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:25.974169  2743 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:25.974929  2743 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:25.978217  2743 ts_tablet_manager.cc:1434] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:58:25.981654  1581 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-b11fdc1931874b5389be76ef648b6ae1 received from {username='slave'} at 127.0.0.1:38394
I20260709 12:58:25.982169  1581 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-b11fdc1931874b5389be76ef648b6ae1 on tablet b11fdc1931874b5389be76ef648b6ae1 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:26.003185  2748 tablet_bootstrap.cc:492] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:26.004833  2748 tablet_bootstrap.cc:492] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:26.006191  2748 ts_tablet_manager.cc:1403] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.040s	user 0.025s	sys 0.008s
I20260709 12:58:26.017539  2748 raft_consensus.cc:359] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:26.018720  2748 raft_consensus.cc:740] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:26.019529  2748 consensus_queue.cc:260] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:26.031363  2748 ts_tablet_manager.cc:1434] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 12:58:26.036650  1581 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-691bccf09f2f475a98a7ab9cbbd1dd8d received from {username='slave'} at 127.0.0.1:38394
I20260709 12:58:26.037164  1581 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-691bccf09f2f475a98a7ab9cbbd1dd8d on tablet 691bccf09f2f475a98a7ab9cbbd1dd8d with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:26.153405  2446 raft_consensus.cc:1217] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:26.166676  2444 raft_consensus.cc:1217] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:58:26.174260  2444 raft_consensus.cc:1217] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:26.249212  2444 raft_consensus.cc:1217] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:26.675189  2719 raft_consensus.cc:1064] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:26.677747  2719 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:26.684574  2444 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:26.685493  1641 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:26.686703  1716 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:26.687711  2733 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:26.689787  2725 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:26.693173  2733 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:26.715165  2719 raft_consensus.cc:2955] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:26.718353  2446 raft_consensus.cc:2955] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:26.726395  1641 raft_consensus.cc:2955] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:26.732070  2621 raft_consensus.cc:1064] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:26.734942  2621 consensus_queue.cc:237] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:26.737733  1469 catalog_manager.cc:5697] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:26.781026  2619 raft_consensus.cc:1064] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:26.787846  2619 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:26.796379  2446 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:26.800935  2733 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:26.807964  1716 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:26.819353  2733 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:26.835714  1643 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:26.878840  2733 raft_consensus.cc:1064] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:26.891103  2762 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:58:26.908542  2733 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:26.927788  1719 raft_consensus.cc:2955] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:26.954703  2446 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:26.955802  1569 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:26.956629  1645 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:26.960250  2721 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:26.964952  2757 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:26.974530  1571 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:26.975548  2621 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:27.004750  2444 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:27.012317  2721 raft_consensus.cc:2955] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.022684  2767 raft_consensus.cc:2955] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.028084  1571 raft_consensus.cc:2955] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.032524  1719 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:27.038300  1716 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:27.034132  2766 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:58:27.056675  1641 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:58:27.066817  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 59217.1us
I20260709 12:58:27.069775  2444 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:27.081421  2769 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:27.094403  2725 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:27.094897  2446 raft_consensus.cc:2955] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.101334  2777 raft_consensus.cc:2955] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.105630  2448 raft_consensus.cc:2955] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.107999  2447 raft_consensus.cc:2955] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.110962  2778 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:27.115527  2766 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:27.191125  1645 raft_consensus.cc:2955] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.207562  1719 raft_consensus.cc:2955] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.223930  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b11fdc1931874b5389be76ef648b6ae1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:27.225323  1638 raft_consensus.cc:2955] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.245654  1466 catalog_manager.cc:5697] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.262255  1636 tablet_service.cc:1558] Processing DeleteTablet for tablet b11fdc1931874b5389be76ef648b6ae1 with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36684
I20260709 12:58:27.289654  1717 raft_consensus.cc:2955] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.295673  2784 tablet_replica.cc:333] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 12:58:27.306823  2784 raft_consensus.cc:2243] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:27.306447  1467 catalog_manager.cc:5697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.307955  2784 raft_consensus.cc:2272] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:27.316779  2784 ts_tablet_manager.cc:1916] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:58:27.321875  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 118608us
I20260709 12:58:27.336680  1469 catalog_manager.cc:5697] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:27.373028  2762 raft_consensus.cc:2955] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.400383  1719 consensus_queue.cc:237] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:27.418855  2444 raft_consensus.cc:2955] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.423091  2447 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:27.427767  1641 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:27.429139  2621 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:27.436605  2721 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:27.440969  2780 raft_consensus.cc:2955] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.448560  1469 catalog_manager.cc:5697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.454942  2444 raft_consensus.cc:2955] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.463850  1641 raft_consensus.cc:2955] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.491196  1717 raft_consensus.cc:2955] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.491994  1467 catalog_manager.cc:5697] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.503427  1645 raft_consensus.cc:2955] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.518329  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f4986d58f61a45638a1088287c2004d8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:27.524940  1571 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:27.531198  1557 tablet_service.cc:1558] Processing DeleteTablet for tablet f4986d58f61a45638a1088287c2004d8 with delete_type TABLET_DATA_TOMBSTONED (TS 338d817f94ee4c1bad162e9a5860b68a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46620
I20260709 12:58:27.536562  2444 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:27.536760  2784 ts_tablet_manager.cc:1929] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:27.537305  2784 log.cc:1199] T b11fdc1931874b5389be76ef648b6ae1 P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/b11fdc1931874b5389be76ef648b6ae1
I20260709 12:58:27.543826  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet b11fdc1931874b5389be76ef648b6ae1 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:27.538584  2762 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:58:27.556488  2777 raft_consensus.cc:2955] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.558876  2447 raft_consensus.cc:2955] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.574450  1469 catalog_manager.cc:5697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.584117  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bc72a09ffebe49218d3a2f9d4e0bcc45 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:27.584865  2787 tablet_replica.cc:333] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 12:58:27.594879  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet bc72a09ffebe49218d3a2f9d4e0bcc45 with delete_type TABLET_DATA_TOMBSTONED (TS 66344ad7cd844754b2c81cc689a709b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60074
I20260709 12:58:27.596740  1645 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:27.608886  2787 raft_consensus.cc:2243] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:27.611491  2788 tablet_replica.cc:333] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 12:58:27.613008  2787 raft_consensus.cc:2272] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:27.624512  2788 raft_consensus.cc:2243] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:27.633962  2788 raft_consensus.cc:2272] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:27.643728  2788 ts_tablet_manager.cc:1916] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:27.646356  2787 ts_tablet_manager.cc:1916] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:27.661634  2777 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:27.675469  1641 raft_consensus.cc:2955] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.695566  2787 ts_tablet_manager.cc:1929] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:27.696226  2787 log.cc:1199] T f4986d58f61a45638a1088287c2004d8 P 338d817f94ee4c1bad162e9a5860b68a: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/wals/f4986d58f61a45638a1088287c2004d8
I20260709 12:58:27.697090  2788 ts_tablet_manager.cc:1929] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:58:27.697681  2788 log.cc:1199] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 66344ad7cd844754b2c81cc689a709b0: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/wals/bc72a09ffebe49218d3a2f9d4e0bcc45
I20260709 12:58:27.698554  1456 catalog_manager.cc:5028] TS 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): tablet f4986d58f61a45638a1088287c2004d8 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:27.701792  1455 catalog_manager.cc:5028] TS 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): tablet bc72a09ffebe49218d3a2f9d4e0bcc45 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:27.703118  1571 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:27.711635  2447 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:27.715688  2769 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:27.721428  1713 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:27.724525  2767 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:27.729139  2766 raft_consensus.cc:2955] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.730309  1713 raft_consensus.cc:2955] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.739989  2447 raft_consensus.cc:2955] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.772688  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 691bccf09f2f475a98a7ab9cbbd1dd8d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:27.774537  1467 catalog_manager.cc:5697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:27.793922  1636 tablet_service.cc:1558] Processing DeleteTablet for tablet 691bccf09f2f475a98a7ab9cbbd1dd8d with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36684
I20260709 12:58:27.795176  2784 tablet_replica.cc:333] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 12:58:27.797300  2784 raft_consensus.cc:2243] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:27.798314  2784 raft_consensus.cc:2272] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:27.805226  2784 ts_tablet_manager.cc:1916] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:27.823745  2784 ts_tablet_manager.cc:1929] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:27.824215  2784 log.cc:1199] T 691bccf09f2f475a98a7ab9cbbd1dd8d P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/691bccf09f2f475a98a7ab9cbbd1dd8d
I20260709 12:58:27.825980  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet 691bccf09f2f475a98a7ab9cbbd1dd8d (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:28.868220  1641 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:28.875595  1713 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:28.876260  1571 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:58:28.876539  1612 consensus_peers.cc:597] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36a0e244d11c4ffe96ee4a663e2c69c8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:28.877252  2786 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:28.878247  2789 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:28.893322  2786 raft_consensus.cc:2955] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:28.896142  1713 raft_consensus.cc:2955] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:28.897481  1571 raft_consensus.cc:2955] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:28.910943  1719 consensus_queue.cc:237] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:28.919924  1647 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:28.921555  1686 consensus_peers.cc:597] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e13ac9e112d84ff79c9ea7f4762a82ab. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:28.921761  2721 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:28.922153  1470 catalog_manager.cc:5697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:28.923283  1571 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:28.925298  2721 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:28.946151  2780 raft_consensus.cc:2955] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:28.949438  1568 raft_consensus.cc:2955] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:28.951856  1647 raft_consensus.cc:2955] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:29.007462  1713 consensus_queue.cc:237] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:29.020850  1469 catalog_manager.cc:5697] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:29.030683  1571 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:29.034374  1686 consensus_peers.cc:597] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7404e443f1f4264bb8ea4e04b8e8627. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:29.034471  1647 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:29.035487  2780 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:29.036550  2798 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:29.067539  2798 raft_consensus.cc:2955] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:29.070309  1647 raft_consensus.cc:2955] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:29.070878  1571 raft_consensus.cc:2955] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:29.095727  1469 catalog_manager.cc:5697] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:29.105572  1571 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:29.128432  1647 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:29.130007  1713 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:29.130345  2719 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:29.131584  2805 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:58:29.136300  1537 consensus_peers.cc:597] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72ddc5b6631d45ffb9776db2cc41447d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:29.142802  2777 raft_consensus.cc:2955] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:29.144688  1713 raft_consensus.cc:2955] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:29.169667  1470 catalog_manager.cc:5697] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:29.171756  1647 raft_consensus.cc:2955] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:58:29.391525  2809 ts_tablet_manager.cc:933] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:29.393913  2809 tablet_copy_client.cc:323] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:45463
I20260709 12:58:29.395829  1657 tablet_copy_service.cc:140] P a4be9cc90aca4dd4ad7db103062a7208: Received BeginTabletCopySession request for tablet 36a0e244d11c4ffe96ee4a663e2c69c8 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38584)
I20260709 12:58:29.396358  1657 tablet_copy_service.cc:161] P a4be9cc90aca4dd4ad7db103062a7208: Beginning new tablet copy session on tablet 36a0e244d11c4ffe96ee4a663e2c69c8 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38584: session id = 6f381117554e49bb816791ab0a10f2b8-36a0e244d11c4ffe96ee4a663e2c69c8
I20260709 12:58:29.403388  1657 tablet_copy_source_session.cc:215] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:29.406896  2809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a0e244d11c4ffe96ee4a663e2c69c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:29.422735  2809 tablet_copy_client.cc:806] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:29.423540  2809 tablet_copy_client.cc:670] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:29.428995  2809 tablet_copy_client.cc:538] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:29.439504  2809 tablet_bootstrap.cc:492] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:29.447118  2811 ts_tablet_manager.cc:933] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:29.449760  2811 tablet_copy_client.cc:323] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 12:58:29.451957  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet e13ac9e112d84ff79c9ea7f4762a82ab from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 12:58:29.452543  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet e13ac9e112d84ff79c9ea7f4762a82ab from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-e13ac9e112d84ff79c9ea7f4762a82ab
I20260709 12:58:29.465153  1730 tablet_copy_source_session.cc:215] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:29.469333  2811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e13ac9e112d84ff79c9ea7f4762a82ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:29.477873  2809 tablet_bootstrap.cc:492] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:29.479219  2809 tablet_bootstrap.cc:492] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:29.480115  2809 ts_tablet_manager.cc:1403] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.017s
I20260709 12:58:29.484719  2809 raft_consensus.cc:359] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:29.485720  2809 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:29.490510  2809 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:29.494599  2809 ts_tablet_manager.cc:1434] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.006s
I20260709 12:58:29.497185  1657 tablet_copy_service.cc:342] P a4be9cc90aca4dd4ad7db103062a7208: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-36a0e244d11c4ffe96ee4a663e2c69c8 received from {username='slave'} at 127.0.0.1:38584
I20260709 12:58:29.497620  1657 tablet_copy_service.cc:434] P a4be9cc90aca4dd4ad7db103062a7208: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-36a0e244d11c4ffe96ee4a663e2c69c8 on tablet 36a0e244d11c4ffe96ee4a663e2c69c8 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:29.503078  2811 tablet_copy_client.cc:806] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:29.503767  2811 tablet_copy_client.cc:670] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:29.509222  2811 tablet_copy_client.cc:538] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:29.519996  2811 tablet_bootstrap.cc:492] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:29.547210  2811 tablet_bootstrap.cc:492] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:29.548609  2811 tablet_bootstrap.cc:492] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:29.549542  2811 ts_tablet_manager.cc:1403] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.004s
I20260709 12:58:29.552928  2811 raft_consensus.cc:359] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:29.553838  2811 raft_consensus.cc:740] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:29.554548  2811 consensus_queue.cc:260] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:29.557123  2811 ts_tablet_manager.cc:1434] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:58:29.559231  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-e13ac9e112d84ff79c9ea7f4762a82ab received from {username='slave'} at 127.0.0.1:54412
I20260709 12:58:29.559660  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-e13ac9e112d84ff79c9ea7f4762a82ab on tablet e13ac9e112d84ff79c9ea7f4762a82ab with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:29.649704  2811 ts_tablet_manager.cc:933] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:29.651671  2811 tablet_copy_client.cc:323] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 12:58:29.653424  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet b7404e443f1f4264bb8ea4e04b8e8627 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 12:58:29.653937  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet b7404e443f1f4264bb8ea4e04b8e8627 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-b7404e443f1f4264bb8ea4e04b8e8627
I20260709 12:58:29.660481  1730 tablet_copy_source_session.cc:215] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:29.663426  2811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7404e443f1f4264bb8ea4e04b8e8627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:29.671532  2809 ts_tablet_manager.cc:933] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 12:58:29.683699  2811 tablet_copy_client.cc:806] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:29.684491  2811 tablet_copy_client.cc:670] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:29.693668  2809 tablet_copy_client.cc:323] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 12:58:29.695117  2811 tablet_copy_client.cc:538] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:29.708630  2811 tablet_bootstrap.cc:492] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:29.729838  1581 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet 72ddc5b6631d45ffb9776db2cc41447d from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 12:58:29.730636  1581 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet 72ddc5b6631d45ffb9776db2cc41447d from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-72ddc5b6631d45ffb9776db2cc41447d
W20260709 12:58:29.730831  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 46002.1us
I20260709 12:58:29.745039  2811 tablet_bootstrap.cc:492] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:29.746270  2811 tablet_bootstrap.cc:492] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:29.747126  2811 ts_tablet_manager.cc:1403] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.039s	user 0.024s	sys 0.007s
I20260709 12:58:29.748925  1581 tablet_copy_source_session.cc:215] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:29.750524  2811 raft_consensus.cc:359] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:29.756987  2811 raft_consensus.cc:740] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:29.757869  2811 consensus_queue.cc:260] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:29.766721  2811 ts_tablet_manager.cc:1434] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 12:58:29.771875  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-b7404e443f1f4264bb8ea4e04b8e8627 received from {username='slave'} at 127.0.0.1:54412
I20260709 12:58:29.772393  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-b7404e443f1f4264bb8ea4e04b8e8627 on tablet b7404e443f1f4264bb8ea4e04b8e8627 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:29.779017  2809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72ddc5b6631d45ffb9776db2cc41447d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:29.802213  2809 tablet_copy_client.cc:806] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:29.802975  2809 tablet_copy_client.cc:670] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:29.829190  2809 tablet_copy_client.cc:538] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:29.840306  2809 tablet_bootstrap.cc:492] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:29.859549  2809 tablet_bootstrap.cc:492] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:29.860544  2809 tablet_bootstrap.cc:492] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:29.861269  2809 ts_tablet_manager.cc:1403] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.005s
I20260709 12:58:29.864501  2809 raft_consensus.cc:359] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:29.865414  2809 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:29.866165  2444 raft_consensus.cc:1217] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:29.866194  2809 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:29.871243  2809 ts_tablet_manager.cc:1434] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:58:29.875751  1581 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-72ddc5b6631d45ffb9776db2cc41447d received from {username='slave'} at 127.0.0.1:38394
I20260709 12:58:29.876266  1581 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-72ddc5b6631d45ffb9776db2cc41447d on tablet 72ddc5b6631d45ffb9776db2cc41447d with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:29.882983  2444 raft_consensus.cc:1217] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:58:30.116598  2444 raft_consensus.cc:1217] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:30.233721  2444 raft_consensus.cc:1217] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:58:30.289067  2818 raft_consensus.cc:1064] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:30.292549  2818 consensus_queue.cc:237] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:30.300796  1645 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.303364  1569 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.303364  2444 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.304003  2818 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:58:30.306138  2800 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.308312  2780 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.347342  2444 raft_consensus.cc:2955] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.345480  2818 raft_consensus.cc:2955] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.364158  1571 raft_consensus.cc:2955] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.371289  1467 catalog_manager.cc:5697] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.376068  2786 raft_consensus.cc:1064] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:30.379943  2786 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:30.399132  1719 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:30.402298  2830 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.401813  1645 raft_consensus.cc:2955] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.407357  2444 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:30.410003  2789 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.421976  1571 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:30.426611  2789 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.435741  2830 raft_consensus.cc:2955] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.466383  1719 consensus_queue.cc:237] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:30.468433  2444 raft_consensus.cc:2955] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.476039  2447 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:30.478461  2818 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:30.484877  1717 raft_consensus.cc:2955] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.487464  1470 catalog_manager.cc:5697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.494220  2800 raft_consensus.cc:2955] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.498934  1571 raft_consensus.cc:2955] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.509855  2444 raft_consensus.cc:2955] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.530099  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e13ac9e112d84ff79c9ea7f4762a82ab with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:30.531740  1647 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:30.533461  2818 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:30.540966  1647 raft_consensus.cc:2955] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.559126  1645 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:30.567133  2446 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:30.569375  2789 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:30.577790  2833 raft_consensus.cc:2955] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.586314  2446 raft_consensus.cc:2955] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.590723  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36a0e244d11c4ffe96ee4a663e2c69c8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:30.612870  1467 catalog_manager.cc:5697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New cstate: current_term: 2 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:30.615325  1467 catalog_manager.cc:5697] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.621887  1571 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:30.685773  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet 36a0e244d11c4ffe96ee4a663e2c69c8 with delete_type TABLET_DATA_TOMBSTONED (TS 66344ad7cd844754b2c81cc689a709b0 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60074
I20260709 12:58:30.694556  1557 tablet_service.cc:1558] Processing DeleteTablet for tablet e13ac9e112d84ff79c9ea7f4762a82ab with delete_type TABLET_DATA_TOMBSTONED (TS 338d817f94ee4c1bad162e9a5860b68a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46620
I20260709 12:58:30.708325  2840 tablet_replica.cc:333] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 12:58:30.729450  2789 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:30.738870  2841 tablet_replica.cc:333] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 12:58:30.738734  2840 raft_consensus.cc:2243] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:30.746196  2837 raft_consensus.cc:1064] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:30.752434  2841 raft_consensus.cc:2243] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:30.752621  2840 raft_consensus.cc:2272] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:30.753238  2841 raft_consensus.cc:2272] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:30.755005  2837 consensus_queue.cc:237] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:30.757117  2840 ts_tablet_manager.cc:1916] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:30.760778  2841 ts_tablet_manager.cc:1916] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:30.773159  2821 raft_consensus.cc:1064] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:58:30.776664  1568 raft_consensus.cc:2955] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.777649  2821 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:30.804996  2446 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:30.805382  1719 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:30.806830  2840 ts_tablet_manager.cc:1929] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:58:30.807006  2820 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.811902  2777 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.812604  2444 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.807411  2840 log.cc:1199] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 66344ad7cd844754b2c81cc689a709b0: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/wals/36a0e244d11c4ffe96ee4a663e2c69c8
I20260709 12:58:30.814354  2838 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.817170  1455 catalog_manager.cc:5028] TS 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): tablet 36a0e244d11c4ffe96ee4a663e2c69c8 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:30.823169  1569 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.827080  2818 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.832369  1647 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.846791  1638 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:30.857810  2818 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.867534  2777 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.855398  2841 ts_tablet_manager.cc:1929] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:30.872694  2841 log.cc:1199] T e13ac9e112d84ff79c9ea7f4762a82ab P 338d817f94ee4c1bad162e9a5860b68a: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/wals/e13ac9e112d84ff79c9ea7f4762a82ab
I20260709 12:58:30.886502  1456 catalog_manager.cc:5028] TS 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): tablet e13ac9e112d84ff79c9ea7f4762a82ab (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:30.885764  2838 raft_consensus.cc:2955] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.894640  1569 raft_consensus.cc:2955] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.904742  2777 raft_consensus.cc:2955] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.905494  1647 raft_consensus.cc:2955] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.915336  1470 catalog_manager.cc:5697] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.919624  1639 raft_consensus.cc:2955] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.928447  2444 raft_consensus.cc:2955] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.931062  2446 raft_consensus.cc:2955] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.934805  1720 raft_consensus.cc:2955] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:30.946712  1467 catalog_manager.cc:5697] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 2 to 3, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:30.977486  1569 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:30.984992  1719 consensus_queue.cc:237] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:30.998651  1720 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:30.994602  2444 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:31.006570  2821 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:31.008666  2821 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:31.012876  1639 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:31.014242  2818 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:31.022301  2444 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:31.022969  2838 raft_consensus.cc:2955] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:31.027984  2839 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:31.029305  2820 raft_consensus.cc:2955] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:31.036556  1638 raft_consensus.cc:2955] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:31.046399  2444 raft_consensus.cc:2955] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:31.051913  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b7404e443f1f4264bb8ea4e04b8e8627 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:31.056399  1469 catalog_manager.cc:5697] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 3 to 4, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:31.056715  2446 raft_consensus.cc:2955] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:31.061110  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 72ddc5b6631d45ffb9776db2cc41447d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:31.084267  1557 tablet_service.cc:1558] Processing DeleteTablet for tablet b7404e443f1f4264bb8ea4e04b8e8627 with delete_type TABLET_DATA_TOMBSTONED (TS 338d817f94ee4c1bad162e9a5860b68a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46620
I20260709 12:58:31.085297  2841 tablet_replica.cc:333] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 12:58:31.086431  2841 raft_consensus.cc:2243] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:31.087184  2841 raft_consensus.cc:2272] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:31.091377  2841 ts_tablet_manager.cc:1916] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:31.096163  1469 catalog_manager.cc:5697] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:31.106997  1720 raft_consensus.cc:2955] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:31.121380  2841 ts_tablet_manager.cc:1929] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:31.122295  2841 log.cc:1199] T b7404e443f1f4264bb8ea4e04b8e8627 P 338d817f94ee4c1bad162e9a5860b68a: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/wals/b7404e443f1f4264bb8ea4e04b8e8627
I20260709 12:58:31.124001  1456 catalog_manager.cc:5028] TS 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): tablet b7404e443f1f4264bb8ea4e04b8e8627 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:31.136266  1636 tablet_service.cc:1558] Processing DeleteTablet for tablet 72ddc5b6631d45ffb9776db2cc41447d with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36684
I20260709 12:58:31.139802  2852 tablet_replica.cc:333] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 12:58:31.140695  2852 raft_consensus.cc:2243] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:31.141811  2852 raft_consensus.cc:2272] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:31.146351  2852 ts_tablet_manager.cc:1916] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:31.166762  2852 ts_tablet_manager.cc:1929] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:58:31.167301  2852 log.cc:1199] T 72ddc5b6631d45ffb9776db2cc41447d P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/72ddc5b6631d45ffb9776db2cc41447d
I20260709 12:58:31.169085  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet 72ddc5b6631d45ffb9776db2cc41447d (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 12:58:33.421676  2854 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.424062  2854 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:33.430234  2856 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.430337  2855 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.431356  2856 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:33.431728  2855 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:33.433415  2854 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:33.434397  2856 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:33.434572  2855 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:33.440327  2856 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.441684  2856 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:33.447348  2856 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:33.467296  2855 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.467377  2854 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:33.467546  2856 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.472831  2856 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:33.471681  2854 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:33.482677  2856 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:33.484061  2854 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:33.468675  2855 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:33.516513  2855 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:33.571568  2860 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:33.572926  2860 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:33.574163  2854 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.575351  2854 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:33.578527  2856 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.579672  2856 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:33.582307  2855 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:33.583369  2855 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:33.593930  2854 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:33.595922  2856 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:33.598810  2855 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:33.607954  2860 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:33.610724  2860 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.621078  2860 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:33.636509  2860 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:33.647591  2860 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:33.648537  2864 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.648722  2860 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:33.654807  2859 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.655902  2859 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:33.657003  2860 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:33.663938  2858 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:33.664994  2858 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:33.649643  2864 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:33.673094  2858 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:33.669737  2864 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:33.674557  2864 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.681756  2867 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:33.676115  2864 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:33.867926  2871 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.697386  2854 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.868914  2859 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:33.879124  2854 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:33.869078  2862 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.868538  2867 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:33.679915  2860 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:33.886943  2862 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:33.886752  2871 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:33.909236  2862 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:33.912146  2871 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:33.952914  2877 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:33.960088  2868 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.974877  2868 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:33.972676  2854 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:33.952973  2870 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:33.930400  2860 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:33.984961  2870 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:33.973277  2871 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:34.035527  2859 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.036257  2871 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.036685  2859 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.038285  2858 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:34.038545  2876 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:34.039142  2858 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.039232  2876 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.108218  2880 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:33.982455  2877 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.176887  2880 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.178043  2877 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:33.984864  2857 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:33.988206  2867 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.114198  2871 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.192030  2867 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.194923  2872 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.195108  2867 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.127846  2868 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.039254  2861 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:34.035591  2873 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.207669  2883 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.208666  2883 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.210462  2868 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.210302  2862 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.205513  2882 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:34.202347  2864 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.197050  2877 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.210950  2867 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.217828  2868 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:34.222687  1613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.008s	sys 0.053s
I20260709 12:58:34.226933  2868 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.227633  2882 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.244084  2854 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 12:58:34.244202  1613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.009s	sys 0.054s
I20260709 12:58:34.256593  2854 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.263916  2877 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.264341  2871 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:34.257035  2864 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.214970  2857 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.196040  2872 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.270797  2858 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.271570  2858 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:34.271940  2877 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.257273  2868 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.272260  2864 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.273249  2881 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.273032  2868 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.271646  2854 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.272477  2858 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.237910  2867 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:34.274916  2862 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.205646  2873 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.274036  2881 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.223673  2861 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.285411  2862 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.282590  2871 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.287191  2855 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.282460  2886 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.307606  2871 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.288779  2868 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:34.292397  2883 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.314950  2890 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.314903  2855 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.285980  2860 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.281010  2877 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:34.285763  2857 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.281562  2854 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:34.326014  2861 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.324116  2885 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.326488  2872 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.327168  2886 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.328640  2877 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.329530   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:34.329963  2873 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.285689  2867 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.323421  2864 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.331708  2890 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.324528  2871 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.348131  2886 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.343778  2885 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.351898  2881 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.388235  2855 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.355650  2882 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:34.391826  2887 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.394236  2887 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.361586  2877 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.402828  2890 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.403267  2885 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.420380  2887 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.354811  2871 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.439692  2871 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:34.646018  2474 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb720 after lost signal to thread 434
W20260709 12:58:34.648633  2474 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6360 after lost signal to thread 1504
W20260709 12:58:34.690442  2474 debug-util.cc:398] Leaking SignalData structure 0x7b08003296c0 after lost signal to thread 1596
W20260709 12:58:34.691882  2474 debug-util.cc:398] Leaking SignalData structure 0x7b08002eee20 after lost signal to thread 1671
W20260709 12:58:34.693234  2474 debug-util.cc:398] Leaking SignalData structure 0x7b08003351a0 after lost signal to thread 1745
I20260709 12:58:34.769987  2880 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.783022  2881 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.783833  2881 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.784402  2882 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.785072  2892 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:34.785104  2882 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.786232  2873 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:34.785913  2892 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.787101  2887 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:34.786902  2873 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.787411  2885 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:34.787709  2887 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.788080  2885 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.789201  2873 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:34.790334  2885 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.790419  2889 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.790604  2887 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.791045  2885 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.791168  2889 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.791663  2885 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.793358  2892 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.793663  2889 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:34.794431  2888 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.795447  2882 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.782562  2880 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.795619  2888 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.796185  2880 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.789775  2873 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.794868  2892 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:34.799460  2873 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.794807  2881 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:34.793666  2885 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.798275  2880 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.802858  2873 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.804348  2893 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:34.799825  2892 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.804975  2893 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.806862  2892 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:34.798302  2888 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.807724  2893 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:34.810971  2474 debug-util.cc:398] Leaking SignalData structure 0x7b080032b380 after lost signal to thread 2477
W20260709 12:58:34.811370  2474 debug-util.cc:398] Leaking SignalData structure 0x7b080025bba0 after lost signal to thread 2478
I20260709 12:58:34.820873  2855 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.821012  2883 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.822923  2871 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.823302  2859 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.824066  2855 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.825212  2883 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.827431  2855 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.827561  2890 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.828083  2855 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:34.828336  2890 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.828725  2855 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.830268  2886 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:34.831099  2886 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.831472  2855 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.833952  2886 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.837158  2890 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.821153  2857 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.839131  2857 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.841643  2857 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.842908  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.845022  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.825227  2871 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.847486  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.848230  1714 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:34.848830  2871 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.849268  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.851959  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.845707  1718 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:34.853758  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.855937  1712 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:34.856178  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.857062  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.850816  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.858548  1718 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:34.859421  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.861227  1714 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:34.861547  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.862481  1715 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:34.862556  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.863408  1714 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:34.864578  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.860438  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.865576  1712 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:34.866499  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.855028  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.864662  1611 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:34.869283  2893 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:34.869692  2893 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.870149  2893 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:34.859671  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.877041  1714 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:34.879134  1611 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:34.880208  1611 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:34.880998  2892 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:34.881433  2892 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.881561  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.881620  1611 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:34.881903  2892 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:34.881803  2859 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:34.886551  2859 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.887002  2859 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:34.854198  2883 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.889146  1611 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:34.882370  1717 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:34.891685  2873 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:34.891916  2888 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:34.892127  2873 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.892596  2873 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:34.892516  2888 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.893287  2888 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:34.895553  1611 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:34.896556  2880 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:34.896988  2880 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.897359  2880 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:34.898628  2881 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:34.899293  2881 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.899925  2889 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.900676  2889 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.901827  2881 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.902819  2889 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.356462  2854 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:34.913401  1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.015s	sys 0.033s
W20260709 12:58:34.913866  1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.016s	sys 0.033s
I20260709 12:58:34.914034  2893 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.914503  2856 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.915215  2856 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:34.916518  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:34.917163  2444 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:34.917512  2856 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:34.918375  2854 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.918229  2892 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.920449  2876 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.927701  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:34.928256  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:34.928972  2444 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:34.928643  2446 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:34.930591  2892 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.931970  2856 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:34.932734  2856 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.934562  1611 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:34.937799  2854 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.938010  2893 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.938840  2892 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:34.938591  2854 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.334776  2870 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.928150  2888 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.943006  2856 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.945940  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:34.942811  2854 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:34.946911  2440 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:34.947011  2873 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.949546  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:34.948740  2888 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.950263  2444 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:34.951306  2873 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.953207  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:34.954542  2854 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:34.954485  2859 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.955199  2854 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.955768  2854 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:34.957226  2859 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.958894  1611 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:34.958810  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:34.961287  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:34.356833  2858 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:34.963213  2868 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:34.966270  2868 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.967746  2868 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:34.969446  2894 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:34.971067  2894 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.971660  2894 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:34.959018  2892 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 12:58:34.975528  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.019s	sys 0.046s
W20260709 12:58:34.976009  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.019s	sys 0.047s
I20260709 12:58:34.976297  1611 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:34.977733  2858 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:34.978289  2858 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.978716  2858 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:34.979504  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:34.982180  2862 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.355995  2867 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.982972  2862 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:34.985675  2862 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:34.964180  2859 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:34.987896  1611 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:34.989184  2862 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:34.989604  2862 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.990015  2862 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:34.977270  2892 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:34.999014  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.001494  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.001784  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.002710  1717 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:34.985805  2893 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.988368  2859 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:34.985911  2889 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.004621  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:35.006594  1721 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.005290  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:35.007164  1712 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.009083  2888 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.009898  2888 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.010008  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:35.012032  1718 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.012894  2888 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.014987  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:35.010425  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:35.015669  2889 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.016124  2442 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:35.016463  1714 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.018117  2889 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.018471  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.018723  2893 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.020951  2893 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.019109  1716 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 1.
I20260709 12:58:35.035720  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.037070  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:35.037634  1713 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.038829  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.040062  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:35.041005  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.041077  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:35.040715  1716 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:35.042361  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.041229  2856 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:35.046206  2856 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.046288  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.046734  2856 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.045435  1712 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:35.046316  2891 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:35.048287  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.050781  1721 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:35.049778  2891 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.051555  2891 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:35.013737  2859 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.052268  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.057420  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:35.058687  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.048072  2854 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:35.053894  2889 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.062296  2857 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:35.063367  2857 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.063326  2889 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.063935  2857 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.062732  2888 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.067003  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.075371  2888 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.078003  2888 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.078409  2882 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:35.079145  2882 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:35.080935  2881 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.081632  2881 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.084949  2888 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.083482  2893 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.086766  2893 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.085871  2888 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.095793  2893 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.061714  2873 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.096313  2896 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.098747  2873 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.102464  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.103502  1712 raft_consensus.cc:2393] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:35.104902  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.106122  2881 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.111006  1611 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:35.104370  1714 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:35.117661  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.109263  2858 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.105218  1718 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:35.119743  2884 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:35.117604  2881 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:35.120671  2865 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:35.122568  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.125548  1721 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:35.113065  2893 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:35.098914  2896 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.121279  2880 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.133862  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.134241  2862 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.134711  1720 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:35.144363  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.145962  1721 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:35.147298  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.144400  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.150089  1712 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:35.148135  1721 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:35.126192  2889 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.136602  2863 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:35.123430  2894 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:35.119637  2405 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:35.162513  1638 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:35.143617  2862 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.128005  2884 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:35.170826  1715 raft_consensus.cc:2393] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:35.174939  2898 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:35.175851  2898 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.176440  2898 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.178602  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.179353  1712 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:35.175048  2875 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:35.143283  2856 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:35.156581  2889 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:35.132285  2893 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.199249  2867 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:35.225283  2882 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:35.152272  2881 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:35.185207  2854 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:35.246692  2900 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:35.250226  1717 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:35.259888  2896 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.261006  2866 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:35.263968  1713 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:35.171553  2865 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.272678  2865 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.275820  2869 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:35.154119  2863 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.235461  2867 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.280817  1715 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:35.192341  2891 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:35.286294  1719 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 4: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:35.243932  2873 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.248833  2888 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.213821  2889 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:35.241703  2884 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:35.184145  2875 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.305361  2878 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:35.307302  2894 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:35.289759  2867 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.313897  2899 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:35.316339  2863 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:35.190037  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 77122.2us
I20260709 12:58:35.326284  2897 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:35.308887  2874 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:35.327708  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:35.333562  2448 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:35.276579  2869 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.352823  2869 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.322777  2858 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.378892  2875 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.368274  2899 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.381939  1712 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:35.261801  2866 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:35.389708  2899 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.365440  2880 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.310765  2900 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.416993  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.417766  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.418593  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.420665  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.421339  1567 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
I20260709 12:58:35.422345  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.422768  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.411747  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.405274  2891 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:35.422389  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.426307  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.424917  1568 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 1.
I20260709 12:58:35.424582  2856 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:35.439319  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.446400  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:35.447508  2442 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:35.438836  1563 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 1.
I20260709 12:58:35.450278  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.429919  2893 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.413465  2874 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.451689  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.461463  1564 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 1.
I20260709 12:58:35.463701  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.364565  2878 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:35.477576  1501 debug-util.cc:398] Leaking SignalData structure 0x7b0800038ae0 after lost signal to thread 434
I20260709 12:58:35.453583  2881 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:35.476320  2868 consensus_meta.cc:287] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.508s	user 0.003s	sys 0.011s
W20260709 12:58:35.488713  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 374599us
I20260709 12:58:35.495255  1611 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:35.496785  1611 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:35.406450  2897 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.487504  2900 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.501428  2899 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:35.506393  2895 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:35.514966  2895 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.516234  2406 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:35.516434  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.517292  2895 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.517477  2906 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:35.518257  2879 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:35.518498  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.518865  2879 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.519896  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.519814  2899 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.520602  1571 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:35.521126  2879 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.522076  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.522549  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.511322  1611 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:35.522140  2875 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:35.503006  2893 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:35.500242  2889 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:35.508397  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08000391c0 after lost signal to thread 1504
I20260709 12:58:35.517916  2895 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:35.537531  2895 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.538507  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.538793  2875 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.539602  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.540014  2895 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.540307  1572 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:35.541114  2875 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.537577  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.538341  2858 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:35.493973  2868 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:35.526433  2880 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:58:35.560334  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 44166.6us
I20260709 12:58:35.521981  2899 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.527719  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:35.536500  2893 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.569805  2910 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:35.570806  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.579146  1716 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:35.579118  1718 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:35.579285  1611 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:35.560026  2866 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:35.535820  2906 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.595775  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:35.596764  2444 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:35.596975  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:35.598796  1611 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:35.600054  1611 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:35.577143  2893 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:35.604380  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.578702  2910 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:35.604444  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.603773  1715 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:35.605356  1572 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:35.605965  1611 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:35.590981  1501 debug-util.cc:398] Leaking SignalData structure 0x7b0800303c40 after lost signal to thread 1596
I20260709 12:58:35.614562  1611 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:35.582724  2858 raft_consensus.cc:697] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:35.575030  2880 raft_consensus.cc:697] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:58:35.613560  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08002add60 after lost signal to thread 1597
I20260709 12:58:35.623144  1712 raft_consensus.cc:1240] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:35.623721  1611 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:35.606920  2888 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:35.626706  1611 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:35.629153  2882 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:35.629153  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:35.629853  1611 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:35.624655  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.629611  2882 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.630954  2896 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:35.631152  2882 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.631443  2896 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.607259  2889 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:35.609356  2907 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:35.606915  2910 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:35.631916  2896 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.622466  2873 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:35.652552  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.652187  2858 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.631086  2874 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.622421  2866 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:35.627030  2903 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:35.661024  2880 consensus_queue.cc:237] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.662254  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:35.639549  2904 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:35.665702  2903 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.666476  2448 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:35.667711  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:35.669601  2892 consensus_meta.cc:287] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.626s	user 0.012s	sys 0.001s
I20260709 12:58:35.682296  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.670439  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.671149  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:58:35.682581  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 52828.8us
I20260709 12:58:35.671258  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.633973  2888 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.637148  2889 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.683430  1611 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:35.677779  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.678857  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:35.655148  2907 raft_consensus.cc:697] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:35.674294  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:35.656121  2897 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.688359  2447 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: []
W20260709 12:58:35.684177  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08003223a0 after lost signal to thread 1671
I20260709 12:58:35.680074  2904 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:35.695966  1715 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:35.679890  2903 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.699414  1715 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:35.699898  2857 consensus_meta.cc:287] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.635s	user 0.015s	sys 0.002s
I20260709 12:58:35.700306  2857 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:35.701625  1719 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:35.681453  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:35.702556  1713 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:35.659539  2878 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.683933  2888 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.685070  2889 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.707278  1721 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:35.707695  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.708087  1717 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:35.687255  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.716493  2906 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.711104  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.707352  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.696318  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.713240  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.664273  2405 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:35.680305  2867 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:35.685025  2892 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.703606  2904 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.691486  2866 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.733479  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.733598  2907 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.735235  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:35.735033  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08002f8960 after lost signal to thread 1745
I20260709 12:58:35.738981  2437 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:35.727622  2868 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:35.729146  2909 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
I20260709 12:58:35.733479  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.720844  2893 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.746260  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:35.743659  2898 consensus_meta.cc:287] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.004s
I20260709 12:58:35.724977  2897 consensus_queue.cc:1059] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:58:35.742316  2892 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.742157  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.750981  1569 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:35.757355  1646 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:35.758194  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:35.761420  1640 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:35.783989  1685 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.558s (SENT) [suppressed 1 similar messages]
I20260709 12:58:35.753566  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.761905  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:35.786628  2873 raft_consensus.cc:697] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:35.799343  2881 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:35.754786  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.803630  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.802934  2881 raft_consensus.cc:697] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:58:35.756891  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08001bb9a0 after lost signal to thread 2477
W20260709 12:58:35.798481  2859 consensus_meta.cc:287] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.736s	user 0.015s	sys 0.001s
I20260709 12:58:35.817355  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:35.785133  2898 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.824740  1640 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:35.826550  1645 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:35.751771  2857 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:35.826797  2898 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.857583  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.845113  2859 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:35.914619  2859 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:35.803356  2906 consensus_queue.cc:1059] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:58:35.757133  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:35.940155  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:58:35.822310  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9600 after lost signal to thread 2478
I20260709 12:58:35.953749  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.954095  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.955428  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.956863  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.956888  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.959631  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.960219  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.960354  1566 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:35.961454  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.961582  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.962634  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.962864  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:35.963752  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:35.964253  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.965056  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:35.965559  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.966223  1571 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:35.966583  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.967151  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.967844  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:35.968529  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.963830  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:35.969977  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:35.969980  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.976186  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.976877  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.977830  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.978334  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.979912  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:35.983480  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 199645us
I20260709 12:58:35.935575  2866 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:35.930649  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 279524us
I20260709 12:58:35.983822  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.945196  2891 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:35.991940  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 146126us
W20260709 12:58:35.995658  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 52245us
I20260709 12:58:35.986723  2913 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:35.998402  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 315055us
I20260709 12:58:36.002038  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.004433  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.006198  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:35.992890  2893 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:36.011345  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.010675  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:35.997520  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.021724  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:36.025970  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.026437  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.027079  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.025974  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.028986  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.034204  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:36.034693  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.037403  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:36.038187  1715 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.038275  1639 raft_consensus.cc:1240] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.040277  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.041787  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:36.042373  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.042821  2889 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.043730  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:35.948707  2873 consensus_queue.cc:237] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.010637  2867 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:36.045547  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.045001  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:36.083227  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 69895.8us
I20260709 12:58:36.042903  2442 raft_consensus.cc:2393] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:36.030231  2443 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:36.093747  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:36.096356  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:36.101959  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.046576  2891 raft_consensus.cc:697] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:36.103124  1641 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.104103  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.105019  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:36.103297  1647 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.110270  2903 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.111593  1645 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.112111  1721 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:36.011025  2881 consensus_queue.cc:237] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.113478  1686 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:36.104094  2891 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:36.041781  2882 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.118649  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.122310  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.120311  1638 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:36.030951  2405 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.107362  2874 raft_consensus.cc:3055] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:36.123809  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:36.136943  1686 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:36.144302  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.148567  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.126044  2903 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:36.155067  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:36.150636  1638 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:36.127786  2874 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:36.140827  2922 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:36.163125  2889 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:36.165448  1639 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.150265  2868 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:36.139025  2867 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.175463  1715 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:36.181318  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:36.183600  1642 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.180059  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.188279  1647 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:36.177346  2868 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:36.204161  2868 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.165103  2878 raft_consensus.cc:3055] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.191799  1686 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:58:36.154827  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 134771us
I20260709 12:58:36.149284  2897 consensus_queue.cc:1059] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:58:36.208343  1642 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.155681  2888 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.213577  1640 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:36.212215  2923 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:58:36.214383  2856 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:36.215826  1643 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.215991  2856 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:36.216437  2856 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:36.216882  2916 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:58:36.217378  2903 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:36.220534  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.172071  2922 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:36.174474  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.223424  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.226399  1647 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:36.228125  2896 consensus_meta.cc:287] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.002s
I20260709 12:58:36.228565  2896 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.230270  1646 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.208895  2878 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:36.235483  2888 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:36.231561  2896 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:36.231688  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.231881  1641 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.241717  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:36.242089  2910 consensus_meta.cc:287] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.020s
I20260709 12:58:36.242331  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.242583  2882 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:36.242528  2910 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:36.243021  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.243731  1645 raft_consensus.cc:2393] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.244038  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.244783  1647 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.239214  1686 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:36.238013  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.244545  2436 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:36.256608  1611 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:36.255429  1569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:36.255479  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:36.258518  1569 raft_consensus.cc:606] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.258922  1718 raft_consensus.cc:2393] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:36.257474  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:36.260412  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:36.259473  2857 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:36.261428  2919 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:36.261783  2857 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:36.261634  2872 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.263875  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.225190  2922 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.263614  2857 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.270030  2910 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:36.263710  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.272168  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:36.272878  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.273926  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:36.274549  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.276059  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.236726  2878 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:36.278205  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:36.278488  1564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:36.279112  1564 raft_consensus.cc:606] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.278868  2874 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:36.280071  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.280217  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.280364  2874 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:36.283406  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:36.284246  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.284614  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:36.287824  2918 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:36.288023  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.288308  2918 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:36.278234  2878 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.288736  2918 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.264322  2873 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:36.286227  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:36.286554  2872 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.268429  2868 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.298852  2920 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.303253  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:36.307456  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.302793  2873 raft_consensus.cc:697] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:36.304504  2867 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.305369  2872 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.314705  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.301311  2856 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.317883  1647 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.321471  1568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:36.325621  1568 raft_consensus.cc:606] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.329874  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.330525  1715 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.332794  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.339807  1720 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 12:58:36.341327  1570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "681b2518696f44d99824827761c9c9f1"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:36.342334  1570 raft_consensus.cc:606] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.358078  2882 consensus_queue.cc:1059] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:36.359411  2882 raft_consensus.cc:3055] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.359890  2882 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:36.360792  2882 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.347671  1466 catalog_manager.cc:5697] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 2 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:36.366398  2873 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.369823  2882 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.415450  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:36.379271  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 71756.1us
I20260709 12:58:36.419293  2856 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:36.424003  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.424938  1641 raft_consensus.cc:2393] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 12:58:36.375576  2904 consensus_meta.cc:287] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.640s	user 0.000s	sys 0.012s
I20260709 12:58:36.436645  2904 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.438643  1644 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.438894  2904 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:36.373637  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.440724  2437 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.442447  2897 consensus_queue.cc:1059] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:36.443540  2897 raft_consensus.cc:3055] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.444820  2897 raft_consensus.cc:740] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:36.434599  2922 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.425730  2880 consensus_queue.cc:1059] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:58:36.447002  2868 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:36.349054  2913 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.447314  2880 raft_consensus.cc:3055] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.447811  2880 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:36.447974  2922 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:36.445775  2897 consensus_queue.cc:260] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:36.433992  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.452062  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.453539  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.458947  1720 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:36.460057  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:36.460436  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.460899  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.461158  1645 raft_consensus.cc:2393] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.469488  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.461520  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.471544  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:36.469333  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.469540  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.461633  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.479539  1639 raft_consensus.cc:2393] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.475651  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.480998  1640 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.483193  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.484922  1564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff20dea159284907b41e95b640800f50"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:36.485659  1564 raft_consensus.cc:606] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.467494  1718 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.479929  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.394366  2857 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.449050  2880 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:36.488374  1641 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.492130  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.454905  2897 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.500916  2406 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:36.501456  2913 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:36.502013  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.502808  2910 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:36.503170  2910 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:36.503541  2910 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.504498  1714 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:36.468981  2873 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:58:36.495265   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:36.506613  2867 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:36.508234   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:36.500169  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.509716  1715 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.497678  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.511669  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.498394  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.499120  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.514412  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.495211  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.515055  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.515668  1643 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.515808  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.516237  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.516495  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.516875  1642 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.516978  1641 raft_consensus.cc:2393] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.517169  1643 raft_consensus.cc:2393] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.515108  1640 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.509896  1639 raft_consensus.cc:2393] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.496125  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.519985  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:36.522019  2925 log.cc:927] Time spent T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.266s	user 0.002s	sys 0.000s
W20260709 12:58:36.523207  2928 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:58:36.523581  2918 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.530340  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.531629  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.532121  2918 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:36.532470  1642 raft_consensus.cc:2393] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.524626  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.533484  2857 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:36.526291  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.527101  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.523908  2880 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.528743  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.538300  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.538406  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.538558  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.539193  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.540979  1646 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:36.528687  2913 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:36.543002  1645 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.544104  2910 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:36.544450  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.546087  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.546837  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.547526  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:36.555286  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:58:36.555859  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.548223  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:36.558394  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.559049  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.559397  1645 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.560243  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.560986  2436 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.561368  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.549525  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.562904  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.563957  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.564029  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.564364  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.565121  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.566167  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.566553  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.566947  1714 raft_consensus.cc:2393] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:36.566741  2906 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:36.567879  2906 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.568243  2906 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:36.569193  2906 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:36.566573  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.571390  2906 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.573050  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.573518  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:36.565160  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:36.575219  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.578039  1638 raft_consensus.cc:2410] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:36.579459  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.552211  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.548811  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:36.581020  1643 raft_consensus.cc:2410] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:36.581837  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.579587  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.583986  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.586812  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.587396  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.587939  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.588574  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.588984  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.590621  1713 raft_consensus.cc:1240] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.591140  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.592204  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.589715  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.593287  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.595247  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:36.596113  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.596431  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.596877  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.598166  1638 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:36.550465  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.600116  1639 raft_consensus.cc:2410] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:36.602252  2882 consensus_queue.cc:1059] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:36.604019  2882 raft_consensus.cc:3055] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.604413  2882 raft_consensus.cc:740] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:36.606361  2873 consensus_queue.cc:1059] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:36.606776  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:36.607522  2873 raft_consensus.cc:3055] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.607920  2873 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:36.608955  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:36.612071  1640 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:36.614502  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.615059  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.608803  2873 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.616406  2873 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.618177  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.605280  2882 consensus_queue.cc:260] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.619521  2882 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:36.619685  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.618242  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.623396  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.625818  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.627822  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:36.628666  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.631699  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:36.633085  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:36.608763  2910 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:36.609513  2880 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:58:36.674527  1685 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.676649  1469 catalog_manager.cc:5697] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 2, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:36.679148  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.679443  2857 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.680806  1469 catalog_manager.cc:5697] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 2, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:36.684127  1469 catalog_manager.cc:5697] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 2, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:36.687644  1469 catalog_manager.cc:5697] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 2, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:36.690609  1469 catalog_manager.cc:5697] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 2, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:36.692885  1564 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
I20260709 12:58:36.693121  1469 catalog_manager.cc:5697] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 2, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:36.679177  1685 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.698378  1685 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.702675  2891 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.705027  2857 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:36.705919  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 68614.7us
I20260709 12:58:36.708572  2857 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.708074  2873 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:36.711400  2866 consensus_queue.cc:1059] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:58:36.714391  2906 raft_consensus.cc:3055] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:36.714890  2906 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:36.713569  1612 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.716485  2906 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:36.718787  1612 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.717163  2903 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.721944  2906 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:36.723343  2903 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.712646  2873 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:36.730857  2873 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.737553  1685 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.737619  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.739660  1612 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.739236  1685 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.740188  2857 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.746428  1685 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.740525  2882 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.749032  1685 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.745468  2903 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.752741  1685 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.747402  2891 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.754621  1685 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.756026  1685 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.742782  2897 consensus_queue.cc:1059] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:58:36.749735  2918 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:36.759728  1685 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.773514  2922 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.775418  2857 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.778967  2906 consensus_queue.cc:1059] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:36.780517  2932 raft_consensus.cc:993] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 12:58:36.765977  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.750429  2874 consensus_queue.cc:1059] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:58:36.755573  2920 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.755323  2868 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.770207  2919 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.771286  2897 raft_consensus.cc:3055] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.753849  2927 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.749660  2878 consensus_queue.cc:1059] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:58:36.771919  2873 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.786845  1685 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.792091  1685 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.787719  2882 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.793133  2872 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.793485  1685 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.794229  2856 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.794613  2919 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.796205  2878 raft_consensus.cc:1081] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Signalling peer 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 12:58:36.796738  1685 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.789002  2897 raft_consensus.cc:740] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:36.797538  2919 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.798195  2897 consensus_queue.cc:260] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.799405  1685 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.800113  2918 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:36.800662  2919 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.801854  1685 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.799407  2897 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.791409  2866 raft_consensus.cc:3055] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.802779  2866 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:36.803896  2922 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.804957  2866 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.810490  1612 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.812168  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.810514  1685 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.814373  1685 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.817119  1685 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.818024  2919 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.818236  2880 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.818771  2872 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.815147  2922 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.824432  2873 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:36.815397  2882 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.815579  2857 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.825639  2920 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.837461  1685 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:36.817313  1612 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.840888  2880 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.832940  2868 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.843165  2866 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.831389  2891 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.847199  1612 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:36.864537  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:36.840660  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 65400.9us
I20260709 12:58:36.835517  2922 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.840655  2920 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.847839  2927 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.865619  2878 raft_consensus.cc:3055] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.856247  2932 raft_consensus.cc:3055] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.894102  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.894460  1715 raft_consensus.cc:1240] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:36.865868  1564 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:36.897109  1718 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:36.899228  2935 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:36.900067  2872 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.901361  2878 raft_consensus.cc:740] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:36.909257  2878 consensus_queue.cc:260] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.892530  2880 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.910558  2878 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.911114  2437 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:36.902865  2938 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:36.912288  2872 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:36.913120  2940 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:36.919790  2935 raft_consensus.cc:3055] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:36.920248  2935 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:36.920576  2903 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.920697  1713 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:36.921196  2935 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.923234  2935 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:36.924587  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.926497  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:36.926687  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:36.924065  2888 consensus_queue.cc:1059] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:58:36.903818  2932 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:36.941186  2915 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:36.941845  2915 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:36.942382  2915 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:36.951020  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 49190.7us
I20260709 12:58:36.954310  2880 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:36.956666  2938 consensus_queue.cc:1059] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:36.957895  2938 raft_consensus.cc:3055] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:58:36.958202  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.958276  2938 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:36.932852  2904 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:58:36.968148  2932 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:36.970268  2932 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:36.974920  2406 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.977706  2910 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:36.989749  2915 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:36.991577  2406 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:36.992813  2910 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.002298  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:37.006623  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.011197  2897 raft_consensus.cc:3055] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.011970  2897 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 12:58:37.015717  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 87025.9us
I20260709 12:58:37.015264  2913 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:37.014848  2915 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:37.014897  2873 raft_consensus.cc:3055] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.023121  2873 raft_consensus.cc:740] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:37.019279  2913 raft_consensus.cc:697] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:37.031597  1718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:60082
I20260709 12:58:37.032332  1718 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:37.032711  1718 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:37.031939  2913 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:37.034361  1717 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.017436  2938 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.035621  1719 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.013307  2897 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:37.036666  2897 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.036954  1721 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.054374  1721 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.025285  2873 consensus_queue.cc:260] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.073096  2873 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.035655  2938 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.097761  2878 consensus_queue.cc:1059] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:37.098868  2934 consensus_queue.cc:1059] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:37.100576  2934 raft_consensus.cc:3055] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.100936  2934 raft_consensus.cc:740] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 12:58:37.097265  1611 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.107.254:33273, user_credentials={real_user=slave}} blocked reactor thread for 55900.6us
W20260709 12:58:37.103215  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 170917us
I20260709 12:58:37.105749  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:37.110782  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:37.106928  1718 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.118633  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:37.121213  1718 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:37.123731  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.127303  1536 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.114132  2878 raft_consensus.cc:3055] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:37.144718  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:37.132565  1536 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.136173  2906 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.122992  2941 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:37.128348  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:37.120360  2882 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:37.146822  1536 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:37.123289  2904 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:37.101886  2934 consensus_queue.cc:260] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.167922  2934 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.127357  2874 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.166129  1612 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:37.116941  2935 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:58:37.153913  2873 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.144011  2878 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:37.147655  2938 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.127043  2866 consensus_queue.cc:1059] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:58:37.179394  2866 raft_consensus.cc:3055] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.179915  2866 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:37.183632  2878 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.185209  2878 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:37.186599  2866 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.187400  2936 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:37.149881  2882 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:37.162096  2941 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:37.188392  2946 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.171296  2903 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.181190  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:37.194299  2910 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.265812  1564 raft_consensus.cc:3055] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:37.266197  2882 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:37.266515  1564 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:37.267586  1564 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.268790  1564 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:37.272663  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 91579.4us
I20260709 12:58:37.275775  1612 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:37.286154  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:37.291219  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:37.305054  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:37.308811  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.309108  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.309778  1640 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:37.287272  2436 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:37.309864  1645 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:37.313503  2944 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.313606  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:37.318235  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.319180  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.287387  2880 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:37.302380  2896 consensus_queue.cc:1059] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:58:37.304157  2915 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:37.328233  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.328253  2896 raft_consensus.cc:3055] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:37.329373  2896 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:37.329766  2866 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.301479  2903 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.289477  2936 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:37.301726  2941 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:37.341602  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.345001  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.339614  2882 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:37.352352  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.352991  1647 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.353384  1640 raft_consensus.cc:2410] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:37.352401  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.354136  2882 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:37.356009  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.356676  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.357304  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.358166  1647 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:37.340517  2936 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.363445  1685 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.365001  2940 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.377365  1685 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.378373  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.378782  2920 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.379297  1646 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:37.380539  2405 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.330394  2896 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:37.381912  2910 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.382244  2896 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:37.386904  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.388551  2910 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:37.391956  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.396706  1685 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.400873  2405 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.405045  2910 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:37.405364  2920 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.405048  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.410844  1685 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.413261  1685 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:58:37.423585  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 276810us
I20260709 12:58:37.419035  2940 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:37.417881  2920 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:58:37.434206  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.421191  2910 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.446388  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.446328  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.448726  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:37.448594  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.452692  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:37.452886  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.478144  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:37.483424  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.484153  1647 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 1.
I20260709 12:58:37.484195  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.485028  1641 raft_consensus.cc:2393] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:37.474411  2878 consensus_queue.cc:1059] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:58:37.488329  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:37.505683  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.490578  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:37.490864  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:37.509063  1643 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:37.498451  1714 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.512356  1719 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.514221  1640 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:37.504271  1645 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:37.519773  2932 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:37.479231  2940 raft_consensus.cc:697] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:37.511571  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:37.527374   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:37.520342  2951 consensus_queue.cc:1059] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:58:37.529991  2938 raft_consensus.cc:3055] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.530184  2951 raft_consensus.cc:3055] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.530481  2938 raft_consensus.cc:740] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:37.531535  2938 consensus_queue.cc:260] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.532784  2938 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.530598  2951 raft_consensus.cc:740] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:37.478379  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.517204  2915 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:58:37.523203  2932 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:37.541612  1645 raft_consensus.cc:1240] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.542260  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:37.543942  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.545121  2932 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.553426  2940 consensus_queue.cc:237] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.554919  2936 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.557739  2936 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:37.533761  2951 consensus_queue.cc:260] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.562806  2951 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:37.566385  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.567654  1685 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:37.566160  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 112384us
I20260709 12:58:37.568616  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.569598  2920 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.570119  2405 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.571226  2913 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.571895  2913 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:37.549950  2910 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.542467  2880 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:58:37.541100  2878 consensus_queue.cc:1059] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:58:37.578817  2941 raft_consensus.cc:3055] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.579243  2941 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:37.580298  2941 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.582093  2941 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.583423  1564 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
W20260709 12:58:37.584120  2906 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:58:37.590307  2936 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:37.590941  2936 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:37.591504  2936 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:37.594753  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 52592.9us
I20260709 12:58:37.603477  1536 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.602818  2906 consensus_queue.cc:1059] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:58:37.609031  2906 raft_consensus.cc:3055] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.609398  2906 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:37.610339  2906 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.608111  2878 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.611747  2906 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:37.615799  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 45787.4us
I20260709 12:58:37.616806  2932 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.616881  2405 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.601987  2951 consensus_queue.cc:1059] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:58:37.624286  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:37.627101  2940 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:37.627698  2940 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:37.628204  1564 raft_consensus.cc:1240] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.628680  2940 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:37.629848  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 57767.7us
I20260709 12:58:37.621778  2932 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:37.631292  2959 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.633867  2941 consensus_queue.cc:1059] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:37.634850  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.635109  2941 raft_consensus.cc:3055] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.635510  2941 raft_consensus.cc:740] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:37.635895  2910 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:37.636404  2878 consensus_queue.cc:1059] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:37.637709  2866 raft_consensus.cc:3055] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.638137  2866 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:37.639118  2866 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.639314  1466 catalog_manager.cc:5697] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 2, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:37.640594  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.637559  2405 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.648790  2959 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:37.650966  2405 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.631508  2951 raft_consensus.cc:3055] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.651507  2866 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.643476  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:37.659061  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:37.657536  1685 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.666983  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.667100  2959 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:37.669010  1536 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.670287  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.633176  2938 consensus_queue.cc:1059] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:58:37.656764  2951 raft_consensus.cc:740] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:37.672652  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.672344  2934 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.673835  2927 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.671236  2897 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.671525  2874 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.675745  2857 consensus_queue.cc:1059] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:37.678079  2915 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.666582  2878 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:37.649614  2941 consensus_queue.cc:260] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.667886  2906 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:37.687463  2915 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:37.688824  2857 raft_consensus.cc:3055] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.689267  1564 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.691066  2874 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.692281  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.698419  2878 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:37.642865  2936 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.708305  2915 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:37.709486  2938 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.710880  2936 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:37.723366  2941 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.709146  2878 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.716372  2932 raft_consensus.cc:3055] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.727192  2932 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:37.728474  2932 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.706179  2857 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:37.713980  1685 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:37.712663  2405 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.731719  2960 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:37.732393  2960 raft_consensus.cc:697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:37.733026  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:37.709398  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.735128  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.735301  2959 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.736027  2959 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:37.736354  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:37.737257  2938 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.715809   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:37.737864  2897 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.715732  2918 consensus_queue.cc:1059] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:58:37.738255  2932 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.738561  2897 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.739204  2918 raft_consensus.cc:3055] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.739552  2918 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:37.739737  2897 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.740507  2918 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.736353  2959 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:37.742446  2959 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.731654  1685 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:37.743297  2436 raft_consensus.cc:1240] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.737486  1536 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:37.744656  2956 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:37.744942  2935 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:37.746201  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:37.748246  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.733363  2960 consensus_queue.cc:237] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.751322  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:37.752728  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:37.752871  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:37.763031  1570 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:37.745352  2935 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:37.764621  2935 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.731793  2857 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.765188  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:37.765574  2857 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.767668  2915 consensus_queue.cc:1059] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:37.701859  2906 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:37.741997  2918 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.775050  1715 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:37.780715  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:37.781085  1565 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:37.782255  2913 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:37.782462  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:37.785005  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:58:37.786664  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.787050  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:37.788013  1570 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:37.788715  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:37.802109  1572 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.803385  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:37.804545  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:37.806325  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:37.803556  1564 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.811965  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:37.813995  1569 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:37.813156  1718 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.813719  1721 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.817149  1645 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:37.768707  2874 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.805740  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:37.815063  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:58:37.824005  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.821285  1569 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.823511  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:37.825456  1645 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:37.826678  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:37.827520  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:37.828751  1612 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:37.829879  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:37.830262  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:37.774199  2906 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.832554  1612 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:37.834184  1717 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.836618  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:37.838814  1570 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.839316  1565 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
W20260709 12:58:37.840303  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.841337  1720 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.844379  1712 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:37.846132  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:37.848850  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:37.849016  1565 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.844695  1642 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:37.844476  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:37.850215  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:58:37.841176  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 95924.8us
I20260709 12:58:37.858600  1570 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.841593  2956 raft_consensus.cc:697] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:37.865068  1570 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:37.839763  2880 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:37.839210  2903 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:37.871913  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.842512  1563 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:37.880777  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.873751  1565 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:37.813040  2959 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:37.848136  2896 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:37.859367  2944 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.845531  2888 raft_consensus.cc:3055] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:37.849928  2915 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:58:37.903678  2927 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.786721  2951 consensus_queue.cc:260] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:37.907881  2956 consensus_queue.cc:237] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:37.911446  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:37.911803  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:37.912914  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:37.914331  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 67348.3us
W20260709 12:58:37.915619  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.865398  2943 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:37.924979  2896 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:37.928337  2951 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:37.945116  1718 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:37.946768  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.929147  1643 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:37.911918  2880 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:37.914485  2888 raft_consensus.cc:740] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:37.975042  1572 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:38.011080  2437 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:38.037643  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.964924  2938 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.023017  2880 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.166525  2888 consensus_queue.cc:260] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:38.169545  2897 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.173368  1469 catalog_manager.cc:5697] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 1 to 2, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:38.190626  2897 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.193581  2897 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:38.036387  2896 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.202809  2938 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.203292  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:38.203950  1719 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:38.179037  1567 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:37.969672  2927 consensus_queue.cc:1059] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.192s
I20260709 12:58:38.170466  2878 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.170302  2941 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.201172  1566 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:38.189275  1568 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
W20260709 12:58:38.209472  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.218412  2972 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.275498  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:38.225054  2910 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.298828  1571 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:38.209682  2935 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.310657  2935 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:38.311738  2935 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.314952  2935 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:38.306457  2934 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:38.280650  2972 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:38.258888  2936 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.278659  2938 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:38.275760  2888 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:38.263911  2932 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.304796  2910 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:38.329283  2932 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.225463  2941 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:37.768976  2957 consensus_queue.cc:1175] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a4be9cc90aca4dd4ad7db103062a7208" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:38.344204  2972 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:38.353026  2874 consensus_meta.cc:287] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.005s
I20260709 12:58:38.317768  2934 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:38.375793  2934 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:38.353785  2874 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:38.399442  1572 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:58:38.426802  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.384938  2904 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.326660  2936 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.431063  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:38.394022  2959 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:38.405301  2918 consensus_meta.cc:287] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.617s	user 0.014s	sys 0.001s
I20260709 12:58:38.438392  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:38.445057  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.415859  2874 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.451687  2874 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:38.453250  1565 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:38.437968  2975 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.455281  2936 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:38.455719  2975 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:38.459456  2951 consensus_meta.cc:287] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.000s
I20260709 12:58:38.461130  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:38.463346  2941 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:38.461803  1563 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:38.463784  2878 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:38.439919  2904 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.465276  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:38.463832  1566 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:38.467797  2959 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:38.470028  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:38.470860  2437 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:38.471712  1713 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:38.472533  2920 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:38.473024  2920 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.473410  2920 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:38.475529  2973 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:38.476715  2904 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:38.479347  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:38.454041  2874 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:38.480520  2972 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:38.485491  2975 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:38.447469  2906 consensus_meta.cc:287] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.002s
I20260709 12:58:38.492336  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:38.493275  2436 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:38.481115  2972 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.494128  2906 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.539047  2906 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:38.501335  2910 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:38.493878  2967 raft_consensus.cc:3055] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:38.515930  2932 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:38.523891  2920 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:38.541445  2967 raft_consensus.cc:740] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:38.543900  2967 consensus_queue.cc:260] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.526288  2972 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:38.531651  2935 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:38.552256  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:38.553506  1572 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:38.535849  2934 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:38.549408  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:38.544772  2920 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:38.545809  2967 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:38.559429  1721 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:38.575419  2437 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:38.562012  2857 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:58:38.622824  1572 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
W20260709 12:58:38.638006  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 362568us
I20260709 12:58:38.649128  2978 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.651019  2957 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.653388  2979 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:38.694598  2984 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.690598  2981 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:38.708216  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 483426us
I20260709 12:58:38.634618  2857 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.854485  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:38.734230  2940 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.734324  2918 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:38.752100  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.717104  2920 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.728514  2935 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:38.766027  1612 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.031s	sys 0.025s
W20260709 12:58:38.859511  1612 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.031s	sys 0.025s
W20260709 12:58:38.860077  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 687488us
I20260709 12:58:38.773532  1469 catalog_manager.cc:5697] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 2 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:38.762739  2934 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:38.759668  2972 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:38.795747  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:38.821514  1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.047s	sys 0.054s
W20260709 12:58:38.827847  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:38.870414  1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.047s	sys 0.054s
I20260709 12:58:38.828653  2982 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.833163  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:38.857530  1572 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:38.863746  1469 catalog_manager.cc:5697] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 2, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:38.870853  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:38.870903  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 651362us
I20260709 12:58:38.879245  1469 catalog_manager.cc:5697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 2, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:38.881716  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:38.884262  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:38.875519  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:38.886893  1640 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:38.888651  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.890668  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:38.893180  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:38.879714  1611 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:38.896502  1640 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:38.910624  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:38.903656  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:38.900630  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:38.897454  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:38.870843  2960 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:38.898437  1536 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:38.902801  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:38.875409  2975 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.916296  2448 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:38.874801  2906 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.918282  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:38.874939  2888 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:38.887337  2973 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.884022  2874 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:38.921926  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:38.869688  2918 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:38.927971  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:38.871080  2935 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.874444  2920 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.924108  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:38.933193  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:38.933640  1571 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:38.930495  2934 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:38.964658  2972 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:38.934257  1569 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:38.859294  2979 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.894471  2981 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:38.967334  2447 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:58:38.859649  2957 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.935113  1715 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:38.922916  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:38.941206  2888 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.852408  2978 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.973133  2981 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:38.947880  2973 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.975157  1568 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:38.949434  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:38.976222  1713 raft_consensus.cc:2393] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:38.950230  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:38.976768  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:38.950687  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:38.973800  2957 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:38.978482  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:38.952003  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:38.952292  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:38.984918  1717 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:58:38.937542  2938 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:38.870169  2940 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:38.983704  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 66761.3us
I20260709 12:58:38.929498  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:38.894400  2878 consensus_queue.cc:1059] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:58:38.955487  1570 raft_consensus.cc:2376] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2. Re-sending same reply.
I20260709 12:58:38.885454  2984 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.870702  2857 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:38.932962  2903 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:38.936126  2960 raft_consensus.cc:697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:38.941493  2951 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.967828  2979 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:38.876119  2983 consensus_queue.cc:1059] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:58:38.986842  1565 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:38.990399  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:38.902949  2982 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.001818  2987 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:39.003371  2437 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:38.974715  2934 raft_consensus.cc:697] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:38.934513  2975 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.048136  2978 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:39.015913  1716 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:38.940634  2906 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:38.993713  1537 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:39.025890  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:39.050454  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 56830.2us
I20260709 12:58:39.051156  1713 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:38.986546  2880 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:39.032392  1572 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:58:38.991231  2873 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:39.007148  2915 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:39.036229  1645 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:39.015379  2896 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:39.016835  2903 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.006582  2440 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:39.022423  2938 raft_consensus.cc:697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:39.044432  2980 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.045070  2987 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.045713  2882 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.046267  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:39.046615  2943 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:39.047003  2934 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.047508  2960 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:38.986557  2957 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.048686  3003 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.136s
I20260709 12:58:39.053632  2975 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:39.056313  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:58:39.208248  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 152047us
I20260709 12:58:39.066304  2873 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.073098  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:39.074126  2984 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.077539  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:39.078531  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:39.079424  1612 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:39.230897  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 151607us
I20260709 12:58:39.175118  2896 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.085695  2967 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.058449  2874 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:39.031944  2951 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.093716  2866 raft_consensus.cc:3055] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:39.064112  2880 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.133597  2906 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:39.134687  2920 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:39.234215  2981 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:39.070744  2915 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.135844  2932 raft_consensus.cc:3055] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:39.138324  2982 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.142858  2857 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:39.198827  2882 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.160095  1467 catalog_manager.cc:5697] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 2, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.175469  2903 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:39.227670  1643 raft_consensus.cc:2393] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:39.236598  2866 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:39.230495  1642 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:39.231895  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:39.232576  2980 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:39.289970  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 58181.6us
I20260709 12:58:39.056578  2978 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.186111  2944 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:39.238147  3011 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:39.135408  2935 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.226136  2888 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.254498  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:39.204373  2943 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.235018  2874 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.154812  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.227811  1537 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:39.226227  2957 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.283058  2910 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:39.283509  2932 raft_consensus.cc:740] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:39.236881  2967 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.306730  3008 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:58:39.285965  2981 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.314458  1712 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:58:39.302115  2918 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:39.324539  1646 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
W20260709 12:58:39.314649  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 104208us
I20260709 12:58:39.321300  1642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:47230
I20260709 12:58:39.338874  1642 raft_consensus.cc:606] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:39.294404  2904 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:39.315932  2874 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:39.318537  2984 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:39.304782  2978 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.321985  3011 raft_consensus.cc:697] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:39.327075  2981 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:39.322422  2910 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.319561  2888 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:58:39.303040  2938 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.344189  2984 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.351553  2932 consensus_queue.cc:260] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.349591  2941 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:39.342214  2866 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.340409  2973 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:39.349435  2904 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.340593  2987 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:39.349264  2983 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:39.350112  2940 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:39.351675  2936 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:39.367215  2984 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:39.380451  2957 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:39.391697  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.405239  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.406270  1712 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:39.308535  2944 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.408788  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.409195  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.417043  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.417845  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.418356  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.380381  2910 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:39.408595  2880 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:39.420282  2882 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.367215  2980 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:39.381300  2873 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.427603  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:39.429428  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.429692  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.429495  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:39.430397  1720 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:39.430805  2444 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:39.408123  2896 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.436695  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.416085  2951 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:39.433760  2915 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:39.434481  2978 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:39.436794  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.437538  1716 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:39.375559  2941 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.421753  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:39.379185  2904 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.387938  2936 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.432302  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.445147  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:39.452420  2878 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:39.385107  2983 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.381616  3011 consensus_queue.cc:237] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.460219  2878 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.462743  2878 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.463315  2878 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:39.442229  2951 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:39.453653  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:39.456688  2975 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:39.484895  2975 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.485483  2975 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:39.491526  1611 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:39.500787  2904 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.497427  2888 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:58:39.497462  2910 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.504055  2910 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.506441  2906 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:39.507004  2903 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:39.507359  2906 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.508378  1611 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:39.509331  2880 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:39.509673  2880 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.509904  2880 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:39.475494  2878 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.510166  2903 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.511255  2903 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:39.511658  2903 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.476291  2991 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:39.515946  2878 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.515816  2903 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:39.479580  2943 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:39.506430  2910 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:39.523604  2906 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:39.482795  2951 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.525022  2866 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.484063  2967 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:39.544740  2944 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:39.542098  2941 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.494423  2440 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:39.542737  2932 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:39.542877  2983 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.544093  2874 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.561133  2936 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.565465  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.566570  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.554873  2880 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.595291  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.568879  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.600258  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:39.600981  1713 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:39.600589  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.534144  2991 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.604054  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:39.607232  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:39.566720  2951 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:39.609710  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:39.611570  1565 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:39.616425  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:39.617254  1572 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:39.597069  2882 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.621439  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:39.621548  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:39.622416  1572 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 5: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:39.622417  1568 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
W20260709 12:58:39.575444  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 283108us
I20260709 12:58:39.625991  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:39.626854  1572 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:39.628211  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:39.628901  1572 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:39.639590  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:39.640596  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:39.642107  1572 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:39.622711  2936 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.644452  3016 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:39.662164  1713 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:39.671696  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.682385  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.686882  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.695163  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.703193  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:39.705709  1565 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:39.705168  1572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:39.706830  1572 raft_consensus.cc:606] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:39.707340  1572 raft_consensus.cc:614] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:39.709398  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:39.709517  2960 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:39.710326  2437 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:39.645133  2896 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:58:39.710825  2960 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.711493  2991 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:39.711880  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:39.712570  1567 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:39.662361  2967 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:39.705062  1611 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:39.719004  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:39.720502  1570 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:39.695413  2987 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:39.727659  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:39.734908  1570 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:39.729117  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:39.736618  1565 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:39.730692  1686 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:39.662660  2936 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.625339  2882 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.747539  1686 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:39.695319  2904 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:58:39.674428  3016 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.751717  2927 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:39.752466  3020 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.766957  1686 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:39.772308  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:39.775056  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:39.776468  2444 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:39.779873  1568 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:39.744758  3011 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:39.787571  1686 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:39.795302  3014 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:39.796092  3014 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.796674  3014 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:39.804025  1565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:39.725354  2967 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.804775  1565 raft_consensus.cc:606] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:39.805150  1565 raft_consensus.cc:614] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:39.806769  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:39.770627  2972 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:58:39.812786  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 116516us
I20260709 12:58:39.807766  1686 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:39.817415  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:39.777500  2874 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:39.788064  2973 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:39.826301  2979 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:39.814287  2920 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:58:39.826972  2979 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.827415  2979 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:39.803444  2957 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:39.807158  2978 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:39.832897  1686 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:39.743973  2987 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.834458  1713 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:39.768584  2927 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:39.817444  2972 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.843971  1686 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:39.819322  2880 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:39.819203  2857 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:39.899358  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:39.829465  2973 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.901927  1572 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:39.903649  1565 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:39.808992  2405 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:39.838002  2960 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:39.837604  2978 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:39.942718  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.943377  2444 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:58:39.944065  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 128359us
I20260709 12:58:39.945547  1612 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:39.946700  1612 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:39.844034  3011 raft_consensus.cc:697] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:39.847215  2972 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:39.900767  2857 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.793470  3020 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:39.915618  2920 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:39.921552  2973 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:39.900849  2991 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.938937  3003 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.948292  2978 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:39.951956  3015 log.cc:927] Time spent T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.115s	user 0.001s	sys 0.001s
I20260709 12:58:39.957072  2857 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:39.959538  2984 consensus_meta.cc:287] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.002s
I20260709 12:58:39.953209  2880 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:58:39.937144  2980 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:39.952674  2910 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:39.991483  3033 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:39.963131  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 177566us
W20260709 12:58:40.002044  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 55415.1us
I20260709 12:58:39.961675  2920 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.021030  1612 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:39.944527  2975 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:40.035071  2927 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.035614  2975 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:40.019101  3019 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:40.031373  2920 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.019362  2980 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.024798  3020 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:40.041200  2931 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 12:58:40.050694  2981 consensus_meta.cc:287] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.693s	user 0.011s	sys 0.005s
I20260709 12:58:39.997300  2991 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:40.022070  2984 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:40.069731  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 48811.8us
I20260709 12:58:40.066989  3016 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:40.040858  2936 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:40.039199  2987 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:40.077379  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:40.062208  2980 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.041128  3034 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:58:40.072938  3024 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:58:40.068507  2904 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:40.082918  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:40.001546  3003 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.033227  3033 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.047938  3011 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:40.088321  1569 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:40.073407  2915 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.127918  2984 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:40.128443  2903 consensus_meta.cc:287] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.004s
I20260709 12:58:40.077421  3019 raft_consensus.cc:697] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:40.080430  2981 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:40.123814  2987 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:58:40.084424  3016 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:58:40.149372  2932 consensus_meta.cc:287] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.001s
I20260709 12:58:40.128821  2920 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:40.166235  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 46698.6us
I20260709 12:58:40.102406  3020 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:58:40.148409  2915 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.148937  2903 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.153324  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 51) took 1251 ms. Trace:
I20260709 12:58:40.173472  2442 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 5: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
W20260709 12:58:40.173820  3032 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 12:58:40.178596  3028 log.cc:927] Time spent T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 12:58:40.176230  3031 log.cc:927] Time spent T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:58:40.172906  3034 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:40.192294  3041 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:40.193174  3041 raft_consensus.cc:697] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:40.193444  2981 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:40.193708  2920 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.194253  3041 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.187595  3016 raft_consensus.cc:697] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:40.205688  3033 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:40.206197  2440 consensus_meta.cc:287] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.005s
I20260709 12:58:40.189265  2904 raft_consensus.cc:697] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:40.182875  3014 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.226734  2904 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:40.228247  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 540458us
I20260709 12:58:40.219836  2440 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:40.235172  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:40.239010  2934 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:40.203188  2915 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:40.229112  2957 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:40.229343  1537 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:40.228897  2951 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:40.237809  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:40.248174  1721 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:40.252355  1565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:40.253057  1565 raft_consensus.cc:606] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:40.253408  1565 raft_consensus.cc:614] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:40.254733  1640 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:40.257485  1643 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.230624  2991 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.245211  2920 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.263844  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:40.265568  1716 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:40.268460  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.268992  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.269512  1644 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:40.270474  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.271052  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.271742  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.272007  1644 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:40.273391  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:40.273715  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.275522  1647 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.246850  2957 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.280530  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.280439  3016 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.281555  1647 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:40.231477  2979 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.283450  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.290174  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:40.294332  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:40.293062  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:40.296016  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.296663  1568 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:40.298413  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:40.299590  1568 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.287438  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.251406  2978 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.245316  2972 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.307407  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:40.308236  2448 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.306463  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:40.343497  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 114218us
I20260709 12:58:40.344429  1644 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.345168  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:40.345923  1571 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.317198  1568 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:40.290237  3003 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.257160  2951 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:40.359067  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 121372us
I20260709 12:58:40.349261  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:40.220069  3019 consensus_queue.cc:237] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.358804  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:40.347935  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.298784  2935 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.358692  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.370811  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:40.371184  1644 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:40.344537  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.360024  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:40.259763  3034 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.363252  1641 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:40.350761  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.366781  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:40.379007  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 76007.2us
I20260709 12:58:40.378954  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:40.351661  2866 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:40.298822  2986 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:58:40.380765  1642 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:40.372563  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.372632  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.391677  3027 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.392267  3027 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.377183  2448 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:40.380601  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:40.394394  1568 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:40.395635  3027 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:40.395848  2932 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:40.372170  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:40.396520  2444 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:40.283080  2920 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.397539  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:40.398504  2920 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.393496  1571 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:40.399410  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:40.400204  2932 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:40.400583  2932 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:40.400933  2932 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.405423  2984 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:40.406087  2984 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.408847  2984 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:40.302309  2980 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.419968  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:40.369856  2874 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:40.368683  2972 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.427809  2943 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:40.428644  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.430416  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.426836  3025 raft_consensus.cc:2764] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:58:40.378703  3029 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.434454  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.388727  2866 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:40.386169  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:40.431902  2874 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.369568  3003 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:58:40.447408  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:40.435156  1685 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:40.421739  2918 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:40.381857  2935 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.430341  2991 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:40.443143  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.444456  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.381256  2903 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:40.432981  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 140052us
I20260709 12:58:40.453260  1647 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:40.444942  2866 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.429543  2920 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:58:40.449136  1570 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 5: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:40.442266  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:58:40.439239  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 72568.9us
I20260709 12:58:40.447171  2874 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.438073  2943 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.460670  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.468930  1570 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 1.
I20260709 12:58:40.462972  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.456045  2918 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:58:40.466876  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 55154.5us
I20260709 12:58:40.473026  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.474318  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.475056  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.455031  3014 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.466290  2437 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 12:58:40.480417  3048 log.cc:927] Time spent T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:58:40.480605  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:40.480854  3046 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:58:40.481309  1640 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:40.458561  2972 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:40.481920  2972 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.482298  3052 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:40.461243  2981 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:40.488384  3037 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:58:40.441937  3029 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.492475  3029 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:40.493844  2981 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:40.466037  2986 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:58:40.174780  1563 rpcz_store.cc:276] 0709 12:58:38.896042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.913280 (+ 17238us) service_pool.cc:224] Handling call
0709 12:58:38.956920 (+ 43640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:39.091827 (+134907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:39.091872 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:39.092843 (+   971us) log.cc:844] Serialized 26 byte log entry
0709 12:58:39.343742 (+250899us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:39.354163 (+ 10421us) log.cc:844] Serialized 14 byte log entry
0709 12:58:39.596876 (+242713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.938415 (+341539us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b540031bad4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:39.943882 (+  5467us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:40.083983 (+140101us) raft_consensus.cc:1685] finished
0709 12:58:40.122923 (+ 38940us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.147440 (+ 24517us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8308,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":88643,"raft.run_cpu_time_us":457,"raft.run_wall_time_us":3217,"spinlock_wait_cycles":282344832,"thread_start_us":466240,"threads_started":2,"wal-append.queue_time_us":426094}
I20260709 12:58:40.498566  2981 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.502792  2951 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:40.503142  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.503392  2979 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.502254  3029 consensus_queue.cc:1059] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:58:40.503907  1565 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:40.503990  2979 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:40.504791  3029 raft_consensus.cc:3055] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:40.504544  2979 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.504945  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.505194  3029 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:40.457427  2973 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.506551  3029 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:40.508765  3018 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:40.509260  3029 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.497103  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:40.500154  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.512097  1536 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:40.517203  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:40.477279  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.530627  1564 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:40.531617  2980 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.532219  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:40.535177  2967 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.515676  2938 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:40.522840  3003 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:40.523432  2936 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:40.524152  2972 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:40.521615  3047 log.cc:927] Time spent T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:58:40.538767  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.548113  1641 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
I20260709 12:58:40.513175  2951 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:40.509393  3018 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:40.550355  2857 consensus_meta.cc:287] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.004s
I20260709 12:58:40.546636  1716 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:58:40.554411  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:40.557719  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.561879  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.565974  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:40.566815  1572 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.571548  1536 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:40.513887  3052 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:40.542629  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.579948  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:40.587484  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:40.589583  2405 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:58:40.591396  3021 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.724s	user 0.003s	sys 0.002s
I20260709 12:58:40.591544  3027 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:40.584815  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:40.592720  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.593132  2443 raft_consensus.cc:2393] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:40.578495  2938 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:40.594079  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.595187  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.595395  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.595969  1566 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:40.597576  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.601714  2406 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:40.614913  3022 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:40.615929  3022 raft_consensus.cc:697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:40.597775  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.575320  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:40.590026  2936 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:40.586207  3052 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.548026  3003 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.591413  2981 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:40.574618  2857 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.610716  1572 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:40.605927  2979 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.611193  2991 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:40.629544  1567 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.622993  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:40.610643  2938 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:40.651343  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:40.652873  2943 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:40.653837  1564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:40.662771  1564 raft_consensus.cc:606] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:40.663967  2932 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.670375  2882 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:40.671718  2978 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.618631  2918 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:40.654327  2991 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.617355  3022 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:40.672686  2442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42646 (request call id 279) took 1253 ms. Trace:
I20260709 12:58:40.686371  2874 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.687378  2866 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:40.706693  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1051) took 1103 ms. Trace:
I20260709 12:58:40.695600  2936 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.700805  2442 rpcz_store.cc:276] 0709 12:58:39.419762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.421450 (+  1688us) service_pool.cc:224] Handling call
0709 12:58:40.672391 (+1250941us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b54005d02d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:40.672588 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1635884800}
I20260709 12:58:40.699462  2991 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.707227  1569 rpcz_store.cc:276] 0709 12:58:39.603514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.603674 (+   160us) service_pool.cc:224] Handling call
0709 12:58:40.706362 (+1102688us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b5400014d54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:40.706587 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110989056}
I20260709 12:58:40.712333  1565 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:40.714607  1571 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 2: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:40.715924  1569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:40.716758  1569 raft_consensus.cc:606] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:40.722383   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:58:40.701375  3018 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.722119  2940 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.761444  2940 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.751531  2866 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:40.752027  3003 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.714852  2936 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:40.715899  2938 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.774884  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:40.754340  1467 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58252 (request call id 214) took 1759 ms. Trace:
I20260709 12:58:40.776832  2874 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:40.781733  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:40.750738  2932 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:40.784292  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:40.788180  2940 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:40.783157  3041 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:40.795017  2944 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:40.785626  2982 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:40.801095  1612 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:58:40.804593  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 199314us
I20260709 12:58:40.809808  2406 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:40.805678  2981 raft_consensus.cc:697] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:40.815490  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:40.804934  2944 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.805207  1567 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:40.820068  2982 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:40.837571  2944 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.830746  3019 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:40.779922  1467 rpcz_store.cc:276] 0709 12:58:38.994928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.024276 (+ 29348us) service_pool.cc:224] Handling call
0709 12:58:40.754210 (+1729934us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:39.342911 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:39.423087 (+ 80176us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:39.424907 (+  1820us) write_op.cc:435] Acquired schema lock
0709 12:58:39.426411 (+  1504us) tablet.cc:662] Decoding operations
0709 12:58:39.457840 (+ 31429us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:39.459492 (+  1652us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:39.477740 (+ 18248us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:58:39.491492 (+ 13752us) tablet.cc:701] Row locks acquired
0709 12:58:39.496175 (+  4683us) write_op.cc:260] PREPARE: finished
0709 12:58:39.525835 (+ 29660us) write_op.cc:270] Start()
0709 12:58:39.546451 (+ 20616us) write_op.cc:276] Timestamp: P: 1783601919525749 usec, L: 0
0709 12:58:39.547691 (+  1240us) op_driver.cc:348] REPLICATION: starting
0709 12:58:39.812744 (+265053us) log.cc:844] Serialized 540 byte log entry
0709 12:58:40.125690 (+312946us) op_driver.cc:464] REPLICATION: finished
0709 12:58:40.153136 (+ 27446us) write_op.cc:301] APPLY: starting
0709 12:58:40.155816 (+  2680us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:40.164572 (+  8756us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:40.167970 (+  3398us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:40.174917 (+  6947us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:40.191192 (+ 16275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:58:40.196758 (+  5566us) write_op.cc:312] APPLY: finished
0709 12:58:40.199549 (+  2791us) log.cc:844] Serialized 22 byte log entry
0709 12:58:40.199735 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:40.199822 (+    87us) write_op.cc:454] Released schema lock
0709 12:58:40.199861 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:40.204547 (+  4686us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54004254d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd293e28 00007f18d0cce581 00007f18d0ccdd58 00007f18d0cd29f1 00007f18d0cd29a9 00007f18d0cd2939 00007f18d0cd2901 00007f18d0cd1b2d 000000000038f354 000000000038f199
0709 12:58:40.243188 (+ 38641us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:40.245649 (+  2461us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":42554,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":3458,"apply.run_cpu_time_us":2398,"apply.run_wall_time_us":49054,"num_ops":1,"prepare.queue_time_us":1710,"prepare.run_cpu_time_us":11524,"prepare.run_wall_time_us":868481,"replication_time_us":577818,"spinlock_wait_cycles":427200896}]]}
I20260709 12:58:40.821426  2981 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:40.846532  1566 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
W20260709 12:58:40.848034  2957 consensus_meta.cc:287] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.554s	user 0.015s	sys 0.000s
I20260709 12:58:40.865289  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:40.853967  3034 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:40.878113  3061 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:40.861662  3041 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 12:58:40.886533  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 416548us
I20260709 12:58:40.889676  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:58:40.889379  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 79697.8us
I20260709 12:58:40.862260  2936 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:40.891724  1612 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:40.893658  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:40.895506  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:40.896528  1686 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:40.897434  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:40.878847  3061 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.900882  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.901660  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.902139  1643 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:40.902616  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.903136  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:40.903668  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.902704  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.903918  1639 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:40.873210  2991 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:40.904404  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.883623  2935 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:40.901046  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:40.908015  2405 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:40.908358  1686 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:40.911002  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:40.890658  1567 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:40.920365  1686 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:40.894986  2982 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:40.923024  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:40.923347  1641 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.874332  2957 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.921099  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:40.898504  3045 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:40.983493  3059 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:41.020426  3059 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:41.021054  3059 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.919991  3003 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:41.022715  3003 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.023154  3003 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.982889  2986 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:40.983278  3036 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:40.899485  3057 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:40.925984  1612 consensus_peers.cc:597] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e93b49f668f7487dad07043590a5616f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:40.924142  3018 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:40.878446  3034 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.983239  3062 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.909104  2918 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:41.040325  1647 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:41.037835  3057 raft_consensus.cc:697] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:40.933743  2982 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:40.907693  3061 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:40.910758  2882 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:40.921432  2978 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 12:58:41.045156  2406 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.527s (SENT) [suppressed 40 similar messages]
I20260709 12:58:41.045738  2978 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:41.032686  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 128073us
I20260709 12:58:41.050757  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:41.054785  2882 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:40.889755  3041 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:40.918349  2927 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 12:58:41.060038  3041 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:41.049634  2978 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:41.075876  3057 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:41.076977  2957 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:41.077459  3034 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:41.035813  2991 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:41.082470  2991 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:41.083105  2991 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:41.085577  2991 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:41.036459  2986 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:41.091069  2986 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:41.089459  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 158232us
I20260709 12:58:41.038957  3018 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:41.134306  1686 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:41.115993  3018 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.149065  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:41.150168  1570 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:41.109074  2991 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:41.105783  2975 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:41.178503  3071 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:41.179374  3071 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:41.213584  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:41.170845  2918 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:41.168592  2927 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:41.216516  1566 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:41.225957  2982 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:41.206405  3041 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.236377  3041 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:41.152079  2991 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:41.184868  2975 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:41.244009  2975 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:41.220820  2918 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:41.226583  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:41.255553  2918 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:41.230629  2927 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:41.250025  2973 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:41.275588  3052 consensus_meta.cc:287] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.626s	user 0.003s	sys 0.014s
I20260709 12:58:41.303941  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1083) took 1006 ms. Trace:
I20260709 12:58:41.304608  1568 rpcz_store.cc:276] 0709 12:58:40.297542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.371496 (+ 73954us) service_pool.cc:224] Handling call
0709 12:58:41.303660 (+932164us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b5400103454. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:41.303857 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7740800}
I20260709 12:58:41.307399  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:41.309115  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:41.281325  2940 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:41.286635  2957 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 12:58:41.305361  3065 log.cc:927] Time spent T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.315s	user 0.001s	sys 0.002s
I20260709 12:58:41.293414  2906 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:41.293403  2979 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 12:58:41.316135  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 270998us
I20260709 12:58:41.339108  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:41.340008  1646 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:41.320399  3068 log.cc:927] Time spent T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.281s	user 0.001s	sys 0.001s
I20260709 12:58:41.348261  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:41.333698  2979 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:41.354441  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:41.355863  1644 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:41.356871  2979 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:41.329831  2906 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:41.358738  3067 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:58:41.299165  3052 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:41.382167  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:41.385870  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:41.395825  1612 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:41.320531  2957 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:41.319705  2940 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:41.369087  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:41.403370  3070 log.cc:927] Time spent T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:58:41.416411  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:41.389180  3071 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:41.448037  1646 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:41.449548  3057 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.426842  3034 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:41.423810  2973 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:41.434136  3051 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:41.435379  3025 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:41.476293  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:41.476516  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:41.478489  1612 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:41.448473  2882 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:41.452695  3041 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:41.444993  1567 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:41.483103  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:41.493487  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:41.495309  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:41.500687  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:41.454353  2906 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:41.471150  3069 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.243s	user 0.002s	sys 0.000s
W20260709 12:58:41.513491  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 67147us
I20260709 12:58:41.508458  3057 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:41.515522  2951 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:41.515738  2973 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:41.532730  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:41.516140  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:41.516476  3051 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:41.438807  3003 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:41.518546  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:41.519877  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:41.521533  2927 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:41.546872  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:41.547880  1716 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:41.549211  1721 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:41.554838  1718 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:41.519793  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:41.524498  1713 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:41.525040  1720 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:41.523754  1712 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:41.517540  2982 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:41.533718  1717 raft_consensus.cc:2393] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:41.563962  1721 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:41.564205  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:41.565217  1713 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:41.529114  2906 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.562502  1715 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:41.537098  1612 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:41.521459  3025 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:41.571661  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:41.521288  3059 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:41.641623  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:41.642114  1686 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:41.642809  2448 raft_consensus.cc:2393] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:41.642709  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:41.644119  1719 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:41.646750  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:41.655172  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:41.580857  2882 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:41.536785  2951 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:41.562323  1564 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:41.656999  1646 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:41.582396  2906 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:41.679670  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:41.643883  3069 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:58:41.583122  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:41.683972  1643 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:41.643275  1686 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:58:41.690542  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 47344.7us
I20260709 12:58:41.695098  1536 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:41.680464  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:41.684659  2957 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:41.683992  2882 raft_consensus.cc:697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:41.687923  2972 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:58:42.030315  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 338050us
W20260709 12:58:41.918990  3084 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
W20260709 12:58:41.867146  3081 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.219s	user 0.001s	sys 0.001s
I20260709 12:58:42.119079  3051 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:41.919947  3090 log.cc:927] Time spent T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:58:41.926627  3085 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
W20260709 12:58:41.851181  3018 consensus_meta.cc:287] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.707s	user 0.005s	sys 0.009s
W20260709 12:58:41.845916  3086 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:58:42.274264  3018 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:42.275739  3092 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.407s	user 0.001s	sys 0.001s
I20260709 12:58:42.276894  3018 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:42.277859  3093 log.cc:927] Time spent T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 12:58:41.701921  2973 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:41.827993  2438 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:41.788355  2980 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:58:42.339063  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 314126us
I20260709 12:58:42.001670  3079 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:41.938014  3057 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:41.852129  3003 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:41.890722  3097 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.868602  3089 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:42.270712  3061 consensus_meta.cc:287] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 1.176s	user 0.007s	sys 0.008s
W20260709 12:58:42.356912  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 85576.3us
I20260709 12:58:42.389838  1714 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:42.150648  2972 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.412801  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:42.375008  2980 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.378472  3025 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:42.379221  2981 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.421295  3061 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:42.421070  3089 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:42.435645  2882 consensus_queue.cc:237] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:42.439090  2934 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:42.390648  3079 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:42.395747  3018 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:42.396072  3059 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:42.415971  3097 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:42.443135  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1106) took 1954 ms. Trace:
W20260709 12:58:42.413956  3062 consensus_meta.cc:287] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 1.298s	user 0.013s	sys 0.004s
I20260709 12:58:42.402765  2436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 295) took 1187 ms. Trace:
I20260709 12:58:42.431135  2972 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:42.466238  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:42.456471  2944 consensus_meta.cc:287] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 1.602s	user 0.013s	sys 0.004s
I20260709 12:58:42.447470  2980 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:42.472213  1713 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:42.459185  1571 rpcz_store.cc:276] 0709 12:58:40.488393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.790899 (+302506us) service_pool.cc:224] Handling call
0709 12:58:40.791375 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:40.791814 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:40.791853 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:40.792530 (+   677us) log.cc:844] Serialized 26 byte log entry
0709 12:58:40.891135 (+ 98605us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:41.116120 (+224985us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.117327 (+  1207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.117967 (+   640us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.442766 (+1324799us) raft_consensus.cc:1685] finished
0709 12:58:42.442799 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.443038 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":371565,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":5099,"raft.queue_time_us":1807,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":2245,"thread_start_us":303467,"threads_started":2,"wal-append.queue_time_us":327838}
I20260709 12:58:42.446254  2951 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:42.481726  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 80392.2us
W20260709 12:58:42.484781  2960 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.003s	sys 0.005s
W20260709 12:58:42.485415  2960 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.003s	sys 0.005s
I20260709 12:58:42.463091  3025 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:42.470220  3059 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.493485  3059 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:42.482371  2944 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:42.495407  3079 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:42.495827  3059 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:42.496039  3079 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.496622  3079 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:42.486793  2440 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:42.499280  3089 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:42.492507  3107 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.502729  3107 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:42.469018  3062 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:42.508076  3097 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:42.482563  3095 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.509645  3095 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:42.490370  2951 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:42.515550  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:42.457531  2981 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:42.463940  2934 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:42.463635  3018 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:42.490156  1713 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:42.528056  2934 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:42.529496  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1168) took 1148 ms. Trace:
I20260709 12:58:42.529986  1641 rpcz_store.cc:276] 0709 12:58:41.381229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.382198 (+   969us) service_pool.cc:224] Handling call
0709 12:58:41.382658 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.383206 (+   548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.383250 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.401271 (+ 18021us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.659708 (+258437us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:41.660002 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.660081 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.529188 (+869107us) raft_consensus.cc:1685] finished
0709 12:58:42.529212 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.529388 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2019,"raft.queue_time_us":1679,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":25743,"thread_start_us":198370,"threads_started":1,"wal-append.queue_time_us":460121}
I20260709 12:58:42.532020  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:42.532680  2981 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:42.532829  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1180) took 1138 ms. Trace:
I20260709 12:58:42.533182  1641 rpcz_store.cc:276] 0709 12:58:41.394289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.531691 (+1137402us) service_pool.cc:224] Handling call
0709 12:58:42.532759 (+  1068us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.535063  3018 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:42.535354  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:42.464962  2436 rpcz_store.cc:276] 0709 12:58:41.205735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.210473 (+  4738us) service_pool.cc:224] Handling call
0709 12:58:41.237675 (+ 27202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.276458 (+ 38783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.281114 (+  4656us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.346239 (+ 65125us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.639242 (+293003us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:41.646174 (+  6932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.658641 (+ 12467us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.339423 (+680782us) raft_consensus.cc:1685] finished
0709 12:58:42.339462 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.392573 (+ 53111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122813,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":37183,"thread_start_us":226795,"threads_started":1,"wal-append.queue_time_us":327322}
I20260709 12:58:42.536484  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2052) took 1141 ms. Trace:
I20260709 12:58:42.536891  1641 rpcz_store.cc:276] 0709 12:58:41.394920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.533888 (+1138968us) service_pool.cc:224] Handling call
0709 12:58:42.536331 (+  2443us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:42.515312  2918 consensus_meta.cc:287] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.214s	user 0.013s	sys 0.002s
I20260709 12:58:42.495841  2944 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:42.539108  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:42.519385  2951 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:42.542523  1713 raft_consensus.cc:2393] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:42.541137  2918 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:42.546670  3097 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.547819  3104 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:42.558473  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:42.556142  3025 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:42.578696  3025 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:42.580422  2443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 296) took 1328 ms. Trace:
I20260709 12:58:42.580564  2972 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:42.559528  3104 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:42.584132  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:42.557258  3097 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:42.584985  2442 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
W20260709 12:58:42.585629  2442 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42636 (request call id 271) took 1693 ms (client timeout 1848 ms). Trace:
W20260709 12:58:42.586108  2442 rpcz_store.cc:269] 0709 12:58:40.892292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.893297 (+  1005us) service_pool.cc:224] Handling call
0709 12:58:42.583933 (+1690636us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b5800122a98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173e9c 00007f18ca173a5b 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:58:42.585555 (+  1622us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18850176}
I20260709 12:58:42.539263  2934 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:42.594199  3106 ts_tablet_manager.cc:933] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:42.581049  2443 rpcz_store.cc:276] 0709 12:58:41.252057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.256261 (+  4204us) service_pool.cc:224] Handling call
0709 12:58:42.579357 (+1323096us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b5800122a98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:58:42.579650 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.579925 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.579973 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:42.580025 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:42.580076 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.580166 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.580339 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14146432}
I20260709 12:58:42.594990  1717 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:42.596925  3095 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:42.598944  1644 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.040s	sys 0.092s
I20260709 12:58:42.599519  2972 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:42.565532  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:42.936929  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:43.068858  1713 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:43.069209  1571 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:58:43.070204  1644 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.282s	user 0.044s	sys 0.096s
I20260709 12:58:42.934926  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:42.866324  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 262049us
W20260709 12:58:43.058311  2406 leader_election.cc:336] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.527s (SENT)
W20260709 12:58:43.206578  1571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1092) took 2016 ms (client timeout 2339 ms). Trace:
W20260709 12:58:43.257113  1685 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.006s	sys 0.011s
I20260709 12:58:43.080745  2406 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:43.257922  1685 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.006s	sys 0.011s
W20260709 12:58:43.207293  1571 rpcz_store.cc:269] 0709 12:58:41.190555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.592840 (+1402285us) service_pool.cc:224] Handling call
0709 12:58:43.206465 (+613625us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:43.262337  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 613851us
W20260709 12:58:43.272545  1641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1174) took 1808 ms (client timeout 2142 ms). Trace:
W20260709 12:58:43.273216  1641 rpcz_store.cc:269] 0709 12:58:41.391931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.537586 (+1145655us) service_pool.cc:224] Handling call
0709 12:58:43.199753 (+662167us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:43.257488  2882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.001s	sys 0.021s
W20260709 12:58:43.279002  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 206291us
I20260709 12:58:43.281515  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1175) took 1889 ms. Trace:
I20260709 12:58:43.281975  1641 rpcz_store.cc:276] 0709 12:58:41.392565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.280529 (+1887964us) service_pool.cc:224] Handling call
0709 12:58:43.280914 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.281139 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.281167 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.281217 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:43.281254 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.281324 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.281448 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.599994  3107 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.284956  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1176) took 1892 ms. Trace:
I20260709 12:58:43.167460  2991 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.208778  2918 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:42.606954  2440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 272) took 1279 ms. Trace:
I20260709 12:58:43.286675  1641 rpcz_store.cc:276] 0709 12:58:41.392888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.283980 (+1891092us) service_pool.cc:224] Handling call
0709 12:58:43.284337 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.284536 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.284561 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.284606 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:43.284636 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.284695 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.284824 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:43.279803  2882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.003s	sys 0.022s
I20260709 12:58:43.300621  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:43.301728  1571 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:43.067911  3079 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:43.272457  2981 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:43.302421  1571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1089) took 2112 ms (client timeout 2349 ms). Trace:
W20260709 12:58:43.310516  1571 rpcz_store.cc:269] 0709 12:58:41.189536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.279149 (+2089613us) service_pool.cc:224] Handling call
0709 12:58:43.302326 (+ 23177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.211644  2934 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:43.318532  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.669s	user 0.013s	sys 0.014s
I20260709 12:58:43.298976  2991 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:42.669685  2980 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:43.306864  2857 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:43.308678  3079 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:43.289224  2972 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:58:43.297320  2440 rpcz_store.cc:276] 0709 12:58:41.327262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.332158 (+  4896us) service_pool.cc:224] Handling call
0709 12:58:41.378880 (+ 46722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.497562 (+1118682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.606534 (+108972us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54006d2c54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:42.606845 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2497275776}
I20260709 12:58:43.346572  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:43.352029  1571 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:43.314451  2981 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:43.342870  2991 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:43.393107  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.744s	user 0.014s	sys 0.015s
W20260709 12:58:43.394168  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 1.75136e+06us
W20260709 12:58:43.390516  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 332239us
I20260709 12:58:43.396332  1571 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:43.350929  3079 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:43.397680  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 12:58:43.399405  1571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38394 (request call id 59) took 2044 ms (client timeout 2191 ms). Trace:
W20260709 12:58:43.401610  1571 rpcz_store.cc:269] 0709 12:58:41.354629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.318975 (+1964346us) service_pool.cc:224] Handling call
0709 12:58:43.396949 (+ 77974us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.402810  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:43.398432  2882 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:58:43.409310  2991 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.420352  2981 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.421818  2934 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.422142  3106 tablet_copy_client.cc:323] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:45463
I20260709 12:58:43.423261  2986 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.424491  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1171) took 2042 ms. Trace:
I20260709 12:58:43.417171  2991 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:43.429600  3117 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:43.430248  3117 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:43.432281  3118 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:43.432706  3118 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.433058  3118 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:43.433466  3117 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.426537  3120 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:43.434319  3120 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:43.428236  2986 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:43.436681  2986 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:43.436757  3120 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:43.431049  2980 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:43.438501  3079 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.436707  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:43.440510  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:43.441147  1720 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:43.443842  2440 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:43.442041  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:43.454281  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1118) took 1055 ms. Trace:
I20260709 12:58:43.463040  1717 rpcz_store.cc:276] 0709 12:58:42.398853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.399046 (+   193us) service_pool.cc:224] Handling call
0709 12:58:42.399494 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.102474 (+702980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.453881 (+351407us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54003ab454. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:43.454173 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448867712}
I20260709 12:58:43.461318  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:43.465629  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:43.467480  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:43.468696  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:43.470706  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:43.471860  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:43.472920  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:43.473660  1718 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:43.474953  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:43.475613  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:43.469209  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:43.479223  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:43.482115  1714 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2110) took 1928 ms (client timeout 2130 ms). Trace:
I20260709 12:58:43.476882  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:43.482731  1714 rpcz_store.cc:269] 0709 12:58:41.553586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.553765 (+   179us) service_pool.cc:224] Handling call
0709 12:58:43.481784 (+1928019us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400228b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:43.481982 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365201664}
I20260709 12:58:43.484272  1717 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:43.484689  1714 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:43.485723  1717 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:43.487941  1717 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:43.492899  1718 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:43.494172  1718 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:43.475764  1640 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
W20260709 12:58:43.505486  1640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1167) took 2163 ms (client timeout 1900 ms). Trace:
W20260709 12:58:43.505916  1640 rpcz_store.cc:269] 0709 12:58:41.342353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.343545 (+  1192us) service_pool.cc:224] Handling call
0709 12:58:43.474785 (+2131240us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b5800002d98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:58:43.505372 (+ 30587us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9981824}
W20260709 12:58:43.508229  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 110644us
I20260709 12:58:43.509012  2951 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:43.508512  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1137) took 1012 ms. Trace:
I20260709 12:58:43.509826  1718 rpcz_store.cc:276] 0709 12:58:42.495866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.493694 (+997828us) service_pool.cc:224] Handling call
0709 12:58:43.493949 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.507490 (+ 13541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.508434 (+   944us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.511284  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 49) took 1980 ms. Trace:
I20260709 12:58:43.511675  1715 rpcz_store.cc:276] 0709 12:58:41.530749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.530932 (+   183us) service_pool.cc:224] Handling call
0709 12:58:41.562151 (+ 31219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.574534 (+ 12383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.511066 (+1936532us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b540025b2d0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:43.511218 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70900480}
I20260709 12:58:43.512109  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:43.512823  2443 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:43.513506  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1139) took 1017 ms. Trace:
I20260709 12:58:43.515516  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:43.516361  1718 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:43.517095  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1138) took 1020 ms. Trace:
W20260709 12:58:43.517597  3091 log.cc:927] Time spent T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 1.672s	user 0.009s	sys 0.004s
I20260709 12:58:43.425050  1644 rpcz_store.cc:276] 0709 12:58:41.390358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.390580 (+   222us) service_pool.cc:224] Handling call
0709 12:58:41.391132 (+   552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.391677 (+   545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.391719 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.411940 (+ 20221us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.687020 (+275080us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:43.070687 (+1383667us) log.cc:844] Serialized 14 byte log entry
0709 12:58:43.423996 (+353309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.424124 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:43.424189 (+    65us) raft_consensus.cc:1685] finished
0709 12:58:43.424207 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.424405 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":201599,"prepare.queue_time_us":791786,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":285431,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":26065,"thread_start_us":1667775,"threads_started":3,"wal-append.queue_time_us":995952}
I20260709 12:58:41.739118  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:43.403649  1571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1090) took 2213 ms (client timeout 2568 ms). Trace:
I20260709 12:58:43.521394  1646 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
W20260709 12:58:43.521628  1571 rpcz_store.cc:269] 0709 12:58:41.189827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.402441 (+2212614us) service_pool.cc:224] Handling call
0709 12:58:43.403588 (+  1147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.522743  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:43.524833  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2047) took 2622 ms (client timeout 1744 ms). Trace:
I20260709 12:58:43.525543  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:43.526507  2443 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:43.528846  1713 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:43.529523  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1141) took 1032 ms. Trace:
I20260709 12:58:43.535991  3127 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:43.525251  1647 rpcz_store.cc:269] 0709 12:58:40.902207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.902311 (+   104us) service_pool.cc:224] Handling call
0709 12:58:43.524646 (+2622335us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540035c854. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:43.524761 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314871552}
I20260709 12:58:43.536656  3127 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:43.502034  2940 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:43.538281  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1130) took 1044 ms. Trace:
I20260709 12:58:43.504691  2882 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:43.513859  1715 rpcz_store.cc:276] 0709 12:58:42.496516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.512675 (+1016159us) service_pool.cc:224] Handling call
0709 12:58:43.512989 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.513183 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.513207 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.513253 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:43.513285 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.513356 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.513453 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.540086  2882 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:43.542418  1537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.828s	user 0.015s	sys 0.019s
W20260709 12:58:43.542913  1537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.828s	user 0.015s	sys 0.020s
I20260709 12:58:43.529819  1713 rpcz_store.cc:276] 0709 12:58:42.497122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.528337 (+1031215us) service_pool.cc:224] Handling call
0709 12:58:43.528656 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.529240 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.529468 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.538980  3127 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:43.521950  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1173) took 2130 ms (client timeout 1976 ms). Trace:
W20260709 12:58:43.523518  1571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1133) took 1829 ms (client timeout 2197 ms). Trace:
W20260709 12:58:43.544243  1571 rpcz_store.cc:269] 0709 12:58:41.694075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.522418 (+1828343us) service_pool.cc:224] Handling call
0709 12:58:43.523457 (+  1039us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:43.544196  1646 rpcz_store.cc:269] 0709 12:58:41.391556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.679820 (+288264us) service_pool.cc:224] Handling call
0709 12:58:43.521853 (+1842033us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.544661  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1166) took 2202 ms. Trace:
I20260709 12:58:43.500494  3118 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:43.539767  1714 rpcz_store.cc:276] 0709 12:58:42.494018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.485817 (+991799us) service_pool.cc:224] Handling call
0709 12:58:43.497920 (+ 12103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.498224 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.537891 (+ 39667us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.537947 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:43.537993 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.538088 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.538220 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.545454  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:43.546192  1571 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
W20260709 12:58:43.546684  1571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1131) took 1853 ms (client timeout 2243 ms). Trace:
I20260709 12:58:43.546875  3127 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:43.547046  1571 rpcz_store.cc:269] 0709 12:58:41.693596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.545128 (+1851532us) service_pool.cc:224] Handling call
0709 12:58:43.546625 (+  1497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.547397  3127 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:43.548146  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:43.548751  1571 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:43.539891  3079 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:43.517436  1718 rpcz_store.cc:276] 0709 12:58:42.496238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.510756 (+1014518us) service_pool.cc:224] Handling call
0709 12:58:43.511146 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.516819 (+  5673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.517024 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.542552  2882 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:43.547215  3118 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:43.545126  1639 rpcz_store.cc:276] 0709 12:58:41.341884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.342045 (+   161us) service_pool.cc:224] Handling call
0709 12:58:41.342487 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.343027 (+   540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.343071 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.357324 (+ 14253us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.581830 (+224506us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:41.582023 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.582268 (+   245us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:43.516925 (+1934657us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:58:43.544297 (+ 27372us) raft_consensus.cc:1685] finished
0709 12:58:43.544322 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.544569 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3659,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":10662,"spinlock_wait_cycles":17098112,"thread_start_us":223613,"threads_started":1,"wal-append.queue_time_us":487733}
I20260709 12:58:43.557428  3127 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.555384  2882 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:43.561084  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1123) took 1070 ms. Trace:
I20260709 12:58:43.552376  2936 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.563457  2972 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:43.561389  2882 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:43.566038  2936 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:43.554473  2951 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.567727  2951 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:43.568204  2882 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:43.569185  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:43.569864  2951 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.568269  2936 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:43.569916  2443 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
W20260709 12:58:43.618044  1537 connection.cc:256] RPC call timeout handler was delayed by -1.019823663000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260709 12:58:43.623765  2951 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:43.623231  3118 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:43.625478  3131 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.623271  2936 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:43.626825  3131 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:43.628208  2936 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:43.625305  2951 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:43.625480  3118 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:43.633296  2951 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.635596  2936 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.636364  3131 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.637277  3131 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:43.638501  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0763279330000159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 12:58:43.639159  1612 connection.cc:256] RPC call timeout handler was delayed by -1.00191810299998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 12:58:43.642256  2936 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.643182  3127 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.643338  2936 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:43.644420  3127 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:43.646906  2936 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.655300  1537 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:43.664152  2882 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:43.666556  2951 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.667845  2951 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:43.672664  2934 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:43.673283  2934 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.673682  2934 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:43.674971  3127 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:43.678166  2951 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:43.679287  2951 consensus_queue.cc:1059] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:43.687110  2951 raft_consensus.cc:3055] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:43.706487  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1115) took 3214 ms. Trace:
I20260709 12:58:43.708417  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:43.639529  3118 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:43.685572  1537 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:43.665680  2882 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:43.709299  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 66885.2us
I20260709 12:58:43.717746  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:43.719192  2882 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:43.713788  1565 rpcz_store.cc:276] 0709 12:58:40.491384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.173933 (+682549us) service_pool.cc:224] Handling call
0709 12:58:41.207944 (+ 34011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.208428 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.208470 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.209179 (+   709us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.525619 (+316440us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:41.576359 (+ 50740us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.576769 (+   410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.576921 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:43.705611 (+2128690us) raft_consensus.cc:1685] finished
0709 12:58:43.705656 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.706099 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8691,"prepare.queue_time_us":47656,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":70560,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":152,"spinlock_wait_cycles":4503808,"thread_start_us":288111,"threads_started":1,"wal-append.queue_time_us":421644,"wal-append.run_cpu_time_us":17979,"wal-append.run_wall_time_us":1891140}
I20260709 12:58:43.720088  3118 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:43.720728  3118 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.721274  3118 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:43.721913  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 49546.1us
I20260709 12:58:43.729439  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:43.730607  1566 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:43.770699  3080 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 2.109s	user 0.010s	sys 0.010s
I20260709 12:58:43.772667  3071 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:43.734737  3097 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:43.773648  3071 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:43.737737  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:43.777339  1639 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:43.777261  1646 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:43.779037  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:43.780076  1646 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:43.738318  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:43.782078  1647 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:43.739090  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:43.740338  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:43.743029  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:43.753019  1717 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
W20260709 12:58:43.752815  1719 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2100) took 2269 ms (client timeout 1749 ms). Trace:
I20260709 12:58:43.784267  1641 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 1.
W20260709 12:58:43.784638  1719 rpcz_store.cc:269] 0709 12:58:41.483103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.488418 (+  5315us) service_pool.cc:224] Handling call
0709 12:58:43.752043 (+2263625us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b5400229a54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:43.752455 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87194880}
I20260709 12:58:43.754083  3052 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:43.754916  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1165) took 2413 ms. Trace:
I20260709 12:58:41.704135  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:43.733529  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1164) took 2392 ms. Trace:
W20260709 12:58:43.756683  1645 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.095s	user 0.012s	sys 0.012s
I20260709 12:58:43.788178  3071 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:43.759742  3087 log.cc:927] Time spent T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 1.863s	user 0.008s	sys 0.003s
I20260709 12:58:43.562911  1720 rpcz_store.cc:276] 0709 12:58:42.490658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.480997 (+990339us) service_pool.cc:224] Handling call
0709 12:58:43.481335 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.481606 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:43.495012 (+ 13406us) log.cc:844] Serialized 14 byte log entry
0709 12:58:43.560199 (+ 65187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.560279 (+    80us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:43.560323 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.560418 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.560581 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3581,"prepare.queue_time_us":12913,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":5275,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6066,"thread_start_us":59441,"threads_started":1,"wal-append.queue_time_us":74980}
I20260709 12:58:43.689977  3131 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:43.711578  2951 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:43.786010  1638 rpcz_store.cc:276] 0709 12:58:41.341265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.344019 (+  2754us) service_pool.cc:224] Handling call
0709 12:58:43.729656 (+2385637us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b5800002d98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:58:43.753447 (+ 23791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.753998 (+   551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.754042 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.754170 (+   128us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:43.754225 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.754328 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.754564 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9468288}
W20260709 12:58:43.787506  1645 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.126s	user 0.012s	sys 0.012s
I20260709 12:58:43.757511  2936 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:43.787036  1643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2051) took 2392 ms (client timeout 2102 ms). Trace:
I20260709 12:58:43.796119  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:43.797076  2440 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:43.797331  3131 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.799630  2448 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:58:43.801362  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:43.799932  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1118) took 3307 ms. Trace:
I20260709 12:58:43.804682  1565 rpcz_store.cc:276] 0709 12:58:40.492332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.758364 (+3266032us) service_pool.cc:224] Handling call
0709 12:58:43.799108 (+ 40744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.799501 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.799526 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.799585 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:43.799615 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.799687 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.799842 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:43.794580  1643 rpcz_store.cc:269] 0709 12:58:41.394624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.703767 (+309143us) service_pool.cc:224] Handling call
0709 12:58:43.786707 (+2082940us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.787181  1642 rpcz_store.cc:276] 0709 12:58:41.340523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.343705 (+  3182us) service_pool.cc:224] Handling call
0709 12:58:43.731439 (+2387734us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b5800002d98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:58:43.732001 (+   562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.732469 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.732513 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.732622 (+   109us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:43.732676 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.732787 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.733081 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10030976}
I20260709 12:58:43.811110  2934 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:43.811236  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:43.812414  1566 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
W20260709 12:58:43.813259  1566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1086) took 2624 ms (client timeout 1918 ms). Trace:
I20260709 12:58:43.813489  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:43.815377  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:43.819569  1537 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:43.801795  2951 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:43.826045  2951 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:43.817775  2934 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:43.813803  1566 rpcz_store.cc:269] 0709 12:58:41.188673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.324840 (+136167us) service_pool.cc:224] Handling call
0709 12:58:43.707972 (+2383132us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173eee 0000000000375939 00007f18d21e71e0 00007f18d22b00c4 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:58:43.813073 (+105101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41538432}
I20260709 12:58:43.829427  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1085) took 2641 ms. Trace:
W20260709 12:58:43.832288  1536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.136s	user 0.010s	sys 0.014s
I20260709 12:58:43.794709  2936 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:43.834467  1536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.139s	user 0.012s	sys 0.015s
I20260709 12:58:43.834141  1566 rpcz_store.cc:276] 0709 12:58:41.188326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.827798 (+2639472us) service_pool.cc:224] Handling call
0709 12:58:43.828330 (+   532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.828918 (+   588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.828956 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.829034 (+    78us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:43.829080 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.829158 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.829331 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:43.836234  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 2.14102e+06us
I20260709 12:58:43.836470  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1111) took 3346 ms. Trace:
I20260709 12:58:43.838231  2936 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:43.837615  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 12:58:43.838961  1568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1099) took 2573 ms (client timeout 1873 ms). Trace:
W20260709 12:58:43.841540  1568 rpcz_store.cc:269] 0709 12:58:41.265839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.838249 (+2572410us) service_pool.cc:211] Skipping call since client already timed out
0709 12:58:43.838713 (+   464us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:58:43.838480  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1087) took 2649 ms. Trace:
I20260709 12:58:43.842711  2934 raft_consensus.cc:2764] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:58:43.843957  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1101) took 2576 ms. Trace:
I20260709 12:58:43.844027  1536 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:43.848497  1611 connection.cc:256] RPC call timeout handler was delayed by -1.6595006379999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 12:58:43.849184  1611 connection.cc:256] RPC call timeout handler was delayed by -1.5827642609999657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 12:58:43.849519  1611 connection.cc:256] RPC call timeout handler was delayed by -1.4561006380000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
W20260709 12:58:43.854620  1611 connection.cc:256] RPC call timeout handler was delayed by -1.3559365449999632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 12:58:43.852177  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1084) took 2664 ms. Trace:
I20260709 12:58:43.844581  1568 rpcz_store.cc:276] 0709 12:58:41.267241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.842458 (+2575217us) service_pool.cc:224] Handling call
0709 12:58:43.843116 (+   658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.843548 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.843571 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.843650 (+    79us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:43.843678 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.843747 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.843882 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:43.855521  1611 connection.cc:256] RPC call timeout handler was delayed by -1.3274006379999719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260709 12:58:43.836987  1563 rpcz_store.cc:276] 0709 12:58:40.490016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.021783 (+531767us) service_pool.cc:224] Handling call
0709 12:58:41.036542 (+ 14759us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.095699 (+ 59157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.105303 (+  9604us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.210792 (+105489us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.508698 (+297906us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:41.544903 (+ 36205us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.577594 (+ 32691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.583267 (+  5673us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:43.835827 (+2252560us) raft_consensus.cc:1685] finished
0709 12:58:43.835885 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.836225 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14679,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":34557,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":16922,"thread_start_us":225331,"threads_started":1,"wal-append.queue_time_us":412301,"wal-append.run_cpu_time_us":17179,"wal-append.run_wall_time_us":1632399}
I20260709 12:58:43.855581  1565 rpcz_store.cc:276] 0709 12:58:41.187994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.821707 (+2633713us) service_pool.cc:224] Handling call
0709 12:58:43.851262 (+ 29555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.851598 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.851636 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.851696 (+    60us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:43.851741 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.851813 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.852073 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:43.864522  1611 connection.cc:256] RPC call timeout handler was delayed by -1.1393006380000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2445s for a response
I20260709 12:58:43.846423  3097 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:43.868372  3097 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.868894  3097 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:43.840396  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:43.873227  1564 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:43.866420  3131 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:43.877370  3126 raft_consensus.cc:3055] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:43.878000  3126 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:43.877848  3131 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:43.879489  3126 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:43.880909  3126 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.844511  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:43.882655  1569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1096) took 2690 ms (client timeout 1976 ms). Trace:
W20260709 12:58:43.883121  1569 rpcz_store.cc:269] 0709 12:58:41.191997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.361351 (+169354us) service_pool.cc:224] Handling call
0709 12:58:43.844096 (+2482745us) spinlock_profiling.cc:243] Waited 915 us on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:58:43.882562 (+ 38466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2103680}
I20260709 12:58:43.845269  2934 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:43.885851  2906 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.894349  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:43.896572  2906 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:43.897250  3104 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.897706  3061 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:43.898188  3131 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.900050  1571 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
W20260709 12:58:43.900915  1571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1091) took 2710 ms (client timeout 2821 ms). Trace:
W20260709 12:58:43.901397  1571 rpcz_store.cc:269] 0709 12:58:41.190180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.547874 (+2357694us) service_pool.cc:224] Handling call
0709 12:58:43.900793 (+352919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.903271  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1120) took 2212 ms. Trace:
I20260709 12:58:43.904011  1568 rpcz_store.cc:276] 0709 12:58:41.690957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.888046 (+2197089us) service_pool.cc:224] Handling call
0709 12:58:43.902672 (+ 14626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.902926 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.902957 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.903002 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:43.903033 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.903093 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.903214 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.904681  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:43.905604  2436 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:58:43.906200  1568 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:43.907130  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1125) took 2214 ms. Trace:
I20260709 12:58:43.907574  1568 rpcz_store.cc:276] 0709 12:58:41.692253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.905286 (+2213033us) service_pool.cc:224] Handling call
0709 12:58:43.905818 (+   532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.906748 (+   930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.907059 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.909976  1565 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:43.910830  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1122) took 2219 ms. Trace:
I20260709 12:58:43.911163  1565 rpcz_store.cc:276] 0709 12:58:41.691507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.908718 (+2217211us) service_pool.cc:224] Handling call
0709 12:58:43.909400 (+   682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.910515 (+  1115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.910756 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.907147  1567 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:43.917863   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:43.919538  1563 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:43.920480  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1123) took 2228 ms. Trace:
I20260709 12:58:43.924957  3131 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:43.931514  3131 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:43.917776  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 51409.5us
I20260709 12:58:43.939158  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1161) took 2601 ms. Trace:
I20260709 12:58:43.939817  1645 rpcz_store.cc:276] 0709 12:58:41.336789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.336969 (+   180us) service_pool.cc:224] Handling call
0709 12:58:41.358583 (+ 21614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.359046 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.359076 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.359557 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.580637 (+221080us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:43.819282 (+2238645us) log.cc:844] Serialized 14 byte log entry
0709 12:58:43.937938 (+118656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.938075 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:43.938122 (+    47us) raft_consensus.cc:1685] finished
0709 12:58:43.938143 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.938377 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":870330,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":2990,"raft.queue_time_us":1535,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":2467479,"threads_started":3,"wal-append.queue_time_us":328016,"wal-append.run_cpu_time_us":2920,"wal-append.run_wall_time_us":1588669}
I20260709 12:58:43.923904  1563 rpcz_store.cc:276] 0709 12:58:41.691772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.918355 (+2226583us) service_pool.cc:224] Handling call
0709 12:58:43.918932 (+   577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.920054 (+  1122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.920389 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.844069  1566 rpcz_store.cc:276] 0709 12:58:41.188973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.835825 (+2646852us) service_pool.cc:224] Handling call
0709 12:58:43.837570 (+  1745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.837979 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.838022 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:43.838110 (+    88us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:43.838146 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.838220 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.838381 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.964224  1657 tablet_copy_service.cc:140] P a4be9cc90aca4dd4ad7db103062a7208: Received BeginTabletCopySession request for tablet e93b49f668f7487dad07043590a5616f from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38584)
I20260709 12:58:43.965342  1657 tablet_copy_service.cc:161] P a4be9cc90aca4dd4ad7db103062a7208: Beginning new tablet copy session on tablet e93b49f668f7487dad07043590a5616f from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38584: session id = 6f381117554e49bb816791ab0a10f2b8-e93b49f668f7487dad07043590a5616f
I20260709 12:58:43.967219  1566 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:43.968145  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1130) took 2274 ms. Trace:
I20260709 12:58:43.968528  1566 rpcz_store.cc:276] 0709 12:58:41.693374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.966457 (+2273083us) service_pool.cc:224] Handling call
0709 12:58:43.966968 (+   511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.967839 (+   871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.968080 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:43.970238  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.971319  1571 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:43.972127  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1127) took 2279 ms. Trace:
I20260709 12:58:43.972535  1571 rpcz_store.cc:276] 0709 12:58:41.692707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.948510 (+2255803us) service_pool.cc:224] Handling call
0709 12:58:43.971106 (+ 22596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.971855 (+   749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.972074 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:43.974562  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:43.975265  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:43.975499  1571 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:43.976637  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1134) took 1481 ms. Trace:
I20260709 12:58:43.976812  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:43.977007  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:43.977698  1642 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:43.977088  1717 rpcz_store.cc:276] 0709 12:58:42.495058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.488747 (+993689us) service_pool.cc:224] Handling call
0709 12:58:43.752394 (+263647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.784217 (+ 31823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.976361 (+192144us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5400229a50. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:43.976557 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605309696}
I20260709 12:58:43.978315  3131 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.983429  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:43.988000  1640 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:43.984266  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:43.985164  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:43.972558  3104 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:43.976819  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:43.991196  1638 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:43.981112  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:43.994522  3104 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:43.997200  3104 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:43.999531  3131 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:44.000476  3131 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.002935  1563 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:44.003801  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1129) took 2310 ms. Trace:
I20260709 12:58:44.004172  1563 rpcz_store.cc:276] 0709 12:58:41.693147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.979376 (+2286229us) service_pool.cc:224] Handling call
0709 12:58:44.002601 (+ 23225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.003500 (+   899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.003736 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.005488  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.007215  1563 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:44.007253  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.008657  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.009423  1563 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.011507  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.012336  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.012383  1643 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:44.016695  1657 tablet_copy_source_session.cc:215] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:44.017488  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.019503  1567 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
W20260709 12:58:44.020269  1567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1097) took 2757 ms (client timeout 2173 ms). Trace:
I20260709 12:58:44.020362  1568 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:44.013934  2982 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:44.024272  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.024852  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.009927  1638 raft_consensus.cc:3055] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:44.026181  1638 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:44.028367  3131 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:44.029309  1638 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:44.020715  1567 rpcz_store.cc:269] 0709 12:58:41.263002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.577275 (+314273us) service_pool.cc:224] Handling call
0709 12:58:44.020179 (+2442904us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.031278  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.031514  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.032302  1567 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:44.033371  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.030550  1638 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.034341  3104 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:44.035662  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 88486.7us
I20260709 12:58:44.036725  1536 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.038564  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.040693  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.044492  1563 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:44.037590  3104 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:44.046732  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 67299.9us
I20260709 12:58:44.049480  1640 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:58:44.033982  1567 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:44.056859  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.056843  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.058466  1647 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.062211  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.062776  1642 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:44.063158  1571 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:44.063189  3138 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:58:44.062286  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1102) took 2711 ms. Trace:
I20260709 12:58:43.992166  3118 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:44.071115  1647 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:44.073225  1638 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:44.086030  1564 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:44.075655  3108 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:44.075420  3104 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:44.089879  1565 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:44.077554  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.078486  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.078878  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.078507  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.080255  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.088227  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.073607  1536 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.076540  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.092995  3108 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.096949  3104 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:44.091320  1720 raft_consensus.cc:2368] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3.
I20260709 12:58:44.091368  1715 raft_consensus.cc:2393] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:44.088313  1638 pending_rounds.cc:85] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 1
I20260709 12:58:44.102927  1638 pending_rounds.cc:107] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:44.103397  1638 raft_consensus.cc:2889] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:44.099642  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.099450  3108 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:44.117540  3118 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:44.118973  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.065182  1572 rpcz_store.cc:276] 0709 12:58:41.267561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.847696 (+2580135us) service_pool.cc:224] Handling call
0709 12:58:43.848238 (+   542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:43.848865 (+   627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.848897 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:43.849565 (+   668us) log.cc:844] Serialized 26 byte log entry
0709 12:58:43.959483 (+109918us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:43.959547 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.959644 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:43.979023 (+ 19379us) raft_consensus.cc:1685] finished
0709 12:58:43.979044 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.979212 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1561,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":151,"thread_start_us":98573,"threads_started":1,"wal-append.queue_time_us":114400}
I20260709 12:58:44.120627  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.122905  3104 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:44.122913  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.124022  3104 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:44.125801  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.127827  3104 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:44.130442  1536 connection.cc:256] RPC call timeout handler was delayed by -2.2172650269999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 12:58:44.132629  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:58:44.142294  1536 connection.cc:256] RPC call timeout handler was delayed by -2.122765027000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 12:58:44.142594  1638 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:44.142694  1536 connection.cc:256] RPC call timeout handler was delayed by -2.122765027000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 12:58:44.143071  1536 connection.cc:256] RPC call timeout handler was delayed by -2.1182650270000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 12:58:44.143365  1536 connection.cc:256] RPC call timeout handler was delayed by -2.0885650270000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
I20260709 12:58:44.143312  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:44.143909  1536 connection.cc:256] RPC call timeout handler was delayed by -2.0693150600000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 12:58:44.144249  1536 connection.cc:256] RPC call timeout handler was delayed by -1.9811150599999792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
I20260709 12:58:44.144408  1646 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
W20260709 12:58:44.144740  1536 connection.cc:256] RPC call timeout handler was delayed by -1.3038060949999704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 12:58:44.145110  1536 connection.cc:256] RPC call timeout handler was delayed by -1.1661060949999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
W20260709 12:58:44.145373  1536 connection.cc:256] RPC call timeout handler was delayed by -1.1661060949999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
W20260709 12:58:44.145628  1536 connection.cc:256] RPC call timeout handler was delayed by -1.0761060949999433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260709 12:58:44.145545  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.146449  1646 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:44.146801  1572 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.147478  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:44.147857  1564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1094) took 2956 ms (client timeout 2280 ms). Trace:
I20260709 12:58:44.148710  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.133010  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.150660  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:44.150955  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.133474  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.152447  1647 raft_consensus.cc:2376] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2. Re-sending same reply.
I20260709 12:58:44.152810  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.153594  1646 raft_consensus.cc:2376] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3. Re-sending same reply.
I20260709 12:58:44.155583  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.134335  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.134285  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.135332  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.157114  1644 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.136054  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.159642  3025 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:44.109305  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.162468  1563 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:44.162344  3097 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:44.140560  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.139460  1611 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:44.165369  3025 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:44.165594  1641 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:44.167014  1643 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:44.167680  2882 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:44.168450  1611 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:44.169214  1638 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:44.169858  3118 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:44.170779  3118 consensus_queue.cc:1059] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:44.171253  1611 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:44.171950  2982 raft_consensus.cc:3055] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:44.172348  2982 raft_consensus.cc:740] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:44.172505  1611 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:44.172521  2882 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:44.173775  2882 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:44.173450  2982 consensus_queue.cc:260] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:44.148289  1564 rpcz_store.cc:269] 0709 12:58:41.191514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.752617 (+561103us) service_pool.cc:224] Handling call
0709 12:58:44.147744 (+2395127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.174028  1611 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:44.180298  1571 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:44.180351  1644 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:44.174317  2882 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:44.182863  2982 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.184477  1567 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:44.187127  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.181485  1572 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:44.176076  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.188748  3143 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:44.195197  3143 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:44.195670  3143 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:44.196419  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.199599  3097 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:44.189170  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.189783  3141 consensus_queue.cc:1059] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:44.190950  1611 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:44.192173  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.205027  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.205080  3141 raft_consensus.cc:3055] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:44.206286  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.218631  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.207966  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.220996  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.224787  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.220399  3127 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:58:44.232389  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 81911us
I20260709 12:58:44.205935  1563 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:44.201897  1567 raft_consensus.cc:2376] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3. Re-sending same reply.
I20260709 12:58:44.236981  1572 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.237442  1643 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:44.206555  3141 raft_consensus.cc:740] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:44.238900  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.239671  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:44.240725  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 49964us
W20260709 12:58:44.241597  1716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2109) took 2688 ms (client timeout 2102 ms). Trace:
I20260709 12:58:44.242736  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.242995  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.243640  1564 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:44.243752  1563 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:44.244877  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.245611  1563 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:44.246847  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:44.247390  1716 rpcz_store.cc:269] 0709 12:58:41.553242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.553376 (+   134us) service_pool.cc:224] Handling call
0709 12:58:44.191734 (+2638358us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:58:44.241502 (+ 49768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6284544}
I20260709 12:58:44.248751  1641 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:44.248476  3141 consensus_queue.cc:260] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.250276  3141 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.250646  1644 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:44.257131  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:44.257470  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.257659  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:44.257279  3143 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.258407  2442 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.258771  3025 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:44.259223  3025 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:44.259691  3025 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:44.259379  3097 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:44.260139  3143 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:44.261318  3097 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:44.261754  3097 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:44.262012  3097 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.263535  1641 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:44.265388  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.265578  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.266422  1641 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:44.266621  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.266821  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.267494  1567 raft_consensus.cc:2376] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3. Re-sending same reply.
I20260709 12:58:44.268770  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.269132  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.269366  1567 raft_consensus.cc:2376] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3. Re-sending same reply.
I20260709 12:58:44.270550  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.271375  1567 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:44.272182  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.241416  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.247637  1566 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:44.273726  1571 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:44.274657  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.275254  1571 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:44.276219  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.276890  1571 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:44.278360  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.278960  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.280839  1638 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:44.286456  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:44.279736  1718 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:44.290089  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.290758  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.291607  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.293198  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.279256  2442 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:44.294965  1537 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:44.296434  2934 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.296672  1611 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:44.297003  2934 raft_consensus.cc:697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 3 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:44.273057  1567 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:44.298180  2934 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:44.301810  1536 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:44.304944  1647 raft_consensus.cc:2410] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:44.304903  2982 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:44.307423  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.308238  1572 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:44.311206  2906 raft_consensus.cc:2764] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:58:44.311734  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.315025  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1117) took 3822 ms. Trace:
I20260709 12:58:44.310145  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.309825  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.322755  3143 consensus_queue.cc:1059] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:44.321944  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.324893  3104 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:44.326614  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.327972  3118 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:44.331341  1718 raft_consensus.cc:2393] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:44.332211  1644 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:44.333076  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.332916  3127 consensus_queue.cc:1059] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:58:44.338330  3127 raft_consensus.cc:3055] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:44.338792  3127 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:44.338943  1720 raft_consensus.cc:2393] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:44.340644  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.331009  2882 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.339879  3127 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.344868  3127 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.338275  1571 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:44.346566  1640 raft_consensus.cc:1240] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:44.346692  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.345718  2882 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:44.315469  1570 rpcz_store.cc:276] 0709 12:58:40.492013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.177070 (+685057us) service_pool.cc:224] Handling call
0709 12:58:41.177532 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.178079 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.178122 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.181738 (+  3616us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.479881 (+298143us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:41.479942 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.480045 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:44.314531 (+2834486us) raft_consensus.cc:1685] finished
0709 12:58:44.314571 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.314822 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":25422,"thread_start_us":205604,"threads_started":1,"wal-append.queue_time_us":333505,"wal-append.run_cpu_time_us":16167,"wal-append.run_wall_time_us":1639160}
I20260709 12:58:44.348912  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.345517  2936 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:44.354208  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.356781  3140 consensus_queue.cc:1059] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:44.358028  3140 raft_consensus.cc:3055] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:44.358505  3140 raft_consensus.cc:740] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:44.358028  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:44.360209  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 58530.5us
I20260709 12:58:44.362365  1571 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:44.362545  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.363191  1644 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:44.361816  3140 consensus_queue.cc:260] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:44.364465  2951 consensus_meta.cc:287] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.008s
I20260709 12:58:44.365339  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.373412  1570 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:44.378041  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2108) took 2827 ms. Trace:
I20260709 12:58:44.382849  1721 rpcz_store.cc:276] 0709 12:58:41.550899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.552254 (+  1355us) service_pool.cc:224] Handling call
0709 12:58:41.552628 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.564464 (+ 11836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.377425 (+2812961us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b540025a8d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:44.377797 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25108736}
I20260709 12:58:44.380861  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.380329  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1128) took 2687 ms. Trace:
I20260709 12:58:44.379490  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.385522  1568 rpcz_store.cc:276] 0709 12:58:41.692918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.937618 (+2244700us) service_pool.cc:224] Handling call
0709 12:58:44.020147 (+ 82529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.021639 (+  1492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.380092 (+358453us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b54002b6e50. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:44.380233 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137871744}
I20260709 12:58:44.386483  1646 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:44.391093  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.392284  1644 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:44.391983  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.400695  3025 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.419193  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:44.402208  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1124) took 2710 ms. Trace:
I20260709 12:58:44.421173  1569 rpcz_store.cc:276] 0709 12:58:41.692019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.401257 (+2709238us) service_pool.cc:224] Handling call
0709 12:58:44.401656 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.401838 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:44.401862 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:44.401901 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:44.401926 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.401991 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.402121 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:44.403805  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.404415  2436 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:58:44.410205  2936 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:44.409654  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.407336  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.412570  1716 raft_consensus.cc:2393] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:44.402890  1570 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:44.427480  1644 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:44.429126  1640 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:44.430352  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:44.433243  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 77252.1us
I20260709 12:58:44.430081  2906 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:58:44.435957  2951 raft_consensus.cc:3055] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:44.436506  2951 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:44.436790  3143 consensus_queue.cc:1059] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:44.437949  3143 consensus_queue.cc:1059] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:44.439152  3118 raft_consensus.cc:3055] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:44.439575  3118 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:44.439652  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.440771  1716 raft_consensus.cc:2393] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:44.441265  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1126) took 2748 ms. Trace:
I20260709 12:58:44.441656  1565 rpcz_store.cc:276] 0709 12:58:41.692475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.912006 (+2219531us) service_pool.cc:224] Handling call
0709 12:58:44.089666 (+177660us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.090499 (+   833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.441023 (+350524us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54003f93d0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:44.441166 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407613312}
I20260709 12:58:44.442463  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.443403  1716 raft_consensus.cc:2393] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:44.440764  3118 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.444428  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.445184  3118 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.445290  3131 raft_consensus.cc:3055] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:44.445767  3131 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:58:44.446162  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.446502  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.447425  3104 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:44.446961  3131 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.448124  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.449214  3104 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:44.449958  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.437547  2951 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.456182  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58260 (request call id 209) took 5701 ms. Trace:
I20260709 12:58:44.459086  1537 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:44.460028  3126 raft_consensus.cc:3055] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:44.460639  3126 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:44.462394  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.463828  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.461742  3126 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.469046  1564 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:44.470256  2951 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:44.457625  1469 rpcz_store.cc:276] 0709 12:58:38.754973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.755225 (+   252us) service_pool.cc:224] Handling call
0709 12:58:44.455889 (+5700664us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:39.099910 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:39.102631 (+  2721us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:39.102693 (+    62us) write_op.cc:435] Acquired schema lock
0709 12:58:39.102721 (+    28us) tablet.cc:662] Decoding operations
0709 12:58:39.155482 (+ 52761us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:39.155574 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:39.155624 (+    50us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:58:39.156216 (+   592us) tablet.cc:701] Row locks acquired
0709 12:58:39.156243 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:58:39.156478 (+   235us) write_op.cc:270] Start()
0709 12:58:39.156644 (+   166us) write_op.cc:276] Timestamp: P: 1783601919156417 usec, L: 0
0709 12:58:39.156681 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:58:39.157784 (+  1103us) log.cc:844] Serialized 1316 byte log entry
0709 12:58:39.556394 (+398610us) op_driver.cc:464] REPLICATION: finished
0709 12:58:39.817825 (+261431us) write_op.cc:301] APPLY: starting
0709 12:58:39.821498 (+  3673us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:39.842691 (+ 21193us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:39.916791 (+ 74100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:40.030744 (+113953us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:40.060799 (+ 30055us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:58:40.065902 (+  5103us) write_op.cc:312] APPLY: finished
0709 12:58:40.078328 (+ 12426us) log.cc:844] Serialized 34 byte log entry
0709 12:58:40.081379 (+  3051us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:40.081507 (+   128us) write_op.cc:454] Released schema lock
0709 12:58:40.081552 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:40.119088 (+ 37536us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:40.119121 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1183304,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":225311,"apply.run_cpu_time_us":3853,"apply.run_wall_time_us":275350,"num_ops":3,"prepare.queue_time_us":189359,"prepare.run_cpu_time_us":5449,"prepare.run_wall_time_us":63879,"replication_time_us":399423,"thread_start_us":279041,"threads_started":2}]]}
I20260709 12:58:44.465418  2906 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:44.473662  2906 raft_consensus.cc:697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:44.464555  2936 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:44.474861  2906 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:44.475945  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:58:44.481333  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.481603  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:44.482570  2448 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:58:44.484611  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 49619.9us
I20260709 12:58:44.486467  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.487311  1721 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:44.495491  2982 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:44.497318  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.499811  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.499852  1721 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:44.501688  3140 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.507680  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.508492  1721 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:44.512750  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:44.514364  3014 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:44.514866  3014 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:44.515347  3014 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.516685  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.517601  1571 raft_consensus.cc:2393] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:44.519096  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.519830  1571 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 2: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:44.520649  3025 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:44.521448  1571 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:44.522373  1686 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:44.523957  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.527546  1571 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:44.528568  2978 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:44.529000  2978 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:44.529374  2978 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:44.527527  2982 consensus_queue.cc:1059] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:58:44.532047  1645 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:44.536968  3014 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.539507  1686 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:44.539754  3014 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:44.540723  1686 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:44.542248  2982 raft_consensus.cc:3055] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:44.540563  3014 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:44.545490  3018 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.546257  3018 raft_consensus.cc:697] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:44.547308  3018 consensus_queue.cc:237] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:44.550503  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 69305.3us
I20260709 12:58:44.550647  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:44.551501  2448 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:44.555207  3097 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.561260  1611 leader_election.cc:400] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3.
I20260709 12:58:44.562453  1611 leader_election.cc:403] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:44.558321  3014 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:44.565699  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:44.568364  3014 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:44.569312  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.543843  2982 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:44.574385  3131 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.575349  2982 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.576781  2982 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:44.581550  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 47657.1us
I20260709 12:58:44.583168  1611 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:44.589272  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:44.589774  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:44.589293  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:44.593791  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.594012  3014 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.594635  1572 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
I20260709 12:58:44.595671  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.596313  3014 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:44.583020  3127 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3.
I20260709 12:58:44.600113  2448 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:44.597959  2405 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:44.601258  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.602200  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:44.602934  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.603396  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.604020  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.557919  2978 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.606779  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.609334  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:44.612464  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.610956  3071 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:44.613698  3071 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:44.614281  3071 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:44.614840  2978 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:44.601338  3118 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:44.617354  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.620831  2978 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:44.622182  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.622545  2978 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:44.623131  1566 raft_consensus.cc:2393] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:44.623207  2978 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.618247  3118 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.624677  1564 raft_consensus.cc:2376] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3. Re-sending same reply.
I20260709 12:58:44.625247  1686 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:44.627126  1466 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 106) took 5662 ms. Trace:
I20260709 12:58:44.627576  3126 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.628978  3097 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:44.629735  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:44.630666  2448 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:44.625552  1571 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
W20260709 12:58:44.636029  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.627621  1466 rpcz_store.cc:276] 0709 12:58:38.965146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.965301 (+   155us) service_pool.cc:224] Handling call
0709 12:58:44.626891 (+5661590us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3566312,"reported_tablets":1}
I20260709 12:58:44.634011  3118 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:44.640174  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58250 (request call id 193) took 5435 ms. Trace:
I20260709 12:58:44.640576  1470 rpcz_store.cc:276] 0709 12:58:39.208495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.234874 (+ 26379us) service_pool.cc:224] Handling call
0709 12:58:44.639967 (+5405093us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":288515,"reported_tablets":3}
I20260709 12:58:44.641904  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.644901  1686 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:44.646327  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.647285  3061 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:44.647763  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.649221  1567 raft_consensus.cc:2410] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:58:44.649017  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:44.650323  3061 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:44.654542  3061 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.654950  3061 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.658288  3108 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.658977  3108 raft_consensus.cc:697] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:44.659409  3014 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.660074  3108 consensus_queue.cc:237] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.660490  1686 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:44.665023  1686 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:44.666414  3122 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.666983  3122 raft_consensus.cc:697] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:44.667958  3122 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.671048  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.672724  3018 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:44.673169  3018 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:44.666009  1686 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:44.673914  3018 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:44.673141  1567 raft_consensus.cc:1240] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:44.680544  3118 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.684669  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.684993  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.683943  3102 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:44.686133  1566 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:44.686267  3102 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:44.686487  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.686751  3102 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.688470  3119 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:44.690557  2405 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:44.660058  3014 raft_consensus.cc:697] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:44.692021  3119 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:44.693032  3119 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:44.693459  3119 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:44.693904  3119 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:44.693699  3014 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.706929  3118 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:44.691633  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 50734.5us
I20260709 12:58:44.715783  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.723783  2978 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:44.727456  3071 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:44.728080  2978 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:44.729662  3071 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:44.730908  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.731364  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.731665  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.732065  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.733081  1572 raft_consensus.cc:2410] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:58:44.733409  1564 raft_consensus.cc:2368] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3.
I20260709 12:58:44.734754  1566 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:44.735118  3061 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:44.737766  3061 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:44.740687  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.741452  1572 raft_consensus.cc:2393] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 12:58:44.742789  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 52360.2us
I20260709 12:58:44.744345  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.745595  2405 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:44.746881  3159 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:44.747488  3159 raft_consensus.cc:697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:44.747244  3018 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.748914  3159 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:44.751223  3122 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:44.752666  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.751641  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.753803  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:44.754575  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.756773  1685 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:44.758096  3106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93b49f668f7487dad07043590a5616f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:44.769802  1567 raft_consensus.cc:1275] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:44.770665  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.772909  3061 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:44.772825  3102 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.778885  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:44.783413  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:44.788264  3118 consensus_queue.cc:1059] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:44.790251  2982 raft_consensus.cc:3055] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:44.790758  2982 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:44.791675  2982 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:44.793262  2982 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:44.793799  3102 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:44.794479  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.795127  1645 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:44.795595  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.789532  3118 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:44.796247  1644 raft_consensus.cc:2376] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3. Re-sending same reply.
I20260709 12:58:44.798417  3061 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:44.798979  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.802315  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.804714  2406 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:44.761349  3119 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:44.806481  3061 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:44.806892  3061 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:44.807301  3061 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:44.808255  3119 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:44.809551  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:44.815433  3106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45120 (request call id 100) took 3125 ms. Trace:
W20260709 12:58:44.816425  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 60570.4us
I20260709 12:58:44.816102  3106 rpcz_store.cc:276] 0709 12:58:41.832875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.866846 (+ 33971us) service_pool.cc:224] Handling call
0709 12:58:43.204843 (+1337997us) ts_tablet_manager.cc:934] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
0709 12:58:44.756056 (+1551213us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:58:44.777625 (+ 21569us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:44.777765 (+   140us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:58:44.814472 (+ 36707us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:58:44.814822 (+   350us) tablet_replica.cc:206] Creating consensus instance
0709 12:58:44.815193 (+   371us) ts_tablet_manager.cc:989] Replica registered.
0709 12:58:44.815328 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":407,"tablet-copy.queue_time_us":590124,"thread_start_us":612155,"threads_started":2}
I20260709 12:58:44.818218  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.818993  3106 tablet_copy_client.cc:806] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:44.819764  3106 tablet_copy_client.cc:670] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:44.758677  3018 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:44.825870  1470 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 2 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:44.817397  3102 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:44.830668  2406 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.831180  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.832310  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.831184  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.831820  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.834651  1639 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:44.844928  1647 raft_consensus.cc:2376] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2. Re-sending same reply.
I20260709 12:58:44.845741  1645 raft_consensus.cc:2410] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:44.817433  1685 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:44.843165  3102 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:44.849365  1470 catalog_manager.cc:5697] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193), VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194), VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195), NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 12:58:44.849810  1536 leader_election.cc:336] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.595s (SENT)
I20260709 12:58:44.854734  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.854849  2406 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:44.855630  2951 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:44.855736  3119 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:44.856158  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:44.850127  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.850759  3102 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:44.850140  3159 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:44.859556  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.860045  3061 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:44.858894  2406 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:44.861222  3159 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:44.861611  3159 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:44.858350  3119 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:44.862491  3061 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:44.863319  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.861991  3159 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:44.864952  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.864930  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 199005us
I20260709 12:58:44.864668  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:44.854027  1470 catalog_manager.cc:5697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:44.869650  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 52297.8us
I20260709 12:58:44.865953  3018 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:44.870750  3018 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:44.871193  3018 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:44.872690  1685 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:44.873675  1686 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.874223  3014 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.874655  2978 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.874853  3014 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:44.875263  2978 raft_consensus.cc:697] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:44.876134  3014 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.876283  2978 consensus_queue.cc:237] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.882212  1685 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.882480  2406 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.884367  1685 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:44.883335  3122 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:44.883183  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.888365  3160 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:44.889425  3122 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.890177  1685 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:44.890623  3122 raft_consensus.cc:697] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:44.891769  3108 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:44.892194  3108 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.893134  3108 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.892154  3122 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.894960  1686 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.889144  3160 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:44.899713  2406 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:44.901844  3071 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:44.904363  3156 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.905083  3156 raft_consensus.cc:697] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:44.906188  3156 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:44.911509  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 64881us
I20260709 12:58:44.916102  3108 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:44.917014  1686 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.919596   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:44.920977  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.922418  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.923254  1639 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:44.925051  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.927426  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.931192  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:44.931275  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.932483  1644 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.933049  1685 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:44.928972  2448 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:44.926276  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:44.935554  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.909857  3160 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:44.937399  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:44.918576  3061 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:44.942400  1668 debug-util.cc:398] Leaking SignalData structure 0x7b080025d7c0 after lost signal to thread 434
W20260709 12:58:44.943727  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff4a0 after lost signal to thread 1504
W20260709 12:58:44.944103  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08002637c0 after lost signal to thread 1518
I20260709 12:58:44.944186  3097 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:58:44.945557  1668 debug-util.cc:398] Leaking SignalData structure 0x7b080023f9c0 after lost signal to thread 1596
W20260709 12:58:44.945869  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08000bd040 after lost signal to thread 1597
I20260709 12:58:44.953397  2448 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:44.931021  3014 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:58:44.957876  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.975376  1668 debug-util.cc:398] Leaking SignalData structure 0x7b0800156a00 after lost signal to thread 1671
W20260709 12:58:44.975986  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 49860.7us
I20260709 12:58:44.959462  3108 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:44.938597  2982 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:44.968040  1686 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:44.971496  1685 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:44.977000  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:44.977104  1644 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
W20260709 12:58:44.979732  1668 debug-util.cc:398] Leaking SignalData structure 0x7b0800347300 after lost signal to thread 1745
W20260709 12:58:44.983191  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08003681c0 after lost signal to thread 2477
I20260709 12:58:44.955099  3061 raft_consensus.cc:697] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:44.984836  3097 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:58:44.972441  2978 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:44.994293  2978 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:44.994740  2978 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:44.999328  3140 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:45.001878  3140 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:45.004060  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:44.967414  3168 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:45.005573  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:58:45.013584  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 45607.9us
I20260709 12:58:45.014707  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:45.002318  3140 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:45.022676  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.009846  3141 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:45.012868  3126 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:45.035632  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 113394us
I20260709 12:58:45.014735  3168 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:45.031554  3156 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:45.054246  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.055721  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.001958  3061 consensus_queue.cc:237] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:45.035195  3102 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:45.073673  3165 log.cc:927] Time spent T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:58:45.078717  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 64093.6us
I20260709 12:58:45.083065  1686 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:45.066397  3156 raft_consensus.cc:697] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:45.070137  3119 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:45.091305  3102 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:45.092222  3108 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:45.096093  3168 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.099896  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:45.101706  1686 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:45.102702  3177 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:45.106400  3169 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:45.138768  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 50723.9us
I20260709 12:58:45.128366  3169 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:45.143478  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 43673us
I20260709 12:58:45.117344  3108 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:45.111304  3018 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.156702  3018 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:45.171353  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:45.143172  2951 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:45.153646  3167 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:45.162637  3097 consensus_queue.cc:1059] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:58:45.145784  3169 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:45.164968  3108 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:45.128458  3160 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.183995  1721 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:45.128300  3159 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:45.185865  1612 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:45.173707  3126 consensus_queue.cc:1059] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:58:45.176222  2951 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:45.190992  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 219644us
I20260709 12:58:45.175274  3167 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:45.206271  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:45.188597  3141 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:45.203815  3167 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:45.204471  3118 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:45.195828  2951 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:45.219337  3061 consensus_queue.cc:1059] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:45.220611  3061 raft_consensus.cc:3055] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:45.221007  3061 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:45.223176  3061 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:45.224591  3061 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:45.233081  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 54838.4us
W20260709 12:58:45.236538  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 134885us
I20260709 12:58:45.241953  3160 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:45.198482  3156 consensus_queue.cc:237] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.246775  3141 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:45.247825  1685 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:45.249897  3182 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:45.250303  3182 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.250641  3182 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:45.263890  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 57706.3us
I20260709 12:58:45.266199  1685 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:45.269069  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:45.270690  1612 leader_election.cc:400] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3.
I20260709 12:58:45.272955  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:45.237862  3185 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:58:45.287081  1686 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:45.287742  3175 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:45.288920  3175 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:45.290266  3177 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:45.291229  3177 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:45.274171  3126 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:45.296658  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.302642  3159 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:45.302954  3140 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:45.304378  2951 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.305291  3140 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:45.306835  2951 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:45.307049  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:45.307245  3118 raft_consensus.cc:3055] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:45.307719  3118 raft_consensus.cc:740] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:45.308646  3118 consensus_queue.cc:260] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.295172  2978 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.316365  2978 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:45.278162  3119 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:45.318514  3122 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:45.319856  1686 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:45.321869  3160 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:45.322330  3160 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:45.322713  3160 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:45.322578  2978 consensus_queue.cc:1059] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:45.323851  2978 raft_consensus.cc:3055] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:45.324198  2978 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:45.325139  2978 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:45.329624  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.330462  1567 raft_consensus.cc:2376] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3. Re-sending same reply.
I20260709 12:58:45.330546  2951 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:45.331144  2436 raft_consensus.cc:1240] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:45.331089  2951 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:45.333170  1612 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:45.309900  3118 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:45.336850  1612 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:45.274844  3108 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:45.337527  3126 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:45.337363  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:45.341137  1685 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:45.332752  3097 raft_consensus.cc:3055] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:45.317498  3119 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:45.344691  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 45935.6us
I20260709 12:58:45.348062  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.348795  3140 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:45.335454  2951 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:45.350752  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.352002  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:45.355273  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:45.356246  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:45.363349  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.364189  1572 raft_consensus.cc:2393] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:45.367873  2405 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:45.368986  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.369907  1567 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:45.370357  2405 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:45.350170  3182 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.363163  3191 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:45.344863  3097 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:45.373517  3097 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.374938  3097 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:45.376684  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.378300  3194 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:45.378919  3194 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:45.381225  3194 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:45.382191  3187 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:45.354216  2978 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:45.383955  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.384056  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.366956  3141 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:45.366194  3122 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:45.387264  3122 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:45.387828  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.388336  3122 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.391055  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:45.391984  2438 raft_consensus.cc:2393] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
W20260709 12:58:45.394692  3186 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:58:45.393595  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.416653  1565 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:58:45.421236  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 50939.1us
I20260709 12:58:45.422392  2405 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:45.422392  1567 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:45.381850  3194 consensus_queue.cc:1059] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:58:45.426947  3176 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:45.427263  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.430987  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:45.432946  3071 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:45.433704  3071 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:45.434233  3071 raft_consensus.cc:697] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:45.434333  3190 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:45.434880  3190 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.435187  3169 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.436645  3106 tablet_copy_client.cc:538] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:45.435364  3071 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:45.439762  1643 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:45.444756   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:45.404428  3061 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:58:45.453066  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.458225  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.465606  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.435273  3190 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:45.465667  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:45.478248  3174 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:45.482249  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:45.483254  1716 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:45.438002  3169 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:45.492587  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:45.493410  1716 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:45.492327  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:45.494596  3108 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:45.471388  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.466276  2440 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:45.547276  1716 raft_consensus.cc:1240] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:45.555552  1721 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
W20260709 12:58:45.557631  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 76074.5us
W20260709 12:58:45.558982  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 115778us
I20260709 12:58:45.572655  1721 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:45.579427  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:45.533591  3167 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.580549  1644 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
I20260709 12:58:45.586247  1716 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: [1.2-3.3]
W20260709 12:58:45.592283  3184 log.cc:927] Time spent T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:58:45.594702  3141 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.595319  3141 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.603593  1572 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:45.604190  1572 pending_rounds.cc:85] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 1
I20260709 12:58:45.604470  1572 pending_rounds.cc:107] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:45.604944  1572 raft_consensus.cc:2889] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:45.614167  3160 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.615463  3182 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:45.616674  3160 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:45.617396  3167 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:45.580528  3119 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:45.618585  3118 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.619237  3118 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.622125  3118 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:45.623514  1716 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:45.604315  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:45.651793  1713 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
W20260709 12:58:45.652345  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 48206.8us
I20260709 12:58:45.654345  3061 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:45.654851  3061 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:45.655267  3061 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:45.656212  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:45.657052  1721 raft_consensus.cc:1240] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:45.657560  1572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:45.658411  1572 raft_consensus.cc:606] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:45.658782  1718 raft_consensus.cc:1275] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:45.658854  1572 raft_consensus.cc:614] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:58:45.674182  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.681696  1715 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:45.682526  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 329097us
W20260709 12:58:45.685273  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 55283.3us
I20260709 12:58:45.685662  1712 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:45.682785  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:45.694844  1718 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:45.698242  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:45.711186  1719 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:45.711544  1644 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:45.711404  1717 raft_consensus.cc:1240] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:45.713268  1642 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:45.705019  1611 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:45.658128  3141 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:45.674170  3206 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.725472  3206 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:45.623569  3190 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.723332  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:45.673884  3119 consensus_queue.cc:1059] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:58:45.734069  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:45.734404  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:45.730396  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:45.732324  1646 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:45.730553  1611 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:45.731266  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:45.736682  1638 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:45.689426  3118 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:45.724351  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 153615us
I20260709 12:58:45.731688  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:45.742646  1641 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:45.724098  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:58:45.737049  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 173026us
I20260709 12:58:45.746212  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:45.751262  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:45.752027  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:45.752043  1611 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:45.725854  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:45.759416  1718 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:45.760876  1713 raft_consensus.cc:1240] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:45.760941  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:45.774111  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:45.775203  1644 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:45.774984  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:45.728143  3187 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:45.728981  3189 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:45.738034  3126 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:45.773229  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:45.782208  1716 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:45.782379  1719 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:45.786550  3183 consensus_queue.cc:1059] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:58:45.749583  3159 raft_consensus.cc:3055] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:45.788257  3159 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:45.789547  3159 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:45.790693  1720 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:45.791311  3159 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:45.794064  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:45.795507  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:45.797343  1717 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:45.755601  3141 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:45.901418  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:45.902817  1645 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:45.903396  1645 pending_rounds.cc:85] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 1
I20260709 12:58:45.903640  1645 pending_rounds.cc:107] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:45.903970  1645 raft_consensus.cc:2889] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:45.854202  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:58:45.858870  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 88152.6us
I20260709 12:58:45.908097  3202 consensus_queue.cc:1059] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.171s
I20260709 12:58:45.798498  3169 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:45.726492  2951 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:45.869032  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 108168us
I20260709 12:58:45.755139  3118 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.757208  3191 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:45.853325  1721 raft_consensus.cc:2393] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:45.858892  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:45.898167  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:45.938849  1572 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:45.939224  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.939815  1571 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:45.940986  1567 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:45.862931  3189 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:45.914191  1647 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:45.942297  3185 raft_consensus.cc:3055] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:45.942771  3185 raft_consensus.cc:740] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:45.943771  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.942780  3214 raft_consensus.cc:2764] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:58:45.946432  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.947110  1567 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:45.914974  3126 consensus_queue.cc:1059] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:58:45.951408  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.952282  1564 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:45.952924  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.852447  2982 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:45.941769  3191 consensus_queue.cc:1059] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:45.933666  3167 consensus_queue.cc:1059] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:45.952715  3126 consensus_queue.cc:1059] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:45.958662  3106 tablet_bootstrap.cc:492] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:58:45.959424  3014 raft_consensus.cc:3055] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:45.960016  1566 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:45.943764  3185 consensus_queue.cc:260] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:45.918172  3141 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:45.971045  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 46403.9us
I20260709 12:58:45.978658  1567 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:45.998757  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.999446  1565 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:45.909296  3119 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
W20260709 12:58:45.982473  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.984019  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.972726  3194 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:45.980377  1571 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:46.021978  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:46.022524  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:45.941145  3169 raft_consensus.cc:697] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:45.911834  3156 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:58:46.017542  1572 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:45.993347  1715 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:58:45.989235  3014 raft_consensus.cc:740] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:45.851999  3187 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:46.006510  1563 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:46.030720  3108 raft_consensus.cc:3055] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:46.030975  3194 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.014430  2440 raft_consensus.cc:1240] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:46.027868  2438 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:46.046749  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 115906us
I20260709 12:58:46.049965  1686 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.006136  2982 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.063957  1572 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:46.012410  3141 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.044142  3185 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:46.077003  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.078261  1572 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:58:46.078867  1572 pending_rounds.cc:85] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 4
I20260709 12:58:46.079181  1572 pending_rounds.cc:107] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:58:46.079521  1572 raft_consensus.cc:2889] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:46.043926  3108 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:46.091174  1572 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:46.090363  1685 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:46.096848  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:46.094027  3160 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:58:46.097934  1566 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 2: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:46.098377  3226 raft_consensus.cc:3055] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:58:46.106938  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 57091.4us
I20260709 12:58:46.108136  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.109676  1686 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.098806  3226 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:46.094532  3182 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:46.105947  3175 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:46.124404  3223 raft_consensus.cc:3055] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:46.124895  3223 raft_consensus.cc:740] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:46.118801  3191 raft_consensus.cc:3055] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:46.132694  3191 raft_consensus.cc:740] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:46.134950  2406 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:46.138675  2406 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:46.142377  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.150429  3119 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:46.151430  3119 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:46.152164  3119 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:46.145756  3202 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:46.153290  3202 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.154263  1639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:47230
I20260709 12:58:46.155047  1639 raft_consensus.cc:606] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:58:46.125819  3219 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:58:46.149228  1686 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.117343  3168 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:46.133720  3214 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.183619  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.126214  3225 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.192857  1645 raft_consensus.cc:1275] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:46.126343  3226 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:46.196794  1639 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:46.156546  3097 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.200743  1646 raft_consensus.cc:1240] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:46.094908  3014 consensus_queue.cc:260] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:46.205101  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.202939  1642 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:46.216022  1642 pending_rounds.cc:85] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 1
I20260709 12:58:46.216279  1642 pending_rounds.cc:107] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:46.216511  1642 raft_consensus.cc:2889] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:46.207804  1646 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:46.208118  3206 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:46.209046  3189 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:46.210603  3190 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.210707  1565 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:46.179945  2951 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:46.214702  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 65570.4us
W20260709 12:58:46.199208  3061 consensus_meta.cc:287] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.543s	user 0.018s	sys 0.001s
I20260709 12:58:46.224511  1643 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:46.229101  1641 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:46.185985  3175 raft_consensus.cc:697] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:46.192495  3118 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:46.239483  3211 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:58:46.240378  3187 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:46.210855  3202 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.206342  3188 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:46.242115  3222 log.cc:927] Time spent T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:58:46.133132  3223 consensus_queue.cc:260] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.243137  3223 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.139343  3108 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.245332  3108 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:46.248903  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:46.250699  1642 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:58:46.253834  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:46.259414  1686 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.260128  1643 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:46.202931  3182 raft_consensus.cc:697] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:58:46.264056  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 59058.8us
I20260709 12:58:46.264959  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:46.265035  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.265799  1638 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:46.261548  1646 raft_consensus.cc:2393] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:46.262524  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:46.268916  1572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:46.246464  3232 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.232622  3206 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:46.274617  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 134649us
I20260709 12:58:46.223454  3156 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.180445  3169 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:46.234637  3189 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.282313  1686 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.215730  3097 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:46.285979  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 375989us
I20260709 12:58:46.272183  3014 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:46.292946  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:46.296839  1643 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:46.194466  3214 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.271572  3202 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.236964  3061 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:46.283856  3168 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.306491  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.292034  2982 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:46.310263  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:46.292714  3221 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 12:58:46.284169  3188 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:46.311113  1686 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.191179  3191 consensus_queue.cc:260] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.304000  3190 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.289613  3194 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.318569  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.303812  2951 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:46.302799  3141 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.284889  3206 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.294852  3189 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.329222  3236 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.330957  3061 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:46.332294  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:46.334625  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.335798  3242 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.337646  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.313292  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:46.338359  3225 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.339097  3234 consensus_queue.cc:1059] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:46.340703  3237 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:46.341711  3182 consensus_queue.cc:237] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.344025  3097 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:46.325300  3168 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:46.284548  3232 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.366600  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:46.367136  3202 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.368052  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:46.374481  3239 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.375685  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:46.376471  3224 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:58:46.378238  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 76500.4us
I20260709 12:58:46.322633  3122 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:58:46.392362  3141 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.411123  1611 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:46.400216  3159 consensus_meta.cc:287] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.006s
I20260709 12:58:46.327980  3190 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:46.412525  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 46060.1us
I20260709 12:58:46.322479  3188 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.327230  2982 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:58:46.418370  2443 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:46.419459  1564 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:58:46.429425  1567 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:58:46.412081  3097 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:46.405829  3168 raft_consensus.cc:697] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:46.398757  3160 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:58:46.431700  3229 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:46.439849  3188 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.440197  3126 consensus_queue.cc:1059] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:46.422906  3140 consensus_queue.cc:1059] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:58:46.442800  3190 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.354954  3175 consensus_queue.cc:237] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.423002  3214 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.419597  3061 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:46.456193  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 74860.2us
I20260709 12:58:46.414129  3234 consensus_queue.cc:1059] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
W20260709 12:58:46.459381  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 54725us
I20260709 12:58:46.460368  1536 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.366680  3236 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:46.366951  3242 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.421088  3141 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.471557  1572 raft_consensus.cc:606] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.487706  1572 raft_consensus.cc:614] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:46.427909  3177 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 12:58:46.494699  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 76503.3us
I20260709 12:58:46.476030  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:46.478368  3241 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:46.482381  3206 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.482998  3234 raft_consensus.cc:3055] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:46.483726  3244 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:58:46.484910  3189 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.490038  3240 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:58:46.492087  3238 raft_consensus.cc:3055] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:46.496279  1611 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:58:46.507400  1612 leader_election.cc:336] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.570s (SENT)
I20260709 12:58:46.524147  1612 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:46.512233  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.517421  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:46.517328  3168 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.530263  3118 raft_consensus.cc:3055] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:46.530776  3118 raft_consensus.cc:740] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:46.518724  3141 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.459671  3225 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:58:46.498808  3185 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:46.533684  2448 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:58:46.535306  3237 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:46.473927  3181 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.153s
I20260709 12:58:46.509572  3140 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:46.510426  3097 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:46.505127  3159 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:46.502540  3241 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.508219  3234 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:46.523729  3238 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:46.459079  3229 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.474339  3061 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:46.542454  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:46.550361  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 54152us
I20260709 12:58:46.548985  1686 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:46.549502  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:46.559453  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 52087.6us
I20260709 12:58:46.564646  1536 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.566895  1536 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.566877  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:46.565196  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:46.567982  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.569130  1686 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.570825  1686 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.573455  1686 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.541123  3232 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.576712  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:46.582361  1643 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:46.588409  1536 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.558969  3241 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:46.583983  3061 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.584503  3209 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:46.577279  3224 consensus_queue.cc:1059] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:58:46.541481  3160 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:58:46.585453  3234 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.586227  1639 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:46.563297  3141 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.556373  3240 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:58:46.587114  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.563843  3159 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:46.687808  3224 raft_consensus.cc:3055] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:46.688323  3224 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:46.531679  3118 consensus_queue.cc:260] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.593245  3188 raft_consensus.cc:2764] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:58:46.594854  3217 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:46.594758  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.595527  3190 consensus_queue.cc:1059] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:46.600318  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:46.609609  1564 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:46.610574  1568 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:46.611406  1570 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:46.612735  1571 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:46.614084  1569 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:46.575491  3214 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:46.590546  3253 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:46.579546  3169 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:46.712924  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 118275us
I20260709 12:58:46.648268  3252 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:46.578172  3175 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:46.592088  3185 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:46.597575  3225 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:46.725045  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:46.677211  3238 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.621274  3181 consensus_queue.cc:1059] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
W20260709 12:58:46.681354  1612 leader_election.cc:336] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.789s (SENT)
I20260709 12:58:46.601384  3174 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:58:46.691114  3234 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:46.691367  3224 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.694042  3242 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.712769  3097 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:46.695997  1563 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:46.703208  3241 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.712332  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:46.714841  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:46.706936  3188 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.563047  3140 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.706666  2436 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:46.725488  3168 consensus_queue.cc:1059] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:58:46.713135  3253 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:46.744022  3216 raft_consensus.cc:3055] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:46.709179  3217 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.694234  3119 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:46.751840  1638 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
I20260709 12:58:46.767019  3242 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:46.757572  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 76266.4us
I20260709 12:58:46.714010  3202 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:46.766036  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 51278.5us
I20260709 12:58:46.725739  3159 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.727288  3206 consensus_queue.cc:1059] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
W20260709 12:58:46.773526  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 56500.4us
I20260709 12:58:46.770537  3252 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:46.764220  3238 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:46.753919  3224 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:46.725948  2951 consensus_queue.cc:1059] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:58:46.726852  3239 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:58:46.779457  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:46.770242  3185 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:46.774125  3216 raft_consensus.cc:740] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 12:58:46.806414  3256 log.cc:927] Time spent T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:58:46.806782  3216 consensus_queue.cc:260] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.808561  3159 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:46.801052  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.774353  3253 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:46.779632  1612 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.837s (SENT) [suppressed 51 similar messages]
I20260709 12:58:46.777618  3217 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:46.770385  3188 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.817420  3169 raft_consensus.cc:697] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:46.819211  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:46.835933  2951 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:46.836546  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:46.837476  2951 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:46.824929  3241 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.829419  1572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a057e47a0fca4295957540c192996970"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:46.809662  3159 raft_consensus.cc:697] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:46.833379  3237 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:46.837548  3181 raft_consensus.cc:3055] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:46.838873  1572 raft_consensus.cc:606] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:46.849960  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:58:46.849509  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.856343  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:46.857559  1572 raft_consensus.cc:614] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:46.805209  3202 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.858045  1569 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:46.858692  1571 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:46.861419  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:46.780669  3119 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:46.864543  1571 raft_consensus.cc:2368] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3.
I20260709 12:58:46.848594  3118 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:46.882975  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.847653  3160 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:58:46.838687  3140 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.866086  1570 raft_consensus.cc:1275] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:46.859983  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:46.850615  3241 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.839206  3102 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:58:46.847193  3108 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:58:46.867245  3202 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.825250  3190 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:46.845047  3182 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:58:46.839740  3159 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:46.910485  3254 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:58:46.875470  3097 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:46.911386  3119 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.849603  3189 raft_consensus.cc:3055] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:46.878486  3252 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.850781  2951 raft_consensus.cc:697] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:46.834697  3185 raft_consensus.cc:3055] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:46.845999  1564 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:46.921358  3216 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:46.921839  3102 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:46.918660  3185 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:46.922302  3102 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:46.923144  3185 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.923241  3102 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:46.924490  3185 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:46.902688  3241 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.857373  3181 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:46.926705  3181 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:46.926877  2951 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:46.927562  3226 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:46.883184  3225 raft_consensus.cc:697] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:46.846702  3122 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:58:46.793810  3242 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:46.910248  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:46.877681  1569 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:46.913702  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:46.934414  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:46.935048  1569 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:46.916905  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:46.908560  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 56662.4us
I20260709 12:58:46.914173  3189 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:46.920236  3188 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.921623  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:46.888657  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:46.939718  1571 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
W20260709 12:58:46.905138  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 125547us
I20260709 12:58:46.931048  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:46.848306  3210 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:58:46.924594  3102 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:46.943918  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:46.941288  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:46.944448  1571 raft_consensus.cc:1240] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:46.942421  1563 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: [1.2-3.3]
I20260709 12:58:46.945412  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:46.934429  3175 raft_consensus.cc:697] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:46.950711  3175 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:46.940721  1572 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:46.952867  1570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:46.953908  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:46.954510  1571 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:46.955157  1570 raft_consensus.cc:606] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:46.955549  1570 raft_consensus.cc:614] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:58:46.960553  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.964761  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:46.965745  1569 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:46.926913  3241 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:46.971405  1571 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:46.982028  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:46.983103  1570 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:46.986421  1569 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:46.990562  1638 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:46.910125  3264 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.120s
I20260709 12:58:46.992601  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:46.993515  1571 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:46.954583  1564 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:47.003245  1638 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:47.003682  1638 pending_rounds.cc:85] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 1
I20260709 12:58:47.003901  1638 pending_rounds.cc:107] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:47.004163  1638 raft_consensus.cc:2889] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:46.990643  3242 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:47.008047  3119 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.013911  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:47.012639  1571 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:46.946501  3169 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.019598  1569 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:47.028071  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 86206.9us
I20260709 12:58:47.040483  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:47.000496  3255 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:58:47.010628  3225 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:47.045421  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:46.993902  3189 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.027096  1563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:47.046658  1571 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:47.049063  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.050930  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.054153  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.058986  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:47.060231  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.061167  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.036859  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:47.063935  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.064859  1713 raft_consensus.cc:1240] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.065711  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.066525  1720 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:47.021552  3119 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:47.068980  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.066594  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.070281  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.070921  1638 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:47.071342  1638 pending_rounds.cc:85] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 1
I20260709 12:58:47.071652  1638 pending_rounds.cc:107] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:47.071452  1718 raft_consensus.cc:2393] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:47.072152  1638 raft_consensus.cc:2889] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:47.038764  3239 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 12:58:47.064949  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.075073  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:47.076263  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.077311  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.064471  1563 raft_consensus.cc:606] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:47.076851  1712 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:47.076896  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.078503  1713 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:47.075150  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:47.069114  2982 raft_consensus.cc:3055] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:47.082926  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.083264  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.083630  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.082602  1685 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:47.084543  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:47.094592  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.101240  1569 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:47.103314  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:47.106455  1716 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.105315  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.079988  3189 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.114295  3119 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.086783  2982 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:58:47.123776  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:47.157122  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.112197  3239 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:47.163923  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.164654  1721 raft_consensus.cc:1240] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:47.172919  1715 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:58:47.175429  1718 raft_consensus.cc:2410] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:47.180948  3239 raft_consensus.cc:697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:47.182219  2405 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:47.189640  3239 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:47.190973  3246 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.595s	user 0.007s	sys 0.000s
I20260709 12:58:47.192917  3272 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.117s
I20260709 12:58:47.193984  3236 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:47.203186  3212 raft_consensus.cc:3055] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:47.185513  2982 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.230930  2982 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:47.231340  3106 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:58:47.231148  3274 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:58:47.243775  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.210621  3159 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:47.261382  3248 raft_consensus.cc:3055] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:47.219290  3212 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:47.295459  3248 raft_consensus.cc:740] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:47.313639  3212 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.314941  3212 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:47.318140  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:47.319012  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.320128  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:47.278285  3159 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.343293  3119 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.346769  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:47.345680  3159 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:47.378765  1612 leader_election.cc:336] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.197s (SENT)
W20260709 12:58:47.380213  1612 leader_election.cc:336] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.243s (SENT)
I20260709 12:58:47.380736  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:58:47.381191  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 61183.5us
I20260709 12:58:47.382872  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:47.387248  1612 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:47.389130  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:47.406150  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:47.406183  3273 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:58:47.393359  3071 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:47.403091  3230 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:47.417444  1612 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:47.394193  3242 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:58:47.411687  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 289734us
I20260709 12:58:47.416080  1716 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:47.405015  3226 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.413854  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.417642  3241 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:47.435029  1612 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:47.407178  3238 consensus_queue.cc:1059] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:58:47.422526  3230 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.440567  3160 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:47.441519  1714 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:47.427259  3140 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:47.425583  3242 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.438635  3241 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:47.459497  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.459674  1717 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:47.444480  3230 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.447288  3252 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:58:47.451368  3140 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:47.473620  3140 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.453343  3242 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.487495  3243 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:47.488165  3243 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.488631  3243 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:47.487617  3102 consensus_meta.cc:287] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.534s	user 0.013s	sys 0.014s
W20260709 12:58:47.489668  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.489965  3230 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.492748  3230 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.461333  3241 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:47.497340  3106 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:58:47.499586  3106 tablet_bootstrap.cc:492] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260709 12:58:47.500886  3106 tablet_bootstrap.cc:492] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:58:47.448279  3167 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:58:47.506896  2978 raft_consensus.cc:3055] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:47.507570  2978 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:47.458271  3229 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.510753  3229 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:47.511547  3229 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.509696  3188 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:58:47.509662  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:47.517508  3014 raft_consensus.cc:3055] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:47.518095  3014 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:47.518976  3281 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:47.521034  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 70351.1us
I20260709 12:58:47.524263  3248 consensus_queue.cc:260] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:47.528559  3188 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:47.531708  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:58:47.538511  3118 consensus_meta.cc:287] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.652s	user 0.008s	sys 0.014s
W20260709 12:58:47.540046  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.543179  3191 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.545413  1611 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:47.552253  2443 raft_consensus.cc:1240] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:47.562551  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:47.551079  3106 ts_tablet_manager.cc:1403] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 1.544s	user 0.039s	sys 0.030s
W20260709 12:58:47.568243  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 133267us
W20260709 12:58:47.570448  3289 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 12:58:47.562333  3185 consensus_meta.cc:287] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.004s
W20260709 12:58:47.575270  3253 consensus_meta.cc:287] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.755s	user 0.018s	sys 0.006s
W20260709 12:58:47.597240  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.561800  3216 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:58:47.612721  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:47.622449  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:47.519133  3014 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.579234  2951 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:47.617715  3229 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:47.620170  3234 consensus_meta.cc:287] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.840s	user 0.011s	sys 0.005s
I20260709 12:58:47.630266  3236 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.617874  3119 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.631724  3119 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:47.582968  3181 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.580374  3118 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:47.561421  3174 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:58:47.589723  3248 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:47.641593  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 71637.2us
I20260709 12:58:47.602201  3071 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.652338  3071 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:47.575986  2978 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.654503  2978 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.655030  3071 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.645499  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:47.658020  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.645663  1611 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:47.612900  3238 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.659714  3236 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:47.662839  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.663637  1720 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:58:47.672668  3119 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.673079  3106 raft_consensus.cc:359] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 3 NON_PARTICIPANT]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.603240  3253 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:47.675778  3253 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:47.676537  1640 raft_consensus.cc:1240] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.682888  2405 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:47.659966  3071 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:47.657671  3224 consensus_queue.cc:1175] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a4be9cc90aca4dd4ad7db103062a7208" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 12:58:47.644176  3118 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.683210  3234 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:47.690634  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:47.702986  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 57580.9us
I20260709 12:58:47.700917  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:47.706934  3236 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.644351  3243 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.705451  1611 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:47.694973  3234 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.695323  3253 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:47.687228  1612 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:47.707520  3236 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.718293  3253 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:58:47.719278  3288 log.cc:927] Time spent T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.229s	user 0.004s	sys 0.001s
I20260709 12:58:47.719864  3236 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.719409  3253 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.720912  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:47.721642  3217 consensus_meta.cc:287] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.887s	user 0.018s	sys 0.000s
I20260709 12:58:47.722018  3230 raft_consensus.cc:3055] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:47.722215  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:47.722554  3230 raft_consensus.cc:740] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:47.722885  3106 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:58:47.723538  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.687228  3212 consensus_queue.cc:1059] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:58:47.711810  3229 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.728843  3297 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.729585  3297 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:47.732709  3297 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.713286  2982 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:47.712358  3234 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.734654  2982 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.735083  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:47.735940  3212 raft_consensus.cc:3055] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:47.736367  3212 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:47.691716  3071 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:47.738277  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.691769  3242 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.691735  3140 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.742024  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.723989  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:47.724236  1712 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:47.687389  3119 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:47.746795  3119 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.701802  3293 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:47.747287  3119 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:47.747486  3293 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:47.748167  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:47.748927  1563 raft_consensus.cc:2376] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4. Re-sending same reply.
I20260709 12:58:47.750314  3293 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:47.750978  3071 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.723851  3217 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.692924  3241 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.723595  3230 consensus_queue.cc:260] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.726584  1612 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:47.753777  3241 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.754158  3230 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.754453  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:47.754629  3241 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:47.755091  3241 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.755438  3241 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.694684  3118 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.743985  1571 raft_consensus.cc:2376] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3. Re-sending same reply.
I20260709 12:58:47.743981  1572 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:47.744200  1720 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:58:47.751240  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:47.691612  3159 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:47.727977  1565 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:47.757970  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:47.771445  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:47.772087  1639 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:47.772686  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:47.773087  1639 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:47.773659  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:47.737293  3212 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.759443  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:47.759750  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:47.774745  1642 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.775048  3212 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.768577  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:47.760505  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:47.777292  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:47.735150  2982 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.779713  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:47.781147  1565 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
I20260709 12:58:47.782732  1563 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 2: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:47.774210  1639 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:47.783965  3159 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.784435  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:47.784760  2436 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:47.785315  1639 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:47.784754  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:47.786278  1569 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:47.777945  1641 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:47.802618  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:47.803205  1571 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.803465  1641 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:58:47.804613  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:47.753222  3234 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.766263  3293 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.807142  3234 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.809628  1563 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:47.757715  3106 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:58:47.817171  3106 ts_tablet_manager.cc:1434] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.236s	user 0.010s	sys 0.000s
I20260709 12:58:47.818984  3216 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.819630  3216 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.829232  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:47.829994  1713 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:47.830737  1570 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:47.779881  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:47.786660  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:47.831874  1644 raft_consensus.cc:2393] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 12:58:47.788062  3284 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.301s	user 0.000s	sys 0.003s
I20260709 12:58:47.792089  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:47.793394  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:47.794413  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:47.786561  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:47.795792  3242 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.797425  3140 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.810487  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:47.811808  1641 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:47.811765  1647 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.813485  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:47.813799  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:47.841315  1571 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:58:47.841717  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:47.843222  1536 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:47.844764  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:47.838636  1646 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:47.851296  1642 raft_consensus.cc:2410] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:47.848495  1647 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:47.850426  2406 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:47.827667  3234 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.858458  3234 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.860000  2440 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:47.860177  3234 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.849884  3185 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.849836  3236 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:47.854854  3071 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:47.832350  3243 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.832739  3226 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:47.869933  1571 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:58:47.865888  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 71595.8us
W20260709 12:58:47.866518  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.849699  2951 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:47.871233  1612 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:47.853968  3293 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:47.846666  3300 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.879623  1571 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:47.847358  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:47.853523  3175 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.882606  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:47.862836  3071 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.885746  2405 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:47.878865  3241 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.891391  1646 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:47.891942  1640 raft_consensus.cc:1240] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:47.867928  3159 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:47.874971  2951 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:47.903663  2951 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:47.903851  1645 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:47.902344  1657 tablet_copy_service.cc:342] P a4be9cc90aca4dd4ad7db103062a7208: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-e93b49f668f7487dad07043590a5616f received from {username='slave'} at 127.0.0.1:38584
I20260709 12:58:47.869211  3216 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.905321  1645 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:47.897104  3159 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:47.907493  3159 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.910671  1718 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:47.911221  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:47.889513  3230 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:47.905618  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:47.931308  3230 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:47.931913  1568 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:47.932736  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1157) took 1079 ms. Trace:
I20260709 12:58:47.933174  3230 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.891918  3236 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:47.948921  1646 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:47.920214  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:58:47.950897  1716 raft_consensus.cc:606] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:47.921394  3241 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.921518  1657 tablet_copy_service.cc:434] P a4be9cc90aca4dd4ad7db103062a7208: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-e93b49f668f7487dad07043590a5616f on tablet e93b49f668f7487dad07043590a5616f with peer 6f381117554e49bb816791ab0a10f2b8
W20260709 12:58:47.926211  3285 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.422s	user 0.005s	sys 0.000s
I20260709 12:58:47.927640  2978 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:47.927603  3271 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:47.928341  3287 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.432s	user 0.000s	sys 0.004s
I20260709 12:58:47.934881  3229 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:47.936646  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1166) took 1052 ms. Trace:
I20260709 12:58:47.977075  1570 rpcz_store.cc:276] 0709 12:58:46.883834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.986275 (+102441us) service_pool.cc:224] Handling call
0709 12:58:47.000441 (+ 14166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:47.831195 (+830754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.936264 (+105069us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b54000eae54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:47.936564 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1867864320}
I20260709 12:58:47.933130  1568 rpcz_store.cc:276] 0709 12:58:46.852903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.853064 (+   161us) service_pool.cc:224] Handling call
0709 12:58:47.540571 (+687507us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:58:47.905477 (+364906us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173e9c 00007f18ca173a5b 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:58:47.932601 (+ 27124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19442432}
I20260709 12:58:47.850572  3248 consensus_queue.cc:1059] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:58:47.893539  3174 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:47.892453  3071 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.967048  3188 raft_consensus.cc:993] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower 6f381117554e49bb816791ab0a10f2b8 to start an election
I20260709 12:58:47.942466  2982 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.943501  1569 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:47.936686  3119 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:47.895933  3175 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.944010  3300 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.946991  3185 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:48.012058  3212 raft_consensus.cc:1081] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Signalling peer 6f381117554e49bb816791ab0a10f2b8 to start an election
I20260709 12:58:48.012907  3119 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:47.913303  3261 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:58:47.913683  3250 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:47.871096  3226 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:47.952972  1469 catalog_manager.cc:5697] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 2 to 3, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:47.961750  1571 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:47.962271  3293 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.962863  3243 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.963395  3118 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.915308  3216 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:47.894244  3203 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:58:47.981227   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:58:47.986302  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:47.986907  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:48.073804  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:58:47.989476  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.989321  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:47.995072  1569 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:48.053534  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:48.076222  1569 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:48.061996  1647 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:48.007638  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:48.009959  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:48.020169  1571 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:58:48.017419  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:48.023032  3271 raft_consensus.cc:3055] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:48.023793  3175 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:48.089184  1640 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:48.024416  3248 raft_consensus.cc:3055] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:58:48.024994  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 109659us
I20260709 12:58:47.991966  3174 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.030990  1641 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:48.029176  1642 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:48.035553  1713 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:58:48.037858  1611 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:48.004443  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:48.097790  1717 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:48.081967  1572 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:48.016803  3291 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:48.085443  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:48.086529  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:48.028024  2978 raft_consensus.cc:3055] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:48.055822  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:48.102092  1646 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:48.043557  2982 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:48.106987  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 69238.1us
I20260709 12:58:48.112356  1646 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:48.123172  1647 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:48.081102  3217 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.025969  3210 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:58:48.082578  3253 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.082690  3242 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:48.083068  3271 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:48.136639  1611 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:48.091828  3248 raft_consensus.cc:740] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:48.137928  1572 raft_consensus.cc:1275] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:48.038987  3293 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.107431  3174 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:48.044015  3243 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.073503  3118 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.154263  1640 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:58:48.195456  1640 pending_rounds.cc:85] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 1
I20260709 12:58:48.128384  3294 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:48.105841  2978 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:48.122334  3299 raft_consensus.cc:2764] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:58:48.120157  3255 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:58:48.039412  3300 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.153713  2982 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.168215  3271 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.170337  3297 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.170490  2446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45"
dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:42636
I20260709 12:58:48.213913  2446 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:48.065471  3159 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:48.146672  3280 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.186836  3315 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.148257  1714 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:48.230890  3071 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:48.233264  3118 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.233522  3071 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:48.189105  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 301507us
I20260709 12:58:48.189778  1469 catalog_manager.cc:5697] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 3 to 5, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:48.236450  2448 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:48.236208  1469 catalog_manager.cc:5697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.191545   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:48.156109  3266 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:48.195319  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 312749us
I20260709 12:58:48.164893  3226 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.195820  1640 pending_rounds.cc:107] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
W20260709 12:58:48.214432  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.214432  2446 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:48.219452  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58252 (request call id 215) took 3435 ms. Trace:
I20260709 12:58:48.224637  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:48.208739  3294 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:48.234714  2951 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.238955  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:48.233749  3014 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:48.241079  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:48.256379  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:48.255975  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.243553  3217 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.260877  3217 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.237589  2405 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:48.199126  3236 consensus_queue.cc:1059] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:58:48.255553  1642 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:48.263427  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:48.241731  1469 catalog_manager.cc:5697] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:48.268093  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.280421  1640 raft_consensus.cc:2917] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 12:58:48.257542  1718 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:48.289808  1611 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:48.265700  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:48.290887  3234 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.229532  3315 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:48.242939  3243 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.217017  2982 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.336803  1640 raft_consensus.cc:2889] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:48.339148  1536 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:48.340848  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:48.236649  3280 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.376024  2951 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.229600  2978 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.376673  3217 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.369975  3236 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:48.377610  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38580 (request call id 3) took 13319 ms. Trace:
I20260709 12:58:48.378389  3314 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:48.378716  3317 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:58:48.379249  3283 log.cc:927] Time spent T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.893s	user 0.002s	sys 0.003s
I20260709 12:58:48.379361  3317 raft_consensus.cc:697] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:48.243690  3210 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:58:48.257022  3266 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.436089  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:48.439648  3216 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:48.378986  3314 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:48.434263  3250 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.433809  3317 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:48.437682  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:48.299744  3118 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:48.488691  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:48.489563  1571 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:48.290217  3297 consensus_queue.cc:1059] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:58:48.494195  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:48.494941  1572 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:48.493444  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 154375us
I20260709 12:58:48.500814  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:48.503537  1536 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:48.503688  1569 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:48.505260  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:48.506852  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:48.507380  1644 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:58:48.508090  1569 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:48.308825  3234 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.511539  3234 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.512148  3297 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.512669  3297 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.515334  3294 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:48.515602  2982 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.517056  3314 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:48.517904  3316 raft_consensus.cc:3055] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:48.491946  3250 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.518417  3316 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:48.517939  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1274) took 1552 ms. Trace:
I20260709 12:58:48.520404  1715 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:48.502440  1717 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:48.286098  1469 catalog_manager.cc:5697] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.523487  1469 catalog_manager.cc:5697] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 2 to 3, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.534387  1642 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:58:48.380733  1640 rpcz_store.cc:276] 0709 12:58:35.104641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.109760 (+  5119us) service_pool.cc:224] Handling call
0709 12:58:35.296067 (+186307us) log.cc:844] Serialized 506 byte log entry
0709 12:58:35.785724 (+489657us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b180021af00. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca125c0a 00007f18d3865219 00007f18ca1ada40 00007f18ca1a84e4 00007f18ca1a8455 00007f18cd1f1b0b 00007f18cd276b63 00007f18cd29e752 00007f18d225ed29
0709 12:58:35.919602 (+133878us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b54001da220. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd211142 00007f18cd1f1eaa 00007f18cd1f8d53 00007f18cd1f8cd9 00007f18cd1f8c69 00007f18cd1f8c31 00007f18cd1f7dfd 000000000038f354 000000000038f199 00007f18ca1ab475
0709 12:58:48.377463 (+12457861us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85796,"raft.queue_time_us":148809,"raft.run_cpu_time_us":3361,"raft.run_wall_time_us":156099,"spinlock_wait_cycles":89388032,"thread_start_us":341983,"threads_started":1,"wal-append.queue_time_us":375283,"wal-append.run_cpu_time_us":3602,"wal-append.run_wall_time_us":1186347}
I20260709 12:58:48.526024  1469 catalog_manager.cc:5697] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.519395  3316 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:48.515334  3159 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:48.556209  3312 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:58:48.520905  1643 rpcz_store.cc:276] 0709 12:58:46.945421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.945568 (+   147us) service_pool.cc:224] Handling call
0709 12:58:46.945869 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:46.949011 (+  3142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:46.949048 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:46.949502 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 12:58:47.384293 (+434791us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:47.384368 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.384486 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:48.246231 (+861745us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:58:48.492523 (+246292us) raft_consensus.cc:1685] finished
0709 12:58:48.492549 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.497597 (+  5048us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178,"raft.queue_time_us":934,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":361,"spinlock_wait_cycles":166186752,"thread_start_us":389504,"threads_started":1,"wal-append.queue_time_us":455270}
I20260709 12:58:48.491156  3118 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:48.492342  3217 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.486806  2951 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:48.588577  3306 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.711s	user 0.005s	sys 0.000s
W20260709 12:58:48.616401  1568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.032s	sys 0.010s
W20260709 12:58:48.616904  1568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.033s	sys 0.010s
I20260709 12:58:48.378185  3236 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.579358  1640 pending_rounds.cc:107] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:58:48.619211  1640 raft_consensus.cc:2889] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:48.578045  1571 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:58:48.580106  1572 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:48.589973  3316 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:48.626206  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:48.631191  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:48.633172  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:48.634472  1571 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:48.590734  2446 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:48.608501  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.607367  3118 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:48.611325  3315 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.227988  3248 consensus_queue.cc:260] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:48.613579  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:48.615129  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 111715us
I20260709 12:58:48.590516  3159 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:58:48.594036  3294 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:48.627460  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:48.624383  3293 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.639941  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:48.647877  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:48.659973  1643 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:48.618301  3314 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.622032  3234 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:48.661933  1645 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.018s	sys 0.035s
I20260709 12:58:48.622016  3212 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:48.650353  3300 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.256457  1470 rpcz_store.cc:276] 0709 12:58:44.765688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.765912 (+   224us) service_pool.cc:224] Handling call
0709 12:58:48.200680 (+3434768us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:44.959140 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:44.960205 (+  1065us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:44.960284 (+    79us) write_op.cc:435] Acquired schema lock
0709 12:58:44.960318 (+    34us) tablet.cc:662] Decoding operations
0709 12:58:44.961462 (+  1144us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:44.961629 (+   167us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:44.961672 (+    43us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:58:45.004578 (+ 42906us) tablet.cc:701] Row locks acquired
0709 12:58:45.017533 (+ 12955us) write_op.cc:260] PREPARE: finished
0709 12:58:45.034523 (+ 16990us) write_op.cc:270] Start()
0709 12:58:45.066774 (+ 32251us) write_op.cc:276] Timestamp: P: 1783601925031543 usec, L: 0
0709 12:58:45.070706 (+  3932us) op_driver.cc:348] REPLICATION: starting
0709 12:58:45.117774 (+ 47068us) log.cc:844] Serialized 1567 byte log entry
0709 12:58:45.657514 (+539740us) op_driver.cc:464] REPLICATION: finished
0709 12:58:45.965574 (+308060us) write_op.cc:301] APPLY: starting
0709 12:58:45.965726 (+   152us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:45.965983 (+   257us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:45.966179 (+   196us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:46.112411 (+146232us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:46.124402 (+ 11991us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:58:46.124469 (+    67us) write_op.cc:312] APPLY: finished
0709 12:58:46.124832 (+   363us) log.cc:844] Serialized 34 byte log entry
0709 12:58:46.126676 (+  1844us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:46.126905 (+   229us) write_op.cc:454] Released schema lock
0709 12:58:46.127013 (+   108us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:46.127742 (+   729us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:46.127781 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9897,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":307649,"apply.run_cpu_time_us":4606,"apply.run_wall_time_us":162012,"num_ops":3,"prepare.queue_time_us":72905,"prepare.run_cpu_time_us":26162,"prepare.run_wall_time_us":319285,"raft.queue_time_us":261024,"raft.run_cpu_time_us":136066,"raft.run_wall_time_us":253155,"replication_time_us":586609,"thread_start_us":534250,"threads_started":4,"wal-append.queue_time_us":192261,"wal-append.run_cpu_time_us":19069,"wal-append.run_wall_time_us":1793404}]]}
I20260709 12:58:48.584494  1469 catalog_manager.cc:5697] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:48.652951  1647 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:48.653811  2446 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:48.663815  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.664938  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:48.616055  3250 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:48.666814  1645 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.019s	sys 0.036s
I20260709 12:58:48.649971  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:48.683899  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:48.623210  2951 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:48.666256  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 403506us
I20260709 12:58:48.668515  3212 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:48.677029  1469 catalog_manager.cc:5697] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.650223  3280 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:48.666280  3266 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:48.681217  3234 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.687049  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1199) took 1647 ms. Trace:
I20260709 12:58:48.706729  1565 rpcz_store.cc:276] 0709 12:58:47.040046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.806654 (+766608us) service_pool.cc:224] Handling call
0709 12:58:47.807056 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:47.807514 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:47.807545 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:47.811298 (+  3753us) log.cc:844] Serialized 26 byte log entry
0709 12:58:47.866159 (+ 54861us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:47.866201 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.866268 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:48.587716 (+721448us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:58:48.682780 (+ 95064us) raft_consensus.cc:1685] finished
0709 12:58:48.682813 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.686972 (+  4159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1903,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":87051008,"thread_start_us":50832,"threads_started":1,"wal-append.queue_time_us":62661}
I20260709 12:58:48.660421  3297 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.616937  3217 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.693807  3319 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:48.694517  3262 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.714987  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:48.690236  3300 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:48.716148  3300 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:48.715039  3262 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.716758  3300 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.719208  3262 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:48.720902  3217 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.721638  3217 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:48.721808  3174 consensus_meta.cc:287] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.518s	user 0.015s	sys 0.005s
I20260709 12:58:48.699795  2951 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:48.669041  3314 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.702327  1638 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:48.705474  3183 raft_consensus.cc:993] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower 6f381117554e49bb816791ab0a10f2b8 to start an election
I20260709 12:58:48.675385  3293 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.656742  3294 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.690236  3212 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:48.695885  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1196) took 1657 ms. Trace:
I20260709 12:58:48.725530  2405 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:48.725723  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:48.745998  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:48.746673  3156 consensus_queue.cc:1059] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:48.747577  3266 raft_consensus.cc:1081] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Signalling peer 6f381117554e49bb816791ab0a10f2b8 to start an election
I20260709 12:58:48.748059  3156 raft_consensus.cc:3055] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:48.747565  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:48.748613  3156 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:48.749209  1565 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:48.752380  1639 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:48.744452  1572 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
W20260709 12:58:48.731997  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 465267us
W20260709 12:58:48.751401  2442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.010s	sys 0.047s
W20260709 12:58:48.768960  1687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.010s	sys 0.034s
W20260709 12:58:48.770783  1687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.011s	sys 0.034s
I20260709 12:58:48.728484  3014 consensus_queue.cc:1059] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
W20260709 12:58:48.783020  1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.007s	sys 0.042s
W20260709 12:58:48.783524  1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.007s	sys 0.042s
W20260709 12:58:48.783880  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 548991us
I20260709 12:58:48.796286  1565 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
W20260709 12:58:48.766781  2442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.010s	sys 0.047s
I20260709 12:58:48.825577  1565 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:58:48.832049  1639 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
W20260709 12:58:48.817430  1563 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.011s	sys 0.031s
I20260709 12:58:48.743841  3280 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:58:48.730198  3174 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:48.730615  3293 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.729660  3217 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:48.854625  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 65866.8us
I20260709 12:58:48.772821  3250 consensus_queue.cc:1059] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:58:48.750036  3156 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:48.839679  1563 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.012s	sys 0.031s
I20260709 12:58:48.894657  1643 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:48.892087  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1294) took 1100 ms. Trace:
I20260709 12:58:48.857527  3014 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:48.848752  1564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.000s	sys 0.039s
W20260709 12:58:48.917531  3325 log.cc:927] Time spent T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.135s	user 0.001s	sys 0.001s
I20260709 12:58:48.854717  3236 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.844098  3266 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:58:48.833709  3315 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.927209  3293 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.928887  3216 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:48.930554  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1183) took 2090 ms. Trace:
I20260709 12:58:48.916603  1645 rpcz_store.cc:276] 0709 12:58:47.791701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.975520 (+183819us) service_pool.cc:224] Handling call
0709 12:58:47.976617 (+  1097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:47.976870 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:48.682194 (+705324us) log.cc:844] Serialized 14 byte log entry
0709 12:58:48.891417 (+209223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:48.891507 (+    90us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:48.891588 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.891701 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.891996 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":186802,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":20010,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":3398,"thread_start_us":874659,"threads_started":2}
W20260709 12:58:48.864179  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 180422us
I20260709 12:58:48.938004  1567 rpcz_store.cc:276] 0709 12:58:46.840246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.533765 (+693519us) service_pool.cc:224] Handling call
0709 12:58:47.957350 (+423585us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:58:47.957601 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.126601 (+169000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.126656 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:48.127345 (+   689us) log.cc:844] Serialized 26 byte log entry
0709 12:58:48.676331 (+548986us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:48.676391 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.676474 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:48.890923 (+214449us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b48000b0958. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d21c1aa1 00007f18d21b8b37 00007f18d21b89ca 00007f18d22b026f 00007f18d22aff37 00007f18d22c455c 00007f18d22c4508 00007f18d22c4488 00007f18d22c4443 00007f18d22c36ec 00007f18d11eda96
0709 12:58:48.930294 (+ 39371us) raft_consensus.cc:1685] finished
0709 12:58:48.930318 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.930488 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48496,"raft.run_cpu_time_us":13008,"raft.run_wall_time_us":904834,"spinlock_wait_cycles":34699392,"thread_start_us":647767,"threads_started":2,"wal-append.queue_time_us":628330}
I20260709 12:58:48.888839  3300 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.862912  3118 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:48.941165  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:48.919622  3329 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:48.935420  3156 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:48.910624  3326 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:58:48.991078  1571 raft_consensus.cc:2410] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:58:49.001631  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 60576.5us
I20260709 12:58:49.003768  1536 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 12:58:49.007401  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 281935us
I20260709 12:58:48.933475  3203 consensus_queue.cc:1059] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:58:48.938565  3210 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:58:48.925235  3014 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:48.943025  3255 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:58:48.932112  3328 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 12:58:48.987880  3234 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:49.023190  3216 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:49.009650  2405 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:49.026022  3314 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:48.939932  3315 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:48.745234  1566 rpcz_store.cc:276] 0709 12:58:47.038186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.537056 (+498870us) service_pool.cc:224] Handling call
0709 12:58:47.946417 (+409361us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:58:47.946677 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:47.947106 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:47.947148 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:47.947767 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 12:58:48.142291 (+194524us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:48.142373 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.182446 (+ 40073us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:48.695471 (+513025us) raft_consensus.cc:1685] finished
0709 12:58:48.695503 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.695791 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41695,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":17350,"spinlock_wait_cycles":20370816,"thread_start_us":180402,"threads_started":1,"wal-append.queue_time_us":297076}
I20260709 12:58:49.029506  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:49.029260  3236 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.990795  3329 raft_consensus.cc:697] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:49.028254  3300 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.060472  3217 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:49.060418  3300 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.043826  3212 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.059803  3329 consensus_queue.cc:237] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:49.062422  3234 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:49.062747  3300 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:49.063035  3234 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:49.049746  3203 consensus_queue.cc:1243] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer a4be9cc90aca4dd4ad7db103062a7208 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:58:49.053326  3183 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.059382  3236 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.066222  3174 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:49.066262  3183 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.067929  3236 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:49.059772  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:49.068789  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:49.069195  3183 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:49.069420  1569 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:49.062834  3212 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:49.070952  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:49.027551  3316 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:49.071827  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2108) took 1290 ms. Trace:
I20260709 12:58:49.072104  3316 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.072548  3316 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:49.072252  1638 rpcz_store.cc:276] 0709 12:58:47.781066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.832035 (+ 50969us) service_pool.cc:224] Handling call
0709 12:58:47.850977 (+ 18942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.723010 (+872033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.071610 (+348600us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54000d02d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:49.071774 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1957299584}
W20260709 12:58:49.074838  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 45443us
I20260709 12:58:49.075980  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:49.045727  3294 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:49.080029  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:49.081693  1721 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:49.080016  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 224859us
W20260709 12:58:49.086238  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 223008us
I20260709 12:58:49.108853  1611 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:49.079732  3212 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:49.074779  3280 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.124312  3014 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:49.124843  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.125573  1719 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:58:49.096309  3236 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:49.113698  3181 consensus_queue.cc:1059] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:58:49.113258  3216 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.148855  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1212) took 1314 ms. Trace:
I20260709 12:58:49.113754  3317 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:49.213886  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.137895  1566 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:58:49.222919  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1221) took 1002 ms. Trace:
I20260709 12:58:49.218575  1570 rpcz_store.cc:276] 0709 12:58:47.834435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.147814 (+1313379us) service_pool.cc:224] Handling call
0709 12:58:49.148249 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.148478 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.148509 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.148560 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:49.148593 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.148652 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.148786 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:49.229221  3343 consensus_queue.cc:1059] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:58:49.131901  3294 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:58:49.144068  3330 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:58:49.235705  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 226166us
I20260709 12:58:49.147643  3338 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:49.158169  3341 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:58:49.138109  3321 log.cc:927] Time spent T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.276s	user 0.002s	sys 0.000s
W20260709 12:58:49.137893  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet e93b49f668f7487dad07043590a5616f: Aborted: Op aborted by new leader
W20260709 12:58:49.143503  3335 log.cc:927] Time spent T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:58:49.149121  3271 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:49.260592  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.261384  1719 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:58:49.264554  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:49.265218  1715 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:49.149520  3234 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:49.155750  3315 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:49.137127  3280 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.158834  3014 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 12:58:49.246016  2405 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:49.238349  3253 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.232234  3317 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:49.276924  2405 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:49.133790  3183 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 12:58:49.234185  3216 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.280614  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:49.264344  3071 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:49.288720  1569 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:49.289090  1715 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:58:49.262288  3294 raft_consensus.cc:697] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:49.264762  3341 raft_consensus.cc:697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:49.304167  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1187) took 1055 ms. Trace:
I20260709 12:58:49.304836  1569 rpcz_store.cc:276] 0709 12:58:48.244358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.508958 (+264600us) service_pool.cc:224] Handling call
0709 12:58:49.068719 (+559761us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b5c0010808c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d0c02161 00007f18d0da3a79 00007f18d225d9b6 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:49.299578 (+230859us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77304192}
I20260709 12:58:49.302139  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 83) took 1690 ms. Trace:
I20260709 12:58:49.305724  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1219) took 1085 ms. Trace:
W20260709 12:58:49.305146  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 190148us
I20260709 12:58:49.223883  1566 rpcz_store.cc:276] 0709 12:58:48.220899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.096333 (+875434us) service_pool.cc:224] Handling call
0709 12:58:49.126376 (+ 30043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:49.222226 (+ 95850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.222771 (+   545us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:49.281531  3340 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:49.298807  2405 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:49.305835  1568 rpcz_store.cc:276] 0709 12:58:47.611741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.988853 (+377112us) service_pool.cc:224] Handling call
0709 12:58:47.990861 (+  2008us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.007504 (+ 16643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.007540 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:48.008121 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 12:58:48.624163 (+616042us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:48.935641 (+311478us) log.cc:844] Serialized 14 byte log entry
0709 12:58:48.935888 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.935980 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:49.301766 (+365786us) raft_consensus.cc:1685] finished
0709 12:58:49.301801 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.302021 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16201,"prepare.queue_time_us":461729,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":23518,"raft.run_cpu_time_us":461,"raft.run_wall_time_us":4319,"spinlock_wait_cycles":1732864,"thread_start_us":809103,"threads_started":2,"wal-append.queue_time_us":752919}
I20260709 12:58:49.265486  3338 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.314683  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1194) took 1060 ms. Trace:
I20260709 12:58:49.293715  3331 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:49.297418  3344 raft_consensus.cc:3055] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:49.323088  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:58:49.323431  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 225186us
I20260709 12:58:49.326469  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:49.324119  1569 rpcz_store.cc:276] 0709 12:58:48.254220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.313224 (+1059004us) service_pool.cc:224] Handling call
0709 12:58:49.313701 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.314189 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.314229 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.314307 (+    78us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:49.314358 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.314440 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.314595 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:49.307674  3212 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.319367  3340 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.290294  3253 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.326529  3331 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.304390  3071 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:49.330518  3344 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:49.375450  3297 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:49.383595  3338 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:49.384796  3322 log.cc:927] Time spent T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.525s	user 0.000s	sys 0.005s
I20260709 12:58:49.385172  1721 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:58:49.369311  3160 raft_consensus.cc:3055] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:58:49.387449  3337 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:58:49.366945  3315 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:49.370520  3340 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:49.389565  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1218) took 1169 ms. Trace:
I20260709 12:58:49.414515  1572 rpcz_store.cc:276] 0709 12:58:48.219864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.625718 (+405854us) service_pool.cc:224] Handling call
0709 12:58:49.389300 (+763582us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54002b6454. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:49.389473 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261309184}
I20260709 12:58:49.368395  3212 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:49.396049  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 68766.5us
I20260709 12:58:49.357043  3329 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:58:49.396693  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 70312.8us
I20260709 12:58:49.362571  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1211) took 1539 ms. Trace:
I20260709 12:58:49.388182  3294 consensus_queue.cc:237] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.417879  1715 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:49.419446  1685 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:49.399155  3314 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.396991  3331 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:49.367201  3354 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:58:49.441285  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1220) took 1220 ms. Trace:
I20260709 12:58:49.432722  1566 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:58:49.435654  1685 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:49.406983  3160 raft_consensus.cc:740] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:49.442117  1567 rpcz_store.cc:276] 0709 12:58:48.220525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.941887 (+721362us) service_pool.cc:224] Handling call
0709 12:58:48.942332 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.942575 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:49.225190 (+282615us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.440703 (+215513us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.440774 (+    71us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:49.440819 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.440901 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.441046 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3685,"prepare.queue_time_us":199563,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"thread_start_us":445333,"threads_started":2}
I20260709 12:58:49.402578  3225 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:58:49.427515  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 88) took 1693 ms. Trace:
I20260709 12:58:49.448518  1611 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:49.426723  3315 raft_consensus.cc:697] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:49.450469  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1222) took 1229 ms. Trace:
I20260709 12:58:49.445314  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:49.456230  1567 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
W20260709 12:58:49.458905  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.457324  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:49.460611  1572 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:49.463371  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.439231  3329 raft_consensus.cc:697] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:49.442744  1566 pending_rounds.cc:85] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 1
I20260709 12:58:49.456077  1570 rpcz_store.cc:276] 0709 12:58:48.221227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.268837 (+1047610us) service_pool.cc:224] Handling call
0709 12:58:49.282505 (+ 13668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.282730 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:49.302656 (+ 19926us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.449912 (+147256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.449989 (+    77us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:49.450045 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.450169 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.450365 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29706,"prepare.queue_time_us":22278,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":59,"thread_start_us":136841,"threads_started":1}
I20260709 12:58:49.444022  3281 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:49.415561  3297 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:49.439231  3314 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.477805  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:49.496642  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.523021  1567 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:49.524302  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:49.525952  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:49.527011  1572 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:49.527163  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.528908  1567 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:49.530010  1721 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:49.528205  1720 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:49.427062  3341 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:49.477756  1566 pending_rounds.cc:107] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:58:49.499642  3336 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:49.533066  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.504452  3216 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:49.533752  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.490546  2978 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:49.453032  1564 rpcz_store.cc:276] 0709 12:58:47.724474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.011456 (+286982us) service_pool.cc:224] Handling call
0709 12:58:48.011842 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.121964 (+110122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.134719 (+ 12755us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:48.218453 (+ 83734us) log.cc:844] Serialized 26 byte log entry
0709 12:58:48.935334 (+716881us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:49.261105 (+325771us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.271853 (+ 10748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.393253 (+121400us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b54003aa5a0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd20fdc0 00007f18cd29ba02 00007f18cd298dde 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2
0709 12:58:49.393997 (+   744us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b5400420c54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:49.395450 (+  1453us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:49.402419 (+  6969us) raft_consensus.cc:1685] finished
0709 12:58:49.402470 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.417829 (+ 15359us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49688,"prepare.queue_time_us":197321,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":9880,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":21999,"spinlock_wait_cycles":169894656,"thread_start_us":839734,"threads_started":2,"wal-append.queue_time_us":758630}
I20260709 12:58:49.536183  3297 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:49.536375  3332 raft_consensus.cc:3055] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:49.536923  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.536923  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:49.527303  3300 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:49.478986  3280 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:49.458433  3234 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:49.455165  3328 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:49.430101  1563 rpcz_store.cc:276] 0709 12:58:47.818468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.045478 (+227010us) service_pool.cc:224] Handling call
0709 12:58:48.110138 (+ 64660us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.146325 (+ 36187us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:48.933573 (+787248us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.307525 (+373952us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.310867 (+  3342us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:49.320175 (+  9308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.326013 (+  5838us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.357936 (+ 31923us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15391,"prepare.queue_time_us":891418,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":23312,"spinlock_wait_cycles":12806528,"thread_start_us":964666,"threads_started":2,"wal-append.queue_time_us":437086}
I20260709 12:58:49.477018  3174 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 12:58:49.542722  3357 log.cc:927] Time spent T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:58:49.543411  3349 log.cc:927] Time spent T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:58:49.521561  3160 consensus_queue.cc:260] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.551430  1721 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:58:49.589516  1721 pending_rounds.cc:85] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 1
I20260709 12:58:49.551522  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.552289  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.590967  1713 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:49.553145  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.516346  3281 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.551651  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.627481  1718 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:49.627983  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:49.544364  3248 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:49.542757  3351 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:58:49.561496  1570 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:49.528508  3317 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:49.566159  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.446584  3344 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:49.547010  1566 raft_consensus.cc:2889] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:49.589915  1721 pending_rounds.cc:107] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:58:49.561110  3332 raft_consensus.cc:740] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:49.599308  3212 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:49.600265  3160 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:49.602239  3314 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:49.602990  3241 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:49.606994  2442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 354) took 1410 ms. Trace:
I20260709 12:58:49.608973   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:49.692833  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:49.693994  1719 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:49.576469  3328 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.619041  3159 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:49.581826  3300 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.580034  3354 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:49.577440  3234 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:49.621224  3243 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.572751  3297 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:58:49.622479  3236 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:49.625346  1685 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:49.628912  1643 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:49.725270  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:49.726969  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:49.635146  1712 raft_consensus.cc:2368] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:58:49.555903  3336 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:49.637188  1721 raft_consensus.cc:2889] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:49.727767  1643 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:49.643460  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:49.644162  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:49.646413  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.622592  3266 raft_consensus.cc:3055] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:49.650600  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.733549  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.733994  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.734920  1713 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:49.734992  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:49.626225  3262 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.553514  3315 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:49.690259  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.633404  3281 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:49.738818  3266 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:49.740669  3266 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.741714  3266 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:49.691180  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 137302us
I20260709 12:58:49.707249  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:49.708047  1686 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:49.720151  1646 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:49.746680  1646 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:49.694628  3255 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:49.648155  3368 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:49.725629  3234 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:49.595057  3253 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:49.735807  1643 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:58:49.732121  1645 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:49.688654  3348 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.698873  3314 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.705703  3328 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:49.737973  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.788599  1719 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:58:49.751842  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.703872  3225 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:49.703272  3364 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:49.754812  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:49.755438  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:49.729401  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 104194us
W20260709 12:58:49.756315  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 48352.4us
I20260709 12:58:49.723883  3159 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:49.598228  3329 consensus_queue.cc:237] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:49.736629  3356 log.cc:927] Time spent T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 12:58:49.728163  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:49.777485  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.779888  1611 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:49.737048  3102 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:49.700582  3241 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.723385  3354 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:49.790236  1713 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:58:49.830165  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.721783  1642 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:49.805668  3280 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.728361  3243 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.768780  3183 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:49.811179  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:49.844450  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:49.846323  1712 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
W20260709 12:58:49.817567  3361 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.263s	user 0.000s	sys 0.002s
I20260709 12:58:49.753718  3262 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.825846  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:49.826964  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 47185.7us
I20260709 12:58:49.800200  2438 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:49.834785   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:49.838371  3377 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:49.840493  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 133344us
I20260709 12:58:49.786371  3348 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.767647  3255 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.823287  3102 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.880154  3102 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:49.886713  1713 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:49.827524  3266 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.795766  3314 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:49.864265  1612 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:49.768399  3368 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.806658  3225 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.852752  3297 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:49.874095  3348 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:49.860334  2437 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab"
dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:42646
I20260709 12:58:49.875290  3379 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:49.876029  3255 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:49.877106  3369 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.878429  3377 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.878974  3373 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:49.879540  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.880065  3371 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:49.864367  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.766338  3332 consensus_queue.cc:260] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.854849  3343 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:49.849934  3183 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.863526  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:49.941674  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:49.873308  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:49.859189  3253 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:49.899694  1612 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:49.942687  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 69476.3us
W20260709 12:58:49.943305  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 43756.6us
I20260709 12:58:49.944566  1612 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:49.907075  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:49.874439  3367 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:58:49.812449  3364 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:49.925693  3380 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:49.929013  3379 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.879570  3372 raft_consensus.cc:3055] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:49.863821  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:49.934643  1716 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:49.859784  3203 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:58:49.945981  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.950548  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:49.955660  3382 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:49.943782  3300 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:49.848273  3280 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.691838  2442 rpcz_store.cc:276] 0709 12:58:48.196946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.200779 (+  3833us) service_pool.cc:224] Handling call
0709 12:58:48.228959 (+ 28180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.834037 (+605078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.839278 (+  5241us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:48.934356 (+ 95078us) log.cc:844] Serialized 26 byte log entry
0709 12:58:49.252189 (+317833us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:49.257673 (+  5484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.265133 (+  7460us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:49.606551 (+341418us) raft_consensus.cc:1685] finished
0709 12:58:49.606602 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.606859 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":148997,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"spinlock_wait_cycles":956160,"thread_start_us":889002,"threads_started":2,"wal-append.queue_time_us":392150}
I20260709 12:58:49.899660  3266 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:49.969197  1612 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:49.946283  3343 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.991129  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:49.932256  2437 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:49.923607  3297 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:49.945468  3183 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:49.949510  3255 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:49.982806  1612 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:49.946046  3014 consensus_queue.cc:1059] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:58:50.053114  2447 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:50.063136  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 79985.7us
W20260709 12:58:49.980525  3362 log.cc:927] Time spent T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:58:49.962613  3160 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:58:49.964200  3379 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:49.973428  3203 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.972039  3188 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.958604  3371 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.070909  1719 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:58:49.975185  3241 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:49.972582  3212 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:50.072475  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 89774.5us
I20260709 12:58:50.165561  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:49.946282  3369 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.078258  2437 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:50.122803  1566 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:50.123148  3377 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.124965  3376 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:50.125461  3378 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:50.139853  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:50.119247  3380 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:49.976446  3372 raft_consensus.cc:740] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:49.976383  3328 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.048350  3343 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:49.994731  3294 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:50.072227  3383 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:50.071678  3255 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.137765  3159 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.067691  3253 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:50.240708  1718 raft_consensus.cc:2368] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3.
I20260709 12:58:50.198519  1568 raft_consensus.cc:2393] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:50.150645  1643 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:58:49.952729  3373 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:50.129217  3382 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:50.158496  3316 consensus_meta.cc:287] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 1.085s	user 0.018s	sys 0.000s
W20260709 12:58:50.201578  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 87712us
I20260709 12:58:50.211771  3243 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.203428  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:50.154942  3203 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:50.236119  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1304) took 2197 ms. Trace:
I20260709 12:58:50.194490  3236 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.165585  3188 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:50.245705  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 116911us
I20260709 12:58:50.248087  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:50.264878  1568 raft_consensus.cc:2410] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:50.207979  1716 raft_consensus.cc:2410] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:50.231191  3336 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:50.230022  3071 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.232543  3380 raft_consensus.cc:697] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:50.228932  3377 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:50.258239  1641 rpcz_store.cc:276] 0709 12:58:48.038629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.096471 (+ 57842us) service_pool.cc:224] Handling call
0709 12:58:48.132724 (+ 36253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.292609 (+159885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.292645 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:48.292695 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:48.292743 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.235838 (+1943095us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400218754. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:50.235896 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.236038 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367142656}
I20260709 12:58:50.239419  3255 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:50.269785  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:50.244951  3253 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:50.279341  1568 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:50.239966  3262 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:50.280390  1568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:50.281328  1568 raft_consensus.cc:606] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 3 LEADER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:50.199994  3212 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.256165  3314 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:50.295382  1570 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:50.251881  3354 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.267084  3243 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:50.277920  3225 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:50.303275  2978 consensus_meta.cc:287] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.745s	user 0.014s	sys 0.000s
W20260709 12:58:50.313763  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet e28f3d3a9bc24be6b8fc4d90754cdfac: Illegal state: Replica a4be9cc90aca4dd4ad7db103062a7208 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
W20260709 12:58:50.317857  3381 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:58:50.290899  3241 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:50.237665  3378 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:50.256700  3316 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:50.286489  3253 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:50.274799  3364 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:50.326870  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.291908  3368 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.276278  3236 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:50.319515  3385 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:58:50.234368  3376 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.313623  3369 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.314536  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:50.324035  3331 consensus_meta.cc:287] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.881s	user 0.013s	sys 0.002s
I20260709 12:58:50.256820  3382 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:50.349828  3388 log.cc:927] Time spent T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:58:50.348606  3248 consensus_meta.cc:287] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.004s
W20260709 12:58:50.356694  3384 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 12:58:50.319747  3243 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.285454  3372 consensus_queue.cc:260] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.319447  3102 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.347299  3241 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:50.413443  1571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38394 (request call id 90) took 2158 ms (client timeout 2622 ms). Trace:
I20260709 12:58:50.347683  3280 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:50.530602  3340 consensus_meta.cc:287] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 1.099s	user 0.012s	sys 0.003s
W20260709 12:58:50.574352  1571 rpcz_store.cc:269] 0709 12:58:48.254811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.639531 (+384720us) service_pool.cc:224] Handling call
0709 12:58:50.413131 (+1773600us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54002cbad4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:50.413342 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756661120}
I20260709 12:58:50.600817  1571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:50.601940  1571 raft_consensus.cc:606] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:50.602627  1571 raft_consensus.cc:614] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:50.504508  3160 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.611300  3160 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.576045  3175 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.612573  3175 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:50.613531  3160 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:50.533113  3188 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.511860  3328 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:50.618824  3395 log.cc:927] Time spent T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:58:50.362390  3297 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:50.540287  3271 consensus_meta.cc:287] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.272s	user 0.017s	sys 0.000s
I20260709 12:58:50.583740  3248 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.371821  3118 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.616065  3340 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:50.619832  3291 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:50.629920  3281 consensus_meta.cc:287] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.890s	user 0.013s	sys 0.000s
I20260709 12:58:50.631570  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:50.632537  1611 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:50.529580  3378 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:50.638736  1642 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.016s	sys 0.032s
I20260709 12:58:50.475248  3212 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.531072  3396 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.491930  3181 consensus_queue.cc:1059] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.145s
I20260709 12:58:50.578922  3371 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.531710  3391 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:50.583889  1566 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:50.692751  2448 raft_consensus.cc:2368] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:50.694208  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1324) took 1048 ms. Trace:
W20260709 12:58:50.631253  3234 consensus_meta.cc:287] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.850s	user 0.013s	sys 0.000s
I20260709 12:58:50.575068  3241 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.470237  3386 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.660648  1611 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:50.575657  3331 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:50.661952  1642 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.016s	sys 0.032s
I20260709 12:58:50.644215  3168 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.694830  1644 rpcz_store.cc:276] 0709 12:58:49.645729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.646737 (+  1008us) service_pool.cc:224] Handling call
0709 12:58:49.647055 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:49.751241 (+104186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.751273 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:49.753939 (+  2666us) log.cc:844] Serialized 26 byte log entry
0709 12:58:49.890972 (+137033us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:49.891042 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.891154 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:50.693859 (+802705us) raft_consensus.cc:1685] finished
0709 12:58:50.693888 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.694113 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10413,"raft.queue_time_us":179492,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":18927,"thread_start_us":152474,"threads_started":2,"wal-append.queue_time_us":172016}
I20260709 12:58:50.699963  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:50.700611  3102 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:50.700954  3376 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.658954  3316 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:50.686398  3378 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.679752  3236 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.749475  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1323) took 1104 ms. Trace:
I20260709 12:58:50.685917  3373 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:50.768728  1640 rpcz_store.cc:276] 0709 12:58:49.645345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.645509 (+   164us) service_pool.cc:224] Handling call
0709 12:58:49.645854 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:49.983703 (+337849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.983773 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:50.062577 (+ 78804us) log.cc:844] Serialized 26 byte log entry
0709 12:58:50.263033 (+200456us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:50.263081 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.263156 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:50.749103 (+485947us) raft_consensus.cc:1685] finished
0709 12:58:50.749139 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.749384 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10585,"raft.queue_time_us":169674,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":9439,"thread_start_us":393409,"threads_started":2,"wal-append.queue_time_us":313211}
I20260709 12:58:50.774708  2446 raft_consensus.cc:2368] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
W20260709 12:58:50.746490  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 85936.4us
I20260709 12:58:50.656652  3248 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.680037  3118 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:50.661352  3281 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.798590  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:50.799603  1717 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
W20260709 12:58:50.800796  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.031s	sys 0.037s
W20260709 12:58:50.801185  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.031s	sys 0.037s
I20260709 12:58:50.763197  3226 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:58:50.801769  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 598369us
I20260709 12:58:50.792444  1611 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:50.794384  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 86) took 1087 ms. Trace:
I20260709 12:58:50.804502  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:50.806015  1611 leader_election.cc:400] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:58:50.806563  1611 leader_election.cc:403] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:50.357862  3380 consensus_queue.cc:237] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.809567  1720 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:50.773669  3175 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:50.805159  1640 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:50.862078  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:50.743112  3386 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:50.881224  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:50.660992  3291 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.716739  3234 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:50.803117  3183 consensus_meta.cc:287] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.676s	user 0.014s	sys 0.000s
I20260709 12:58:50.744227  3255 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:50.873535  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 64511.3us
I20260709 12:58:50.749034  3391 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:50.771865  3168 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.802845  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:50.804111  3226 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:50.817930  3376 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:50.874586  3297 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:50.792059  3378 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:50.854544  3167 raft_consensus.cc:3055] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:50.702239  3396 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:50.855739  3371 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:58:50.930349  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:50.968669  1640 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
W20260709 12:58:50.895694  3333 log.cc:927] Time spent T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 1.888s	user 0.019s	sys 0.010s
W20260709 12:58:50.937189  1638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.040s	sys 0.045s
I20260709 12:58:50.938035  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:50.974406  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:50.925679  3175 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.958927  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:50.975538  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:50.969990  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:50.926604  3243 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.970939  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:50.932071  3183 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:50.974426  1638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.040s	sys 0.045s
I20260709 12:58:50.975632  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.060622  1644 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:51.086680  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:51.142724  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 214692us
I20260709 12:58:50.977780  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.179673  1569 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:58:51.180387  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 209606us
I20260709 12:58:50.975968  1645 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:51.029045  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:51.029631  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.183351  1721 raft_consensus.cc:2393] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:51.186375  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:50.960311  1566 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:50.955415  3376 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.217142  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:50.967741  3316 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.024600  3271 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:51.184718  3409 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:58:51.226451  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.232580  1647 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:51.234786  1646 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:50.956171  3382 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.235563  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.216734  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:51.189316  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:50.974923  3236 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:50.968081  3167 raft_consensus.cc:740] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:58:51.088171  3399 log.cc:927] Time spent T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.410s	user 0.000s	sys 0.001s
W20260709 12:58:51.184499  3401 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 12:58:51.186113  3329 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:51.235653  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.236398  1647 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:51.244104  1646 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:51.245033  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.236423  1717 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:51.187124  3402 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:58:51.237883  1643 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:51.214943  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.239312  1721 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
W20260709 12:58:51.189042  3403 log.cc:927] Time spent T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:58:50.973925  3212 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:50.949998  3226 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.062744  3241 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.185798  3188 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:51.222908  3340 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.129940  3210 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:51.245081  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.187322  3175 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.280196  1646 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:51.187757  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.250334  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.234541  3376 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:51.136291  3391 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:51.281355  1569 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:51.254995  1640 raft_consensus.cc:2393] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:51.282430  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.282565  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.283262  1640 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:58:51.284061  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.284205  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.284893  1640 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:51.285202  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:51.285807  1569 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:51.285898  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.292179  1569 raft_consensus.cc:2410] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:51.293207  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:51.293848  1569 raft_consensus.cc:3055] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:51.294149  1569 raft_consensus.cc:740] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:51.294981  1569 consensus_queue.cc:260] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:51.295840  1569 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:51.254781  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.237702  3331 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.249142  3239 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.256744  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:51.258948  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:58:51.259649  1568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.017s	sys 0.063s
W20260709 12:58:51.310912  1568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.018s	sys 0.064s
I20260709 12:58:51.239111  3281 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:51.263092  3183 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:51.240135  3248 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:51.254451  2437 consensus_meta.cc:287] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 1.023s	user 0.015s	sys 0.000s
I20260709 12:58:51.268420  3167 consensus_queue.cc:260] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.248864  3236 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:51.270431  3255 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:51.265799  3328 raft_consensus.cc:3055] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:51.243867  3329 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:51.343532  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.394846  3328 raft_consensus.cc:740] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:51.395195  3329 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.395406  1721 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:51.396138  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 1226) took 1132 ms. Trace:
I20260709 12:58:51.395951  3328 consensus_queue.cc:260] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:51.396489  1721 rpcz_store.cc:276] 0709 12:58:50.263929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.343082 (+1079153us) service_pool.cc:224] Handling call
0709 12:58:51.396067 (+ 52985us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:51.397089  3379 consensus_meta.cc:287] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 1.235s	user 0.013s	sys 0.001s
I20260709 12:58:51.397680  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.398696  3236 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:51.349203  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.398932  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.399315  3236 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.399830  3236 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:51.400123  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.400686  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:51.278705  3253 consensus_meta.cc:287] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.931s	user 0.008s	sys 0.005s
W20260709 12:58:51.401512  3343 consensus_meta.cc:287] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.164s	user 0.005s	sys 0.006s
I20260709 12:58:51.401779  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.402905  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.401857  3253 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:51.403504  3413 log.cc:927] Time spent T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:58:51.276939  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.405366  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.317332  3234 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.370247  3396 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:51.405992  1566 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:51.316787  3291 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:51.407015  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.241528  3271 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.409648  3271 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:51.239593  3316 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:51.411847  3316 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:51.412417  3316 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:51.397083  3328 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:51.413697  3316 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:51.420567  3387 log.cc:927] Time spent T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 1.266s	user 0.005s	sys 0.005s
I20260709 12:58:51.420905  3316 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.397588  3379 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.422379  1647 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:51.423127  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1241) took 1463 ms. Trace:
I20260709 12:58:51.423321  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:51.423538  1568 rpcz_store.cc:276] 0709 12:58:49.959232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.291656 (+332424us) service_pool.cc:224] Handling call
0709 12:58:50.292197 (+   541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:50.292882 (+   685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:50.292930 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:50.293647 (+   717us) log.cc:844] Serialized 26 byte log entry
0709 12:58:51.311418 (+1017771us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:51.311474 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.311565 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:51.422869 (+111304us) raft_consensus.cc:1685] finished
0709 12:58:51.422893 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.423059 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":148,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":10659,"thread_start_us":971316,"threads_started":1,"wal-append.queue_time_us":632647}
I20260709 12:58:51.425410  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.425944  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.426709  1641 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:51.427004  3376 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.428014  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.428737  1644 raft_consensus.cc:2368] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3.
I20260709 12:58:51.429279  3376 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.436093  3175 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:51.439474  2446 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42636 (request call id 300) took 2165 ms (client timeout 1510 ms). Trace:
W20260709 12:58:51.440264  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.276626  3212 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.442953  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1229) took 2065 ms. Trace:
I20260709 12:58:51.443446  1567 rpcz_store.cc:276] 0709 12:58:49.378012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.530110 (+152098us) service_pool.cc:224] Handling call
0709 12:58:49.530424 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.723012 (+192588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.723063 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.723127 (+    64us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:49.723177 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.442674 (+1719497us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540035aa54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:51.442733 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.442880 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442296192}
I20260709 12:58:51.444851  3212 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.444927  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.391373  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1244) took 1419 ms. Trace:
I20260709 12:58:51.446514  1571 rpcz_store.cc:276] 0709 12:58:49.972256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:50.617123 (+644867us) service_pool.cc:224] Handling call
0709 12:58:50.639879 (+ 22756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:50.640400 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:50.640445 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:50.643643 (+  3198us) log.cc:844] Serialized 26 byte log entry
0709 12:58:50.798962 (+155319us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:50.799029 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.799129 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:51.391077 (+591948us) raft_consensus.cc:1685] finished
0709 12:58:51.391104 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.391300 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":781,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":14030,"thread_start_us":106787,"threads_started":1,"wal-append.queue_time_us":213910}
I20260709 12:58:51.393450  3167 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:51.404076  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.452502  1721 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:51.452414  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.453173  1568 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:51.453518  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.454020  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.454197  1721 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:51.454627  1568 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:51.455049  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.455418  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.455626  1721 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:58:51.455986  1568 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:51.456425  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.456753  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.457000  1721 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:51.457336  1568 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
W20260709 12:58:51.440016  2446 rpcz_store.cc:269] 0709 12:58:49.279826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.280312 (+   486us) service_pool.cc:224] Handling call
0709 12:58:51.439178 (+2158866us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54006a2554. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:51.439368 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3399339392}
I20260709 12:58:51.401551  1646 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:51.397709  3410 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:58:51.315528  1717 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:51.462208  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 1229) took 1085 ms. Trace:
I20260709 12:58:51.462802  1717 rpcz_store.cc:276] 0709 12:58:50.379511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.188112 (+808601us) service_pool.cc:224] Handling call
0709 12:58:51.462120 (+274008us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:51.445786  1567 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:51.448709  1640 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:51.342587  3210 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.451261  1569 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:58:51.464066  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.465410  1569 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:58:51.436283  3383 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:51.457814  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.465142  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:51.487310  1571 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.298683  3239 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.488603  1721 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:51.469785  1569 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:51.370203  3386 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:51.401969  3236 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:51.492588  1569 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:58:51.493325  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.451856  3315 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:51.499390  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:58:51.500047  1717 raft_consensus.cc:606] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:51.500509  1717 raft_consensus.cc:614] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:51.498742  3217 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.458742  2437 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:51.505470  3217 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:51.507150  2437 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.507789  2437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:42646 (request call id 358) took 1877 ms. Trace:
I20260709 12:58:51.488251  3383 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:51.496726  3316 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:51.490940  3212 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:51.316023  2443 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:51.490559  3416 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.507791  3217 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:51.521750  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:51.521754  1571 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:51.522923  1567 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:58:51.277981  3188 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:51.523949  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.463687  1566 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
W20260709 12:58:51.526623  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 79906.6us
I20260709 12:58:51.458380  3343 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:51.508126  2437 rpcz_store.cc:276] 0709 12:58:49.630284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.634045 (+  3761us) service_pool.cc:224] Handling call
0709 12:58:51.507665 (+1873620us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:51.524053  3203 consensus_meta.cc:287] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.241s	user 0.014s	sys 0.003s
I20260709 12:58:51.534502  3217 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:51.537176  3365 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 1.990s	user 0.005s	sys 0.008s
I20260709 12:58:51.537542  3379 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.531132  3416 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.536417  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:51.510394  3315 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:51.544512  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:51.546535  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.548339  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:51.541253  3217 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.550520  1536 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:51.529435  3212 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.530011  3316 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.559728  1714 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:51.564983  3212 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:50.804811  1642 rpcz_store.cc:276] 0709 12:58:49.706641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.832111 (+125470us) service_pool.cc:224] Handling call
0709 12:58:49.832562 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.832869 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:50.750790 (+917921us) log.cc:844] Serialized 14 byte log entry
0709 12:58:50.793826 (+ 43036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:50.793906 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:50.793996 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.794116 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.794296 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":934538,"raft.queue_time_us":113,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7424,"thread_start_us":941591,"threads_started":2}
I20260709 12:58:51.579030  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.541205  3203 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.581256  1611 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:51.566797  1645 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:51.546355  3419 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.571906  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.569195  3391 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.548748  3239 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:51.556814  3210 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:51.585614  1644 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:51.553473  3217 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:51.549006  3382 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:58:51.587903  1712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2169) took 1927 ms (client timeout 1919 ms). Trace:
I20260709 12:58:51.587785  1611 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:51.583599  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.589371  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:49.306568  1565 rpcz_store.cc:276] 0709 12:58:48.220211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.841150 (+620939us) service_pool.cc:224] Handling call
0709 12:58:48.860852 (+ 19702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.861106 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:49.092551 (+231445us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.305234 (+212683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.305314 (+    80us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:49.305364 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.305440 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.305665 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13036,"prepare.queue_time_us":248486,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":13207,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":8664,"thread_start_us":400571,"threads_started":2}
I20260709 12:58:51.593986  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:51.585175  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:51.599879  1712 rpcz_store.cc:269] 0709 12:58:49.646015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.753342 (+107327us) service_pool.cc:224] Handling call
0709 12:58:51.573485 (+1820143us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b5400301954. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:51.573639 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60053376}
W20260709 12:58:51.603044  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.570199  3253 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.600884  1642 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:51.612905  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.613823  1642 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:51.615373  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.616142  1642 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
W20260709 12:58:51.604064  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.595856  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:51.587505  3419 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.592840  3243 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:51.596634  3212 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:51.586905  3391 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:51.592351  3417 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.610226  3379 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:51.618448  3382 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:51.619176  3226 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.632109  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:51.684201  1644 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:51.685539  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.697640  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.699470  1644 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:51.706589  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:51.707254  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:51.707862  1644 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.706097  3188 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.696465  3417 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:51.727807  3315 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.673516  3416 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.731303  3382 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:51.732237  2438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 301) took 2440 ms. Trace:
I20260709 12:58:51.665235  3343 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:51.720155  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 169724us
I20260709 12:58:51.721606  1643 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:51.690523  3419 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.739272  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:51.721331  1685 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:51.725005  3316 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.690963  3391 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.729113  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 96) took 1045 ms. Trace:
I20260709 12:58:51.688957  3212 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.683549  3243 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.633419  3203 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:51.706766  3379 raft_consensus.cc:697] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:51.756632  3417 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.739295  1644 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:51.759532  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.742652  3416 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:51.762869  3416 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:51.763044  2448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42636 (request call id 302) took 2459 ms (client timeout 1821 ms). Trace:
I20260709 12:58:51.763360  3416 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:51.763525  2448 rpcz_store.cc:269] 0709 12:58:49.303269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.303851 (+   582us) service_pool.cc:224] Handling call
0709 12:58:51.762805 (+2458954us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54006fead4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:51.762959 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3140220672}
I20260709 12:58:51.743657  1568 rpcz_store.cc:276] 0709 12:58:50.683769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.457902 (+774133us) service_pool.cc:224] Handling call
0709 12:58:51.464172 (+  6270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:51.523832 (+ 59660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:51.523869 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:51.524378 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:58:51.590299 (+ 65921us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:51.628133 (+ 37834us) log.cc:844] Serialized 14 byte log entry
0709 12:58:51.628370 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.628472 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:51.728885 (+100413us) raft_consensus.cc:1685] finished
0709 12:58:51.728905 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.729050 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3008,"prepare.queue_time_us":78600,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":98756,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":5691,"thread_start_us":66392,"threads_started":2,"wal-append.queue_time_us":138822}
I20260709 12:58:51.746999  3212 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.750679  3243 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:51.741587  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:51.760735  1644 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:51.757963  3379 consensus_queue.cc:237] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.761850  3316 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.760039  3347 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:58:51.757841  3266 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:51.732766  2438 rpcz_store.cc:276] 0709 12:58:49.291939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.296619 (+  4680us) service_pool.cc:224] Handling call
0709 12:58:49.324372 (+ 27753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.871454 (+547082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.731896 (+1860442us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b540063e554. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:51.732130 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016380288}
I20260709 12:58:51.772624  3226 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.775200  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.761134  3343 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:51.779984  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.777298  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:51.783346  1644 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:51.784385  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.785050  1644 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:51.786123  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.786836  1644 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:51.791474  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.792083  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1239) took 1833 ms. Trace:
I20260709 12:58:51.792901  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.785269  3188 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:51.795060  3344 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:51.795250  3188 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:51.795792  3188 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:51.791501  3417 consensus_queue.cc:1059] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:58:51.798499  3315 raft_consensus.cc:3055] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:51.799050  3315 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:51.792476  1563 rpcz_store.cc:276] 0709 12:58:49.958585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.963566 (+  4981us) service_pool.cc:224] Handling call
0709 12:58:51.791306 (+1827740us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:58:51.791512 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:51.791723 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:51.791762 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:51.791808 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:51.791843 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.791899 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.792023 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11145472}
I20260709 12:58:51.802066  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:51.802546  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.802938  1644 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.803807  3378 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.784119  3343 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.805347  3343 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:51.808970  1570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1238) took 1850 ms (client timeout 2162 ms). Trace:
W20260709 12:58:51.809468  1570 rpcz_store.cc:269] 0709 12:58:49.958256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.959645 (+  1389us) service_pool.cc:224] Handling call
0709 12:58:51.808759 (+1849114us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b5400279f54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:51.808896 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558242688}
I20260709 12:58:51.814908  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:51.815318  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.815855  1647 raft_consensus.cc:2393] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:51.830099  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 12:58:51.815834  1537 connection.cc:256] RPC call timeout handler was delayed by -1.4740208279999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
I20260709 12:58:51.833873  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:51.818037  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:51.834849  3293 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.835331  2438 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:51.835498  3293 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:51.818151  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:51.820278  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:51.837018  2448 raft_consensus.cc:2410] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:51.838235  3293 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:51.797936  3188 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:51.839332  3188 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:51.841741  3188 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.785041  3422 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:51.822587  1719 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2173) took 2139 ms (client timeout 2685 ms). Trace:
W20260709 12:58:51.848573  1719 rpcz_store.cc:269] 0709 12:58:49.683079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.864050 (+180971us) service_pool.cc:224] Handling call
0709 12:58:51.822367 (+1958317us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54003aaf54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:51.822512 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302658304}
I20260709 12:58:51.838387  2443 raft_consensus.cc:2368] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:51.827687  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.849979  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:51.828855  1644 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:51.783259  3316 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.850518  1563 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:51.853042  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:51.853104  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.854264  1644 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 1.
I20260709 12:58:51.800328  3315 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:51.856751  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:51.857028  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:58:51.858768  3374 log.cc:927] Time spent T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 1.949s	user 0.018s	sys 0.012s
I20260709 12:58:51.859517  3188 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.859669  3316 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.860113  3188 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.860971  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:51.860170  3316 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.860734  3188 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.864188  1612 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:51.869246  1536 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.628s (SENT) [suppressed 10 similar messages]
I20260709 12:58:51.871513  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:51.873672  1612 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:51.877323  1612 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:51.857141  3315 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.854707  3422 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:51.825197  3212 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.866611  3378 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:51.875842  3386 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:51.875655  3382 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:51.887881  1612 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:51.875653  3226 raft_consensus.cc:2764] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:58:51.918884  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:51.919142  1717 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:51.921306  1611 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:51.905972  3376 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:51.900629  3422 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:51.912830  3175 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.928751  1612 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:51.868386  3316 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.931335  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:58:51.935441  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 66610.3us
I20260709 12:58:51.939035  1563 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:58:51.899453  3217 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.939469  1563 pending_rounds.cc:85] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 5
I20260709 12:58:51.940330  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:51.942095  1563 pending_rounds.cc:107] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:58:51.942458  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1226) took 2578 ms. Trace:
I20260709 12:58:51.943125  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:51.943886  1717 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:51.942878  1572 rpcz_store.cc:276] 0709 12:58:49.364089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.528165 (+164076us) service_pool.cc:224] Handling call
0709 12:58:49.533531 (+  5366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:49.550112 (+ 16581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.550145 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:49.550643 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:58:49.576235 (+ 25592us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:49.576300 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.941950 (+2365650us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b540028c654. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:51.942011 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:51.942098 (+    87us) raft_consensus.cc:1685] finished
0709 12:58:51.942116 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.942375 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1189,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":91,"spinlock_wait_cycles":37079936,"thread_start_us":25073,"threads_started":1,"wal-append.queue_time_us":59411,"wal-append.run_cpu_time_us":2332,"wal-append.run_wall_time_us":1008235}
I20260709 12:58:51.942435  1563 raft_consensus.cc:2889] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:51.923898  3293 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:51.947181  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:51.926990  3396 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:51.947444  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:51.945991  3382 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:58:51.948743  3431 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.934191  3378 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:51.951206  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:51.967542  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.928906  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:58:51.953289  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.968688  1717 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:51.949124  3241 consensus_queue.cc:1059] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:58:51.967135  2448 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:51.954120  1570 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:51.951030  3376 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 12:58:51.967942  1537 leader_election.cc:336] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Timed out: RequestConsensusVote RPC to 127.0.107.196:39297 timed out after 1.510s (SENT)
I20260709 12:58:51.955911  3217 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:51.963212  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:51.963848  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:51.951567  1563 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:51.969861  1611 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:51.950402  3293 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.981345  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:51.972687  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.964287  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:58:51.976171  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.985213  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.983318  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:51.985905  1717 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:58:51.985972  1563 raft_consensus.cc:2376] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5. Re-sending same reply.
I20260709 12:58:51.986195  1685 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:51.941768  3226 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:51.975759  3329 consensus_meta.cc:287] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.001s
I20260709 12:58:51.988273  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.991568  1563 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 1.
I20260709 12:58:51.991331  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.966667  3378 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:51.940917  3175 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:51.991608  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:51.993134  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:51.994867  1685 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:51.979764  3427 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:51.975330  3396 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:51.995494  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.032676  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:51.988399  3241 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:51.984675  3293 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:51.987691  3226 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.047538  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.048197  1571 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:51.970793  3431 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:52.038025  1685 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:52.003194  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:51.997030  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:52.039665  1717 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:51.996616  3378 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:52.039382  3383 consensus_meta.cc:287] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.002s
I20260709 12:58:52.050747  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.051059  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.059391  1569 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:52.059855  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.060328  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.057385  3416 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:52.053772  1685 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:52.071153  1685 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:52.054090  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:52.043061  1563 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:52.044051  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.035785  3392 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:52.055816  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:52.044548  3203 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:52.053676  3226 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:52.082235  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.049057  3241 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.042862  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.073511  1717 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:52.074159  1644 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:52.075866  1685 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:52.004338  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.996259  3329 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:52.094290  2438 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:52.095504  3329 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:52.077280  1565 raft_consensus.cc:1275] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:58:52.078191  3212 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:52.075433  3203 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.097335  3203 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:52.079468  3167 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:52.087805  1685 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:52.102300  3167 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.102785  3167 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:52.102581  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:52.075765  3392 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:52.080195  3266 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:52.045951  3427 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:52.067214  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.083225  1563 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:52.084046  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:52.058457  3328 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:52.088528  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:52.087739  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:52.090595  3188 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:52.091843  3175 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:52.093375  3250 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.107147  1568 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:52.109717  1570 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:58:52.061615  3383 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:52.170934  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:52.171348  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:52.171904  1570 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:52.171984  1563 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:52.162585  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.174706  1571 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:52.156648  1567 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:52.111716  2444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 360) took 2472 ms. Trace:
I20260709 12:58:52.177520  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.178325  1571 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:58:52.179522  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:52.110165  1717 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:52.180231  1571 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:52.182302  1717 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:58:52.176034  2444 rpcz_store.cc:276] 0709 12:58:49.641378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.698072 (+ 56694us) service_pool.cc:224] Handling call
0709 12:58:52.110493 (+2412421us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b5800122a98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:58:52.110822 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:52.111090 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:52.111129 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:52.111187 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:52.111237 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:52.111315 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:52.111473 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2750208}
I20260709 12:58:52.182762  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:52.191776  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:52.088264  3241 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:52.111073  3428 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:58:52.151297  3210 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:52.205044  3210 raft_consensus.cc:697] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:52.188946  3250 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:52.206177  3210 consensus_queue.cc:237] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:52.207341  3168 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:52.153084  3344 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:52.210608  3434 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.217s	user 0.001s	sys 0.001s
I20260709 12:58:52.212153  3344 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.229036  3431 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:52.229285  3344 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:52.174817  3386 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:52.212829  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:52.230795  2978 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.231462  2978 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:52.155555  3419 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:52.233985  3419 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:52.234311  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.235195  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:52.237265  1713 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 1222) took 2432 ms (client timeout 2001 ms). Trace:
W20260709 12:58:52.237833  1713 rpcz_store.cc:269] 0709 12:58:49.805259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.829736 (+ 24477us) service_pool.cc:224] Handling call
0709 12:58:52.237037 (+2407301us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b5400237154. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:52.237169 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127954304}
I20260709 12:58:52.238353  3315 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:52.239537  1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 1216) took 2707 ms (client timeout 1610 ms). Trace:
I20260709 12:58:52.240100  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:52.242110  2437 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:52.243243  2436 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:52.243382  2978 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:52.247015  2446 raft_consensus.cc:2410] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:52.156458  3328 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.194412  1563 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:52.199487  1569 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:52.196864  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:52.213521  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.220093  3427 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:52.190733  3266 raft_consensus.cc:697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:52.180779  3392 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:52.222347  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet c55d053b55024621933828292867f0e6: Illegal state: Replica 338d817f94ee4c1bad162e9a5860b68a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:58:52.209810  3250 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:52.224494  3416 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:52.225437  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1240) took 2266 ms. Trace:
I20260709 12:58:52.325001  1564 rpcz_store.cc:276] 0709 12:58:49.958897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.963725 (+  4828us) service_pool.cc:224] Handling call
0709 12:58:50.058388 (+ 94663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:50.126608 (+ 68220us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:50.324350 (+197742us) log.cc:844] Serialized 14 byte log entry
0709 12:58:52.224723 (+1900373us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b180011bde0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18cce404bc 00007f18ca18e48b 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1aac02 00007f18cce3220b 00007f18cce37d23 00007f18cce3823a
0709 12:58:52.225014 (+   291us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:52.225079 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:52.225138 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:52.225232 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:52.225365 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10934,"prepare.queue_time_us":528707,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":988,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":94,"spinlock_wait_cycles":47170304,"thread_start_us":496156,"threads_started":2,"wal-append.queue_time_us":473744,"wal-append.run_cpu_time_us":9130,"wal-append.run_wall_time_us":1431040}
I20260709 12:58:52.327656  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.225946  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:52.268668  3386 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:52.328739  2443 raft_consensus.cc:2368] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:52.226191  3236 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:52.240006  1720 rpcz_store.cc:269] 0709 12:58:49.532381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.552833 (+ 20452us) service_pool.cc:224] Handling call
0709 12:58:52.239315 (+2686482us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54003408d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:52.239460 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2783511296}
I20260709 12:58:52.331213  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2127) took 1264 ms. Trace:
I20260709 12:58:52.331511  1564 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:52.264467  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.203863  1570 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:52.268138  3253 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.102674  3316 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:52.313621  1571 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:52.317341  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:52.318465  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:52.319439  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:52.320432  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:52.321408  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:58:52.322558  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.323786  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2135) took 1192 ms. Trace:
I20260709 12:58:52.323918  3383 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:52.268643  3328 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:52.330284  3372 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:52.331627  1640 rpcz_store.cc:276] 0709 12:58:51.063336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.285657 (+222321us) service_pool.cc:224] Handling call
0709 12:58:52.327579 (+1041922us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540033bdd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:52.327739 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372274048}
W20260709 12:58:52.333653  3411 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 1.072s	user 0.010s	sys 0.000s
I20260709 12:58:52.296305  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.251267  1644 raft_consensus.cc:2393] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:52.104734  3396 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:52.655368  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1320) took 3019 ms. Trace:
I20260709 12:58:52.959766  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:52.647462  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:52.959084  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:52.655900  1716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2160) took 3012 ms (client timeout 2065 ms). Trace:
W20260709 12:58:53.057816  2446 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42636 (request call id 309) took 1228 ms (client timeout 1637 ms). Trace:
W20260709 12:58:52.635334  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:52.657567  1568 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:58:53.057255  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1227) took 2721 ms. Trace:
W20260709 12:58:53.154268  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 899395us
I20260709 12:58:52.784941  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58260 (request call id 210) took 7030 ms. Trace:
W20260709 12:58:52.656185  1718 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2172) took 3006 ms (client timeout 2087 ms). Trace:
W20260709 12:58:53.252015  1613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.014s	sys 0.026s
W20260709 12:58:53.334240  1613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.016s	sys 0.029s
I20260709 12:58:52.334931  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:52.556936  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 469168us
I20260709 12:58:53.336269  1685 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:53.322023  1715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.072s	user 0.018s	sys 0.050s
W20260709 12:58:52.599152  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.329380  1569 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
W20260709 12:58:53.329360  1716 rpcz_store.cc:269] 0709 12:58:49.643707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.643850 (+   143us) service_pool.cc:224] Handling call
0709 12:58:52.655642 (+3011792us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400229054. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:52.655815 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464365312}
W20260709 12:58:52.375972  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.329689  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2145) took 1325 ms. Trace:
I20260709 12:58:53.332437  1721 rpcz_store.cc:276] 0709 12:58:50.335849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.496792 (+1160943us) service_pool.cc:224] Handling call
0709 12:58:51.497177 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:51.509920 (+ 12743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:51.509969 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:51.510033 (+    64us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:51.510126 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.056888 (+1546762us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b540038efd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:53.056944 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.057142 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28652928}
I20260709 12:58:53.340210  1644 rpcz_store.cc:276] 0709 12:58:52.004519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.196444 (+191925us) service_pool.cc:224] Handling call
0709 12:58:53.329598 (+1133154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.327442  1563 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
W20260709 12:58:53.337383  1715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.019s	sys 0.050s
I20260709 12:58:53.339088  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1275) took 1023 ms. Trace:
I20260709 12:58:53.342344  1570 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:53.343199  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1258) took 1102 ms. Trace:
I20260709 12:58:53.342141  1569 rpcz_store.cc:276] 0709 12:58:52.316078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.958676 (+642598us) service_pool.cc:224] Handling call
0709 12:58:53.339019 (+380343us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.344159  1570 rpcz_store.cc:276] 0709 12:58:52.240639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.334634 (+ 93995us) service_pool.cc:224] Handling call
0709 12:58:53.343131 (+1008497us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:53.329756  2446 rpcz_store.cc:269] 0709 12:58:51.829573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.829741 (+   168us) service_pool.cc:224] Handling call
0709 12:58:53.057582 (+1227841us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54006a0c54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:53.057720 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956190592}
I20260709 12:58:53.327533  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1229) took 1174 ms. Trace:
I20260709 12:58:53.341085  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1268) took 1095 ms. Trace:
I20260709 12:58:53.346369  1571 rpcz_store.cc:276] 0709 12:58:52.152997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.179131 (+ 26134us) service_pool.cc:224] Handling call
0709 12:58:53.327454 (+1148323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.345695  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:53.347546  1569 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:53.330489  1567 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:53.348361  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1262) took 1106 ms. Trace:
I20260709 12:58:53.348980  1569 rpcz_store.cc:276] 0709 12:58:52.241629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.345314 (+1103685us) service_pool.cc:224] Handling call
0709 12:58:53.348285 (+  2971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.331363  1643 rpcz_store.cc:276] 0709 12:58:51.131241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.249589 (+118348us) service_pool.cc:224] Handling call
0709 12:58:52.323587 (+1073998us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54002c56d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:52.323717 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012162304}
I20260709 12:58:53.346572  1563 rpcz_store.cc:276] 0709 12:58:52.245261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.295806 (+ 50545us) service_pool.cc:224] Handling call
0709 12:58:53.341003 (+1045197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.347594  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:53.352687  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1271) took 1046 ms. Trace:
I20260709 12:58:53.353495  2447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42636 (request call id 321) took 1036 ms. Trace:
I20260709 12:58:53.327651  1639 rpcz_store.cc:276] 0709 12:58:49.635782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.636366 (+   584us) service_pool.cc:224] Handling call
0709 12:58:49.636766 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.858915 (+222149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.858953 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.859003 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:49.859046 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:52.655073 (+2796027us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b540034dad4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:52.655136 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:52.655280 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510288768}
W20260709 12:58:53.333279  1718 rpcz_store.cc:269] 0709 12:58:49.649427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.754527 (+105100us) service_pool.cc:224] Handling call
0709 12:58:52.654496 (+2899969us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400065754. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:52.656117 (+  1621us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996010240}
I20260709 12:58:53.348651  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1253) took 1109 ms. Trace:
I20260709 12:58:53.328457  1565 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:53.332803  1469 rpcz_store.cc:276] 0709 12:58:45.754592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.768145 (+ 13553us) service_pool.cc:224] Handling call
0709 12:58:45.956063 (+187918us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54004254d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd202090 00007f18cd2a0f3a 00007f18d30571cc 00007f18d315537e 00007f18d16162a4 00007f18d1616232 00007f18d1616161 00007f18d16160dc 00007f18d1615392 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:52.784782 (+6828719us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:49.070622 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:49.071354 (+   732us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:49.071424 (+    70us) write_op.cc:435] Acquired schema lock
0709 12:58:49.071451 (+    27us) tablet.cc:662] Decoding operations
0709 12:58:49.072635 (+  1184us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:49.072729 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:49.072757 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:58:49.125119 (+ 52362us) tablet.cc:701] Row locks acquired
0709 12:58:49.125144 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:58:49.125317 (+   173us) write_op.cc:270] Start()
0709 12:58:49.125444 (+   127us) write_op.cc:276] Timestamp: P: 1783601929125262 usec, L: 0
0709 12:58:49.125465 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:58:49.126219 (+   754us) log.cc:844] Serialized 3626 byte log entry
0709 12:58:50.342082 (+1215863us) op_driver.cc:464] REPLICATION: finished
0709 12:58:50.925599 (+583517us) write_op.cc:301] APPLY: starting
0709 12:58:50.925719 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:50.948359 (+ 22640us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:50.967278 (+ 18919us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:51.130531 (+163253us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:51.130921 (+   390us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:58:51.130993 (+    72us) write_op.cc:312] APPLY: finished
0709 12:58:51.131423 (+   430us) log.cc:844] Serialized 71 byte log entry
0709 12:58:51.131704 (+   281us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:51.131919 (+   215us) write_op.cc:454] Released schema lock
0709 12:58:51.131994 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:51.186538 (+ 54544us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:51.194139 (+  7601us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":330828,"reported_tablets":18,"spinlock_wait_cycles":280550272,"child_traces":[["op",{"apply.queue_time_us":536171,"apply.run_cpu_time_us":16977,"apply.run_wall_time_us":253042,"num_ops":9,"prepare.queue_time_us":308511,"prepare.run_cpu_time_us":39819,"prepare.run_wall_time_us":307032,"raft.queue_time_us":313865,"raft.run_cpu_time_us":49706,"raft.run_wall_time_us":501374,"replication_time_us":1189886,"thread_start_us":1094304,"threads_started":4,"wal-append.queue_time_us":338556,"wal-append.run_cpu_time_us":165090,"wal-append.run_wall_time_us":2656616}]]}
I20260709 12:58:53.357300  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1276) took 1040 ms. Trace:
I20260709 12:58:53.357892  1565 rpcz_store.cc:276] 0709 12:58:52.316430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.647066 (+330636us) service_pool.cc:224] Handling call
0709 12:58:53.357233 (+710167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.353410  1571 rpcz_store.cc:276] 0709 12:58:52.306500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.347301 (+1040801us) service_pool.cc:224] Handling call
0709 12:58:53.352603 (+  5302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.356329  1567 rpcz_store.cc:276] 0709 12:58:52.239353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.264012 (+ 24659us) service_pool.cc:224] Handling call
0709 12:58:53.348594 (+1084582us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.362706  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38394 (request call id 102) took 1415 ms. Trace:
I20260709 12:58:53.361325  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:53.354205  2447 rpcz_store.cc:276] 0709 12:58:52.316753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.321123 (+  4370us) service_pool.cc:224] Handling call
0709 12:58:53.353410 (+1032287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.363365  1568 rpcz_store.cc:276] 0709 12:58:51.947054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.947180 (+   126us) service_pool.cc:224] Handling call
0709 12:58:53.362521 (+1415341us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54003b4054. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:53.362642 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361079680}
I20260709 12:58:53.364926  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:53.365849  1568 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:53.366613  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1265) took 1122 ms. Trace:
I20260709 12:58:53.367069  1568 rpcz_store.cc:276] 0709 12:58:52.244347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.364618 (+1120271us) service_pool.cc:224] Handling call
0709 12:58:53.366531 (+  1913us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.362720  1640 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:53.065232  1466 catalog_manager.cc:5697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:53.370903  1536 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:53.373719  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:58:53.063050  3167 consensus_meta.cc:287] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.960s	user 0.016s	sys 0.010s
I20260709 12:58:53.395062  3167 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:53.397636  3167 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:53.398149  3241 consensus_meta.cc:287] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 1.112s	user 0.008s	sys 0.004s
I20260709 12:58:53.398806  3241 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.401484  3241 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:53.385180  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:53.403808  1643 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:53.291378  3422 consensus_meta.cc:287] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 1.348s	user 0.009s	sys 0.004s
I20260709 12:58:53.406590  3422 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:53.407747  1572 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:52.955282  3359 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.409112  3359 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:53.409628  3422 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:53.194078  3343 consensus_meta.cc:287] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.388s	user 0.000s	sys 0.031s
I20260709 12:58:53.384577  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1361) took 1364 ms. Trace:
I20260709 12:58:53.417398  1640 rpcz_store.cc:276] 0709 12:58:52.020111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.362182 (+1342071us) service_pool.cc:224] Handling call
0709 12:58:53.362540 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.384115 (+ 21575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.384472 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.179159  3332 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:53.290851  3378 consensus_meta.cc:287] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 1.225s	user 0.018s	sys 0.009s
W20260709 12:58:52.701328  3293 consensus_meta.cc:287] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.645s	user 0.009s	sys 0.004s
W20260709 12:58:53.291769  3203 consensus_meta.cc:287] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.194s	user 0.007s	sys 0.005s
I20260709 12:58:53.370934  1466 catalog_manager.cc:5697] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 1 to 3, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:53.385927  2440 raft_consensus.cc:2368] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:52.335032  3253 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.386708  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:53.387342  3444 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.433975  1466 catalog_manager.cc:5697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:53.414585  3383 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:53.304009  3392 consensus_meta.cc:287] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.978s	user 0.011s	sys 0.000s
I20260709 12:58:53.387713  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:53.444502  1570 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:53.388832  2436 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:53.234961  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:53.356221  3416 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:53.369398  2442 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:58:53.321128  3417 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.435452  3183 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:53.405452  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:58:53.457437  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 52107.9us
I20260709 12:58:53.458423  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:58:52.561196  3380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.297s	user 0.006s	sys 0.032s
W20260709 12:58:52.520246  3280 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.786s	user 0.022s	sys 0.016s
W20260709 12:58:53.467967  3280 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.841s	user 0.029s	sys 0.041s
W20260709 12:58:53.236250  3243 consensus_meta.cc:287] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 1.457s	user 0.019s	sys 0.011s
I20260709 12:58:53.469514  3243 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.415637  1572 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:58:53.416384  1643 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:53.470696  3183 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.920389  1714 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:53.449986  2440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42636 (request call id 319) took 1134 ms. Trace:
W20260709 12:58:53.168267  3262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.012s	sys 0.023s
I20260709 12:58:53.471962  2440 rpcz_store.cc:276] 0709 12:58:52.315984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.319117 (+  3133us) service_pool.cc:224] Handling call
0709 12:58:53.446371 (+1127254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.471313  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1359) took 1466 ms. Trace:
I20260709 12:58:53.426578  3343 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.473129  1643 rpcz_store.cc:276] 0709 12:58:52.005208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.382505 (+1377297us) service_pool.cc:224] Handling call
0709 12:58:53.471208 (+ 88703us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.475034  3343 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:53.441992  3293 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.476475  1641 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:53.477242  1639 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:53.477679  3293 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:52.590337  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:53.236210  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:53.426844  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:53.532179  1568 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:53.533030  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1232) took 1285 ms. Trace:
I20260709 12:58:53.429772  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:53.534510  1569 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:53.535164  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1266) took 1290 ms. Trace:
I20260709 12:58:53.535571  1569 rpcz_store.cc:276] 0709 12:58:52.244680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.429466 (+1184786us) service_pool.cc:224] Handling call
0709 12:58:53.535086 (+105620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.429598  3378 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:53.536975  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:53.539212  1569 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:53.540273  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1263) took 1298 ms. Trace:
I20260709 12:58:53.540758  1569 rpcz_store.cc:276] 0709 12:58:52.241875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.536579 (+1294704us) service_pool.cc:224] Handling call
0709 12:58:53.540180 (+  3601us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.542644  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:53.543555  1569 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:53.544209  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1274) took 1228 ms. Trace:
I20260709 12:58:53.544828  1569 rpcz_store.cc:276] 0709 12:58:52.315774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.542280 (+1226506us) service_pool.cc:224] Handling call
0709 12:58:53.544141 (+  1861us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:53.431969  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 69195.9us
I20260709 12:58:53.411990  3316 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:53.440835  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:52.306986  1566 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:53.440209  1466 catalog_manager.cc:5697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 2 to 4, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:53.448690  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1318) took 3819 ms. Trace:
I20260709 12:58:53.404482  3236 raft_consensus.cc:2764] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:58:53.456283  1644 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:53.553227  1638 rpcz_store.cc:276] 0709 12:58:49.629813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.637662 (+  7849us) service_pool.cc:224] Handling call
0709 12:58:49.639931 (+  2269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:49.730007 (+ 90076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.730041 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:49.730784 (+   743us) log.cc:844] Serialized 26 byte log entry
0709 12:58:50.412595 (+681811us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b18000109c0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca18de07 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1aac02 00007f18cce3220b 00007f18cce37d23 00007f18cce380d1 00007f18cd253a0f
0709 12:58:51.177516 (+764921us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:51.177569 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.177645 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:52.332957 (+1155312us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:58:53.448357 (+1115400us) raft_consensus.cc:1685] finished
0709 12:58:53.448389 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.448599 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6107,"raft.queue_time_us":137088,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":13009,"spinlock_wait_cycles":42825216,"thread_start_us":854209,"threads_started":2,"wal-append.queue_time_us":1484832}
I20260709 12:58:52.888775  3266 consensus_queue.cc:237] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.454586  2442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42636 (request call id 320) took 1138 ms. Trace:
I20260709 12:58:53.466914  3422 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:53.467449  3380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.203s	user 0.014s	sys 0.054s
W20260709 12:58:52.553236  3391 consensus_meta.cc:287] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.803s	user 0.016s	sys 0.002s
I20260709 12:58:53.470321  2438 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 5: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:53.471263  3183 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:53.472306  3262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.154s	user 0.013s	sys 0.027s
W20260709 12:58:53.280800  3344 consensus_meta.cc:287] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.051s	user 0.011s	sys 0.000s
I20260709 12:58:53.479597  3243 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:53.438858  3203 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.446926  3444 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:53.482434  3226 consensus_meta.cc:287] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 1.376s	user 0.010s	sys 0.002s
I20260709 12:58:53.482580  1719 raft_consensus.cc:2368] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4.
I20260709 12:58:53.454842  3416 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.289709  3386 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:53.483764  2436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42636 (request call id 317) took 1142 ms. Trace:
I20260709 12:58:53.487980  3359 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:53.483501  3417 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:53.450232  3392 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.496600  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:53.605615  1567 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.496965  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:53.502316  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38394 (request call id 101) took 1555 ms. Trace:
I20260709 12:58:53.504323  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1233) took 1714 ms. Trace:
I20260709 12:58:53.505991  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1340) took 1947 ms. Trace:
I20260709 12:58:53.608304  1641 rpcz_store.cc:276] 0709 12:58:51.571159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.571283 (+   124us) service_pool.cc:224] Handling call
0709 12:58:53.505728 (+1934445us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b540034dfd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:53.505914 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4311901952}
I20260709 12:58:53.512436  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1360) took 1506 ms. Trace:
I20260709 12:58:53.609205  1639 rpcz_store.cc:276] 0709 12:58:52.005541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.364028 (+1358487us) service_pool.cc:224] Handling call
0709 12:58:53.364369 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:53.477752 (+113383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.512077 (+ 34325us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400394754. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:53.512339 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258820992}
I20260709 12:58:53.512653  3406 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.610441  3406 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.611156  3392 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:53.613332  3417 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:53.516587  3253 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:53.519935  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:53.614861  2437 raft_consensus.cc:2410] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:58:53.614953  1563 raft_consensus.cc:2393] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:53.615741  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1261) took 1374 ms. Trace:
I20260709 12:58:53.616163  1563 rpcz_store.cc:276] 0709 12:58:52.241381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.519536 (+1278155us) service_pool.cc:224] Handling call
0709 12:58:53.615634 (+ 96098us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.617508  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:53.520335  3328 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.533474  1568 rpcz_store.cc:276] 0709 12:58:52.248053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.426462 (+1178409us) service_pool.cc:224] Handling call
0709 12:58:53.532934 (+106472us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.619369  1568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b968f124f3854f20bff4af609192c41a"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:53.620146  1568 raft_consensus.cc:606] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:53.620622  1568 raft_consensus.cc:614] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:58:53.430627  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 94467.6us
I20260709 12:58:53.622540  1685 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:53.596061  3236 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:53.630302  3236 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.630955  3236 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:53.608119  1714 rpcz_store.cc:276] 0709 12:58:51.789414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.790584 (+  1170us) service_pool.cc:224] Handling call
0709 12:58:52.678761 (+888177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.471813 (+793052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.503995 (+ 32182us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b5400229050. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:53.504222 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1990234496}
I20260709 12:58:53.630339  3332 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:53.633217  3332 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.633657  3332 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:53.598260  3344 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.606410  3226 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:52.679185  3376 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:53.638475  3376 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:53.549019  2448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.173s	user 0.014s	sys 0.055s
W20260709 12:58:53.639737  2448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.264s	user 0.014s	sys 0.055s
I20260709 12:58:53.640722  2448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 365) took 1401 ms. Trace:
I20260709 12:58:53.641117  2448 rpcz_store.cc:276] 0709 12:58:52.239346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.243208 (+  3862us) service_pool.cc:224] Handling call
0709 12:58:52.243530 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:52.243751 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:52.375584 (+131833us) log.cc:844] Serialized 14 byte log entry
0709 12:58:53.640280 (+1264696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:53.640347 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:53.640410 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.640496 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.640646 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1333278,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"thread_start_us":1395639,"threads_started":2}
I20260709 12:58:53.642642  3234 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.643198  3234 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.549697  1565 raft_consensus.cc:2376] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4. Re-sending same reply.
I20260709 12:58:53.647557  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1236) took 1266 ms. Trace:
I20260709 12:58:53.648026  1565 rpcz_store.cc:276] 0709 12:58:52.380896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.440462 (+1059566us) service_pool.cc:224] Handling call
0709 12:58:53.647469 (+207007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.650105  1568 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:53.651104  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1254) took 1411 ms. Trace:
I20260709 12:58:53.451072  3383 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:53.651538  1568 rpcz_store.cc:276] 0709 12:58:52.239631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.621402 (+1381771us) service_pool.cc:224] Handling call
0709 12:58:53.621819 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:53.650741 (+ 28922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.651035 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.653297  1563 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:53.560738  1647 raft_consensus.cc:2393] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:53.560997  1570 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:53.561905  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:53.557605  3210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.025s	sys 0.054s
I20260709 12:58:53.654728  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1264) took 1412 ms. Trace:
W20260709 12:58:53.654901  3210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.025s	sys 0.054s
W20260709 12:58:53.655244  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 93462.2us
I20260709 12:58:53.655597  3210 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:53.656031  3210 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:53.656385  3210 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:53.657212  1686 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:58:53.554693  3379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.775s	user 0.008s	sys 0.064s
I20260709 12:58:53.567479  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2144) took 1563 ms. Trace:
W20260709 12:58:53.658078  3379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.879s	user 0.008s	sys 0.064s
I20260709 12:58:53.658241  1644 rpcz_store.cc:276] 0709 12:58:52.004009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.360993 (+1356984us) service_pool.cc:224] Handling call
0709 12:58:53.567264 (+206271us) spinlock_profiling.cc:243] Waited 92.2 ms on lock 0x7b5400219654. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:53.567409 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212070784}
I20260709 12:58:53.565371  3422 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.659628  3422 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:53.641395  3376 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:53.660055  3438 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:53.660576  3438 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.660933  3438 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:53.567883  1566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1230) took 1365 ms (client timeout 1612 ms). Trace:
I20260709 12:58:53.607366  1571 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 12:58:53.662467  1566 rpcz_store.cc:269] 0709 12:58:52.195072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.211641 (+ 16569us) service_pool.cc:224] Handling call
0709 12:58:53.560224 (+1348583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.662892  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1259) took 1422 ms. Trace:
I20260709 12:58:53.663301  1571 rpcz_store.cc:276] 0709 12:58:52.240889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.496624 (+1255735us) service_pool.cc:224] Handling call
0709 12:58:53.662820 (+166196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.607146  1572 rpcz_store.cc:276] 0709 12:58:51.946666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.946917 (+   251us) service_pool.cc:224] Handling call
0709 12:58:53.502025 (+1555108us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400014d54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:53.502213 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3357406080}
I20260709 12:58:53.664877  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1270) took 1419 ms. Trace:
I20260709 12:58:53.559574  2442 rpcz_store.cc:276] 0709 12:58:52.316378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.320142 (+  3764us) service_pool.cc:224] Handling call
0709 12:58:53.454448 (+1134306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.625169  1640 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:53.623968  1567 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:53.685452  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1256) took 1445 ms. Trace:
I20260709 12:58:53.685813  1567 rpcz_store.cc:276] 0709 12:58:52.240105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.496159 (+1256054us) service_pool.cc:224] Handling call
0709 12:58:53.685381 (+189222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.687207  1567 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:58:53.687804  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1234) took 1412 ms. Trace:
I20260709 12:58:53.688088  1567 rpcz_store.cc:276] 0709 12:58:52.275737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.686570 (+1410833us) service_pool.cc:224] Handling call
0709 12:58:53.686968 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:53.687564 (+   596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.687751 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.689587  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1235) took 1379 ms. Trace:
I20260709 12:58:53.573647  3391 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:53.655135  1570 rpcz_store.cc:276] 0709 12:58:52.244018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.387368 (+1143350us) service_pool.cc:224] Handling call
0709 12:58:53.654664 (+267296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.691725  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1273) took 1376 ms. Trace:
I20260709 12:58:53.691977  1570 rpcz_store.cc:276] 0709 12:58:52.315438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.690936 (+1375498us) service_pool.cc:224] Handling call
0709 12:58:53.691235 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.691414 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.691442 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:53.691483 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:53.691518 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.691571 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.691678 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.549175  3316 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.624616  1685 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:53.665756  1645 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
W20260709 12:58:53.696154  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 71624us
I20260709 12:58:53.696959  1685 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:53.637742  3226 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:53.665305  1571 rpcz_store.cc:276] 0709 12:58:52.245926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.664036 (+1418110us) service_pool.cc:224] Handling call
0709 12:58:53.664380 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.664568 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.664596 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:53.664639 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:53.664676 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.664728 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.664821 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:53.705118  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 363490us
I20260709 12:58:53.670394  1686 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:53.676759  1719 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 1243) took 1850 ms (client timeout 1732 ms). Trace:
W20260709 12:58:53.710383  1719 rpcz_store.cc:269] 0709 12:58:51.826753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.856437 (+ 29684us) service_pool.cc:224] Handling call
0709 12:58:53.676496 (+1820059us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400065c54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:53.676670 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3737071488}
W20260709 12:58:53.677896  2437 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42636 (request call id 318) took 1362 ms (client timeout 1637 ms). Trace:
I20260709 12:58:53.678323  3328 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:53.679802  3234 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:53.682233  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1257) took 1441 ms. Trace:
W20260709 12:58:53.682776  1642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1351) took 2028 ms (client timeout 2340 ms). Trace:
W20260709 12:58:53.684032  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2140) took 1681 ms (client timeout 1983 ms). Trace:
W20260709 12:58:53.729847  1642 rpcz_store.cc:269] 0709 12:58:51.654851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.697213 (+ 42362us) service_pool.cc:224] Handling call
0709 12:58:53.682526 (+1985313us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b540022b854. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:53.682700 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4508085632}
I20260709 12:58:53.729736  1568 rpcz_store.cc:276] 0709 12:58:52.240351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.662314 (+1421963us) service_pool.cc:224] Handling call
0709 12:58:53.662676 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.662877 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.662906 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:53.662953 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:53.662991 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.663044 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.682139 (+ 19095us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.626933  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38580 (request call id 5) took 1022 ms. Trace:
I20260709 12:58:53.731519  1641 rpcz_store.cc:276] 0709 12:58:52.604187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.625598 (+1021411us) service_pool.cc:224] Handling call
0709 12:58:53.626840 (+  1242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.689873  1567 rpcz_store.cc:276] 0709 12:58:52.309883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.688760 (+1378877us) service_pool.cc:224] Handling call
0709 12:58:53.689091 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.689274 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.689299 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:53.689342 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:53.689376 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.689442 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.689539 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.664425  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1267) took 1419 ms. Trace:
I20260709 12:58:53.605540  2436 rpcz_store.cc:276] 0709 12:58:52.315092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.316983 (+  1891us) service_pool.cc:224] Handling call
0709 12:58:53.457576 (+1140593us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:53.718132  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.653820  3383 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:53.725112  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1362) took 1704 ms. Trace:
I20260709 12:58:53.751433  1640 rpcz_store.cc:276] 0709 12:58:52.020538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.419007 (+1398469us) service_pool.cc:224] Handling call
0709 12:58:53.419656 (+   649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.699333 (+279677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.724889 (+ 25556us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400373554. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:53.725057 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472156032}
I20260709 12:58:53.709684  1537 leader_election.cc:400] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:53.752826  1537 leader_election.cc:403] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:58:53.548063  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:53.753716  1569 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:58:53.731874  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 61563.4us
I20260709 12:58:53.738318  1563 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
W20260709 12:58:53.746613  1645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1343) took 2151 ms (client timeout 2084 ms). Trace:
W20260709 12:58:53.730597  1647 rpcz_store.cc:269] 0709 12:58:52.002670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.002835 (+   165us) service_pool.cc:224] Handling call
0709 12:58:53.683794 (+1680959us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540021a054. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:53.683960 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3466448640}
I20260709 12:58:53.754518  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:53.755298  1646 raft_consensus.cc:1240] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: []
W20260709 12:58:53.754426  1645 rpcz_store.cc:269] 0709 12:58:51.572104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.583178 (+ 11074us) service_pool.cc:224] Handling call
0709 12:58:53.723428 (+2140250us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b5400373f54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:53.723570 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4749729536}
I20260709 12:58:53.757541  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1272) took 1442 ms. Trace:
I20260709 12:58:53.758533  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1260) took 1517 ms. Trace:
I20260709 12:58:53.758982  1569 rpcz_store.cc:276] 0709 12:58:52.241140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.547701 (+1306561us) service_pool.cc:224] Handling call
0709 12:58:53.758464 (+210763us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.759197  1568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:34298
W20260709 12:58:53.752610  1685 connection.cc:256] RPC call timeout handler was delayed by -1.190368253000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
I20260709 12:58:53.760632  1568 raft_consensus.cc:606] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:53.761142  1568 raft_consensus.cc:614] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:53.704885  3316 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:53.758118  1563 rpcz_store.cc:276] 0709 12:58:52.315033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.617118 (+1302085us) service_pool.cc:224] Handling call
0709 12:58:53.757451 (+140333us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:53.763758  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 305444us
I20260709 12:58:53.723039  3262 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:53.768577  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 435685us
I20260709 12:58:53.725447  3347 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:53.772316  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:53.777666  3343 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.781334  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:53.781116  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:53.782122  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:53.782833  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:53.797389  1718 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:53.770889  3383 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.784338  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:53.802531  1720 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:53.785315  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:53.761370  3392 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:53.794974  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:53.786566  1719 raft_consensus.cc:1275] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:58:53.782768  1686 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:53.801398  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:53.803440  1717 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:53.807183  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:53.807814  1713 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:53.772513  3347 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.804126  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:53.724516  2437 rpcz_store.cc:269] 0709 12:58:52.315547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.318079 (+  2532us) service_pool.cc:224] Handling call
0709 12:58:53.677666 (+1359587us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54006a0c54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:53.677822 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":595903744}
I20260709 12:58:53.780193  3328 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:53.806231  1612 connection.cc:256] RPC call timeout handler was delayed by -1.293154449000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 12:58:53.812867  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2778544490000741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 12:58:53.814093  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2544544490000362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 12:58:53.815562  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2355544490000625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 12:58:53.816052  1612 connection.cc:256] RPC call timeout handler was delayed by -1.181554449000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
I20260709 12:58:53.820170  1717 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:53.798118  3250 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:53.786232  3262 raft_consensus.cc:697] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:53.834264  1685 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:53.835064  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:53.804729  3392 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:53.814504  3347 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:53.801250  3396 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.826329  3156 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:53.848378  3396 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.808306  3383 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:53.814824  3328 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:53.821640  3452 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.800402  3343 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.826176  3250 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:53.857359  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 86542us
I20260709 12:58:53.824466  3378 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:53.848412  3156 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:53.856621  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 132040us
I20260709 12:58:53.853313  3392 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:53.850967  3396 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:53.832012  3160 consensus_queue.cc:1059] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:58:53.857991  3328 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:53.862799  3452 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.769706  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:54.037480  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:53.865477  3250 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:54.041657  3316 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.868579  3156 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:54.113303  3475 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.002s
I20260709 12:58:54.117578  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1233) took 1868 ms. Trace:
I20260709 12:58:53.983493  3449 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 12:58:54.113379  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:53.883675  3262 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.118306  1572 rpcz_store.cc:276] 0709 12:58:52.248411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.665078 (+1416667us) service_pool.cc:224] Handling call
0709 12:58:53.665378 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:53.665710 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:54.048147 (+382437us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.055208 (+  7061us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:54.056866 (+  1658us) log.cc:844] Serialized 26 byte log entry
0709 12:58:54.057064 (+   198us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:54.092608 (+ 35544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.112847 (+ 20239us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:54.116662 (+  3815us) raft_consensus.cc:1685] finished
0709 12:58:54.116705 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:54.117071 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174196,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":199979,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":5732,"thread_start_us":330570,"threads_started":2,"wal-append.queue_time_us":6589}
W20260709 12:58:54.058821  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 356926us
I20260709 12:58:54.129161  1611 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:53.821321  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:53.866756  3102 consensus_queue.cc:1059] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.264s
I20260709 12:58:53.959280  3332 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.132009  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:53.961768  3347 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.884779  3383 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:54.135562  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:54.137145  2442 raft_consensus.cc:2393] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:53.893204  3406 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:53.885636  3442 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:58:53.896373  3453 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:54.122849  1640 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:54.112332  2436 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 1.
I20260709 12:58:54.061939  1686 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:54.164861  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 394900us
I20260709 12:58:53.878582  3465 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:53.963884  3359 raft_consensus.cc:3055] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:58:53.884200  3456 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:58:53.890913  3344 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:54.137200  3347 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:53.934428  3391 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:53.749434  1566 rpcz_store.cc:276] 0709 12:58:52.244980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.663297 (+1418317us) service_pool.cc:224] Handling call
0709 12:58:53.663734 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.663974 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.664013 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:53.664064 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:53.664138 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.664214 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.664353 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:54.158259  3332 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:53.871441  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:53.964999  3466 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:54.186896  3465 raft_consensus.cc:697] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:54.188021  1645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:47230
I20260709 12:58:54.190182  1713 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
W20260709 12:58:54.191855  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 63228.8us
I20260709 12:58:54.192920  3344 raft_consensus.cc:3055] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:53.935192  3416 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:53.980393  3438 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:54.195051  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 133521us
W20260709 12:58:54.195477  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.196003  3347 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:54.199146  3316 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:54.200091  3210 consensus_meta.cc:287] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.008s
W20260709 12:58:54.200866  3472 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.145s	user 0.002s	sys 0.000s
I20260709 12:58:53.951725  3444 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:53.869024  3203 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:53.885465  3343 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:54.201604  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1349) took 2578 ms. Trace:
I20260709 12:58:54.208236  3416 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:54.222647  2437 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:54.223011  3416 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.204880  3344 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:54.209052  3452 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:54.209129  1645 raft_consensus.cc:606] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:58:54.210183  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 339573us
I20260709 12:58:54.210806  3359 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:54.234398  3453 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.235580  3359 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.881839  3448 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.322s
I20260709 12:58:54.237500  3359 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:53.909984  3183 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.225224  3416 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:54.241366  3183 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:54.235850  3453 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.244427  1712 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:54.244571  3453 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:54.215992  3236 consensus_meta.cc:287] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.534s	user 0.005s	sys 0.016s
I20260709 12:58:54.227830  1645 raft_consensus.cc:614] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:54.222107  3210 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.247222  1685 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:54.248113   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:58:54.248760  3203 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:54.250941  1685 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:54.245669  3236 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.253598  3183 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:54.228102  3344 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.254607  3183 consensus_queue.cc:1059] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:54.255396  3344 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:54.255853  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.257213  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1255) took 2017 ms. Trace:
I20260709 12:58:54.224040  1611 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:54.223806  3347 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:58:54.260999  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 337847us
I20260709 12:58:54.261576  3347 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.262346  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:54.245644  3438 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:54.263550  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1223) took 4400 ms. Trace:
W20260709 12:58:54.265791  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 554151us
I20260709 12:58:54.257359  3225 raft_consensus.cc:3055] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:54.282366  3225 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:54.282768  3465 consensus_queue.cc:237] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.266929  3479 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.284360  3479 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:54.268095  3482 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:54.272575  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:54.258180  1565 rpcz_store.cc:276] 0709 12:58:52.239870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.648905 (+1409035us) service_pool.cc:224] Handling call
0709 12:58:53.649407 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.649731 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:53.751466 (+101735us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.255658 (+504192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:54.255794 (+   136us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:54.256046 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.256212 (+   166us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:54.256796 (+   584us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":180487,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"thread_start_us":545044,"threads_started":2}
I20260709 12:58:54.286460  3482 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.286890  1640 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:54.287030  3482 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:54.287304  2405 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:54.269804  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:54.289009  1641 raft_consensus.cc:2368] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4.
I20260709 12:58:54.270183  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:54.290206  1642 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:54.290462  3417 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:54.291004  3417 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:54.291462  3417 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.283784  3225 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.295773  3225 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:54.297659  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:54.298540  1713 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:54.298965  1537 leader_election.cc:336] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Timed out: RequestConsensusVote RPC to 127.0.107.196:39297 timed out after 1.553s (SENT)
I20260709 12:58:54.299530  1537 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:54.301308  1714 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:54.302930  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:54.304126  1717 raft_consensus.cc:3055] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:54.271973  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:54.274816  3236 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:54.221769  1646 rpcz_store.cc:276] 0709 12:58:51.623112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.707771 (+ 84659us) service_pool.cc:224] Handling call
0709 12:58:51.708059 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.755974 (+2047915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.200889 (+444915us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b540021a554. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:54.201336 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4707680640}
I20260709 12:58:54.304538  1717 raft_consensus.cc:740] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:54.269369  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:54.248004  3210 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:54.320946  1647 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:54.322307  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1364) took 2254 ms. Trace:
I20260709 12:58:54.323578  3383 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:54.322857  1638 rpcz_store.cc:276] 0709 12:58:52.067881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.568425 (+1500544us) service_pool.cc:224] Handling call
0709 12:58:53.593198 (+ 24773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.593530 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:53.774120 (+180590us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.321453 (+547333us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:54.321598 (+   145us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:54.321698 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.321818 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:54.322043 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122200,"prepare.queue_time_us":265137,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":2658,"thread_start_us":565866,"threads_started":2,"wal-append.queue_time_us":392237}
I20260709 12:58:54.324151  3383 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.324961  3383 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:54.253855  1685 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:54.262742  3392 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:53.977300  3422 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:54.335652  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 116429us
I20260709 12:58:54.335764  1717 consensus_queue.cc:260] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:54.337146  1611 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:54.338140  3316 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:54.338771  3396 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:54.339581  1717 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:54.343230  2405 connection.cc:256] RPC call timeout handler was delayed by -2.1286964680000438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
W20260709 12:58:54.343833  2405 connection.cc:256] RPC call timeout handler was delayed by -1.9630964680000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 12:58:54.344107  3452 consensus_queue.cc:1059] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:54.345865  3476 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:54.340072  3396 raft_consensus.cc:697] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:54.340634  3444 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:54.346879  3476 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:54.347885  2405 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:54.348001  3444 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.349151  3449 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:54.350080  3449 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:58:54.351084  3480 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:58:54.351395  3444 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:54.341023  3391 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:54.339783  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.352686  3476 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:54.342360  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:54.353910  1712 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:54.353120  3396 consensus_queue.cc:237] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.353175  1719 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
W20260709 12:58:54.341940  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 70306.5us
I20260709 12:58:54.359928  1612 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:54.345924  3452 raft_consensus.cc:3055] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:54.360785  3452 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:54.361335   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:54.361876  3391 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:54.362494  3391 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:54.362346  3452 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.362941  3391 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.276947  1715 rpcz_store.cc:276] 0709 12:58:49.862607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.945647 (+ 83040us) service_pool.cc:224] Handling call
0709 12:58:51.823202 (+1877555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:51.828683 (+  5481us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:52.154202 (+325519us) log.cc:844] Serialized 14 byte log entry
0709 12:58:53.431762 (+1277560us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:53.442883 (+ 11121us) log.cc:844] Serialized 26 byte log entry
0709 12:58:53.443071 (+   188us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:53.443109 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.443191 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:54.208838 (+765647us) raft_consensus.cc:1685] finished
0709 12:58:54.208886 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:54.263075 (+ 54189us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54003aaf50. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:54.263259 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93471,"prepare.queue_time_us":125368,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":90414,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":18140,"spinlock_wait_cycles":4309423872,"thread_start_us":1436819,"threads_started":2,"wal-append.queue_time_us":1395080}
I20260709 12:58:54.371467  3479 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:54.371585  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.377362  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1363) took 2329 ms. Trace:
I20260709 12:58:54.378139  1643 rpcz_store.cc:276] 0709 12:58:52.047279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.474092 (+1426813us) service_pool.cc:224] Handling call
0709 12:58:53.474567 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.474862 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:53.758770 (+283908us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.289184 (+530414us) spinlock_profiling.cc:243] Waited 9.85 ms on lock 0x7b180031c1e0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca125c0a 00007f18d3865219 00007f18ca1ada40 00007f18ca1a84e4 00007f18ca1a8455 00007f18cd290060 00007f18cd2a2716 00007f18cd2b3287 00007f18cd2b3208
0709 12:58:54.301216 (+ 12032us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b240029b8c8. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0319c4 00007f18ca02facb 00007f18ca1eadc9 00007f18ca1eaa55 00007f18ca1ea09d 00007f18cce1c10e 00007f18cce3388c 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221
0709 12:58:54.333365 (+ 32149us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:54.365344 (+ 31979us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:54.374192 (+  8848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.376799 (+  2607us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:54.377087 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14099,"prepare.queue_time_us":339662,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":147483,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":300,"spinlock_wait_cycles":63003648,"thread_start_us":689087,"threads_started":2,"wal-append.queue_time_us":424387}
I20260709 12:58:54.380189  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:54.395323  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:54.400840  1717 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
I20260709 12:58:54.364665  3452 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:54.382681  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 163684us
W20260709 12:58:54.418282  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 61823.5us
W20260709 12:58:54.413007  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 67911.4us
I20260709 12:58:54.411585  3210 raft_consensus.cc:2764] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:58:54.425102  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 354500us
I20260709 12:58:54.428951  3444 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:54.428596  3391 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.432646  3391 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:54.437361  1713 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:58:54.432519  1611 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:54.435453  3416 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.433022  1647 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
W20260709 12:58:54.384368  3328 consensus_meta.cc:287] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.502s	user 0.016s	sys 0.000s
I20260709 12:58:54.393242  3392 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:54.447268  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.452008  3476 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:54.454348  1564 raft_consensus.cc:2368] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4.
W20260709 12:58:54.456203  1564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1231) took 2208 ms (client timeout 1732 ms). Trace:
W20260709 12:58:54.456648  1564 rpcz_store.cc:269] 0709 12:58:52.247666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:52.528712 (+281046us) service_pool.cc:224] Handling call
0709 12:58:54.455852 (+1927140us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b5400279f54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:54.456083 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2110168320}
I20260709 12:58:54.450754  1715 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
W20260709 12:58:54.461835  1537 leader_election.cc:336] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Timed out: RequestConsensusVote RPC to 127.0.107.196:39297 timed out after 1.637s (SENT)
I20260709 12:58:54.473348  1719 raft_consensus.cc:2368] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 2. Current term is 3.
W20260709 12:58:54.479861  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 100110us
I20260709 12:58:54.481079  1612 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:54.482452  1537 leader_election.cc:336] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Timed out: RequestConsensusVote RPC to 127.0.107.196:39297 timed out after 1.821s (SENT)
I20260709 12:58:54.482828  3487 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:54.483745  3487 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:54.483961  1537 leader_election.cc:336] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Timed out: RequestConsensusVote RPC to 127.0.107.196:39297 timed out after 1.852s (SENT)
I20260709 12:58:54.484367  3487 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:54.491096  3482 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.492511  3383 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:54.494197  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 62369.5us
I20260709 12:58:54.486338  3476 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:54.496165  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.464737  3328 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:54.499482  3416 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:54.500056  1713 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:54.501505  3328 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:54.503501  3422 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:54.487098  3156 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.506178  3156 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:54.485747  2406 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:54.510865  2406 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:54.512152  1537 leader_election.cc:336] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Timed out: RequestConsensusVote RPC to 127.0.107.196:39297 timed out after 1.918s (SENT)
I20260709 12:58:54.512001  3458 consensus_queue.cc:1048] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:54.513454  1537 leader_election.cc:336] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Timed out: RequestConsensusVote RPC to 127.0.107.196:39297 timed out after 1.983s (SENT)
W20260709 12:58:54.517086  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet 71dad2e408414d2fa4f055c6eccf5b92: Illegal state: Replica a4be9cc90aca4dd4ad7db103062a7208 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:58:54.512478  3476 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:54.511942  3449 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:54.518688  3449 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:54.519286  3449 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.523330  1612 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:54.526515  1612 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:54.532122  1611 leader_election.cc:336] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Timed out: RequestConsensusVote RPC to 127.0.107.195:43271 timed out after 1.610s (SENT)
I20260709 12:58:54.534934  3487 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.538686  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.539110  3487 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:54.542877  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.544206  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.545998  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.546907  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.548003  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.548200  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.549038  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.556066  1642 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:54.561087  1719 raft_consensus.cc:2393] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 6: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 12:58:54.563417  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 309724us
I20260709 12:58:54.569016  1718 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:54.573029  1640 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:54.576805  3380 raft_consensus.cc:2764] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:58:54.582614  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:58:54.583431  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.581360  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:54.585040  1716 raft_consensus.cc:2410] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:54.568881  3458 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:54.588701  1720 raft_consensus.cc:2368] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:54.569139  3396 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:54.590683  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.591212  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.591534  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:54.592216  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.587618  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.572144  3391 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:54.591050  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:58:54.594934  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 133615us
I20260709 12:58:54.596652  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.598692  3476 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:54.602128  3476 raft_consensus.cc:697] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:54.602970  1720 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:54.603349  3476 consensus_queue.cc:237] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:54.606068  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.606616  1719 raft_consensus.cc:2410] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:58:54.607553  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.578374  3416 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:54.607594  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 81243.7us
I20260709 12:58:54.608385  1721 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:58:54.608372  3416 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.609392  2405 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:54.572826  3417 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:54.610577  3478 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:54.611127  3478 raft_consensus.cc:697] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:54.611570  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.612427  1713 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:54.612239  3478 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:54.613435  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:54.608752  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:54.614039  3416 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:54.618731  1715 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:54.625427  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:54.627310  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:54.631739  1719 raft_consensus.cc:2368] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:54.596287  3449 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:54.633246  1536 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:54.639437  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:54.641317  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:54.643450  2436 raft_consensus.cc:2410] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:54.638324  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:54.646178  3391 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:54.651003  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:54.654489  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:54.656302  3383 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:54.657051  1717 raft_consensus.cc:2410] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:54.657245  3416 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:54.657829  3416 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:54.658275  3416 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:54.658434  3482 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:54.651057  3391 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:54.661767  3391 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:54.631748  3250 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:54.666285  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.662734  2405 leader_election.cc:400] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 2. Current term is 3.
I20260709 12:58:54.668673  2405 leader_election.cc:403] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:58:54.669461  2437 raft_consensus.cc:2368] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:54.671021  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 12:58:54.669488  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 49271.2us
I20260709 12:58:54.679438  1611 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:54.679769  3383 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:54.681071  3383 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.680896  3396 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:54.681941  3383 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:54.682926  3458 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:54.683743  3458 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.679582  3417 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:54.682219  3396 raft_consensus.cc:697] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:54.687937  1537 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:54.689031  3396 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:54.690040  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 56904.6us
I20260709 12:58:54.692723  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:54.694391  3482 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:54.687278  3458 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:54.699456  1712 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:54.708053  3449 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:54.709903  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:54.714692  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.717645  3482 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:58:54.710860  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 50175.4us
I20260709 12:58:54.713251  1612 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:54.717918  3250 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:54.720487  3482 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:54.723896  3417 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:54.724383  3482 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.725270  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:54.741349  1611 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:54.748796  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:54.753615  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:54.754328  1612 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:54.758957  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:54.759958  1640 raft_consensus.cc:2393] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:54.761395  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:54.762241  3452 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:54.762676  1537 leader_election.cc:400] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:54.763036  1537 leader_election.cc:403] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:58:54.763131  3452 raft_consensus.cc:697] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:54.763895  3484 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:54.734889  3449 consensus_queue.cc:1059] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:58:54.765036  3449 raft_consensus.cc:3055] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:54.765396  3449 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:54.765802  3452 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.766469  3449 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:54.767968  3449 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:54.774582  1642 raft_consensus.cc:2410] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:54.774742  3378 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:54.775494  3378 raft_consensus.cc:697] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:54.775772  3422 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:54.776270  3422 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:54.776763  3422 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:54.776865  3378 consensus_queue.cc:237] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.774582  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:54.775223  3458 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:54.783965  3203 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:54.784327  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:54.784996  3458 raft_consensus.cc:697] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:58:54.783968  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 66693.4us
I20260709 12:58:54.785336  1643 raft_consensus.cc:2393] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 12:58:54.791131  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.791308  1611 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:54.793134  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:54.793471  1647 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:58:54.795339  1640 raft_consensus.cc:2393] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:54.786154  3458 consensus_queue.cc:237] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:54.804041  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 60373.3us
I20260709 12:58:54.804806  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:58:54.805826  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 66147.6us
I20260709 12:58:54.803293  3380 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:54.797122  3478 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:54.820063  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:54.821347  1647 raft_consensus.cc:2410] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:54.822794  3448 consensus_queue.cc:1059] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:58:54.823906  1466 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 107) took 9093 ms. Trace:
I20260709 12:58:54.827207  1467 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 1 to 2, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:54.829538  1467 catalog_manager.cc:5697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 1 to 2, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:54.809645  3383 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:54.797036  3391 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:54.836098  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:54.837162  1640 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:54.798712  3416 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:54.843437  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 45812.5us
I20260709 12:58:54.817734  3380 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.854678  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:54.855623  1647 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:54.859072  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:54.857769  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:58:54.862314  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 44420.4us
I20260709 12:58:54.863649  1536 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:54.864866  3484 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:58:54.866765  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:54.868389  1564 raft_consensus.cc:2393] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 5: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:54.882969  1467 catalog_manager.cc:5697] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 1 to 2, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:54.886955  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.855544  3380 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:54.870774  3316 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:54.893469  1536 leader_election.cc:400] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3.
I20260709 12:58:54.872754  3391 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:54.895241  1536 leader_election.cc:403] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:54.897993  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:54.904198  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:54.904625  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:54.905108  2437 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:54.905355  1564 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:54.826367  1466 rpcz_store.cc:276] 0709 12:58:45.725550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.737345 (+ 11795us) service_pool.cc:224] Handling call
0709 12:58:45.970937 (+233592us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54004254d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd202090 00007f18cd2a0f3a 00007f18d30571cc 00007f18d315537e 00007f18d16162a4 00007f18d1616232 00007f18d1616161 00007f18d16160dc 00007f18d1615392 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:54.817310 (+8846373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:53.830787 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:53.911592 (+ 80805us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:53.911635 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:58:53.911661 (+    26us) tablet.cc:662] Decoding operations
0709 12:58:53.912393 (+   732us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:53.912458 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:53.912496 (+    38us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:58:53.912923 (+   427us) tablet.cc:701] Row locks acquired
0709 12:58:53.912938 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:58:53.913133 (+   195us) write_op.cc:270] Start()
0709 12:58:53.913267 (+   134us) write_op.cc:276] Timestamp: P: 1783601933913068 usec, L: 0
0709 12:58:53.913288 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:58:53.916100 (+  2812us) log.cc:844] Serialized 1686 byte log entry
0709 12:58:54.546167 (+630067us) op_driver.cc:464] REPLICATION: finished
0709 12:58:54.667570 (+121403us) write_op.cc:301] APPLY: starting
0709 12:58:54.706253 (+ 38683us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:54.706515 (+   262us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:54.706731 (+   216us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:54.707606 (+   875us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:54.708015 (+   409us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:58:54.708069 (+    54us) write_op.cc:312] APPLY: finished
0709 12:58:54.708617 (+   548us) log.cc:844] Serialized 41 byte log entry
0709 12:58:54.709755 (+  1138us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:54.709946 (+   191us) write_op.cc:454] Released schema lock
0709 12:58:54.710018 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:54.710731 (+   713us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:54.710775 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"spinlock_wait_cycles":269576576,"child_traces":[["op",{"apply.queue_time_us":90954,"apply.run_cpu_time_us":3932,"apply.run_wall_time_us":62117,"num_ops":4,"prepare.queue_time_us":237794,"prepare.run_cpu_time_us":22295,"prepare.run_wall_time_us":238480,"raft.queue_time_us":141891,"raft.run_cpu_time_us":40520,"raft.run_wall_time_us":171982,"replication_time_us":552216,"thread_start_us":416874,"threads_started":4,"wal-append.queue_time_us":138847}]]}
I20260709 12:58:54.910622  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:54.849427  3478 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:54.917302  3478 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:54.919138  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:54.920204  1640 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:54.922017  3482 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:54.924331  3482 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:54.926697  3417 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 2. Current term is 3.
I20260709 12:58:54.927084  3383 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:54.928335  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:54.929463  1642 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:54.896147  3448 consensus_queue.cc:1243] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:54.930776  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:54.931844  1565 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:54.937328  2448 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:54.942375  3416 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:54.944033  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 58125.1us
I20260709 12:58:54.942518  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.948086  3396 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.948930  3396 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:54.964329  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 62278.5us
I20260709 12:58:54.972880  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:54.976904  1718 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:54.979269  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:54.985412  1712 raft_consensus.cc:2393] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:54.986794  1612 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:54.989914  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:54.965700  3416 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3.
I20260709 12:58:54.993505  1564 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:55.000052  3482 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:55.007807  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:55.007565  3378 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:55.009212  3378 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:55.017432  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:55.018563  1717 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:58:55.004462  3458 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:55.011353  3378 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:55.026984  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:55.028257  1566 raft_consensus.cc:2368] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4.
I20260709 12:58:55.031741  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:55.037155  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:55.038955  1717 raft_consensus.cc:2368] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4.
I20260709 12:58:55.041080  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:55.044847  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:55.045861  1712 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:55.048031  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:55.049777  1720 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:55.053917  3391 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:55.054492  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:55.049831  1719 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:58:55.057628  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:55.050709  1713 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:55.050583  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:55.051508  1716 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:55.062327  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:55.024343  3452 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.063835  3452 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.025141  3476 raft_consensus.cc:3055] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:55.064793  3476 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:55.065235  1712 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:55.065879  3476 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:55.066254  3383 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:55.067788  3476 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:55.069041  3487 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:55.069545  3487 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:55.069931  3487 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:55.072243  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.075340  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:55.076004  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:55.076176  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:55.076643  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:55.076999  1566 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:55.077296  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:55.076525  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:55.077310  1567 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:55.078863  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 56899.1us
I20260709 12:58:55.076061  1568 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:55.084715  2448 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:58:55.087091  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:55.088043  1611 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:55.090663  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2607074439999906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
I20260709 12:58:55.091609  1563 raft_consensus.cc:1240] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:55.091733  1569 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:55.091897  3482 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:55.092347  3482 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:55.092784  3482 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:55.093528  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:55.094118  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.106570  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:55.107443  2442 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:55.110044  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:55.114787  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:55.085721  3452 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:55.063144  3458 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.136770  1567 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:55.136463  1536 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:55.145197  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.129647  3416 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:55.157413  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:55.158511  1571 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:55.159632  3316 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:55.165548  1536 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:55.160187  3316 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:55.171855  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 87449.3us
W20260709 12:58:55.151825  3506 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.129s	user 0.000s	sys 0.002s
I20260709 12:58:55.178390  3516 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:55.179251  3516 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:55.179811  3508 log.cc:927] Time spent T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.171s	user 0.001s	sys 0.003s
I20260709 12:58:55.181322  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:55.182478  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:55.182670  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:55.183233  1571 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:58:55.187458  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:55.187742  1717 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:58:55.188102  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.189538  3516 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:55.189620  3499 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:55.191954  1611 leader_election.cc:400] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4.
I20260709 12:58:55.192303  1611 leader_election.cc:403] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:58:55.199388  3516 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4.
I20260709 12:58:55.201069  3383 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:55.203996  3383 consensus_queue.cc:1059] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:55.205241  3516 raft_consensus.cc:3055] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:55.205726  3516 raft_consensus.cc:740] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:55.206912  3516 consensus_queue.cc:260] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.211568  3516 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:55.213737  3444 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:55.221438  3444 raft_consensus.cc:3055] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:55.221838  3444 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:55.222735  3444 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.214715  3383 consensus_queue.cc:1059] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:55.216712  1571 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:55.168247  3316 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:55.163096  3452 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:55.163121  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 12:58:55.237079  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 132253us
I20260709 12:58:55.238281  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:55.173382  3396 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:55.255014  1571 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 5: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:58:55.257663  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 92222.8us
I20260709 12:58:55.239068  3391 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:55.238575  3452 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.268003  3444 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:55.265175  3156 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.269896  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:58:55.278352  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0672194869999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
I20260709 12:58:55.271332  2442 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:55.271943  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:55.272825  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:55.251510  3484 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:55.273661  2438 raft_consensus.cc:1240] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:55.295040  1536 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:55.296604  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:55.296830  3416 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:55.298237  3482 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.300819  3482 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:55.285362  2448 raft_consensus.cc:1240] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:55.302141  1567 raft_consensus.cc:1240] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:55.285845  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:55.286075  3509 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:58:55.287276  3458 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:55.273754  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:55.309245  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:55.273923  2436 raft_consensus.cc:1240] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:55.311455  1569 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:55.297688  3416 raft_consensus.cc:2764] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:58:55.317080  1721 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:55.281611  3452 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:55.323967  1640 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:55.328392  1565 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:55.329782  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.333216  1570 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:55.334411  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.334583  1644 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:55.335244  1638 raft_consensus.cc:2368] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 2. Current term is 3.
I20260709 12:58:55.336354  1566 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:55.338454  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:55.340420  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:55.341737  1642 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:55.341974  1571 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:58:55.267266  3396 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:58:55.354766  1646 raft_consensus.cc:1240] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:55.355149  1570 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:58:55.362377  1642 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:55.362607  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.362085  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:58:55.363235  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.363897  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:58:55.364784  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 225830us
I20260709 12:58:55.307349  3156 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.364818  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:55.375834  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:55.374804  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.377558  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:55.380826  1686 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:55.381953  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.382254  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:55.382915  1645 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:55.382961  1639 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:55.383946  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.384035  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:55.384620  1645 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:55.385697  1570 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:55.386142   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:55.390627  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.394567  1571 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:55.365176  2437 raft_consensus.cc:2410] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:58:55.395969  1570 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:55.397089  1642 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:55.397212  1568 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:55.402981  1638 raft_consensus.cc:2393] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:55.352231  3487 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:55.414745  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:55.420694  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.421507  1647 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:55.422724  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.425534  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.426546  3518 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:55.427623  1572 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:55.430706  3203 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:58:55.431154  3515 log.cc:927] Time spent T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:58:55.431986  1572 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:55.431867  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 51368.4us
I20260709 12:58:55.436910  1647 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:55.438122  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.356258  3380 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:55.407223  3422 consensus_meta.cc:287] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.005s
I20260709 12:58:55.450773  1571 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:55.447798  1565 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
W20260709 12:58:55.453290  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.454080  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.454749  1638 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:55.449226  1641 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:55.463023  3527 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:55.464681  1645 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:55.472393  3499 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:55.477288  3527 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.477913  3527 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:55.490927  1569 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:55.503449  3380 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:55.453745  3422 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:55.505836  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 56186.6us
I20260709 12:58:55.459213  3525 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:55.532595  1643 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
I20260709 12:58:55.534571  1640 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:55.544152  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 95669.1us
W20260709 12:58:55.546241  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 113473us
I20260709 12:58:55.549806  1644 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:55.550446  1642 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:55.551157  2405 leader_election.cc:400] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 2. Current term is 3.
I20260709 12:58:55.555959  1685 leader_election.cc:400] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4.
I20260709 12:58:55.556339  1685 leader_election.cc:403] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:58:55.555058  1643 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:55.519187  1566 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
W20260709 12:58:55.559911  1612 leader_election.cc:336] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.962s (SENT)
I20260709 12:58:55.560678  1612 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:55.562208  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:55.569520  3396 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:55.571456  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:55.572618  3396 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:55.573103  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:55.575115  1642 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:55.574491  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:55.539381  3503 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:58:55.584014  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:55.585832  1643 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:58:55.546506  3499 consensus_queue.cc:1059] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:58:55.536933  3525 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.565224  3518 raft_consensus.cc:697] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:55.586330  1643 pending_rounds.cc:85] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 1
I20260709 12:58:55.574043  3396 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:55.591634  1643 pending_rounds.cc:107] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:58:55.586851  3482 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:55.599751  1643 raft_consensus.cc:2889] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:55.587361  3530 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.591013  3458 raft_consensus.cc:3055] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:58:55.617645  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.596354  3203 raft_consensus.cc:697] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:55.594897  3380 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:55.597198  3156 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:55.597168  3533 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4.
W20260709 12:58:55.624495  3378 consensus_meta.cc:287] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.597s	user 0.014s	sys 0.000s
I20260709 12:58:55.615048  3482 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:55.584821  3250 consensus_queue.cc:1059] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:58:55.622655  3458 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:55.623838  3422 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:55.646878  3391 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.643559  3378 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:55.647485  3391 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.639345  3530 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.649152  3378 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:55.619040  3532 consensus_queue.cc:1059] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:58:55.650206  3530 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:55.649922  3391 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:55.651911  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.652609  1646 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:55.654274  3518 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:55.632966  3487 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:55.635460  3380 raft_consensus.cc:697] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:55.643608  3482 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:55.642297  3465 consensus_queue.cc:1059] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:58:55.669219  3484 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:55.685101  3523 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:55.667094  3476 consensus_queue.cc:1059] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:58:55.668124  3534 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:55.701009  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 12:58:55.693749  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:55.706189  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.687542  3531 raft_consensus.cc:3055] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:55.711822  3517 raft_consensus.cc:3055] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:55.712098  3532 raft_consensus.cc:3055] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:58:55.719246  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 119505us
I20260709 12:58:55.714526  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:55.715030  3476 raft_consensus.cc:3055] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:55.705922  3544 consensus_queue.cc:1059] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:58:55.688242  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:55.698894  3528 raft_consensus.cc:3055] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:55.727535  1638 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:55.719504  3517 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:55.718879  3531 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:58:55.734629  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.719749  3532 raft_consensus.cc:740] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:55.690699  3527 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:55.754814  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 116957us
I20260709 12:58:55.731868  3476 raft_consensus.cc:740] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:55.687964  3458 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.734764  3526 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:55.761310  1685 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:55.765947  2448 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:55.747879  3528 raft_consensus.cc:740] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:55.706653  3523 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.693249  3203 consensus_queue.cc:237] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:55.771494  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 172284us
I20260709 12:58:55.773085  1686 leader_election.cc:400] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4.
I20260709 12:58:55.772182  3544 consensus_queue.cc:1059] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:58:55.775501  3544 raft_consensus.cc:3055] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:55.775823  3544 raft_consensus.cc:740] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:55.776647  3544 consensus_queue.cc:260] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:55.778172  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.778774  3528 consensus_queue.cc:260] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:55.780160  3528 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:55.782291  3458 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:55.782578  3250 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:55.783151  3250 raft_consensus.cc:697] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:55.784166  3250 consensus_queue.cc:237] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.783370  3544 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:55.795897  3523 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:55.796176  3541 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:58:55.797865  1685 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:55.800678  3547 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:55.801354  3547 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:55.802403  3547 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.803812  1686 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:55.804860  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.805234  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:55.805766  1641 raft_consensus.cc:2368] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3.
I20260709 12:58:55.805876  3545 consensus_queue.cc:1059] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:55.807080  3545 raft_consensus.cc:3055] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:55.807441  3545 raft_consensus.cc:740] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:55.808537  3452 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.810127  1686 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:55.810443  1638 raft_consensus.cc:2368] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6.
W20260709 12:58:55.810513  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.812402  1646 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:55.808440  3545 consensus_queue.cc:260] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:55.771780  2405 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:55.816291  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 44603.7us
I20260709 12:58:55.817238  2405 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:55.843590  1685 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:55.846855  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:55.771363  3525 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:55.860437  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:55.849524  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:55.740888  3380 consensus_queue.cc:237] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:55.861620  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:55.862217  3546 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:55.862537  1640 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:55.804867  3156 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:55.863437  3546 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:55.863550  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:55.863502  3156 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.864470  3156 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:55.865077  3546 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:55.865521  3546 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.865855  3546 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:55.860630  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:58:55.872295  1536 connection.cc:256] RPC call timeout handler was delayed by -2.4815008600000397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 12:58:55.873054  1536 connection.cc:256] RPC call timeout handler was delayed by -2.4347008600000777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 12:58:55.873404  1536 connection.cc:256] RPC call timeout handler was delayed by -2.2682008600000358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 12:58:55.873719  1536 connection.cc:256] RPC call timeout handler was delayed by -2.2403008600000476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
W20260709 12:58:55.884671  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.913406  1686 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:55.874547  1685 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:55.913122  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.840225  3544 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:55.919319  1536 connection.cc:256] RPC call timeout handler was delayed by -2.0162008600000263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 12:58:55.921898  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:58:55.921936  1536 connection.cc:256] RPC call timeout handler was delayed by -1.9793008600000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 12:58:55.923273  1536 connection.cc:256] RPC call timeout handler was delayed by -1.9640008600000556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 12:58:55.923636  1536 connection.cc:256] RPC call timeout handler was delayed by -1.8290156930000308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
I20260709 12:58:55.924338  1641 raft_consensus.cc:2368] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3.
I20260709 12:58:55.770157  3526 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:55.926715  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 52248us
W20260709 12:58:55.924055  1536 connection.cc:256] RPC call timeout handler was delayed by -1.7867156930000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 12:58:55.929692  1536 connection.cc:256] RPC call timeout handler was delayed by -1.6922156930000369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260709 12:58:55.930022  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:58:55.930276  1536 connection.cc:256] RPC call timeout handler was delayed by -1.6292156929999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 12:58:55.930689  1536 connection.cc:256] RPC call timeout handler was delayed by -1.6274156930000458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
W20260709 12:58:55.930976  1536 connection.cc:256] RPC call timeout handler was delayed by -1.5959156929999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 12:58:55.931246  1536 connection.cc:256] RPC call timeout handler was delayed by -1.5356156930000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 12:58:55.931505  1536 connection.cc:256] RPC call timeout handler was delayed by -1.5122156930000301s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 12:58:55.931787  1536 connection.cc:256] RPC call timeout handler was delayed by -1.4933156929999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
W20260709 12:58:55.932112  1536 connection.cc:256] RPC call timeout handler was delayed by -1.4348008600000526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26940000000000003s for a response
W20260709 12:58:55.932345  1536 connection.cc:256] RPC call timeout handler was delayed by -1.404215693000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 12:58:55.932587  1536 connection.cc:256] RPC call timeout handler was delayed by -1.3025156930000321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
I20260709 12:58:55.855818  3533 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:58:55.932849  1536 connection.cc:256] RPC call timeout handler was delayed by -1.2872156930000074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
I20260709 12:58:55.934338  1642 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:55.929605  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.931604  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:55.938691  1640 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 6: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:55.939330  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.940594  1644 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:55.942425  1641 raft_consensus.cc:2393] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:55.970202  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:55.974259  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:55.975394  1646 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:58:55.918516  3528 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:58:55.935422  3472 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.090s	user 0.001s	sys 0.005s
I20260709 12:58:55.979204  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:55.842662  3531 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:55.984856  3551 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:58:55.986459  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 143361us
I20260709 12:58:56.001953  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:56.002853  1642 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:55.925505  3544 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:55.984269  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:55.938527  3545 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.012472  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:55.937633  3203 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:55.840261  3532 consensus_queue.cc:260] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.019743  3549 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.020270  3550 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:56.021277  3527 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:56.022550  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:56.023770  3539 raft_consensus.cc:3055] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:56.029724  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:56.001897  3380 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:56.030447  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.054903  1567 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 12:58:56.015976  3316 consensus_meta.cc:287] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.762s	user 0.014s	sys 0.001s
I20260709 12:58:56.020280  1566 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:56.013751  3544 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:56.032752  1639 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:56.033697  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:55.874117  3517 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:56.072161  1642 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
W20260709 12:58:56.059389  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 135878us
W20260709 12:58:56.015022  3516 consensus_meta.cc:287] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.784s	user 0.014s	sys 0.000s
I20260709 12:58:56.005501  3528 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:56.076283  1646 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:56.031755  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:56.040776  3550 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:56.062170  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.053680  3539 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:56.007612  3359 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:58:56.088289  1569 raft_consensus.cc:2393] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:56.088761  1647 raft_consensus.cc:2410] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:56.060101  3531 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.092386  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.080356  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:58:56.084800  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:56.075491  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 94083.1us
W20260709 12:58:56.090492  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.095450  1568 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:56.098131  3540 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:56.098980  3527 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:56.101792  1685 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:56.102926  3540 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:56.103577  3540 raft_consensus.cc:697] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:56.086138  3550 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:56.068997  3465 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:56.066174  3203 raft_consensus.cc:697] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:56.075928  3452 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:56.068706  3380 raft_consensus.cc:697] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:56.075904  3503 raft_consensus.cc:3055] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:56.038569  3546 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.119714  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.131911  1569 raft_consensus.cc:2393] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:56.065711  3316 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:56.133189  1563 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:56.132895  3203 consensus_queue.cc:237] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:56.134398  3316 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:56.122241  3380 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.127257  1643 raft_consensus.cc:2410] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:56.060288  3534 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:58:56.108980  3532 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:56.143482  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.127863  3156 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:56.149586  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 137213us
I20260709 12:58:56.130743  3503 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:56.151787  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.136315  3533 raft_consensus.cc:697] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:56.117118  3499 consensus_queue.cc:1059] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 12:58:56.153486  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.181886  3528 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:56.199554  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.220715  3476 consensus_queue.cc:260] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.235910  3476 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:56.237875  3458 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.238529  3458 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:56.241566  3458 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:56.232016  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.242769  1563 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:56.249953  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:56.251670  3552 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.393s	user 0.003s	sys 0.000s
I20260709 12:58:56.254691  3517 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:56.255043  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:56.231046  3550 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:56.257346  3550 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:56.198778  1565 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:56.259631  1715 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:56.260131  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.265038  1565 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:56.243703  3503 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.194928  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.217049  3540 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:56.248821  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:56.262382  1715 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:56.155542  1686 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:56.261618  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:56.284458  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.199234  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.285415  1571 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:56.286310  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.287492  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:56.287814  3482 consensus_meta.cc:287] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.002s
I20260709 12:58:56.288311  1571 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:56.288460  3482 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:56.199733  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.290390  3549 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.290961  3549 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.153976  1568 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:56.293515  3549 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:56.197049  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.293835  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.294287  3482 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:56.262441  3156 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:56.195349  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.296516  1638 raft_consensus.cc:1240] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:56.258018  3533 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:56.296942  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.297683  1564 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:56.177546  1567 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:56.272249  1639 raft_consensus.cc:1240] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:56.289151  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.309784  1644 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:56.273113  1569 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:56.274940  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:56.196575  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.298365  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:56.311488  1718 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:56.315187  1720 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:56.317269  1713 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:58:56.300602  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:56.269451  1642 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:56.319896  1716 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:56.294605  1570 raft_consensus.cc:2393] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:56.302253  1568 raft_consensus.cc:2393] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:56.309494  1571 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:56.272763  1643 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:56.321211  1572 raft_consensus.cc:2393] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:56.309521  1685 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:56.311580  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.323851  1569 raft_consensus.cc:2368] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4.
I20260709 12:58:56.323686  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.325596  1565 raft_consensus.cc:2376] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4. Re-sending same reply.
W20260709 12:58:56.326538  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:56.328524  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 173083us
I20260709 12:58:56.328737  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:56.329444  1715 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:56.329562  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.331163  1719 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:56.258023  3526 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:56.337805  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:56.336963  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.338877  1572 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:56.337088  1641 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:58:56.340588  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.343925  1571 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:58:56.345364  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.338707  1721 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:56.368953  1686 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:56.347102  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:56.351238  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.350839  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.408861  1565 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:56.349996  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:56.410082  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 274791us
I20260709 12:58:56.417044  1569 raft_consensus.cc:2393] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:56.370841  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:56.417596  1639 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:56.375674  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:56.370815  1566 raft_consensus.cc:2393] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:56.410380  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.387395  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:58:56.423427  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 54820.7us
I20260709 12:58:56.389698  3156 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:56.421793  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.447273  1572 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:56.453135  1571 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:58:56.454437  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:58:56.405894  3542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.019s	sys 0.006s
I20260709 12:58:56.373588  3482 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.367388  3250 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:56.461014  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:58:56.462332  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.469794  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.334534  3523 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.111s
I20260709 12:58:56.470104  1569 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:56.334813  3458 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 12:58:56.471069  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.473361  1571 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:56.474512  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.441619  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:56.451782  3518 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:56.484748  1570 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:56.462894  3546 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:56.486131  1571 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:58:56.515326  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 71772.2us
I20260709 12:58:56.478174  1639 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:56.521014  1643 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:56.528013  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.449813  3527 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:58:56.492660  1565 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:58:56.459406  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:56.419219  3538 consensus_queue.cc:1059] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:58:56.499049  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.559749  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:56.471832  3542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.021s	sys 0.011s
I20260709 12:58:56.495896  3316 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:56.468043  3156 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:56.528560  1685 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:56.536773  1611 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:56.564656  1572 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:56.560640  1720 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:58:56.485443  1563 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:58:56.472666  3556 consensus_queue.cc:1059] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:58:56.575497  1570 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:58:56.576982  1571 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:56.578605  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 133632us
I20260709 12:58:56.514899  3518 raft_consensus.cc:697] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:56.582587  1611 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:56.477826  3482 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.586134  2442 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:56.586654  3380 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:58:56.587136  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 58684.5us
I20260709 12:58:56.561101  3546 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.566710  3444 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:58:56.602738  3546 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.605119  3546 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:56.570209  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.588165  3518 consensus_queue.cc:237] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:56.588570  3562 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:58:56.596443  1569 raft_consensus.cc:1240] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:56.561723  3526 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:58:56.592078  2437 raft_consensus.cc:2393] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:56.515309  3550 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:58:56.612366  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.603250  3482 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:56.618535  2405 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:56.621536  1568 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:58:56.602732  3564 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:58:56.619441  3538 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:56.625944  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:56.626082  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.649534  1569 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:56.626972  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:56.650010  1716 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:58:56.628185  3547 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:56.606583  3516 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:56.610795  3452 consensus_queue.cc:1059] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:58:56.634462  3576 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:56.635885  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 55092.8us
I20260709 12:58:56.637563  1566 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:56.656402  1570 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:56.638664  3156 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:56.590734  3560 consensus_queue.cc:1059] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:58:56.671324  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:56.650658  1715 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:58:56.654561  1720 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:56.599484  3316 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.676657  1570 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:58:56.664969  3568 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:58:56.683158  1566 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:58:56.683940  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:56.685302  3579 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:56.685999  3579 raft_consensus.cc:697] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:56.687304  1645 raft_consensus.cc:2410] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:58:56.687716  3532 consensus_meta.cc:287] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.539s	user 0.004s	sys 0.008s
I20260709 12:58:56.687160  3579 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.688472  3316 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:56.660466  3523 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:58:56.654522  3516 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:56.670080  3538 raft_consensus.cc:697] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:58:56.705824  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 49923.7us
I20260709 12:58:56.708592  3250 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:58:56.717314  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.719233  3538 consensus_queue.cc:237] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:56.720736  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:56.721597  3316 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.722468  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.722604  3550 consensus_queue.cc:1059] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:56.723150  1568 raft_consensus.cc:2376] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5. Re-sending same reply.
I20260709 12:58:56.723928  3550 raft_consensus.cc:3055] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:56.724295  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.725546  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.726408  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:58:56.726977  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:56.727751  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.727607  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.729238  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.724324  3550 raft_consensus.cc:740] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:56.729839  1569 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:58:56.730585  3550 consensus_queue.cc:260] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:56.732583  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.733403  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.735730  1568 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:56.738323  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:56.693537  2437 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:56.742826  1570 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:58:56.743605  1572 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:58:56.699602  3516 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.749178  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:58:56.734995  3531 consensus_meta.cc:287] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.003s
I20260709 12:58:56.750129  1568 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:56.751120  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:56.752872  1565 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:56.751273  3577 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:56.667980  3576 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.733736  3527 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:56.753878  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.757499  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:56.751680  2443 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:56.761942  1572 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:58:56.759438  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:56.760299  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:56.760807  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:56.769302  3575 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.769629  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:56.769963  3575 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:56.770583  1714 raft_consensus.cc:2368] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6.
I20260709 12:58:56.770929  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:56.748088  3316 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:56.766602  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:56.769330  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:56.774240  1720 raft_consensus.cc:2368] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
W20260709 12:58:56.775496  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.769886  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:56.778898  1721 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:56.741853  3573 consensus_queue.cc:1059] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:58:56.753645  3577 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.753624  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:56.781499  1719 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:58:56.758358  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:58:56.779001  3544 consensus_meta.cc:287] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.004s
I20260709 12:58:56.781266  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:56.791929  1572 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:56.783918  1569 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:56.796186  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:56.773439  3527 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:58:56.801002  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.796943  2438 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:56.788895  3482 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:56.799960  3544 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.789253  3577 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:56.809085  2437 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:56.809233  3539 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.810654  1572 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:58:56.812238  3533 raft_consensus.cc:3055] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:56.816962  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:56.819468  1566 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:56.819631  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.771749  3523 consensus_queue.cc:1059] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 12:58:56.804153  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 43952.4us
I20260709 12:58:56.836169  1570 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 12:58:56.800941  3545 consensus_meta.cc:287] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.782s	user 0.007s	sys 0.007s
I20260709 12:58:56.821939  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:56.837224  1721 raft_consensus.cc:2393] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:58:56.861050  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:56.862324  2448 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:56.862381  1565 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:56.863976  3583 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.864372  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:56.864678  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:56.864553  3583 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.865875  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:56.867002  3583 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:56.856019  3316 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.868904  3316 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:56.871079  3316 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:56.872130  3584 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:56.872802  3584 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:56.875393  3584 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:56.877705  3581 log.cc:927] Time spent T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:58:56.878763  2438 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:56.881245  3544 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:56.858176  3476 consensus_meta.cc:287] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.622s	user 0.013s	sys 0.000s
I20260709 12:58:56.881639  3586 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:58:56.882923  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:56.855589  3560 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:58:56.884516  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:56.891264  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:56.910445  1720 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:56.912560  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:58:56.922796  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.974236  1568 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:56.834754  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:56.978209  1565 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
W20260709 12:58:56.979533  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 67099.5us
I20260709 12:58:56.977699  3316 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.985704  3482 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:56.851899  3533 raft_consensus.cc:740] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:57.022910  1568 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:57.029433  1565 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:56.986545  3539 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:56.996052  3532 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:56.996640  3523 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:57.046375  2448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 332) took 1073 ms. Trace:
I20260709 12:58:57.023123  3452 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.833882  3250 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:56.998437  3586 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:58:57.047312  2448 rpcz_store.cc:276] 0709 12:58:55.972712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.982353 (+  9641us) service_pool.cc:224] Handling call
0709 12:58:55.982663 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.862777 (+880114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.045873 (+183096us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b54005901d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:57.046232 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2022487296}
I20260709 12:58:57.050426  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:57.049760  1565 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:57.164783  1563 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:58:57.031363  3316 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.153429  3580 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.162889  3476 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.090029  3557 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.079538  3452 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:57.126125  3564 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:58:57.115011  3576 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:57.190765  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 306310us
I20260709 12:58:57.057559  3532 raft_consensus.cc:697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:57.209475  3482 consensus_queue.cc:1059] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:57.210901  3482 raft_consensus.cc:3055] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:57.211302  3482 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:57.212430  3482 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:57.213994  3482 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:57.194463  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.216948  1469 catalog_manager.cc:5697] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 1 to 2, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.221596  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:57.223534  1611 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:57.080204  3523 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:57.228940  1720 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:57.048708  3527 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:57.189556  3580 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:57.194797  3476 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:57.194212  3316 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:57.248180  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:57.110654  3533 consensus_queue.cc:260] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:57.195220  3557 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:57.276199  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.295235  3592 log.cc:927] Time spent T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.124s	user 0.000s	sys 0.002s
I20260709 12:58:57.231220  3545 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.213925  3577 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:57.300992  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 77527.3us
I20260709 12:58:57.324041  1611 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:57.325803  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.253353  3594 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:57.323800  3538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.017s	sys 0.017s
W20260709 12:58:57.336269  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.325069  3516 consensus_meta.cc:287] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.007s
I20260709 12:58:57.340014  3516 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:57.349853  3516 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:57.331833  3533 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.357311  3594 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:57.351295  3599 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:57.359573  3316 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:57.360380  3557 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:57.361281  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1279) took 1125 ms. Trace:
I20260709 12:58:57.361441  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:57.362138  3580 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:57.361754  1717 rpcz_store.cc:276] 0709 12:58:56.235864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.236014 (+   150us) service_pool.cc:224] Handling call
0709 12:58:56.236455 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:56.236862 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:56.236899 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:56.697168 (+460269us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b2c00047778. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cbb91a11 00007f18cbba1372 00007f18cd2d3a01 00007f18cd29843a 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2
0709 12:58:56.703763 (+  6595us) log.cc:844] Serialized 26 byte log entry
0709 12:58:57.037124 (+333361us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:57.037178 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.037289 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:57.360917 (+323628us) raft_consensus.cc:1685] finished
0709 12:58:57.360941 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:57.361182 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":412,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":166,"spinlock_wait_cycles":31295232,"thread_start_us":284905,"threads_started":1,"wal-append.queue_time_us":428889}
I20260709 12:58:57.362190  2444 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:58:57.364354  3577 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:57.365028  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.365496  1537 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:58:57.367403  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.379251  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 137350us
I20260709 12:58:57.383220  1536 leader_election.cc:400] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:57.383658  1536 leader_election.cc:403] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:58:57.392861  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 68931.8us
I20260709 12:58:57.332072  3545 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:57.323697  3532 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:57.378577  3605 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:57.403839  3316 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:57.431846  3476 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:57.397174  3452 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:57.435814  1536 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:57.407338  3516 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:58:57.414002  3593 log.cc:927] Time spent T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:58:57.414724  3605 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.454977  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:57.458384  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 64538.4us
I20260709 12:58:57.464349  3545 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:57.464810  3516 raft_consensus.cc:697] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:57.465974  3516 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:57.467433  1567 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:57.468218  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1267) took 1220 ms. Trace:
I20260709 12:58:57.468537  1567 rpcz_store.cc:276] 0709 12:58:56.247478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.466665 (+1219187us) service_pool.cc:224] Handling call
0709 12:58:57.467083 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:57.467896 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.468154 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.469394  3594 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.451347  3316 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:58:57.478557  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 66833.8us
W20260709 12:58:57.479683  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.455689  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:57.462231  3523 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:57.488751  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet 5c79f18b2f4247348564b91d430d6124: Illegal state: Replica 338d817f94ee4c1bad162e9a5860b68a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:58:57.458458  3605 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:57.488577  3316 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:57.494645  3545 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.481117  3452 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.469974  3594 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:57.494817  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1255) took 1297 ms. Trace:
I20260709 12:58:57.495409  3545 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:57.502447  3476 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.504976  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:57.505584  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:57.597826  3594 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:57.508315  3600 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
W20260709 12:58:57.602960  2406 leader_election.cc:336] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.648s (SENT)
I20260709 12:58:57.603632  2406 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:57.659884  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.660317  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 205414us
W20260709 12:58:57.665306  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet cbe76ebe20be4546bed4f95e2ee090bd: Illegal state: Replica a4be9cc90aca4dd4ad7db103062a7208 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
W20260709 12:58:57.672364  2406 leader_election.cc:336] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.719s (SENT)
I20260709 12:58:57.506906  3452 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:57.507644  1564 rpcz_store.cc:276] 0709 12:58:56.197170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.407022 (+1209852us) service_pool.cc:224] Handling call
0709 12:58:57.494737 (+ 87715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:57.675119  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:57.641193  3539 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:57.676584  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:57.659943  3600 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:57.529770  3476 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:57.705256  3482 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:57.715499  3476 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:57.718472  3545 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:57.720461  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.673418  3605 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:57.746239  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 71238us
I20260709 12:58:57.242342   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:57.747905  1469 catalog_manager.cc:5697] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 5 to 6, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:58:57.774550  1712 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:57.776588  1712 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:57.660290  3611 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:58:57.789666  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.789302  3611 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:57.791849  3611 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:57.791990  3605 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:57.792470  3611 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.685283  3600 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:57.792999  3611 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:57.795339  3600 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:57.796119  3600 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:57.796283  3612 log.cc:927] Time spent T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.216s	user 0.002s	sys 0.000s
I20260709 12:58:57.796751  3600 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:57.799428  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:57.801354  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:57.761319  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.803342  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:57.804240  2442 raft_consensus.cc:2393] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
W20260709 12:58:57.805001  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.818385  3482 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:57.830612  3452 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:57.831305  3452 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:57.835662  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:58:57.824517  3605 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:57.878651  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:57.863282  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.831831  3452 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:57.839233  2442 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:57.898524  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 97278.5us
I20260709 12:58:57.904263  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:57.949460  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:57.953039  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:57.954212  1717 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:57.910169  3527 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 12:58:57.963961  3533 consensus_meta.cc:287] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.003s
I20260709 12:58:57.970367  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:57.952440  3605 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:58:57.982281  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.962759  1714 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:58:57.965909  3620 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.969244  3626 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.976737  3625 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.976521  3523 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:58:57.981459  3476 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.997956  1536 leader_election.cc:400] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:57.985899  3606 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:57.972267  3527 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:57.998611  3611 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:58.015377  1536 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:58.020174  3380 raft_consensus.cc:3055] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:58.020797  3380 raft_consensus.cc:740] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:58.007304  3606 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:58.023022  3606 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:58.017134  3611 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.025862  3611 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:58.028286  3611 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:58.021756  3380 consensus_queue.cc:260] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:58.030679  3619 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:58:58.030747  3380 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:58.035089  2406 leader_election.cc:336] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.617s (SENT)
I20260709 12:58:58.037590  3605 raft_consensus.cc:2764] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:58:58.038878  3624 log.cc:927] Time spent T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:58:58.039534  3633 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.040130  3633 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:58.038443  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:58.043397  3605 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:57.991977  3620 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:58.045308  3528 raft_consensus.cc:3055] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:58.001377  3523 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:58.053784  3452 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:58.003386  3476 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:58.055431  3523 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:58.055590  3575 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:58.049222  1645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2163) took 2189 ms (client timeout 2685 ms). Trace:
I20260709 12:58:58.012874  3600 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:58.050284  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.046742  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:57.997015  3626 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:58.060465  2406 leader_election.cc:336] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.506s (SENT)
I20260709 12:58:58.060959  2406 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:58.063058  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.063189  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.065065  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.051541  1536 leader_election.cc:400] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6.
I20260709 12:58:58.000520  3625 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:58.055969  3476 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:58.056412  1645 rpcz_store.cc:269] 0709 12:58:55.859844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.860012 (+   168us) service_pool.cc:224] Handling call
0709 12:58:58.048981 (+2188969us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400240754. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:58.049125 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1898495360}
I20260709 12:58:58.066351  1536 leader_election.cc:403] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:58:58.067209  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 77399.7us
I20260709 12:58:58.071396  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.072178  1719 raft_consensus.cc:2410] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:58.052804  3528 raft_consensus.cc:740] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:58:58.070587  3597 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.712s	user 0.005s	sys 0.000s
I20260709 12:58:58.074352  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1323) took 1340 ms. Trace:
I20260709 12:58:58.077589  3605 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:58:58.078457  1536 leader_election.cc:400] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:58:58.086707  2442 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:58:58.089272  3625 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:58.079223  1638 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:58.080387  1642 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:58.094569  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b724690541549b4be895303885a0998"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:58:58.096993  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.093458  1566 rpcz_store.cc:276] 0709 12:58:56.734240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.871528 (+137288us) service_pool.cc:224] Handling call
0709 12:58:56.871875 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.998729 (+126854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:56.999815 (+  1086us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:57.023392 (+ 23577us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:57.026806 (+  3414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.074039 (+1047233us) spinlock_profiling.cc:243] Waited 96.2 ms on lock 0x7b54003b3b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:58:58.074121 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.074281 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221238528}
I20260709 12:58:58.068368  3539 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.099766  3526 raft_consensus.cc:3055] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:58.074297  3527 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:58.105885  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.105515  1719 raft_consensus.cc:606] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:58.074944  3476 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:58.124200  1572 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:58.124424  1563 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:58:58.100340  3528 consensus_queue.cc:260] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:58.125415  1567 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:58:58.122892  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 62481.9us
I20260709 12:58:58.127627  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:58.130815  1719 raft_consensus.cc:614] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:58.124642  3539 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:58.140738  1537 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:58:58.141217  2406 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.714s (SENT) [suppressed 43 similar messages]
I20260709 12:58:58.142786  1569 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:58.145243  1640 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:58.119616  3633 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:58.147915  1686 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:58.119930  3610 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:58.125432  3526 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:58.152998  3359 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:58:58.159880  1640 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:58.160140  3539 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:58.154865  3614 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:58.141482  3527 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.162417  3527 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:58.154816  3594 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:58.164580  3527 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:58.156354  3575 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:58.165688  3575 raft_consensus.cc:697] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:58.166478  3626 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:58.167092  2442 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:58.166766  3575 consensus_queue.cc:237] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:58.149150  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:58.168232  3620 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:58.168668  2438 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:58.169729  1714 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:58:58.170320  3594 raft_consensus.cc:697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:58.170490  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:58:58.171080  1713 raft_consensus.cc:606] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:58.171414  3594 consensus_queue.cc:237] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:58.175570  3595 log.cc:927] Time spent T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.819s	user 0.000s	sys 0.002s
I20260709 12:58:58.165557  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:58.177146  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1318) took 1449 ms. Trace:
I20260709 12:58:58.164701  3614 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:58.180363  1686 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:58.183395  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.178558  3614 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:58.177665  1570 rpcz_store.cc:276] 0709 12:58:56.728002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.851626 (+123624us) service_pool.cc:224] Handling call
0709 12:58:56.868379 (+ 16753us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:56.868642 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:56.868670 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:56.978537 (+109867us) log.cc:844] Serialized 26 byte log entry
0709 12:58:57.309095 (+330558us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:57.309139 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.309234 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:58.174677 (+865443us) spinlock_profiling.cc:243] Waited 69.6 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:58:58.176850 (+  2173us) raft_consensus.cc:1685] finished
0709 12:58:58.176874 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.177084 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160097024,"thread_start_us":276047,"threads_started":1,"wal-append.queue_time_us":348706}
W20260709 12:58:58.161826  3635 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:58:58.198635  1640 raft_consensus.cc:1240] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
W20260709 12:58:58.154511  3599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.005s	sys 0.012s
I20260709 12:58:58.198671  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:58:58.203442  1686 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:58.201942  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.212908  1713 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:58:58.179502  3528 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:58.214660  1536 connection.cc:256] RPC call timeout handler was delayed by -1.1087678829999845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 12:58:58.221191  1536 connection.cc:256] RPC call timeout handler was delayed by -1.0961678829999641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
I20260709 12:58:58.222460  1536 leader_election.cc:400] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3.
I20260709 12:58:58.222878  1536 leader_election.cc:403] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:58:58.224990  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.225247  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.225967  1719 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
I20260709 12:58:58.230160  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1330) took 1492 ms. Trace:
I20260709 12:58:58.234642  1640 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:58.196602  3602 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:58.230757  1568 rpcz_store.cc:276] 0709 12:58:56.737451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.025510 (+288059us) service_pool.cc:224] Handling call
0709 12:58:57.025737 (+   227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:57.170800 (+145063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.170843 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:57.171500 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 12:58:57.242221 (+ 70721us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:57.242279 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.242386 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:58.041545 (+799159us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:58:58.218384 (+176839us) raft_consensus.cc:1685] finished
0709 12:58:58.218417 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.230034 (+ 11617us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1304,"raft.queue_time_us":48101,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":36765,"spinlock_wait_cycles":122687360,"thread_start_us":70223,"threads_started":1,"wal-append.queue_time_us":155275}
W20260709 12:58:58.211400  3599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.006s	sys 0.013s
I20260709 12:58:58.172216  3560 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:58:58.248126  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:58.255237  1568 raft_consensus.cc:2410] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:58.259471  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.262931  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 109) took 1727 ms. Trace:
I20260709 12:58:58.157629  3610 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:58.219044  3482 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:58.226928  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:58.233299  3573 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:58.263520  1571 rpcz_store.cc:276] 0709 12:58:56.535174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.535462 (+   288us) service_pool.cc:224] Handling call
0709 12:58:56.576721 (+ 41259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:56.577582 (+   861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.262636 (+1685054us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b54004204d0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:58.262848 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93828480}
I20260709 12:58:58.266798  1568 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:58.284024  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.284499  3601 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:58.218406  3545 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:58:58.228117  3518 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:58:58.299595  3601 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:58.300282  3601 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:58.235942  3533 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 12:58:58.289587  3634 log.cc:927] Time spent T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 12:58:58.293577  1568 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:58.306174  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.294128  1571 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:58:58.296125  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:58.286617  1714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:58:58.255386  3599 raft_consensus.cc:697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:58.247156  3602 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.323946  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.324864  1713 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
W20260709 12:58:58.325394  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:58.325578  1612 leader_election.cc:336] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.531s (SENT)
I20260709 12:58:58.326242  1612 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:58.326442  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 88536.9us
I20260709 12:58:58.332058  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.333163  1713 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
I20260709 12:58:58.334374  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:58.335829  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:58.297605  3540 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:58.336964  3540 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:58.337738  2442 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:58:58.338551  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:58:58.345036  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.311337  3476 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:58.346375  3476 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:58.350510  3476 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:58.351444  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:58.352972  2437 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:58.363440  3574 raft_consensus.cc:3055] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:58.364079  3574 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:58.364993  3574 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:58.324536  3602 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:58.274073  3527 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 12:58:58.377593  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 52041.8us
W20260709 12:58:58.378652  1612 leader_election.cc:336] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.553s (SENT)
I20260709 12:58:58.379172  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:58.383643  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:58.398615  2405 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:58:58.387952  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.436273  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.272938  3526 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:58.329523  3359 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:58:58.375559  3574 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:58.440665  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:58.329815  1714 raft_consensus.cc:606] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:58:58.446213  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 305016us
W20260709 12:58:58.452293  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 230209us
I20260709 12:58:58.311424  3482 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:58.297567  3573 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:58.438750  3476 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:58.454875  2444 raft_consensus.cc:2410] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:58:58.380834  3606 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:58.461082  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:58.463053  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:58.465969  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:58.456775  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 59553.3us
W20260709 12:58:58.469791  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet 289133b3cbb949f4967bbf24c6b14e19: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:58:58.470131  1686 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:58.396013  3560 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
W20260709 12:58:58.465648  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.463079  3526 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:58.492990  1566 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
W20260709 12:58:58.496712  3596 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 1.138s	user 0.003s	sys 0.000s
W20260709 12:58:58.486837  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 91011.5us
W20260709 12:58:58.501708  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 96230us
I20260709 12:58:58.519784  3573 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:58.520848  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1302) took 1291 ms. Trace:
I20260709 12:58:58.521746  3482 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:58.475710  3539 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:58.506610  3640 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:58.509372  3645 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:58.560603  3645 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:58.507455  3647 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.132s
I20260709 12:58:58.508421  3649 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:58:58.473948  3476 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:58.400189  3601 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:58.504415  1612 leader_election.cc:336] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.591s (SENT)
I20260709 12:58:58.506398  3638 consensus_queue.cc:1059] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:58:58.486727  3599 consensus_queue.cc:237] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:58.557473  3642 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:58:58.501986  3614 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:58.557528  3610 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:58.553339  1720 rpcz_store.cc:276] 0709 12:58:57.229032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.230034 (+  1002us) service_pool.cc:224] Handling call
0709 12:58:57.241026 (+ 10992us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:57.337266 (+ 96240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.337326 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:58.096425 (+759099us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b4800061158. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d21c1aa1 00007f18d21b8b37 00007f18d21b89ca 00007f18d22b026f 00007f18d22aff37 00007f18d22c455c 00007f18d22c4508 00007f18d22c4488 00007f18d22c4443 00007f18d22c36ec 00007f18d11eda96
0709 12:58:58.172883 (+ 76458us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b2c00047778. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cbb91a11 00007f18cbba1372 00007f18cd2d3a01 00007f18cd29843a 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2
0709 12:58:58.173636 (+   753us) log.cc:844] Serialized 26 byte log entry
0709 12:58:58.297368 (+123732us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:58.297421 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.297505 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:58.520516 (+223011us) raft_consensus.cc:1685] finished
0709 12:58:58.520549 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.520777 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10148,"raft.queue_time_us":102996,"raft.run_cpu_time_us":56555,"raft.run_wall_time_us":745281,"spinlock_wait_cycles":9311232,"thread_start_us":213579,"threads_started":2,"wal-append.queue_time_us":263842}
I20260709 12:58:58.571074  1612 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:58.501258  3594 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3.
I20260709 12:58:58.570083  3476 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:58.569979  3482 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:58.603086  3605 consensus_meta.cc:287] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
I20260709 12:58:58.570165  3558 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 12:58:58.680174  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2209) took 1921 ms. Trace:
I20260709 12:58:58.582002  3656 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:58.676671  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 215742us
I20260709 12:58:58.679613  1718 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
W20260709 12:58:58.679839  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 175474us
I20260709 12:58:58.684444  2406 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:58.659627  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 189623us
W20260709 12:58:58.691509  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 292967us
W20260709 12:58:58.693384  1612 leader_election.cc:336] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.612s (SENT)
I20260709 12:58:58.693624  1536 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:58.694010  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:58.573282  3560 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:58:58.680639  1716 rpcz_store.cc:276] 0709 12:58:56.759057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.759186 (+   129us) service_pool.cc:224] Handling call
0709 12:58:58.679238 (+1920052us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003aaf54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:58.680095 (+   857us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2591055744}
I20260709 12:58:58.695472  2405 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:58.653870  3640 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:58.699601  3648 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:58.699724  3559 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:58.700428  3559 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.701272  3559 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:58.701380  3645 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:58.702121  3645 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:58.702806  3594 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:58.703106  3645 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:58.705621  3645 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:58.706662  1612 leader_election.cc:336] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.664s (SENT)
I20260709 12:58:58.662324  3605 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6.
I20260709 12:58:58.670361  3614 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.714275  3557 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.713837  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:58.712399  3606 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:58.661648  3482 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:58.721824  3557 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:58.723269  3650 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:58:58.743760  1611 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 12:58:58.750233  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:58.744303  3630 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.841s	user 0.004s	sys 0.005s
I20260709 12:58:58.771294  3605 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:58.771304  3640 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:58.713207  3503 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:58.778582  1469 catalog_manager.cc:5697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 4 to 5, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:58.781427  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.784714  1469 catalog_manager.cc:5697] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 3 to 5, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:58.798523  1469 catalog_manager.cc:5697] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 3 to 5, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:58.697714  3638 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:58:58.730849  3614 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:58.917266  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 218012us
I20260709 12:58:58.917557  3557 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:58:58.880236  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.772205  3640 raft_consensus.cc:697] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:58:58.919392  3482 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:58.918314  1536 leader_election.cc:400] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6.
W20260709 12:58:58.916997  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 171345us
W20260709 12:58:58.924278  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 217626us
W20260709 12:58:58.925379  1612 leader_election.cc:336] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.732s (SENT)
W20260709 12:58:58.926510  1612 leader_election.cc:336] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.749s (SENT)
W20260709 12:58:58.926774  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 228278us
I20260709 12:58:58.927783  1536 leader_election.cc:400] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3.
I20260709 12:58:58.928771  1536 leader_election.cc:403] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:58:58.861653  3659 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.960062  1469 catalog_manager.cc:5697] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 1 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:58.930648  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:58.934374  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:58.963604  2436 raft_consensus.cc:2393] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 2: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:58.964385  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:58.861291  3558 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.965595  1469 catalog_manager.cc:5697] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 3 to 5, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:58.966379  3558 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:58.968645  3661 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:58.935108  3594 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3.
W20260709 12:58:58.936532  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.939029  2448 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:58:58.941818  3653 log.cc:927] Time spent T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:58:58.968911  3558 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:58.969343  3661 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:58.974197  3659 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:58.974962  3661 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:58.969925  3594 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:58.976933  3659 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:58.977276  3594 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:58.979440  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.982220  3539 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.982765  3539 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:58.983484  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:58:58.928705  1612 leader_election.cc:336] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.821s (SENT)
I20260709 12:58:58.943559  3559 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:58.947844  3528 consensus_meta.cc:287] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.721s	user 0.011s	sys 0.003s
I20260709 12:58:58.997684  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.998180  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:58.998589  1719 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:58:58.999013  1713 raft_consensus.cc:2410] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:58:58.999861  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.000079  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:59.000509  1569 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:58:59.001657  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:58:59.003670  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.003582  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:59.004299  3598 log.cc:927] Time spent T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 1.647s	user 0.001s	sys 0.018s
I20260709 12:58:59.005889  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:59.008306  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:59.009541  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:59.012848  1567 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:58.948369  3614 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:58.926191  3645 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.940925  3476 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:58.956266  3602 consensus_meta.cc:287] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.590s	user 0.013s	sys 0.000s
I20260709 12:58:59.016768  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:59.016697  3602 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:59.018805  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:59.019402  3602 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:58.861737  3575 consensus_queue.cc:1059] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 12:58:58.961314  3540 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:59.020198  3476 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:59.020972  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.021862  1567 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
W20260709 12:58:58.962576  1467 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58250 (request call id 194) took 12809 ms (client timeout 15000 ms). Trace:
W20260709 12:58:58.970367  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.988031  3550 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:58.986151  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:58.987401  3668 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:58.986567  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:59.022827  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.025759  2448 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:58:59.032444  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1292) took 2765 ms. Trace:
I20260709 12:58:58.940816  3640 consensus_queue.cc:237] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:58.781646  3499 raft_consensus.cc:3055] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:59.010141  1569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:58:59.033077  1718 rpcz_store.cc:276] 0709 12:58:56.267115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.322176 (+ 55061us) service_pool.cc:224] Handling call
0709 12:58:57.250590 (+928414us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173eee 0000000000375939 00007f18d21e71e0 00007f18d22b00c4 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:58:58.679389 (+1428799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:58.697413 (+ 18024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:59.032067 (+334654us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54003aaf50. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:59.032335 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3301875968}
I20260709 12:58:59.038743  1569 raft_consensus.cc:606] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:59.039338  1569 raft_consensus.cc:614] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:59.010164  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:59.040361  1713 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:59.040544  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:59.058266  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 45886.4us
I20260709 12:58:58.945245  1611 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:59.010913  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:58:59.011104  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 82425.5us
I20260709 12:58:59.027278  3659 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:58.985882  3547 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:58:59.019774  2444 raft_consensus.cc:2393] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 6: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:58:59.025208  3526 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:59.063127  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 132836us
W20260709 12:58:59.063639  1612 leader_election.cc:336] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.849s (SENT)
I20260709 12:58:59.065946  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:59.066563  1612 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:59.012132  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:59.066831  1611 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:58:59.048101  3499 raft_consensus.cc:740] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 12:58:59.078850  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 69027.3us
W20260709 12:58:59.080425  1612 leader_election.cc:336] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.068s (SENT)
I20260709 12:58:59.086557  1612 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:59.087915  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:58:59.022747  1467 rpcz_store.cc:269] 0709 12:58:46.153583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.179601 (+ 26018us) service_pool.cc:224] Handling call
0709 12:58:58.962486 (+12782885us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:55.093894 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:55.105777 (+ 11883us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:55.105833 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:58:55.105858 (+    25us) tablet.cc:662] Decoding operations
0709 12:58:55.106790 (+   932us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:55.106923 (+   133us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:55.106966 (+    43us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:58:55.107561 (+   595us) tablet.cc:701] Row locks acquired
0709 12:58:55.107630 (+    69us) write_op.cc:260] PREPARE: finished
0709 12:58:55.107872 (+   242us) write_op.cc:270] Start()
0709 12:58:55.108097 (+   225us) write_op.cc:276] Timestamp: P: 1783601935107775 usec, L: 0
0709 12:58:55.108129 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:58:55.167717 (+ 59588us) log.cc:844] Serialized 1317 byte log entry
0709 12:58:55.636505 (+468788us) op_driver.cc:464] REPLICATION: finished
0709 12:58:55.807809 (+171304us) write_op.cc:301] APPLY: starting
0709 12:58:55.807909 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:55.808061 (+   152us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:55.808246 (+   185us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:55.808865 (+   619us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:55.809084 (+   219us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:58:55.809130 (+    46us) write_op.cc:312] APPLY: finished
0709 12:58:55.809426 (+   296us) log.cc:844] Serialized 35 byte log entry
0709 12:58:55.809650 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:55.815167 (+  5517us) write_op.cc:454] Released schema lock
0709 12:58:55.815235 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:55.856661 (+ 41426us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:55.874683 (+ 18022us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1479436,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":165034,"apply.run_cpu_time_us":2590,"apply.run_wall_time_us":33251,"num_ops":3,"prepare.queue_time_us":153431,"prepare.run_cpu_time_us":5869,"prepare.run_wall_time_us":132350,"replication_time_us":511623,"thread_start_us":152227,"threads_started":2}]]}
I20260709 12:58:59.092257  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:59.093675  3594 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:59.095486  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:59.096568  3594 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:59.098234  1536 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:59.099287  3594 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:59.100312  3594 raft_consensus.cc:697] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:58:59.101552  3594 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:59.106326  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:58:59.064203  3380 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:58:59.109251  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 95201.2us
I20260709 12:58:59.025604  3645 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:59.116973  3672 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.117605  3672 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:59.120728  3672 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:59.121595  3636 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:59.124567  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:59.125486  1568 raft_consensus.cc:2376] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5. Re-sending same reply.
I20260709 12:58:59.064357  3667 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.126461  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:59.056617  3665 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:58:59.074373  3599 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:58:59.082325  3606 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:59.133294  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.129561  1568 raft_consensus.cc:2376] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6. Re-sending same reply.
I20260709 12:58:59.134783  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.130180  3667 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:59.136708  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:59.137601  1569 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:59.135465  1612 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:59.138540  1717 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
I20260709 12:58:59.090512  3659 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:59.109088  3482 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:58:59.140093  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:59.125098  3549 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.079715  3526 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:59.112196  3605 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:58:59.149655  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.143347  1713 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
W20260709 12:58:59.150089  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 88854.1us
I20260709 12:58:59.115703  3380 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:59.154860  3559 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:59.155426  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:58:59.129086  1566 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:59.161377  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:59.165464  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:59.182978  1720 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:58:59.184114  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 48753.6us
I20260709 12:58:59.144824  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.137650  3606 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:59.142452  3659 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:59.186745  1568 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:59.125408  3534 consensus_queue.cc:1059] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:58:59.200443  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.209101  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:59.210139  2448 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:58:59.212047  1569 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:59.212191  1537 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:59.206977  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.216290  1571 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:59.158558  3503 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:59.207464  3659 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:59.217235  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.218097  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:59.220340  1569 raft_consensus.cc:2393] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:58:59.202987  3647 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:59.202785  3547 raft_consensus.cc:993] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower 6f381117554e49bb816791ab0a10f2b8 to start an election
W20260709 12:58:59.203970  3644 log.cc:927] Time spent T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.892s	user 0.011s	sys 0.015s
I20260709 12:58:59.203248  3599 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:59.234253  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.235818  1565 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:58:59.226593  1571 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:58:59.237114  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.214304  3606 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:59.182302  3380 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:59.237845  1571 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:59.234010  3503 raft_consensus.cc:697] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:59.239377  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:59.227120  3482 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:59.232329  3647 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:59.248193  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.163090  3549 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:59.255733  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.236570  3661 raft_consensus.cc:1081] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Signalling peer 6f381117554e49bb816791ab0a10f2b8 to start an election
I20260709 12:58:59.268024  1565 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:59.240556  3670 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:58:59.227484  3534 consensus_queue.cc:1243] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer 6f381117554e49bb816791ab0a10f2b8 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:59.269440  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.241698  3605 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.188421  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.265338  1563 raft_consensus.cc:1275] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:59.286267  1568 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:59.287431  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.287483  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.276154  1720 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:58:59.237807  3599 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:59.288429  1563 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:58:59.274210  3482 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.270591  3640 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:58:59.276142  3647 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:59.298219  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.263234  3636 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:58:59.188740  3499 consensus_queue.cc:260] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:59.314543  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 239782us
W20260709 12:58:59.311632  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.306982  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.290117  1568 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:59.336841  1571 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:59.297948  3645 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:58:59.339591  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 151163us
I20260709 12:58:59.339051  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:59.341195  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:59.314616  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:58:59.338755  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.296862  3599 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:59.344609  1568 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:58:59.345811  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.346211  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:59.346567  1568 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:58:59.347568  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.337674  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.347800  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:58:59.348623  1563 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:58:59.348755  1565 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:58:59.326344  3681 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.321512  3482 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:59.366852  3499 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:59.349630  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.363615  2437 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:58:59.377835  1537 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:59.305552  3605 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:59.385340  1571 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:58:59.363871  3661 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:59.386575  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.369671  3545 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:59.392031  1686 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:59.394388  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.398267  1571 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:58:59.399358  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.400204  1571 raft_consensus.cc:2410] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:59.390194  3645 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:59.395972  3545 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:58:59.406791  3545 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:59.410794  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:59.411612  1571 raft_consensus.cc:2376] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4. Re-sending same reply.
I20260709 12:58:59.411828  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:59.386090  3526 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:59.417294  1686 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:58:59.421089  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 205381us
I20260709 12:58:59.372859  3681 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:59.422315  1686 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:58:59.422338  1612 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:59.368395  3503 consensus_queue.cc:237] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:59.418696  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.413175  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:59.412946  3534 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:59.419201  3661 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:59.425155  3573 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:59.425099  3538 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:58:59.445979  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 72253.4us
I20260709 12:58:59.432300  3534 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.433482  1564 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:59.433774  3661 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:59.447484  3538 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 12:58:59.510854  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:59.524150  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 49601.2us
W20260709 12:58:59.527768  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.505218  2405 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:58:59.540616  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:59.543008  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:59.460093  3668 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:58:59.546798  2406 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:58:59.491281  3687 log.cc:927] Time spent T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:58:59.469462  3534 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:58:59.499636  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.513206  3645 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.495792  3579 raft_consensus.cc:3055] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:59.480005  3601 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:59.545089  3665 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:58:59.492542  3684 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:58:59.509835  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:58:59.455747  3575 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 12:58:59.507601  3667 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:59.525315  3538 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:59.475641  3661 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:59.538218  3636 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:59.563956  3476 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:59.607146  3681 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:59.592937  3668 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:59.603935  3579 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:59.604538  3645 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:59.568835  3559 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:59.686280  3559 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:59.686931  3559 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:59.687598  3380 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:59.525708  3539 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:59.690462  2436 raft_consensus.cc:2368] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7.
I20260709 12:58:59.690651  3539 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:58:59.691380  3550 consensus_meta.cc:287] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.654s	user 0.014s	sys 0.000s
I20260709 12:58:59.691463  3539 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:59.692178  3539 raft_consensus.cc:697] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:59.692281  3693 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:59.693827  3693 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.694276  3203 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.694375  3693 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:59.694940  3203 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:58:59.640425  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 211333us
I20260709 12:58:59.696673  3693 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:59.697042  3545 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:59.660461  3549 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:59.698758  3549 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:59.699227  3549 raft_consensus.cc:697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:58:59.700253  3549 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:58:59.662178  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 215062us
I20260709 12:58:59.662812  3665 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:59.703469  1611 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:58:59.655445  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 227576us
I20260709 12:58:59.709635  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:59.710286  1715 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:58:59.713510  1717 raft_consensus.cc:606] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:58:59.712710  1612 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:59.713884  1717 raft_consensus.cc:614] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:59.713852  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:59.722198  1564 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:58:59.693323  3539 consensus_queue.cc:237] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:59.697036  1686 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:58:59.729094  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 224010us
W20260709 12:58:59.740533  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 43588.2us
I20260709 12:58:59.741745  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:58:59.744201  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet 4759b34f9b3e4074a8a1cffa7efc8ff7: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:58:59.758638  3693 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:59.759191  3693 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:58:59.759548  3693 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:59.668372  1566 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
W20260709 12:58:59.762303  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:59.764909  1715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2220) took 2999 ms (client timeout 1843 ms). Trace:
W20260709 12:58:59.765435  1715 rpcz_store.cc:269] 0709 12:58:56.765407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.770643 (+  5236us) service_pool.cc:224] Handling call
0709 12:58:59.764693 (+2994050us) spinlock_profiling.cc:243] Waited 2.93 s on lock 0x7b5400236c54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:58:59.764817 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6728248192}
I20260709 12:58:59.694298  3599 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:58:59.764926  1566 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:59.768379  3599 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:59.743671  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:58:59.742764  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:58:59.667263  3605 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:59.663239  3640 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.109s
I20260709 12:58:59.617973  3606 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:59.739825  3647 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:58:59.768684  1566 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:59.816563  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 279848us
I20260709 12:59:00.213665  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1289) took 1100 ms. Trace:
I20260709 12:59:00.191530  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1361) took 1134 ms. Trace:
I20260709 12:59:00.253664  1713 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:58:59.821007  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:58:59.740461  3681 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:59.816942  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 270226us
I20260709 12:59:00.275148  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:00.249681  2407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.016s	sys 0.012s
W20260709 12:59:00.239718  1613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.005s	sys 0.005s
W20260709 12:59:00.275889  2407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.016s	sys 0.012s
W20260709 12:59:00.275978  1613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.006s	sys 0.006s
I20260709 12:59:00.275889  2448 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
W20260709 12:59:00.276679  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:00.277051  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:00.252911  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.005s	sys 0.006s
I20260709 12:59:00.253598  1566 rpcz_store.cc:276] 0709 12:58:59.112803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.768184 (+655381us) service_pool.cc:224] Handling call
0709 12:58:59.768512 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:00.213354 (+444842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.213598 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:00.277848  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.006s	sys 0.007s
I20260709 12:59:00.253861  1571 rpcz_store.cc:276] 0709 12:58:59.057374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.412354 (+354980us) service_pool.cc:224] Handling call
0709 12:58:59.413133 (+   779us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:59.413402 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:59.413433 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:59.424169 (+ 10736us) log.cc:844] Serialized 26 byte log entry
0709 12:58:59.657577 (+233408us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:58:59.657632 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:59.657740 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:00.191132 (+533392us) raft_consensus.cc:1685] finished
0709 12:59:00.191172 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:00.191430 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":225186,"threads_started":1,"wal-append.queue_time_us":621500}
W20260709 12:59:00.278532  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 458267us
I20260709 12:59:00.278721  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:00.223162  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.011s
W20260709 12:59:00.279362  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.000s	sys 0.013s
W20260709 12:59:00.280028  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 567354us
I20260709 12:59:00.272668  1716 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:00.280827  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:00.277324  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:00.255095  1536 leader_election.cc:336] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Timed out: RequestConsensusVote RPC to 127.0.107.195:43271 timed out after 2.685s (SENT)
I20260709 12:58:59.690047  3380 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:00.228013  1567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.005s	sys 0.006s
W20260709 12:59:00.285008  1567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.006s	sys 0.007s
I20260709 12:59:00.281841  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:00.281796  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:00.285652  1565 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:59:00.198994  3545 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:00.255671  3534 consensus_meta.cc:287] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.651s	user 0.008s	sys 0.003s
I20260709 12:59:00.284425  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:00.200721  3482 consensus_meta.cc:287] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.821s	user 0.009s	sys 0.005s
I20260709 12:59:00.287624  1537 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:00.226637  3682 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.852s	user 0.006s	sys 0.019s
I20260709 12:58:59.940595  3668 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:58:59.882853  3573 raft_consensus.cc:697] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:58:59.618923  3659 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:00.290454  1713 raft_consensus.cc:2410] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:58:59.932312  3665 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:58:59.960204  3575 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:00.229580  3549 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.011s	sys 0.002s
I20260709 12:59:00.295931  1719 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:00.293449  3694 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:00.298357  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1362) took 1239 ms. Trace:
I20260709 12:59:00.299691  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:00.277963  3681 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.754814  3667 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:00.350705  1563 raft_consensus.cc:2393] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:00.351493  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:00.307010  1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.018s	sys 0.013s
I20260709 12:59:00.310428  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:00.352303  1715 raft_consensus.cc:2368] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3.
I20260709 12:59:00.310510  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:00.353283  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:00.354475  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:00.355244  1713 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:00.355559  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:58:59.878798  3610 raft_consensus.cc:3055] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:00.319166  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.327745  1716 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:58:59.736469  3636 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.543s
I20260709 12:59:00.331254  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:00.333973  1565 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:00.361433  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1374) took 1139 ms. Trace:
I20260709 12:59:00.361799  1565 rpcz_store.cc:276] 0709 12:58:59.221803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.304459 (+1082656us) service_pool.cc:224] Handling call
0709 12:59:00.333467 (+ 29008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:00.361076 (+ 27609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.361372 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:00.363251  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:00.364112  1565 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:00.299726  3526 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.366039  3526 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:00.369087  3526 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:58:59.775959  3574 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.541s
I20260709 12:59:00.296553  3710 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:00.372112  3710 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:00.330091  3549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.013s	sys 0.002s
I20260709 12:59:00.394083  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:00.309638  3721 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:00.399971  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:00.356204  1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.018s	sys 0.013s
I20260709 12:59:00.400687  1570 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:00.401196  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1360) took 1347 ms. Trace:
I20260709 12:59:00.310402  3614 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:00.465021  1611 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:00.303397  3717 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:00.387825  1612 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:00.335764  1567 rpcz_store.cc:276] 0709 12:58:59.059180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.695695 (+636515us) service_pool.cc:224] Handling call
0709 12:58:59.696073 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:59.696319 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:58:59.696690 (+   371us) log.cc:844] Serialized 14 byte log entry
0709 12:59:00.297815 (+601125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:00.297898 (+    83us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:00.297970 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.298083 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:00.298261 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12745,"prepare.queue_time_us":6167,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":14289,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":9256,"spinlock_wait_cycles":84210560,"thread_start_us":588697,"threads_started":1,"wal-append.queue_time_us":539991}
I20260709 12:59:00.344502  1536 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:00.334537  3665 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:00.399772  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1349) took 1406 ms. Trace:
I20260709 12:59:00.301036  3534 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:00.617125  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:00.358392  3499 consensus_meta.cc:287] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.979s	user 0.010s	sys 0.005s
I20260709 12:59:00.401504  1570 rpcz_store.cc:276] 0709 12:58:59.054217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.054929 (+   712us) service_pool.cc:224] Handling call
0709 12:59:00.399785 (+1344856us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:00.401139 (+  1354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6896000}
I20260709 12:58:59.815616  3579 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:00.350922  3681 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:00.446071  2406 leader_election.cc:336] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.714s (SENT)
I20260709 12:59:00.628116  2406 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:00.298089  3482 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:00.490909  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:00.637555  1569 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:00.495931  3714 log.cc:927] Time spent T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.272s	user 0.003s	sys 0.000s
I20260709 12:59:00.497143  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1296) took 1224 ms. Trace:
I20260709 12:59:00.465986  3667 raft_consensus.cc:697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:00.518319  3719 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.295s	user 0.000s	sys 0.004s
W20260709 12:59:00.538269  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:00.589779  3720 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.345s	user 0.006s	sys 0.006s
I20260709 12:59:00.350478  3602 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.663805  1568 raft_consensus.cc:2393] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 5: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:00.358731  3610 raft_consensus.cc:740] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:00.595395  2440 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 12:59:00.349470  2437 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d"
dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:42646
I20260709 12:59:00.319824  3380 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:59:00.369915  3526 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:00.390723  3599 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:00.391077  3679 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:00.596360  1572 rpcz_store.cc:276] 0709 12:58:58.993708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.993944 (+   236us) service_pool.cc:224] Handling call
0709 12:58:59.013752 (+ 19808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:59.064923 (+ 51171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:59.064961 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:59.083247 (+ 18286us) log.cc:844] Serialized 26 byte log entry
0709 12:58:59.275172 (+191925us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:58:59.391505 (+116333us) log.cc:844] Serialized 14 byte log entry
0709 12:58:59.391756 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:59.391843 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:59.799149 (+407306us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b48000b0958. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d21c1aa1 00007f18d21b8b37 00007f18d21b89ca 00007f18d22b026f 00007f18d22aff37 00007f18d22c455c 00007f18d22c4508 00007f18d22c4488 00007f18d22c4443 00007f18d22c36ec 00007f18d11eda96
0709 12:59:00.226206 (+427057us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b24001553a8. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0319c4 00007f18ca02facb 00007f18ca1eadc9 00007f18ca1eaa55 00007f18ca1ea09d 00007f18cce1c10e 00007f18cce3388c 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221
0709 12:59:00.399524 (+173318us) raft_consensus.cc:1685] finished
0709 12:59:00.399546 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:00.399704 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":216,"prepare.queue_time_us":100847,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":12494,"raft.run_cpu_time_us":4659,"raft.run_wall_time_us":788292,"spinlock_wait_cycles":106088576,"thread_start_us":291837,"threads_started":3,"wal-append.queue_time_us":192079}
I20260709 12:59:00.397114  3698 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:00.632725  1570 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:00.719146  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1377) took 1483 ms. Trace:
I20260709 12:59:00.719663  1570 rpcz_store.cc:276] 0709 12:58:59.235869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.623710 (+1387841us) service_pool.cc:224] Handling call
0709 12:59:00.624181 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:00.718748 (+ 94567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.719058 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:00.499050  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42630 (request call id 5) took 1344 ms. Trace:
I20260709 12:59:00.340075  3575 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:00.650122  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 204144us
I20260709 12:59:00.646341  1563 rpcz_store.cc:276] 0709 12:58:59.272870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.349335 (+ 76465us) service_pool.cc:224] Handling call
0709 12:59:00.496914 (+1147579us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54003cebd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:00.497076 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2245566336}
I20260709 12:59:00.591626  3614 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.659114  1712 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:00.721040  1717 rpcz_store.cc:276] 0709 12:58:59.155076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.155253 (+   177us) service_pool.cc:224] Handling call
0709 12:59:00.498845 (+1343592us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b5400236c54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd292853 00007f18d226060a 00007f18cb7e67d4 00007f18cb7e6762 00007f18cb7e6691 00007f18cb7e660c 00007f18cb7e58c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:00.498984 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1225405696}
I20260709 12:59:00.674129  1569 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:00.641211  3640 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.676717  1686 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:00.663689  3549 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:00.652649  2442 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:00.657889  3579 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:00.754482  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 77839.8us
I20260709 12:59:00.755743  1686 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:00.622084  3665 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:00.737669  1563 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:59:00.738963  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:00.726627  3694 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:00.726862  3599 raft_consensus.cc:697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:00.675148  3558 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:59:00.743023  3380 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.747273  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1363) took 1680 ms. Trace:
W20260709 12:59:00.747354  3719 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:59:00.859308  1564 rpcz_store.cc:276] 0709 12:58:59.067391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.724462 (+657071us) service_pool.cc:224] Handling call
0709 12:58:59.725010 (+   548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:00.228414 (+503404us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:59:00.228451 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:00.229041 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 12:59:00.328646 (+ 99605us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:00.330592 (+  1946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.330698 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:00.746916 (+416218us) raft_consensus.cc:1685] finished
0709 12:59:00.746947 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:00.747194 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":67645,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":597146,"threads_started":2,"wal-append.queue_time_us":423219}
W20260709 12:59:00.725628  3645 consensus_meta.cc:287] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.998s	user 0.012s	sys 0.003s
I20260709 12:59:00.690475  3647 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:00.757720  3538 consensus_meta.cc:287] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.043s	user 0.010s	sys 0.002s
I20260709 12:59:00.646191  3573 consensus_queue.cc:237] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:00.659365  3717 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:00.760097  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1326) took 1052 ms. Trace:
I20260709 12:59:00.691987  3729 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:00.596472  3721 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:00.836573  3518 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:01.002310  1565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.014s	sys 0.031s
I20260709 12:59:00.789784  1717 raft_consensus.cc:1240] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:00.832377  3606 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:00.855983  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 100329us
I20260709 12:59:00.679934  3602 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:00.892298  2406 leader_election.cc:336] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.684s (SENT)
W20260709 12:59:01.038466  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 146242us
W20260709 12:59:01.039391  2406 leader_election.cc:336] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.720s (SENT)
I20260709 12:59:01.039875  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:00.920574  1572 raft_consensus.cc:1240] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:01.041441  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 138) took 1612 ms. Trace:
I20260709 12:59:01.041903  1572 rpcz_store.cc:276] 0709 12:58:59.429038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.752371 (+1323333us) service_pool.cc:224] Handling call
0709 12:59:00.920296 (+167925us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.041041 (+120745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.041360 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:00.859022  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1330) took 1149 ms. Trace:
I20260709 12:59:00.733798  3614 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:00.746333  3679 raft_consensus.cc:697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:00.727285  3716 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:00.857210  2437 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:59:00.976302  1571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.050s	sys 0.059s
I20260709 12:59:00.779953  3526 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:00.835682  3586 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.200s
W20260709 12:59:01.002763  1565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.014s	sys 0.031s
W20260709 12:59:01.056749  1571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.051s	sys 0.059s
I20260709 12:59:01.076146  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1372) took 1855 ms. Trace:
I20260709 12:59:01.076597  1571 rpcz_store.cc:276] 0709 12:58:59.221111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.283337 (+1062226us) service_pool.cc:224] Handling call
0709 12:59:00.283632 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:00.283865 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:00.360191 (+ 76326us) log.cc:844] Serialized 14 byte log entry
0709 12:59:01.075722 (+715531us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:01.075784 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:01.075839 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.075920 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.076080 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":392488,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":60,"thread_start_us":775423,"threads_started":2}
I20260709 12:59:01.043339  1721 rpcz_store.cc:276] 0709 12:58:59.709911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.710026 (+   115us) service_pool.cc:224] Handling call
0709 12:58:59.745871 (+ 35845us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:59.746415 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:59.746460 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:59.755579 (+  9119us) log.cc:844] Serialized 26 byte log entry
0709 12:59:00.252585 (+497006us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:00.252654 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.252810 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:00.589154 (+336344us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:00.782896 (+193742us) raft_consensus.cc:1685] finished
0709 12:59:00.782932 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:00.858926 (+ 75994us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5476,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":14153,"spinlock_wait_cycles":91537792,"thread_start_us":426609,"threads_started":1,"wal-append.queue_time_us":447113}
W20260709 12:59:01.057512  1566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.018s	sys 0.027s
I20260709 12:59:00.757313  3640 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:00.971251  1712 rpcz_store.cc:276] 0709 12:58:59.707670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.708794 (+  1124us) service_pool.cc:224] Handling call
0709 12:58:59.709099 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:00.728908 (+1019809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.759672 (+ 30764us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b5400229054. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:00.760005 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184292096}
I20260709 12:59:00.956153  3545 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:00.995374  3559 consensus_meta.cc:287] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 1.281s	user 0.015s	sys 0.000s
I20260709 12:59:01.056154  1686 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:01.082031  1566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.019s	sys 0.027s
I20260709 12:59:01.002653  3710 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:01.093261  1718 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.052s	sys 0.050s
I20260709 12:59:01.035780  3518 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 12:59:01.104632  1718 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.052s	sys 0.050s
I20260709 12:59:00.949208  3645 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:00.961107  3538 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:01.049883  3659 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:01.053364  3716 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:01.122969  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 66919.7us
W20260709 12:59:01.100343  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 712577us
I20260709 12:59:01.108572  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1371) took 1890 ms. Trace:
I20260709 12:59:00.941936  3380 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:01.057744  2437 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:01.075524  3707 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:01.052985  3729 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:00.861682  3694 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:01.106283  2405 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.013s	sys 0.012s
W20260709 12:59:01.138857  2405 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.013s	sys 0.012s
I20260709 12:59:01.139345  1715 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:01.109504  1536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.003s	sys 0.040s
I20260709 12:59:01.109352  3518 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:01.140208  1536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.003s	sys 0.041s
I20260709 12:59:01.000175  3717 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:01.140861  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 796392us
I20260709 12:59:01.142045  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:00.860431  3667 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:01.119068  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1327) took 1411 ms. Trace:
W20260709 12:59:01.119307  1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.008s	sys 0.017s
I20260709 12:59:01.090440  3545 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 12:59:01.119125  2436 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42646 (request call id 394) took 2122 ms (client timeout 1838 ms). Trace:
I20260709 12:59:01.109740  3605 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.126876  1612 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:01.126299  3716 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:01.139309  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 782672us
W20260709 12:59:01.115690  1610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.022s	sys 0.019s
W20260709 12:59:01.161703  1610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.022s	sys 0.019s
I20260709 12:59:01.157275  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:01.129071  3528 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:01.109459  3559 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:01.147176  1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.008s	sys 0.018s
W20260709 12:59:01.166139  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 701221us
I20260709 12:59:01.130816  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 137) took 1709 ms. Trace:
I20260709 12:59:00.993242  3610 consensus_queue.cc:260] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:01.154757  1536 leader_election.cc:400] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3.
W20260709 12:59:01.157730  1685 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.021s
W20260709 12:59:01.128115  3693 consensus_meta.cc:287] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 1.368s	user 0.008s	sys 0.007s
I20260709 12:59:01.144472  1718 rpcz_store.cc:276] 0709 12:58:59.707965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.708085 (+   120us) service_pool.cc:224] Handling call
0709 12:58:59.744826 (+ 36741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:59.745192 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:59.777299 (+ 32107us) log.cc:844] Serialized 14 byte log entry
0709 12:59:01.105270 (+1327971us) log.cc:844] Serialized 14 byte log entry
0709 12:59:01.118602 (+ 13332us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:01.118667 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:01.118737 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.118833 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.118989 (+   156us) inbound_call.cc:177] Queueing success response
0709 12:59:01.142437 (+ 23448us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
Metrics: {"mutex_wait_us":50740,"prepare.queue_time_us":31835,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":95055,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":24627,"spinlock_wait_cycles":56261376,"thread_start_us":1296266,"threads_started":3,"wal-append.queue_time_us":472773}
W20260709 12:59:01.175619  3359 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.010s	sys 0.014s
I20260709 12:59:01.165869  1612 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:01.167557  1563 rpcz_store.cc:276] 0709 12:58:59.421271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.723665 (+1302394us) service_pool.cc:224] Handling call
0709 12:59:00.737316 (+ 13651us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:00.785586 (+ 48270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.130588 (+345002us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b54003b4050. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:01.130748 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30091008}
I20260709 12:59:01.184108  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:01.184803  1563 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:01.131255  3203 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:01.171895  1536 leader_election.cc:403] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:59:01.172214  1685 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.000s	sys 0.022s
W20260709 12:59:01.186146  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 540201us
I20260709 12:59:01.151551  3545 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:01.167856  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.186276  2448 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:01.146960  3482 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:01.164295  3594 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.017s	sys 0.018s
I20260709 12:59:01.171311  3526 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:01.165009  3528 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:01.163934  3602 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:01.171092  3606 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:01.173655  3659 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:01.178018  3661 consensus_meta.cc:287] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.467s	user 0.012s	sys 0.003s
I20260709 12:59:01.180631  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:01.115418  3599 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:01.171528  3731 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:01.124801  1566 rpcz_store.cc:276] 0709 12:58:59.218470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.279793 (+1061323us) service_pool.cc:224] Handling call
0709 12:59:00.302307 (+ 22514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:00.302650 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:00.394707 (+ 92057us) log.cc:844] Serialized 14 byte log entry
0709 12:59:01.108135 (+713428us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:01.108201 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:01.108250 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.108334 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.108494 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8224,"prepare.queue_time_us":454265,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"thread_start_us":781073,"threads_started":2}
I20260709 12:59:01.170239  3733 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 12:59:01.165509  3605 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:01.142899  3729 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:01.181042  3679 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:01.584327  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1336) took 1171 ms. Trace:
I20260709 12:59:01.584688  1717 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:01.468807  1563 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
W20260709 12:59:01.262301  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 74509.1us
W20260709 12:59:01.368422  1567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.017s	sys 0.028s
I20260709 12:59:01.293665  1718 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:01.596316  1716 rpcz_store.cc:276] 0709 12:59:00.412873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.755128 (+342255us) service_pool.cc:224] Handling call
0709 12:59:00.923034 (+167906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.003431 (+ 80397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:01.003478 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:01.003542 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:01.003593 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.584007 (+580414us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b5400017054. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:01.584071 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.584257 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184129280}
W20260709 12:59:01.409207  1568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38394 (request call id 132) took 2068 ms (client timeout 2126 ms). Trace:
W20260709 12:59:01.595014  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.020s	sys 0.033s
W20260709 12:59:01.588308  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 401253us
W20260709 12:59:01.584255  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 418434us
W20260709 12:59:01.599623  1568 rpcz_store.cc:269] 0709 12:58:59.341237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.347309 (+  6072us) service_pool.cc:224] Handling call
0709 12:59:01.408860 (+2061551us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540041ffd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:01.409107 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3025098496}
I20260709 12:59:01.541002  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:01.599809  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.020s	sys 0.033s
I20260709 12:59:01.600814  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:59:01.598497  1567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.023s	sys 0.034s
W20260709 12:59:01.455835  1713 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.014s	sys 0.010s
W20260709 12:59:01.601835  1713 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.018s	sys 0.010s
I20260709 12:59:01.601115  1569 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:01.418506  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1375) took 2196 ms. Trace:
I20260709 12:59:01.597749  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:01.610284  1612 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:01.611443  2405 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:01.339627  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.597112  3482 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3.
I20260709 12:59:01.210777  3526 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.588774  2437 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:01.290547  3718 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 1.040s	user 0.007s	sys 0.016s
I20260709 12:59:01.630162  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:01.607852  1565 rpcz_store.cc:276] 0709 12:58:59.230831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.364931 (+1134100us) service_pool.cc:224] Handling call
0709 12:59:00.365458 (+   527us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:00.376093 (+ 10635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:00.376144 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:00.376989 (+   845us) log.cc:844] Serialized 52 byte log entry
0709 12:59:01.078449 (+701460us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:01.078503 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.078603 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:01.418138 (+339535us) raft_consensus.cc:1685] finished
0709 12:59:01.418164 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.418411 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":267968,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":15535,"thread_start_us":700847,"threads_started":1,"wal-append.queue_time_us":1036487}
W20260709 12:59:01.183169  3359 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.010s	sys 0.014s
W20260709 12:59:01.213127  3594 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.017s	sys 0.018s
W20260709 12:59:01.626128  1571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.033s	sys 0.045s
I20260709 12:59:01.292145  3534 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:01.280877  3681 consensus_meta.cc:287] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.000s
I20260709 12:59:01.203882  3636 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:01.627915  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.625349  3701 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:01.631733  1566 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:59:01.192657  3740 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.608053  2440 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:01.595620  3610 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:01.637394  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.183452  3693 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:01.641361  1571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.034s	sys 0.046s
W20260709 12:59:01.152582  2436 rpcz_store.cc:269] 0709 12:58:58.985603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.985782 (+   179us) service_pool.cc:224] Handling call
0709 12:59:01.079613 (+2093831us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b540053cad4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:01.105403 (+ 25790us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1529423104}
I20260709 12:59:01.627383  1563 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:01.547137  3538 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:01.596031  3606 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.595501  3528 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:01.643817  3742 consensus_queue.cc:1059] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:01.645675  3698 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:01.413067  3747 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.501708  3640 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:01.663985  3694 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:01.384783  3380 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:01.614240  3503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.033s	sys 0.030s
I20260709 12:59:01.613200  3526 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:01.245636  3735 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:59:01.649435  3743 consensus_queue.cc:1059] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 12:59:01.661755  1569 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:01.625315  3559 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:01.668923  2448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 396) took 1388 ms. Trace:
I20260709 12:59:01.776149  2448 rpcz_store.cc:276] 0709 12:59:00.280433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.280553 (+   120us) service_pool.cc:224] Handling call
0709 12:59:00.280871 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.191153 (+910282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.668509 (+477356us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54005d02d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:01.668826 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081747840}
W20260709 12:59:01.675005  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.780129  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:01.639721  3549 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:01.781606  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:01.610453  3661 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:01.691428  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1386) took 1448 ms. Trace:
I20260709 12:59:01.687410  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1388) took 1387 ms. Trace:
I20260709 12:59:01.788625  1563 rpcz_store.cc:276] 0709 12:59:00.243051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.626648 (+1383597us) service_pool.cc:224] Handling call
0709 12:59:01.627022 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.691094 (+ 64072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.691361 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:01.788782  1566 rpcz_store.cc:276] 0709 12:59:00.301358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.660206 (+1358848us) service_pool.cc:224] Handling call
0709 12:59:01.686620 (+ 26414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.686918 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:01.686957 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:01.687021 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:01.687074 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.687150 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.687321 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:01.608717  3731 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:01.736344  1613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.139s	user 0.009s	sys 0.058s
W20260709 12:59:01.796612  1613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.009s	sys 0.058s
W20260709 12:59:01.797456  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.653862  3636 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:01.741974  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1384) took 1499 ms. Trace:
I20260709 12:59:01.751542  3741 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.595273  3665 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:01.732964  3518 consensus_meta.cc:287] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.000s
I20260709 12:59:01.749984  1642 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:01.656559  3681 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:01.762187  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 176219us
W20260709 12:59:01.733479  3724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.005s	sys 0.018s
I20260709 12:59:01.613395  3707 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:01.759135  3718 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:59:01.772955  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 118686us
I20260709 12:59:01.749382  3606 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:01.762748  3503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.034s	sys 0.030s
W20260709 12:59:01.792143  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 181980us
I20260709 12:59:01.672962  3659 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:59:01.800005  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1334) took 1387 ms. Trace:
I20260709 12:59:01.799024  1571 rpcz_store.cc:276] 0709 12:59:00.242426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.081042 (+838616us) service_pool.cc:224] Handling call
0709 12:59:01.081380 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.081607 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:01.113664 (+ 32057us) log.cc:844] Serialized 14 byte log entry
0709 12:59:01.739138 (+625474us) log.cc:844] Serialized 14 byte log entry
0709 12:59:01.741400 (+  2262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:01.741477 (+    77us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:01.741554 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.741666 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.741888 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63595,"prepare.queue_time_us":32991,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":3072,"raft.queue_time_us":86292,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":23258,"thread_start_us":565017,"threads_started":1,"wal-append.queue_time_us":657867}
I20260709 12:59:01.659801  3701 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:01.673704  3740 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:01.765866  3747 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:02.232443  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.865188  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1392) took 1515 ms. Trace:
I20260709 12:59:02.412336  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:01.787766  3711 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 1.551s	user 0.012s	sys 0.000s
W20260709 12:59:02.345920  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:02.433318  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.434376  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:02.435859  2405 connection.cc:256] RPC call timeout handler was delayed by -1.1869484680000255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 12:59:02.437605  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:02.439188  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:01.787271  3531 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:02.443274  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:02.417061  1566 rpcz_store.cc:276] 0709 12:59:00.349943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.790473 (+1440530us) service_pool.cc:224] Handling call
0709 12:59:01.864391 (+ 73918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.864704 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:01.864743 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:01.864806 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:01.864862 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.864939 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.865103 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:02.342970  3752 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.422s	user 0.000s	sys 0.001s
I20260709 12:59:02.152155  3729 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:02.325525  1570 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:02.445113  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1394) took 1316 ms. Trace:
I20260709 12:59:02.445623  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1385) took 2202 ms. Trace:
W20260709 12:59:02.426766  1536 connection.cc:256] RPC call timeout handler was delayed by -2.8853799630000481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
I20260709 12:59:02.445602  1570 rpcz_store.cc:276] 0709 12:59:01.128688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.324717 (+1196029us) service_pool.cc:224] Handling call
0709 12:59:02.325252 (+   535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:02.444723 (+119471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.445034 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:02.102313  3605 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:02.426118  3693 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:02.447125  3693 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:02.446195  1568 rpcz_store.cc:276] 0709 12:59:00.242740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.600794 (+1358054us) service_pool.cc:224] Handling call
0709 12:59:01.602551 (+  1757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.602842 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:01.640730 (+ 37888us) log.cc:844] Serialized 14 byte log entry
0709 12:59:01.774640 (+133910us) log.cc:844] Serialized 14 byte log entry
0709 12:59:02.445281 (+670641us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:02.445338 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:02.445389 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.445453 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:02.445566 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10228,"prepare.queue_time_us":58525,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":108,"raft.queue_time_us":158202,"spinlock_wait_cycles":314240,"thread_start_us":534691,"threads_started":2}
I20260709 12:59:02.447628  3693 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.428577  3743 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:02.447207  1536 connection.cc:256] RPC call timeout handler was delayed by -2.3840799630000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
I20260709 12:59:02.176999  3758 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.429172  3661 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:02.128398  3721 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:02.411487  1713 rpcz_store.cc:276] 0709 12:59:00.412212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.425559 (+ 13347us) service_pool.cc:224] Handling call
0709 12:59:00.426190 (+   631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:00.426544 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:01.606947 (+1180403us) log.cc:844] Serialized 14 byte log entry
0709 12:59:01.799592 (+192645us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:01.799651 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:01.799704 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.799781 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:01.799943 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":979177,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":2314,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":115161,"thread_start_us":1179020,"threads_started":2}
W20260709 12:59:02.190878  3550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.045s	sys 0.090s
W20260709 12:59:02.089473  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:01.806347  3709 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 1.579s	user 0.001s	sys 0.011s
I20260709 12:59:01.787616  3534 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.456032  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:02.456898  1536 connection.cc:256] RPC call timeout handler was delayed by -1.6766799630000264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2889s for a response
I20260709 12:59:02.330207  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1332) took 1918 ms. Trace:
I20260709 12:59:01.800182  3380 raft_consensus.cc:3055] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:02.432122  3701 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:02.448063  3693 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:01.977458  1714 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:01.803017  3549 raft_consensus.cc:697] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:02.471629   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:01.802812  3636 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:02.461951  1715 rpcz_store.cc:276] 0709 12:59:00.411471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.417571 (+  6100us) service_pool.cc:224] Handling call
0709 12:59:00.618477 (+200906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.139927 (+521450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.329861 (+1189934us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54001a9d54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:02.330118 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1197268224}
W20260709 12:59:02.017279  3757 log.cc:927] Time spent T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
W20260709 12:59:02.463052  2405 connection.cc:256] RPC call timeout handler was delayed by -1.0090306539999574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2516s for a response
I20260709 12:59:02.465461  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1397) took 1309 ms. Trace:
I20260709 12:59:02.479050  1566 rpcz_store.cc:276] 0709 12:59:01.155652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.464426 (+1308774us) service_pool.cc:224] Handling call
0709 12:59:02.464801 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:02.465042 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:02.465069 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:02.465121 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:02.465159 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.465219 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:02.465389 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:02.460925  3575 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:02.461853  1536 connection.cc:256] RPC call timeout handler was delayed by -1.6604799630000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2907s for a response
I20260709 12:59:02.470305  1612 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:02.448527  3743 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:02.455524  3531 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:02.461427  3550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.051s	sys 0.107s
I20260709 12:59:02.475760  3739 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.804003  3559 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.661s
I20260709 12:59:02.339197  3683 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:02.461334  3710 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:02.488098  3594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.004s	sys 0.028s
I20260709 12:59:02.463657  3380 raft_consensus.cc:740] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:02.485803  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:02.480583  3767 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.469636  3721 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:02.481535  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1398) took 1315 ms. Trace:
I20260709 12:59:02.473701   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:59:02.484470  1536 connection.cc:256] RPC call timeout handler was delayed by -1.5459568929999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 12:59:02.557130  1536 connection.cc:256] RPC call timeout handler was delayed by -1.4595568930000127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
I20260709 12:59:02.442270  3707 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:02.503978  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:02.448952  3605 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.505072  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:02.564332  1645 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:02.489079  3575 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.506100  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:02.568396  1639 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:02.507292  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:01.863647  3741 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:02.570264  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:02.570616  3715 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.441371  3518 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:02.571784  3741 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:02.571425  3715 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:02.573668  3518 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:02.510859  3755 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.366s	user 0.000s	sys 0.001s
I20260709 12:59:02.509814  3710 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:02.512704  3765 log.cc:927] Time spent T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
W20260709 12:59:02.514305  3722 log.cc:927] Time spent T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 2.266s	user 0.011s	sys 0.005s
W20260709 12:59:02.508373  3594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.005s	sys 0.028s
I20260709 12:59:02.470155  3534 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:02.489415  3742 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:02.518571  3549 consensus_queue.cc:237] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:02.529353  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:02.529878  3743 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:02.530740  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:02.532393  1644 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:59:02.532528  3751 log.cc:927] Time spent T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.764s	user 0.001s	sys 0.000s
W20260709 12:59:02.533460  3614 consensus_meta.cc:287] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 1.476s	user 0.005s	sys 0.009s
I20260709 12:59:02.533485  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 142) took 1282 ms. Trace:
I20260709 12:59:02.481381  3773 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:02.540799  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 128881us
W20260709 12:59:02.541725  3545 consensus_meta.cc:287] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.295s	user 0.007s	sys 0.003s
I20260709 12:59:02.543123  3740 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:02.543682  3636 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:02.544450  3681 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:02.474056  3774 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
W20260709 12:59:02.544876  3764 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 12:59:02.703778  3614 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:02.545429  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:02.723512  1647 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:02.724444  3614 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:02.724860  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:02.547212  3747 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:02.547952  3579 consensus_meta.cc:287] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.714s	user 0.013s	sys 0.002s
I20260709 12:59:02.509502  1640 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:59:02.726930  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:02.728145  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:02.729079  1719 raft_consensus.cc:2410] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:02.708498  3733 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:02.513162  3768 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:02.487630  3573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.009s	sys 0.008s
I20260709 12:59:02.502743  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1380) took 2285 ms. Trace:
W20260709 12:59:02.557607  1536 connection.cc:256] RPC call timeout handler was delayed by -1.4147799630000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31800000000000006s for a response
I20260709 12:59:02.556869  1566 rpcz_store.cc:276] 0709 12:59:01.165756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.480470 (+1314714us) service_pool.cc:224] Handling call
0709 12:59:02.480913 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:02.481148 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:02.481186 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:02.481251 (+    65us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:02.481298 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.481355 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:02.481476 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:02.450455  3758 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:02.505700  1565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.011s	sys 0.038s
I20260709 12:59:02.566421  3605 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:02.563232  3701 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:02.578698  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:02.580485  3762 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:02.633797  3575 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:02.580984  3531 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:02.582731  3526 consensus_meta.cc:287] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.795s	user 0.012s	sys 0.000s
W20260709 12:59:02.584129  3716 consensus_meta.cc:287] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 1.405s	user 0.013s	sys 0.000s
W20260709 12:59:02.584810  2440 consensus_meta.cc:287] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.847s	user 0.009s	sys 0.002s
I20260709 12:59:02.509588  3683 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:02.569270  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:02.625312  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:02.666740  1563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.029s	sys 0.046s
W20260709 12:59:02.763572  1563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.029s	sys 0.046s
I20260709 12:59:02.669330  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:02.548578  3380 consensus_queue.cc:260] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:02.766213  3710 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:02.766845  3380 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:02.587466  2443 raft_consensus.cc:1240] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:02.682281  1569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.009s	sys 0.013s
I20260709 12:59:02.730031  3359 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.751142  3559 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:02.732612  3768 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:02.768783  2437 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:02.634546  3721 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:02.701716  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.703181  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:02.708810  1645 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:02.719318  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:02.781980  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1381) took 2564 ms. Trace:
I20260709 12:59:02.737172  1643 raft_consensus.cc:2393] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 12:59:02.731753  2405 leader_election.cc:336] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.517s (SENT)
W20260709 12:59:02.792966  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 61245.7us
W20260709 12:59:02.733259  1536 connection.cc:256] RPC call timeout handler was delayed by -1.399256892999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260709 12:59:02.735405  1565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.011s	sys 0.038s
W20260709 12:59:02.793527  1536 connection.cc:256] RPC call timeout handler was delayed by -1.3776568929999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 12:59:02.793855  1536 connection.cc:256] RPC call timeout handler was delayed by -1.3155568930000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
I20260709 12:59:02.801206  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:02.682562  3640 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.010s	sys 0.011s
I20260709 12:59:02.504959  3739 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:02.699075  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:02.822731  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.559767  3767 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:02.729128  3610 consensus_meta.cc:287] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.050s	user 0.008s	sys 0.006s
W20260709 12:59:02.732976  3573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.012s	sys 0.012s
W20260709 12:59:02.764088  1612 connection.cc:256] RPC call timeout handler was delayed by -2.9167936299999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260709 12:59:02.704008  3773 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:02.764791  1638 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:02.730943  3733 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:02.770149  3762 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:02.770622  1569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.009s	sys 0.013s
I20260709 12:59:02.697216  1721 rpcz_store.cc:276] 0709 12:59:01.251390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.251513 (+   123us) service_pool.cc:224] Handling call
0709 12:59:01.269365 (+ 17852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.931725 (+662360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:01.931766 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:01.931824 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:01.931858 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.533208 (+601350us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b5400016b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:02.533264 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:02.533418 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1522666752}
I20260709 12:59:02.733111  1564 rpcz_store.cc:276] 0709 12:59:00.217466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.869554 (+652088us) service_pool.cc:224] Handling call
0709 12:59:00.870028 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:00.940092 (+ 70064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:00.940147 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:00.962928 (+ 22781us) log.cc:844] Serialized 26 byte log entry
0709 12:59:01.585886 (+622958us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:01.585950 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.586074 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:02.323862 (+737788us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b48000b0958. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d21c1aa1 00007f18d21b8b37 00007f18d21b89ca 00007f18d22b026f 00007f18d22aff37 00007f18d22c455c 00007f18d22c4508 00007f18d22c4488 00007f18d22c4443 00007f18d22c36ec 00007f18d11eda96
0709 12:59:02.488436 (+164574us) raft_consensus.cc:1685] finished
0709 12:59:02.488469 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:02.502639 (+ 14170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":240827,"raft.run_cpu_time_us":4445,"raft.run_wall_time_us":1205016,"spinlock_wait_cycles":27567488,"thread_start_us":421721,"threads_started":1,"wal-append.queue_time_us":697328}
W20260709 12:59:02.823307  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.822836  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:02.824808  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1391) took 2485 ms. Trace:
I20260709 12:59:02.708750  3545 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:02.792194  1572 rpcz_store.cc:276] 0709 12:59:00.217784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.042942 (+825158us) service_pool.cc:224] Handling call
0709 12:59:01.081871 (+ 38929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.630889 (+549018us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:01.662692 (+ 31803us) log.cc:844] Serialized 14 byte log entry
0709 12:59:02.136433 (+473741us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:02.136517 (+    84us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:02.136590 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.781617 (+645027us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54002cc4d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:02.781700 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:02.781900 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16280,"prepare.queue_time_us":32049,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":316338,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":32055,"spinlock_wait_cycles":1261955840,"thread_start_us":473081,"threads_started":2,"wal-append.queue_time_us":369241}
I20260709 12:59:02.756279  1646 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:02.734978  3645 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:02.745304  3715 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:02.828205  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:03.169343  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:03.139685  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:03.169974  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:03.170646  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:03.170873  1646 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:03.171136  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:03.171761  2446 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:59:03.171973  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:03.172670  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.172508  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:03.173501  1568 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:03.173884  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:03.174629  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:03.175172  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:03.175676  3762 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:02.917870  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.785604  2437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:42646 (request call id 398) took 2494 ms. Trace:
I20260709 12:59:02.753958  3594 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.983006  2448 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:03.121258  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:02.899271  2405 leader_election.cc:336] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.671s (SENT)
I20260709 12:59:03.260066  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:02.858155  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.321543  1570 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:03.022238  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:03.177117  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:03.171789  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:03.324041  1638 raft_consensus.cc:2393] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:03.315354  1713 raft_consensus.cc:3055] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:03.172770  1646 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:59:03.326416  1713 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:03.151352  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:03.327193  2444 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:03.041617  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:03.175978  1564 raft_consensus.cc:2393] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 5: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:59:03.317878  3549 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.053s	sys 0.123s
W20260709 12:59:03.331444  3549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.054s	sys 0.123s
I20260709 12:59:03.052642  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:03.316429  1612 connection.cc:256] RPC call timeout handler was delayed by -2.8231936299999916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 12:59:03.337373  1612 connection.cc:256] RPC call timeout handler was delayed by -2.7601936299999466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 12:59:03.315384  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.260519  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:02.949414  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:03.337929  1612 connection.cc:256] RPC call timeout handler was delayed by -2.308393629999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
W20260709 12:59:03.345598  1612 connection.cc:256] RPC call timeout handler was delayed by -1.4812936299999819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31190000000000007s for a response
W20260709 12:59:03.195336  1537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:39297 timed out after 1.579s (SENT) [suppressed 48 similar messages]
I20260709 12:59:03.314605  1563 rpcz_store.cc:276] 0709 12:59:00.339770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.790031 (+1450261us) service_pool.cc:224] Handling call
0709 12:59:01.790521 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.790813 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:01.823808 (+ 32995us) log.cc:844] Serialized 14 byte log entry
0709 12:59:02.824372 (+1000564us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:02.824457 (+    85us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:02.824515 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.824597 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:02.824742 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175768,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":6439,"raft.queue_time_us":61152,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":91490,"spinlock_wait_cycles":218079488,"thread_start_us":939836,"threads_started":1,"wal-append.queue_time_us":883029}
I20260709 12:59:03.322970  2447 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
W20260709 12:59:03.325189  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 425976us
W20260709 12:59:03.323207  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:02.825579  3640 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.011s	sys 0.011s
W20260709 12:59:03.129026  3782 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.366s	user 0.001s	sys 0.000s
W20260709 12:59:03.352334  2405 leader_election.cc:336] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.684s (SENT)
I20260709 12:59:03.354403  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:03.355386  1720 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:03.356110  2405 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:03.355684  1646 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:03.355417  1712 raft_consensus.cc:1240] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:03.359903  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 164625us
I20260709 12:59:03.362402  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:03.365798  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:03.366756  1642 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:03.327719  1713 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:03.139467  3780 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:59:03.153192  3750 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 1.232s	user 0.001s	sys 0.001s
I20260709 12:59:03.173404  3778 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:03.230846  3528 consensus_meta.cc:287] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.468s	user 0.015s	sys 0.004s
W20260709 12:59:03.051352  3606 consensus_meta.cc:287] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.588s	user 0.016s	sys 0.010s
I20260709 12:59:03.370436  1712 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:59:03.371361  1716 raft_consensus.cc:1240] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:03.020800  3575 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:03.137109  3779 log.cc:927] Time spent T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.357s	user 0.002s	sys 0.000s
I20260709 12:59:03.382997  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:02.918841  2442 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:59:02.773995  3701 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:03.124537  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1323) took 3418 ms. Trace:
I20260709 12:59:02.764124  2440 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:02.918028  3710 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.385980  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:03.386224  1715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.016s	sys 0.069s
W20260709 12:59:03.452348  1715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.016s	sys 0.069s
I20260709 12:59:03.171921  3773 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:03.389943  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:03.454195  3759 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:03.454692  2446 raft_consensus.cc:2410] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:03.454914  3759 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:03.455729  2440 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42636 (request call id 346) took 2296 ms (client timeout 2223 ms). Trace:
W20260709 12:59:03.456203  2440 rpcz_store.cc:269] 0709 12:59:01.159074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.160332 (+  1258us) service_pool.cc:224] Handling call
0709 12:59:03.455639 (+2295307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:03.115070  3698 raft_consensus.cc:3055] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:03.436688  1714 rpcz_store.cc:276] 0709 12:58:59.706321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.711267 (+  4946us) service_pool.cc:224] Handling call
0709 12:58:59.814586 (+103319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:02.475588 (+2661002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.124242 (+648654us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b540022ae54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:03.124463 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4825732992}
I20260709 12:59:03.457947  3698 raft_consensus.cc:740] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:03.459173  3698 consensus_queue.cc:260] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:03.460407  3698 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:03.159543  3768 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.111660  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:03.393801  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:03.463258  3773 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:03.463995  1639 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:02.997347  3559 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:03.465013  3559 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:03.466800  3739 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.467442  3559 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.468441  3758 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:03.469776  3733 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:03.470455  3777 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.312s	user 0.001s	sys 0.008s
I20260709 12:59:03.471765  3545 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:03.471872  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1395) took 2340 ms. Trace:
I20260709 12:59:03.473098  3767 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.472275  1571 rpcz_store.cc:276] 0709 12:59:01.131793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.413844 (+1282051us) service_pool.cc:224] Handling call
0709 12:59:02.414329 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:02.414933 (+   604us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:59:02.414975 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:02.441281 (+ 26306us) log.cc:844] Serialized 26 byte log entry
0709 12:59:02.756156 (+314875us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:02.756224 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.756338 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:03.469548 (+713210us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:03.471534 (+  1986us) raft_consensus.cc:1685] finished
0709 12:59:03.471557 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.471798 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2417,"raft.queue_time_us":133,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":18936,"spinlock_wait_cycles":23561472,"thread_start_us":278182,"threads_started":1,"wal-append.queue_time_us":531281}
I20260709 12:59:03.474117  3605 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:03.474943  3683 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.475695  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1376) took 4244 ms. Trace:
I20260709 12:59:03.402815  3528 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:03.476063  1567 rpcz_store.cc:276] 0709 12:58:59.231345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.617848 (+1386503us) service_pool.cc:224] Handling call
0709 12:59:00.636602 (+ 18754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:00.678148 (+ 41546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:00.678199 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:00.685173 (+  6974us) log.cc:844] Serialized 26 byte log entry
0709 12:59:01.601737 (+916564us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:01.601781 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:01.601859 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:03.151957 (+1550098us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:03.475372 (+323415us) raft_consensus.cc:1685] finished
0709 12:59:03.475394 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.475611 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24595,"raft.queue_time_us":453234,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":35595,"spinlock_wait_cycles":23187328,"thread_start_us":809321,"threads_started":1,"wal-append.queue_time_us":1017882}
I20260709 12:59:02.948153  3538 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.397032  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:02.786381  3721 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:03.313726  3740 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.168078  3731 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:03.400990  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:03.503156  2444 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:02.948513  3681 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:03.025707  3741 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:03.405359  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:02.774314  3526 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:02.771384  3359 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:03.408629  1638 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
W20260709 12:59:03.399185  2438 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.005s	sys 0.015s
I20260709 12:59:03.391759  3774 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:02.799394  3716 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:03.324146  2437 rpcz_store.cc:276] 0709 12:59:00.296783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.299943 (+  3160us) service_pool.cc:224] Handling call
0709 12:59:02.766953 (+2467010us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54006d38d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd28fa3d 00007f18d225fcd0 00007f18cb7e4254 00007f18cb7e41e2 00007f18cb7e4111 00007f18cb7e408c 00007f18cb7e3342 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:02.785473 (+ 18520us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334676352}
I20260709 12:59:03.447486  3712 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.451556  3710 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:03.392582  1536 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.009s	sys 0.008s
I20260709 12:59:03.380990  1713 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:03.540694  1536 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.009s	sys 0.008s
I20260709 12:59:03.340230  3594 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:03.514130  3762 consensus_queue.cc:1059] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:59:03.484380  3538 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:03.517736  3740 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:03.516606  3741 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:03.498486  1642 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:03.500164  2448 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:59:02.830374  3729 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.508647  1712 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:03.481936  3761 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.330s	user 0.002s	sys 0.007s
I20260709 12:59:03.444377  3534 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:03.405571  3606 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:03.522529  2406 leader_election.cc:336] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.126s (SENT)
I20260709 12:59:03.519627  1645 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
W20260709 12:59:03.541074  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 707338us
W20260709 12:59:03.559554  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.522307  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:03.649142  1644 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:03.522572  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 145) took 1086 ms. Trace:
I20260709 12:59:03.533303  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:03.536849  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:03.403195  3778 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:03.539904  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1387) took 3296 ms. Trace:
W20260709 12:59:03.648263  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 125765us
I20260709 12:59:03.649490  1647 raft_consensus.cc:2368] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 2. Current term is 3.
I20260709 12:59:03.523847  1537 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:03.652928  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 129213us
I20260709 12:59:03.623978  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1324) took 3917 ms. Trace:
W20260709 12:59:03.653359  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.653622  1720 rpcz_store.cc:276] 0709 12:58:59.707037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.707208 (+   171us) service_pool.cc:224] Handling call
0709 12:58:59.707702 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:03.356083 (+3648381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.623618 (+267535us) spinlock_profiling.cc:243] Waited 3.65 s on lock 0x7b54002dc154. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:03.623890 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8388242688}
I20260709 12:59:03.652220  1565 rpcz_store.cc:276] 0709 12:59:00.243438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.632385 (+1388947us) service_pool.cc:224] Handling call
0709 12:59:01.632882 (+   497us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:01.638004 (+  5122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:01.638075 (+    71us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:01.647890 (+  9815us) log.cc:844] Serialized 52 byte log entry
0709 12:59:02.793892 (+1146002us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:02.793941 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.531116 (+737175us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b540031ced4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:03.531188 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:03.531257 (+    69us) raft_consensus.cc:1685] finished
0709 12:59:03.531273 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.539809 (+  8536us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102582,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":7037,"spinlock_wait_cycles":10219264,"thread_start_us":1095389,"threads_started":1,"wal-append.queue_time_us":910038,"wal-append.run_cpu_time_us":2136,"wal-append.run_wall_time_us":1044756}
I20260709 12:59:03.654659  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38584 (request call id 128) took 1113 ms. Trace:
I20260709 12:59:03.656345  1642 rpcz_store.cc:276] 0709 12:59:02.541393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.365358 (+823965us) service_pool.cc:224] Handling call
0709 12:59:03.654592 (+289234us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:03.657516  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.658270  1713 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:03.659724  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:03.630280  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 2.04505e+06us
I20260709 12:59:03.649793  1718 rpcz_store.cc:276] 0709 12:59:02.436485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.436731 (+   246us) service_pool.cc:224] Handling call
0709 12:59:02.437168 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:02.437487 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:02.437524 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:02.455037 (+ 17513us) log.cc:844] Serialized 26 byte log entry
0709 12:59:02.672533 (+217496us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:02.672603 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:02.672717 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:03.135999 (+463282us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:03.517231 (+381232us) raft_consensus.cc:1685] finished
0709 12:59:03.517250 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.522494 (+  5244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101416192,"thread_start_us":189512,"threads_started":1,"wal-append.queue_time_us":305129}
I20260709 12:59:03.651907  1638 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:59:03.668503  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38584 (request call id 120) took 1129 ms. Trace:
I20260709 12:59:03.669133  1638 rpcz_store.cc:276] 0709 12:59:02.539133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.518767 (+979634us) service_pool.cc:224] Handling call
0709 12:59:03.668417 (+149650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:03.673260  1718 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:03.675262  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:03.523176  2438 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.005s	sys 0.016s
W20260709 12:59:03.678079  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.679111  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1389) took 3370 ms. Trace:
I20260709 12:59:03.682646  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:03.682934  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:03.683487  1642 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:59:03.684217  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38584 (request call id 138) took 1140 ms. Trace:
I20260709 12:59:03.684139  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:03.684965  1571 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:03.517256  3707 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:03.685962  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:03.696914  1564 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:03.683454  1565 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:59:03.694720  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:03.698379  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:03.698601  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:03.699033  2447 raft_consensus.cc:2410] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:03.700578  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:03.702064  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:03.702967  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:03.587467  3380 consensus_meta.cc:287] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.819s	user 0.010s	sys 0.003s
W20260709 12:59:03.616689  3781 log.cc:927] Time spent T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.846s	user 0.002s	sys 0.000s
W20260709 12:59:03.692255  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:03.693511  2406 leader_election.cc:336] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.587s (SENT)
I20260709 12:59:03.689724  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:03.690459  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.620453  3605 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:03.620090  3753 log.cc:927] Time spent T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.493s	user 0.005s	sys 0.002s
I20260709 12:59:03.690881  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1401) took 2507 ms. Trace:
W20260709 12:59:03.585856  3791 log.cc:927] Time spent T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:59:03.627663  3776 raft_consensus.cc:3055] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:03.670001  3667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.010s	sys 0.014s
W20260709 12:59:03.708972  1685 leader_election.cc:336] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.650s (SENT)
W20260709 12:59:03.742965  1685 leader_election.cc:336] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.785s (SENT)
W20260709 12:59:03.743902  1685 leader_election.cc:336] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.838s (SENT)
W20260709 12:59:03.745131  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.709749  1718 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
W20260709 12:59:03.711197  1686 connection.cc:256] RPC call timeout handler was delayed by -1.371370162000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 12:59:03.746042  1686 connection.cc:256] RPC call timeout handler was delayed by -1.371370162000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
I20260709 12:59:03.740279  3776 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:03.747014  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:03.747534  3776 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:03.748536  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:03.748759  3776 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:03.714490  2405 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:03.548044  3712 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:03.715528  1721 raft_consensus.cc:2393] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:03.752399  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:03.753422  3712 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.754202  3712 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:03.754137  3605 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:03.754841  3712 raft_consensus.cc:697] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:03.594376  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:03.685990  3769 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:03.757270  3768 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.717293  1712 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:03.717521  1717 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:59:03.684717  1642 rpcz_store.cc:276] 0709 12:59:02.544080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.682667 (+1138587us) service_pool.cc:224] Handling call
0709 12:59:03.684151 (+  1484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:03.525691  3701 consensus_queue.cc:1059] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.167s
I20260709 12:59:03.517625  3681 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:03.633301  3773 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.673285  3733 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:03.772608  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:03.543233  3528 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:03.666954  3767 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.735373  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:03.735915  1566 rpcz_store.cc:276] 0709 12:59:01.183825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.733695 (+1549870us) service_pool.cc:224] Handling call
0709 12:59:02.734093 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:02.734361 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:03.453260 (+718899us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.690507 (+237247us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:03.690567 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:03.690615 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.690689 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.690822 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":718499,"prepare.queue_time_us":723723,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":122,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7114,"thread_start_us":236804,"threads_started":1}
I20260709 12:59:03.687974  3579 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:59:03.703645  2404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.005s	sys 0.018s
I20260709 12:59:03.753646  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:03.758090  1571 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:03.685671  3729 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:03.764719  3738 log.cc:927] Time spent T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.980s	user 0.004s	sys 0.000s
I20260709 12:59:03.737715  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:03.767935  3679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.006s	sys 0.032s
W20260709 12:59:03.756680  3667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.010s	sys 0.014s
I20260709 12:59:03.764556  3605 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.596444  3526 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.765232  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:03.766022  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:03.766414  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:03.767570  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:03.763708  1565 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:03.758123  3380 consensus_queue.cc:1059] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:59:03.771898  3768 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:03.599061  3721 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.773612  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38584 (request call id 139) took 1229 ms. Trace:
I20260709 12:59:03.835879  1712 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:03.836000  1642 rpcz_store.cc:276] 0709 12:59:02.544344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.772148 (+1227804us) service_pool.cc:224] Handling call
0709 12:59:03.773541 (+  1393us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:03.740285  3761 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:59:03.766579  3787 log.cc:927] Time spent T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:59:03.769068  1564 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:03.839761  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:03.841018  1564 raft_consensus.cc:2410] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:59:03.796613  2404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.005s	sys 0.018s
W20260709 12:59:03.792619  1645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2194) took 1257 ms (client timeout 1674 ms). Trace:
W20260709 12:59:03.844640  1645 rpcz_store.cc:269] 0709 12:59:02.535266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.827938 (+292672us) service_pool.cc:224] Handling call
0709 12:59:03.792403 (+964465us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b540008c5d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:03.792547 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804508928}
I20260709 12:59:03.749878  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:03.794415  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:03.765213  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:03.801019  1611 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:03.788460  1721 raft_consensus.cc:2376] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2. Re-sending same reply.
I20260709 12:59:03.765080  3606 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.772539  3717 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.755864  3712 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:03.833725  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:03.796067  2438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 150) took 1250 ms. Trace:
I20260709 12:59:03.781891  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:03.775010  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.780143  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:03.837248  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:03.890415  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38584 (request call id 126) took 1349 ms. Trace:
I20260709 12:59:03.890779  1642 rpcz_store.cc:276] 0709 12:59:02.540895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.836927 (+1296032us) service_pool.cc:224] Handling call
0709 12:59:03.890329 (+ 53402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:03.889127  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:03.789042  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:03.891757  1571 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:03.837423  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:03.807571  3731 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
W20260709 12:59:03.803328  3679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.013s	sys 0.033s
I20260709 12:59:03.845016  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:03.918577  1719 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2237) took 3632 ms (client timeout 2231 ms). Trace:
I20260709 12:59:03.919329  3741 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.919402  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:03.919952  3594 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.848345  3758 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:03.920833  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:03.920771  3758 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:03.885763  3640 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:03.922045  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:03.922453  3640 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:59:03.848815  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 54528.6us
I20260709 12:59:03.793725  3733 raft_consensus.cc:697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 12:59:03.863059  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 62182.9us
W20260709 12:59:03.878324  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 158027us
I20260709 12:59:03.878968  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:03.834606  1572 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:03.836709  3742 consensus_meta.cc:287] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 1.142s	user 0.014s	sys 0.000s
W20260709 12:59:03.885275  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.803711  3645 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:03.838304  3482 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:03.977068  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:03.880026  3605 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.888827  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:03.807132  3756 raft_consensus.cc:476] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 12:59:03.892786  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:03.893608  1712 raft_consensus.cc:2393] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:03.980715  1611 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:03.843843  1567 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:03.880213  3531 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:03.896473  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:03.793171  3767 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:03.897437  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:03.807832  3545 consensus_queue.cc:1059] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:59:03.983489  3713 raft_consensus.cc:2764] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:59:03.929759  2437 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:03.902004  3778 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:03.990309  3778 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:03.990855  3778 raft_consensus.cc:697] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:03.991798  3778 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:03.907476  3768 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:03.910712  3789 log.cc:927] Time spent T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 12:59:03.976362  3693 consensus_meta.cc:287] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 1.496s	user 0.009s	sys 0.009s
W20260709 12:59:03.914621  1643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2184) took 1405 ms (client timeout 1759 ms). Trace:
W20260709 12:59:04.002107  1643 rpcz_store.cc:269] 0709 12:59:02.510412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.528980 (+ 18568us) service_pool.cc:224] Handling call
0709 12:59:03.914276 (+1385296us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b540034dad4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:03.914430 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104871168}
I20260709 12:59:04.003793  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.004972  1643 raft_consensus.cc:2410] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:59:04.005414  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.915462  3729 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.881047  3380 consensus_queue.cc:1243] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:59:03.922605  3801 log.cc:927] Time spent T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:59:03.770025  3762 consensus_queue.cc:1059] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:59:04.038971  3762 raft_consensus.cc:3055] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:04.039454  3762 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:03.802929  3579 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:03.881453  1714 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
W20260709 12:59:03.900843  3794 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 12:59:03.919338  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38584 (request call id 125) took 1378 ms (client timeout 1603 ms). Trace:
I20260709 12:59:03.927126  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:04.094439  1563 raft_consensus.cc:2368] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6.
I20260709 12:59:04.095767  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:04.096694  1563 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:03.925155  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:03.928678  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1404) took 2329 ms. Trace:
W20260709 12:59:03.966753  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:03.919026  1719 rpcz_store.cc:269] 0709 12:59:00.285815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.330960 (+ 45145us) service_pool.cc:224] Handling call
0709 12:59:03.918341 (+3587381us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b540002a3d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:03.918507 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5445385600}
I20260709 12:59:03.679541  1569 rpcz_store.cc:276] 0709 12:59:00.308648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.775002 (+1466354us) service_pool.cc:224] Handling call
0709 12:59:01.775422 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:01.775698 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:01.948254 (+172556us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.678538 (+1730284us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.678746 (+   208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:03.678799 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:03.678848 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.678922 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.679046 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48423,"prepare.queue_time_us":1677526,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":30930,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":30609,"thread_start_us":1728177,"threads_started":2,"wal-append.queue_time_us":753847}
I20260709 12:59:03.968629  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.100355  1645 raft_consensus.cc:2368] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7.
I20260709 12:59:03.923264  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:03.971910  1713 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:04.102438  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:03.972587  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:03.929569  3759 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:03.933300  2405 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:04.103945  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 170775us
I20260709 12:59:03.843730  3710 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.977162  1644 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:03.923156  3716 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:03.984514  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2189) took 1450 ms. Trace:
I20260709 12:59:03.985385  1571 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:03.982450  1566 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:04.108592  1642 rpcz_store.cc:276] 0709 12:59:02.533984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.897151 (+1363167us) service_pool.cc:224] Handling call
0709 12:59:03.984438 (+ 87287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:04.098352  1570 rpcz_store.cc:276] 0709 12:59:01.598903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.339405 (+1740502us) service_pool.cc:224] Handling call
0709 12:59:03.339866 (+   461us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:59:03.340294 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:03.340343 (+    49us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:59:03.341110 (+   767us) log.cc:844] Serialized 78 byte log entry
0709 12:59:03.778612 (+437502us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:03.805996 (+ 27384us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.861837 (+ 55841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.861925 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:03.928422 (+ 66497us) raft_consensus.cc:1685] finished
0709 12:59:03.928444 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.928616 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55484,"prepare.queue_time_us":27353,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":129847,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":17705,"thread_start_us":316141,"threads_started":1,"wal-append.queue_time_us":479255}
I20260709 12:59:03.987056  1712 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:03.913023  3740 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:03.976267  3698 consensus_meta.cc:287] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.515s	user 0.003s	sys 0.012s
I20260709 12:59:03.925102  3681 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.983875  3742 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:03.923511  3640 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:04.126310  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:04.127846  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:04.128525  1569 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:04.007736  3733 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:04.130524  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:04.010215  3531 raft_consensus.cc:697] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:04.020533  1572 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:04.131181  1645 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:03.985565  3605 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:04.057667  3729 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:04.132977  3729 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:04.034014  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 12:59:04.134832  2436 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 152) took 1567 ms (client timeout 2072 ms). Trace:
I20260709 12:59:03.979507  3645 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:04.135429  3758 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:03.985092  3482 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:04.105351  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2195) took 1569 ms. Trace:
I20260709 12:59:04.137161  1644 rpcz_store.cc:276] 0709 12:59:02.535769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.508337 (+972568us) service_pool.cc:224] Handling call
0709 12:59:04.105284 (+596947us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:03.986797  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.138249  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1402) took 2930 ms. Trace:
W20260709 12:59:04.138543  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.138803  1568 rpcz_store.cc:276] 0709 12:59:01.208138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.175511 (+1967373us) service_pool.cc:224] Handling call
0709 12:59:03.175827 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:03.700650 (+524823us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:03.700679 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:03.701208 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:59:03.878852 (+177644us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:03.878908 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.914688 (+ 35780us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54003f8ed4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:03.914749 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:04.137821 (+223072us) raft_consensus.cc:1685] finished
0709 12:59:04.137847 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.138153 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16231,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":17961,"spinlock_wait_cycles":1205944192,"thread_start_us":177296,"threads_started":1,"wal-append.queue_time_us":315263}
I20260709 12:59:04.140699  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.141011  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1338) took 2361 ms. Trace:
I20260709 12:59:04.141746  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 146) took 1591 ms. Trace:
I20260709 12:59:04.142771  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:04.143162  1717 raft_consensus.cc:1240] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:04.143441  2444 raft_consensus.cc:2376] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5. Re-sending same reply.
I20260709 12:59:04.144903  1638 raft_consensus.cc:2410] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:04.145321  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:04.146278  2447 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:04.036581  3693 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:04.093842  1647 rpcz_store.cc:269] 0709 12:59:02.540597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.724418 (+183821us) service_pool.cc:224] Handling call
0709 12:59:03.919156 (+1194738us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b54002d96d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:03.919277 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2124603776}
I20260709 12:59:04.119282  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.119356  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:04.121415  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.133390  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:04.073060  1685 leader_election.cc:336] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.659s (SENT)
I20260709 12:59:04.040505  3762 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:04.148298  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.141388  1716 rpcz_store.cc:276] 0709 12:59:01.779192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.782923 (+  3731us) service_pool.cc:224] Handling call
0709 12:59:01.802316 (+ 19393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:03.396148 (+1593832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.140754 (+744606us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400237154. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:04.140950 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3607969664}
W20260709 12:59:04.386204  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 313191us
I20260709 12:59:04.387392  1645 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
W20260709 12:59:04.388428  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.388613  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.389384  1564 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:59:04.379830  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:04.279772  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.391794  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:04.393271  1642 raft_consensus.cc:2376] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5. Re-sending same reply.
W20260709 12:59:04.380703  2448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42646 (request call id 402) took 1946 ms (client timeout 2116 ms). Trace:
I20260709 12:59:04.394644  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:04.394696  2448 rpcz_store.cc:269] 0709 12:59:02.442854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.442996 (+   142us) service_pool.cc:224] Handling call
0709 12:59:04.380443 (+1937447us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54003ec6d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:04.380615 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1239543552}
I20260709 12:59:04.395622  1642 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:04.300303  1640 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:04.380474  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:04.389803  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.379362  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 256203us
W20260709 12:59:04.351909  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 374944us
W20260709 12:59:04.402038  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.390476  1568 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:59:04.309582  1569 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:04.413023  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:04.392738  1646 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:59:04.414018  1563 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:59:04.417193  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:04.412607  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:04.419431  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.414880  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2190) took 1880 ms. Trace:
I20260709 12:59:04.421144  1646 rpcz_store.cc:276] 0709 12:59:02.534295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.118961 (+1584666us) service_pool.cc:224] Handling call
0709 12:59:04.414808 (+295847us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:04.403013  1686 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:04.234788  2405 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:04.418074  1564 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:59:04.420605  1643 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:59:04.432650  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.615060  1639 raft_consensus.cc:2410] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:04.615671  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2197) took 2079 ms. Trace:
I20260709 12:59:04.616065  1639 rpcz_store.cc:276] 0709 12:59:02.536338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.432245 (+1895907us) service_pool.cc:224] Handling call
0709 12:59:04.615582 (+183337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:04.618297  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.142207  1715 rpcz_store.cc:276] 0709 12:59:02.550291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.550490 (+   199us) service_pool.cc:224] Handling call
0709 12:59:02.566758 (+ 16268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:02.787691 (+220933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:02.787728 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:02.788294 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:59:03.452818 (+664524us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:03.452868 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.453502 (+   634us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400236254. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:03.453550 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:04.141373 (+687823us) raft_consensus.cc:1685] finished
0709 12:59:04.141396 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.141670 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34593,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":91034,"spinlock_wait_cycles":506916224,"thread_start_us":664088,"threads_started":1,"wal-append.queue_time_us":875930}
I20260709 12:59:03.887779  2438 rpcz_store.cc:276] 0709 12:59:02.545517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.545728 (+   211us) service_pool.cc:224] Handling call
0709 12:59:02.546241 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:02.546608 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:02.734906 (+188298us) log.cc:844] Serialized 14 byte log entry
0709 12:59:03.736033 (+1001127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:03.740719 (+  4686us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:03.767825 (+ 27106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:03.773600 (+  5775us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:03.786507 (+ 12907us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18225,"prepare.queue_time_us":305489,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":86,"raft.queue_time_us":25162,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":21018,"thread_start_us":1113550,"threads_started":2,"wal-append.queue_time_us":787514}
I20260709 12:59:04.112778  3549 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:04.135471  2436 rpcz_store.cc:269] 0709 12:59:02.569959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.631487 (+ 61528us) service_pool.cc:224] Handling call
0709 12:59:04.033840 (+1402353us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b5800122a98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173eee 0000000000375939 00007f18d21e71e0 00007f18d22b00c4 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:04.134698 (+100858us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6589824}
I20260709 12:59:04.458865  3605 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:04.411650  3710 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:04.438112  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:04.440177  3745 raft_consensus.cc:3055] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:04.459893  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.440902  1638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38584 (request call id 122) took 1901 ms (client timeout 2488 ms). Trace:
I20260709 12:59:04.441738  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:04.445693  3715 raft_consensus.cc:3055] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:04.440708  3482 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:04.453778  1718 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:04.440457  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.637355  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:04.442343  3762 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:04.625906  3549 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:04.466965  1716 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:04.636655  2437 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 7: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:04.452203  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:04.478402  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.646281  1718 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:04.363952  3758 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.548439  3729 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:04.560532  3776 consensus_meta.cc:287] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.003s
I20260709 12:59:04.583732  1712 raft_consensus.cc:1240] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:04.496981  1641 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:04.464325  3731 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:04.577653  3679 consensus_queue.cc:1059] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:59:04.612855  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.642004  3549 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:04.417630  3740 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.752317  3693 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:04.460552  3645 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:04.753830  3816 log.cc:927] Time spent T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:59:04.746631  3758 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:04.756495  3758 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:04.631160  1638 rpcz_store.cc:269] 0709 12:59:02.539787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.689196 (+1149409us) service_pool.cc:224] Handling call
0709 12:59:04.440660 (+751464us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b5400218754. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:04.440839 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976889088}
I20260709 12:59:04.632507  1646 raft_consensus.cc:2410] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:04.427703  3698 consensus_queue.cc:1059] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.200s
I20260709 12:59:04.516121  3531 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:04.639313  1647 raft_consensus.cc:2376] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5. Re-sending same reply.
I20260709 12:59:04.439970  3767 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:04.628114  3579 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:04.765064  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.749848  3731 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.776393  3731 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:04.752622  3740 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:04.787523  3640 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.052s	sys 0.089s
I20260709 12:59:04.500430  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:04.923647  1563 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:04.455375  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:04.420037  1569 raft_consensus.cc:2368] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4.
I20260709 12:59:04.451233  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:04.443322  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:04.943358  1565 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 2.
I20260709 12:59:04.943693  1567 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:59:04.944432  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1303) took 1255 ms. Trace:
I20260709 12:59:04.944741  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1332) took 1181 ms. Trace:
I20260709 12:59:04.463425  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:04.461900  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:04.751483  1642 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:59:04.761704  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:04.947068  1566 raft_consensus.cc:2393] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:04.947855  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1314) took 1209 ms. Trace:
I20260709 12:59:04.947943  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:04.949551  1570 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:59:04.949747  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.951292  1644 raft_consensus.cc:2368] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7.
I20260709 12:59:04.951944  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.952957  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.440551  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:04.563354  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 131978us
I20260709 12:59:04.943624  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1313) took 1248 ms. Trace:
I20260709 12:59:04.954744  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:04.955075  1568 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:04.954975  1569 rpcz_store.cc:276] 0709 12:59:03.694733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.412229 (+717496us) service_pool.cc:224] Handling call
0709 12:59:04.943332 (+531103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:04.956460  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.957106  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.956975  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.957267  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:04.957577  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.643815  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.958248  1644 raft_consensus.cc:2410] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:04.954033  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.958951  1643 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:04.959534  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:04.959978  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:04.960273  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:04.960943  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.961442  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.961613  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.623550  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.962272  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1315) took 1220 ms. Trace:
I20260709 12:59:04.962379  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.963168  1639 raft_consensus.cc:2410] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:04.963481  1569 raft_consensus.cc:2393] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:04.963977  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1316) took 1221 ms. Trace:
I20260709 12:59:04.963991  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.964279  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.964453  1569 rpcz_store.cc:276] 0709 12:59:03.742308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.956832 (+1214524us) service_pool.cc:224] Handling call
0709 12:59:04.963886 (+  7054us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:04.964998  1644 raft_consensus.cc:2376] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5. Re-sending same reply.
I20260709 12:59:04.965173  1639 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:59:04.965791  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:04.966463  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:04.948318  1566 rpcz_store.cc:276] 0709 12:59:03.738375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.461594 (+723219us) service_pool.cc:224] Handling call
0709 12:59:04.947756 (+486162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:04.947029  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1463) took 1045 ms. Trace:
I20260709 12:59:04.967398  1638 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:04.967530  1642 rpcz_store.cc:276] 0709 12:59:03.901331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.612374 (+711043us) service_pool.cc:224] Handling call
0709 12:59:04.946686 (+334312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:04.968145  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:04.944967  1571 raft_consensus.cc:2393] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:04.969234  1566 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:04.969585  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1327) took 1208 ms. Trace:
I20260709 12:59:04.969730  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1330) took 1207 ms. Trace:
I20260709 12:59:04.966809  1569 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:04.945309  1567 rpcz_store.cc:276] 0709 12:59:03.763135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.450889 (+687754us) service_pool.cc:224] Handling call
0709 12:59:04.944620 (+493731us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:04.970077  1571 rpcz_store.cc:276] 0709 12:59:03.761563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.443035 (+681472us) service_pool.cc:224] Handling call
0709 12:59:04.969502 (+526467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:04.970947  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1317) took 1228 ms. Trace:
I20260709 12:59:04.968742  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:04.951144  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.972445  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.971529  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:04.974685  1567 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:04.975358  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1329) took 1213 ms. Trace:
I20260709 12:59:04.975922  1643 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:04.975855  1567 rpcz_store.cc:276] 0709 12:59:03.762204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.971024 (+1208820us) service_pool.cc:224] Handling call
0709 12:59:04.975276 (+  4252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6528}
I20260709 12:59:04.976437  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:04.971583  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:04.983295  1571 raft_consensus.cc:2410] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:04.983999  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1328) took 1222 ms. Trace:
I20260709 12:59:04.984472  1571 rpcz_store.cc:276] 0709 12:59:03.761865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.971155 (+1209290us) service_pool.cc:224] Handling call
0709 12:59:04.983919 (+ 12764us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34048}
I20260709 12:59:04.977208  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 114) took 2439 ms. Trace:
I20260709 12:59:04.986727  1647 raft_consensus.cc:2393] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 12:59:04.989771  1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.001s	sys 0.004s
W20260709 12:59:04.990504  1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.002s	sys 0.004s
W20260709 12:59:04.654565  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.993077  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.634088  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 399394us
W20260709 12:59:04.997438  1640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2192) took 2462 ms (client timeout 1644 ms). Trace:
I20260709 12:59:05.017307  3712 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:04.810271  3640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.052s	sys 0.090s
I20260709 12:59:05.018594  3712 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:05.016091  1640 rpcz_store.cc:269] 0709 12:59:02.534796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.727894 (+193098us) service_pool.cc:224] Handling call
0709 12:59:04.996877 (+2268983us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540019ffd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:04.997139 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3220793088}
I20260709 12:59:05.017621  3538 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:04.945082  1565 rpcz_store.cc:276] 0709 12:59:03.688964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.844553 (+155589us) service_pool.cc:224] Handling call
0709 12:59:04.455201 (+610648us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:04.944293 (+489092us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3091200}
I20260709 12:59:05.022100  3693 raft_consensus.cc:3055] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:05.022624  3693 raft_consensus.cc:740] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:05.024503  1565 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:05.024379  3693 consensus_queue.cc:260] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:05.025192  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1306) took 1335 ms. Trace:
I20260709 12:59:04.630368  3710 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:04.981034  1644 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 1.
I20260709 12:59:04.970327  1566 rpcz_store.cc:276] 0709 12:59:03.762540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.967602 (+1205062us) service_pool.cc:224] Handling call
0709 12:59:04.969643 (+  2041us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:04.943516  1572 raft_consensus.cc:2393] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:04.760344  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:05.027974  1566 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:59:04.991413  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:04.991269  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 588285us
W20260709 12:59:05.003499  1641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2185) took 2474 ms (client timeout 1828 ms). Trace:
I20260709 12:59:05.032301  1644 raft_consensus.cc:1240] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:05.032196  1641 rpcz_store.cc:269] 0709 12:59:02.529335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.530413 (+  1078us) service_pool.cc:224] Handling call
0709 12:59:05.002871 (+2472458us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54002c47d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:05.003190 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4151109888}
I20260709 12:59:05.032769  1686 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:05.033269  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 134) took 2490 ms. Trace:
I20260709 12:59:04.635319  3715 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:05.034677  3538 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:04.630196  3745 raft_consensus.cc:740] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:05.077117  3743 raft_consensus.cc:3055] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:05.077826  3743 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:05.078752  3745 consensus_queue.cc:260] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:05.079782  3743 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:04.993860  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2245) took 1245 ms. Trace:
I20260709 12:59:05.081521  3743 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:05.006706  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 118) took 2468 ms. Trace:
I20260709 12:59:05.082597  3733 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:05.004896  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.082815  1647 rpcz_store.cc:276] 0709 12:59:02.538450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.988356 (+2449906us) service_pool.cc:224] Handling call
0709 12:59:04.989026 (+   670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:04.990422 (+  1396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:04.991237 (+   815us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:05.006208 (+ 14971us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:05.006264 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.006371 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.006587 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:05.083833  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.083374  3733 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:04.979657  1638 raft_consensus.cc:1240] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:05.085467  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 117) took 2547 ms. Trace:
I20260709 12:59:05.085959  1638 rpcz_store.cc:276] 0709 12:59:02.538127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.978786 (+2440659us) service_pool.cc:224] Handling call
0709 12:59:04.979289 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.085074 (+105785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.085359 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.081874  1713 rpcz_store.cc:276] 0709 12:59:03.748546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.120224 (+371678us) service_pool.cc:224] Handling call
0709 12:59:04.381562 (+261338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:04.381999 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:04.382036 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:04.382632 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 12:59:04.992850 (+610218us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:04.992970 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.993145 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:04.993228 (+    83us) raft_consensus.cc:1685] finished
0709 12:59:04.993250 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.993518 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25672,"raft.queue_time_us":4474,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":18013,"thread_start_us":411469,"threads_started":1,"wal-append.queue_time_us":420296}
W20260709 12:59:05.007800  2405 leader_election.cc:336] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.603s (SENT)
I20260709 12:59:05.087976  1638 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:05.088857  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1435) took 1697 ms. Trace:
W20260709 12:59:05.089076  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 91276.7us
W20260709 12:59:05.090018  2405 leader_election.cc:336] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.836s (SENT)
I20260709 12:59:05.090667  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:05.015275  3534 raft_consensus.cc:3055] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:05.091693  3534 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:05.092692  3694 raft_consensus.cc:3055] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:05.093271  3694 raft_consensus.cc:740] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:59:05.020503  3599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.018s	sys 0.006s
W20260709 12:59:05.094359  3599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.019s	sys 0.006s
I20260709 12:59:05.014652  1642 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:05.028901  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1312) took 1334 ms. Trace:
I20260709 12:59:05.094926  3694 consensus_queue.cc:260] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:05.095695  3818 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.036293  1641 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:05.096455  3694 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.025616  1565 rpcz_store.cc:276] 0709 12:59:03.689683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.022587 (+1332904us) service_pool.cc:224] Handling call
0709 12:59:05.023061 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.024923 (+  1862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.025138 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.097167  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1432) took 1750 ms. Trace:
I20260709 12:59:05.097625  1641 rpcz_store.cc:276] 0709 12:59:03.347291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.033460 (+1686169us) service_pool.cc:224] Handling call
0709 12:59:05.034074 (+   614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.096787 (+ 62713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.097071 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.003373  1537 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:04.973719  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:04.962867  1570 rpcz_store.cc:276] 0709 12:59:03.741952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.947028 (+1205076us) service_pool.cc:224] Handling call
0709 12:59:04.962160 (+ 15132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.033702  1644 rpcz_store.cc:276] 0709 12:59:02.542948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.029754 (+2486806us) service_pool.cc:224] Handling call
0709 12:59:05.031907 (+  2153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.032994 (+  1087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.033208 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.033756  1564 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:04.971446  1569 rpcz_store.cc:276] 0709 12:59:03.742634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.965393 (+1222759us) service_pool.cc:224] Handling call
0709 12:59:04.970884 (+  5491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.043164  1643 rpcz_store.cc:276] 0709 12:59:02.537283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.974886 (+2437603us) service_pool.cc:224] Handling call
0709 12:59:04.975482 (+   596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:04.976670 (+  1188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.977109 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.065655  1563 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:04.980195  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1410) took 1298 ms. Trace:
I20260709 12:59:05.080533  3745 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.087639  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1351) took 1603 ms. Trace:
I20260709 12:59:05.095606  1566 rpcz_store.cc:276] 0709 12:59:03.694469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.026793 (+1332324us) service_pool.cc:224] Handling call
0709 12:59:05.027439 (+   646us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:05.028484 (+  1045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.028830 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:04.754036  2440 raft_consensus.cc:2410] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:05.089300  1638 rpcz_store.cc:276] 0709 12:59:03.391090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.087078 (+1695988us) service_pool.cc:224] Handling call
0709 12:59:05.087678 (+   600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.088504 (+   826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.088763 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.109082  1639 raft_consensus.cc:2410] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:05.073683  1571 raft_consensus.cc:1240] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:05.101949  1567 rpcz_store.cc:276] 0709 12:59:03.681584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.977001 (+1295417us) service_pool.cc:224] Handling call
0709 12:59:04.977415 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:04.977779 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:04.977814 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:04.977879 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:04.977912 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:04.978001 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:04.980068 (+  2067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.113766  3359 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:05.111150  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1413) took 1413 ms. Trace:
I20260709 12:59:05.116218  1640 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 12:59:05.116456  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 113884us
I20260709 12:59:05.120898  1568 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:59:05.109122  3538 raft_consensus.cc:697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:05.109720  1717 rpcz_store.cc:276] 0709 12:59:03.484155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.918352 (+434197us) service_pool.cc:224] Handling call
0709 12:59:04.142882 (+224530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:04.143578 (+   696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.087084 (+943506us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400236250. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:05.087382 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515449088}
W20260709 12:59:05.119012  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 52204.8us
W20260709 12:59:05.127027  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.135550  3758 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:05.093417  3534 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:05.127830  1564 rpcz_store.cc:276] 0709 12:59:03.696247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.032604 (+1336357us) service_pool.cc:224] Handling call
0709 12:59:05.033091 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.100038 (+ 66947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.109161 (+  9123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.144299  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1311) took 1450 ms. Trace:
I20260709 12:59:05.129652  1640 pending_rounds.cc:85] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 4
I20260709 12:59:05.122563  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1331) took 1359 ms. Trace:
I20260709 12:59:05.124650  3693 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:05.130457  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1305) took 1437 ms. Trace:
I20260709 12:59:05.146595  1571 rpcz_store.cc:276] 0709 12:59:03.689463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.985576 (+1296113us) service_pool.cc:224] Handling call
0709 12:59:04.986587 (+  1011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:05.126719 (+140132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.127074 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.150795  1721 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:05.151146  3817 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:05.156122  1566 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:05.157202  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1325) took 1396 ms. Trace:
W20260709 12:59:05.158680  3822 log.cc:927] Time spent T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:59:05.158901  1570 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:05.160019  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1322) took 1415 ms. Trace:
I20260709 12:59:05.161193  1569 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:05.145572  1563 rpcz_store.cc:276] 0709 12:59:03.762843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.417767 (+654924us) service_pool.cc:224] Handling call
0709 12:59:05.118138 (+700371us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.144963  1568 rpcz_store.cc:276] 0709 12:59:03.694189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.411467 (+717278us) service_pool.cc:224] Handling call
0709 12:59:05.136696 (+725229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.157614  1566 rpcz_store.cc:276] 0709 12:59:03.760838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.120308 (+1359470us) service_pool.cc:224] Handling call
0709 12:59:05.155710 (+ 35402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:05.156792 (+  1082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.157093 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.160570  1570 rpcz_store.cc:276] 0709 12:59:03.744134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.115074 (+1370940us) service_pool.cc:224] Handling call
0709 12:59:05.158421 (+ 43347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.159621 (+  1200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.159937 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.163466  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:05.163014  3518 consensus_queue.cc:1059] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:59:05.162075  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1324) took 1417 ms. Trace:
I20260709 12:59:05.167515  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1438) took 1749 ms. Trace:
I20260709 12:59:05.128137  3599 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.173928  1641 rpcz_store.cc:276] 0709 12:59:03.418497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.110303 (+1691806us) service_pool.cc:224] Handling call
0709 12:59:05.131483 (+ 21180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.143618 (+ 12135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.143673 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:05.167052 (+ 23379us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:05.167138 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.167242 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.167436 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.063846  3715 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:05.147701  1640 pending_rounds.cc:107] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:59:05.173623  1569 rpcz_store.cc:276] 0709 12:59:03.744738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.100344 (+1355606us) service_pool.cc:224] Handling call
0709 12:59:05.160748 (+ 60404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:05.161704 (+   956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.161976 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.169842  1537 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:05.179215  1640 raft_consensus.cc:2889] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:05.141485  3758 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.182013  1644 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:05.182194  3715 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:05.182358  3518 raft_consensus.cc:3055] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:05.183583  1639 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:05.183585  1713 raft_consensus.cc:2410] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:05.184442  3538 consensus_queue.cc:237] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:05.186980  1638 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:05.187235  3636 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:05.189579  3645 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:05.189775  1537 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:05.191052  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1439) took 1748 ms. Trace:
I20260709 12:59:05.197862  1644 rpcz_store.cc:276] 0709 12:59:03.442891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.115222 (+1672331us) service_pool.cc:224] Handling call
0709 12:59:05.164131 (+ 48909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.190793 (+ 26662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.190997 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.192018  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1441) took 1708 ms. Trace:
I20260709 12:59:05.200166  1639 rpcz_store.cc:276] 0709 12:59:03.484160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.128902 (+1644742us) service_pool.cc:224] Handling call
0709 12:59:05.177507 (+ 48605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.191744 (+ 14237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.191962 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.203794  1646 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:05.199864  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 169034us
I20260709 12:59:05.193285  3518 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:05.210402  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.208509  3645 raft_consensus.cc:697] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:05.211270  1641 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:05.211864  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.193722  3758 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:05.215677  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 113) took 2678 ms. Trace:
I20260709 12:59:05.217077  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 131) took 2665 ms. Trace:
I20260709 12:59:05.220700  1642 rpcz_store.cc:276] 0709 12:59:02.537017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.968468 (+2431451us) service_pool.cc:224] Handling call
0709 12:59:05.014188 (+ 45720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.095169 (+ 80981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.215378 (+120209us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b54002c4cd0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:05.215578 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103708416}
W20260709 12:59:05.207327  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 117378us
I20260709 12:59:05.211865  1564 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:05.212100  3534 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:05.224391  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1442) took 1708 ms. Trace:
I20260709 12:59:05.224885  1641 rpcz_store.cc:276] 0709 12:59:03.515607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.194033 (+1678426us) service_pool.cc:224] Handling call
0709 12:59:05.210908 (+ 16875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.223997 (+ 13089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.224307 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.218538  3710 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:05.221832  1646 rpcz_store.cc:276] 0709 12:59:02.542163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.028161 (+2485998us) service_pool.cc:224] Handling call
0709 12:59:05.028818 (+   657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.206207 (+177389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.207941 (+  1734us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.225301  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 129) took 2683 ms. Trace:
I20260709 12:59:05.230640  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 146) took 1181 ms. Trace:
I20260709 12:59:05.230538  1640 rpcz_store.cc:276] 0709 12:59:02.541628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.021402 (+2479774us) service_pool.cc:224] Handling call
0709 12:59:05.021976 (+   574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.224953 (+202977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.225221 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.231213  1564 rpcz_store.cc:276] 0709 12:59:04.049140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.190544 (+1141404us) service_pool.cc:224] Handling call
0709 12:59:05.211451 (+ 20907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.228686 (+ 17235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.230578 (+  1892us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:05.244652  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 268612us
I20260709 12:59:05.251168  1640 raft_consensus.cc:1240] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:05.254246  3729 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:05.254408  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1450) took 1539 ms. Trace:
I20260709 12:59:05.261507  3694 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.262295  3694 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:05.265231  3694 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:05.258258  1640 rpcz_store.cc:276] 0709 12:59:03.715231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.234702 (+1519471us) service_pool.cc:224] Handling call
0709 12:59:05.250578 (+ 15876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.253012 (+  2434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.253986 (+   974us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.232821  3712 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:05.268581  1567 raft_consensus.cc:1240] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:05.268739  1571 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:59:05.254957  3729 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.269804  3733 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:05.272070  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1326) took 1510 ms. Trace:
I20260709 12:59:05.270895  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 150) took 1218 ms. Trace:
I20260709 12:59:05.273289  1571 rpcz_store.cc:276] 0709 12:59:04.052138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.168501 (+1116363us) service_pool.cc:224] Handling call
0709 12:59:05.227641 (+ 59140us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:05.270638 (+ 42997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.270845 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.273182  1567 rpcz_store.cc:276] 0709 12:59:03.761215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.144124 (+1382909us) service_pool.cc:224] Handling call
0709 12:59:05.229352 (+ 85228us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:05.271821 (+ 42469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.272021 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:05.273195  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 244169us
I20260709 12:59:05.271433  3729 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:05.275786  3518 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:05.280905  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 152) took 1572 ms. Trace:
I20260709 12:59:05.297087  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1434) took 1938 ms. Trace:
I20260709 12:59:05.289170  1721 rpcz_store.cc:276] 0709 12:59:03.708993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.978706 (+269713us) service_pool.cc:224] Handling call
0709 12:59:03.988309 (+  9603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.151567 (+1163258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.280481 (+128914us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400302354. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:05.280823 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2627787648}
I20260709 12:59:05.299876  1642 raft_consensus.cc:1275] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:05.305303  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1447) took 1628 ms. Trace:
I20260709 12:59:05.305968  1642 rpcz_store.cc:276] 0709 12:59:03.676593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.227519 (+1550926us) service_pool.cc:224] Handling call
0709 12:59:05.271610 (+ 44091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.304992 (+ 33382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.305235 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.297610  1647 rpcz_store.cc:276] 0709 12:59:03.359117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.084848 (+1725731us) service_pool.cc:224] Handling call
0709 12:59:05.085435 (+   587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.085955 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:05.227124 (+141169us) log.cc:844] Serialized 14 byte log entry
0709 12:59:05.296681 (+ 69557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:05.296750 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:05.296800 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.296869 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.297026 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172424,"raft.queue_time_us":5618,"thread_start_us":124038,"threads_started":2}
I20260709 12:59:05.314141  1646 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:05.314954  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1449) took 1617 ms. Trace:
I20260709 12:59:05.315171  1646 rpcz_store.cc:276] 0709 12:59:03.697721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.238636 (+1540915us) service_pool.cc:224] Handling call
0709 12:59:05.286562 (+ 47926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.314736 (+ 28174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.314906 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.310946  3518 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.316244  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2248) took 1518 ms. Trace:
I20260709 12:59:05.346093  1647 pending_rounds.cc:85] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 1
I20260709 12:59:05.346624  1647 pending_rounds.cc:107] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:59:05.346894  1647 raft_consensus.cc:2889] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:05.371556  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 58605.3us
I20260709 12:59:05.382539  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1446) took 1721 ms. Trace:
I20260709 12:59:05.382699  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:05.383253  1639 rpcz_store.cc:276] 0709 12:59:03.661465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.208577 (+1547112us) service_pool.cc:224] Handling call
0709 12:59:05.243266 (+ 34689us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:05.263158 (+ 19892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.263202 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:05.264157 (+   955us) log.cc:844] Serialized 52 byte log entry
0709 12:59:05.295723 (+ 31566us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:05.295760 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.295821 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:05.382228 (+ 86407us) raft_consensus.cc:1685] finished
0709 12:59:05.382253 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.382457 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1761,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":205,"thread_start_us":31002,"threads_started":1,"wal-append.queue_time_us":111846}
I20260709 12:59:05.384516  1640 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:05.385630  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1451) took 1649 ms. Trace:
I20260709 12:59:05.386202  1640 rpcz_store.cc:276] 0709 12:59:03.736512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.279485 (+1542973us) service_pool.cc:224] Handling call
0709 12:59:05.341865 (+ 62380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.385232 (+ 43367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.385551 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.388808  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1460) took 1488 ms. Trace:
W20260709 12:59:05.390461  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.394496  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1458) took 1495 ms. Trace:
I20260709 12:59:05.395155  1646 rpcz_store.cc:276] 0709 12:59:03.899316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.316609 (+1417293us) service_pool.cc:224] Handling call
0709 12:59:05.393492 (+ 76883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.393989 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.394027 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:05.394145 (+   118us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:05.394190 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.394263 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.394416 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.397542  1646 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:59:05.399986  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 111905us
I20260709 12:59:05.401072  3645 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:05.402678  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:05.405083  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1319) took 1661 ms. Trace:
I20260709 12:59:05.405758  1565 rpcz_store.cc:276] 0709 12:59:03.743254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.098033 (+1354779us) service_pool.cc:224] Handling call
0709 12:59:05.098546 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:05.161745 (+ 63199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.161808 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:05.162910 (+  1102us) log.cc:844] Serialized 26 byte log entry
0709 12:59:05.239847 (+ 76937us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:05.258130 (+ 18283us) log.cc:844] Serialized 14 byte log entry
0709 12:59:05.261512 (+  3382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.262707 (+  1195us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:05.404691 (+141984us) raft_consensus.cc:1685] finished
0709 12:59:05.404724 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.404965 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16562,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":2369,"raft.run_cpu_time_us":441,"raft.run_wall_time_us":443,"thread_start_us":76184,"threads_started":1,"wal-append.queue_time_us":128634}
W20260709 12:59:05.408651  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.394505  1686 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:05.414453  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.385877  1639 raft_consensus.cc:1240] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:05.420281  1720 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:05.421072  3667 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:05.421590  3667 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.422024  3667 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:05.432034  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1459) took 1532 ms. Trace:
I20260709 12:59:05.432601  1639 rpcz_store.cc:276] 0709 12:59:03.899758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.384947 (+1485189us) service_pool.cc:224] Handling call
0709 12:59:05.385606 (+   659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.431583 (+ 45977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.431941 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.433949  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1461) took 1533 ms. Trace:
I20260709 12:59:05.434617  1646 rpcz_store.cc:276] 0709 12:59:03.900653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.396445 (+1495792us) service_pool.cc:224] Handling call
0709 12:59:05.397116 (+   671us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:05.398041 (+   925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.433870 (+ 35829us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.389258  1640 rpcz_store.cc:276] 0709 12:59:03.900075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.387276 (+1487201us) service_pool.cc:224] Handling call
0709 12:59:05.387840 (+   564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.388257 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.388305 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:05.388413 (+   108us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:05.388460 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.388538 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.388721 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:05.444490  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:05.446489  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:05.468364  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.469048  1642 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:05.469899  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1453) took 1701 ms. Trace:
I20260709 12:59:05.475755  1642 rpcz_store.cc:276] 0709 12:59:03.768614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.307027 (+1538413us) service_pool.cc:224] Handling call
0709 12:59:05.415511 (+108484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.469522 (+ 54011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.469805 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.480126  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1457) took 1581 ms. Trace:
I20260709 12:59:05.480746  1647 rpcz_store.cc:276] 0709 12:59:03.898834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.317031 (+1418197us) service_pool.cc:224] Handling call
0709 12:59:05.345732 (+ 28701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:05.347601 (+  1869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.347652 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:05.348219 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:59:05.462606 (+114387us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:05.462666 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.462784 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:05.479840 (+ 17056us) raft_consensus.cc:1685] finished
0709 12:59:05.479871 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.480046 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":42543,"threads_started":1,"wal-append.queue_time_us":58226}
W20260709 12:59:05.484912  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.488327  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1444) took 1946 ms. Trace:
I20260709 12:59:05.489696  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1484) took 1033 ms. Trace:
I20260709 12:59:05.488933  1644 rpcz_store.cc:276] 0709 12:59:03.536310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.199070 (+1662760us) service_pool.cc:224] Handling call
0709 12:59:05.228969 (+ 29899us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:05.298106 (+ 69137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.298177 (+    71us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:05.350831 (+ 52654us) log.cc:844] Serialized 52 byte log entry
0709 12:59:05.463761 (+112930us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:05.463835 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.463949 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:05.482374 (+ 18425us) raft_consensus.cc:1685] finished
0709 12:59:05.482415 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.482680 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12453,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":17143,"thread_start_us":87245,"threads_started":1,"wal-append.queue_time_us":104155}
I20260709 12:59:05.490371  1647 rpcz_store.cc:276] 0709 12:59:04.456021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.482438 (+1026417us) service_pool.cc:224] Handling call
0709 12:59:05.483225 (+   787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.489255 (+  6030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.489298 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:05.489345 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:05.489376 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.489455 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.489609 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":152,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119}
I20260709 12:59:05.492846  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1488) took 1035 ms. Trace:
I20260709 12:59:05.493484  1647 rpcz_store.cc:276] 0709 12:59:04.457372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.491604 (+1034232us) service_pool.cc:224] Handling call
0709 12:59:05.492075 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.492444 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.492470 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:05.492537 (+    67us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:05.492575 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.492644 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.492772 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.497331  1639 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:05.501964  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:05.506176  3762 consensus_meta.cc:287] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.676s	user 0.015s	sys 0.009s
W20260709 12:59:05.506870  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.508112  1645 raft_consensus.cc:2410] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:59:05.508455  1572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38394 (request call id 148) took 1458 ms (client timeout 1784 ms). Trace:
I20260709 12:59:05.509042  2406 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:05.509006  1572 rpcz_store.cc:269] 0709 12:59:04.049876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.133092 (+ 83216us) service_pool.cc:224] Handling call
0709 12:59:05.508195 (+1375103us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b5400279a54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:05.508374 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268152576}
W20260709 12:59:05.509518  1645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1452) took 1751 ms (client timeout 2160 ms). Trace:
W20260709 12:59:05.509976  1645 rpcz_store.cc:269] 0709 12:59:03.758493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.388317 (+629824us) service_pool.cc:224] Handling call
0709 12:59:05.509274 (+1120957us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540010e354. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:05.509439 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2571349376}
I20260709 12:59:05.510221  2406 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:05.512367  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1440) took 2032 ms. Trace:
W20260709 12:59:05.510396  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:05.515512  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.512861  1638 rpcz_store.cc:276] 0709 12:59:03.479855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.126676 (+1646821us) service_pool.cc:224] Handling call
0709 12:59:05.149861 (+ 23185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.198303 (+ 48442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.512048 (+313745us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b54002c42d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:05.512273 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84103424}
I20260709 12:59:05.505419  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1465) took 1603 ms. Trace:
I20260709 12:59:05.520371  1639 rpcz_store.cc:276] 0709 12:59:03.901925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.433632 (+1531707us) service_pool.cc:224] Handling call
0709 12:59:05.474097 (+ 40465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.501594 (+ 27497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.505315 (+  3721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:03.719053   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:05.525794  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:05.506865  3549 consensus_meta.cc:287] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.754s	user 0.016s	sys 0.009s
I20260709 12:59:05.489464  3712 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.538312  3549 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:05.541067  3549 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:05.541333  3740 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:05.542507  2443 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:05.342140  1714 rpcz_store.cc:276] 0709 12:59:03.749379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.138660 (+389281us) service_pool.cc:224] Handling call
0709 12:59:04.139093 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:04.234177 (+ 95084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:04.366554 (+132377us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:04.548025 (+181471us) log.cc:844] Serialized 26 byte log entry
0709 12:59:04.996524 (+448499us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:05.194464 (+197940us) log.cc:844] Serialized 14 byte log entry
0709 12:59:05.216538 (+ 22074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.229910 (+ 13372us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:05.234526 (+  4616us) raft_consensus.cc:1685] finished
0709 12:59:05.234551 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.268019 (+ 33468us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46656,"prepare.queue_time_us":84442,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":106040,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":300,"thread_start_us":618938,"threads_started":2,"wal-append.queue_time_us":318197}
I20260709 12:59:05.544504  3729 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:05.551417  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1467) took 1562 ms. Trace:
I20260709 12:59:05.552191  1640 rpcz_store.cc:276] 0709 12:59:03.989262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.436098 (+1446836us) service_pool.cc:224] Handling call
0709 12:59:05.501431 (+ 65333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.550892 (+ 49461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.550936 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:05.551002 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:05.551047 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.551137 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.551330 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:05.564778  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1466) took 1576 ms. Trace:
I20260709 12:59:05.565277  1646 rpcz_store.cc:276] 0709 12:59:03.988753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.435563 (+1446810us) service_pool.cc:224] Handling call
0709 12:59:05.498178 (+ 62615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.564451 (+ 66273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:05.564476 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:05.564512 (+    36us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:05.564537 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.564586 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.564716 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:05.568635  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.570680  3549 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:05.571264  3549 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.571625  3549 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:05.570716  1686 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:05.577894  1685 leader_election.cc:336] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.570s (SENT)
I20260709 12:59:05.587131  1642 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:05.588440  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1468) took 1598 ms. Trace:
I20260709 12:59:05.588903  1642 rpcz_store.cc:276] 0709 12:59:03.989652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.477072 (+1487420us) service_pool.cc:224] Handling call
0709 12:59:05.564183 (+ 87111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.588064 (+ 23881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.588362 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:05.596487  1685 leader_election.cc:336] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.027s (SENT)
I20260709 12:59:05.598950  2440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42636 (request call id 358) took 1476 ms. Trace:
I20260709 12:59:05.599507  2440 rpcz_store.cc:276] 0709 12:59:04.122607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.125928 (+  3321us) service_pool.cc:224] Handling call
0709 12:59:05.598487 (+1472559us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54006a2554. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:05.598707 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1432062720}
W20260709 12:59:05.604241  3839 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.139s	user 0.003s	sys 0.000s
W20260709 12:59:05.609324  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 146698us
W20260709 12:59:05.612030  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 88017.7us
W20260709 12:59:05.613090  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.614241  3838 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:05.614663  3716 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:05.584683  3712 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:05.618383  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:05.618525  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:05.619789  3531 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:05.622659  3531 raft_consensus.cc:697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:05.624317  3531 consensus_queue.cc:237] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:05.614936  3838 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.626317  3838 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:05.626947  3745 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:05.629511  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:05.620402  1686 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:05.647351  2443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 357) took 1534 ms. Trace:
W20260709 12:59:05.644671  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.631261  3538 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:05.617805  3712 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:05.587189  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1448) took 1900 ms. Trace:
W20260709 12:59:05.635586  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:05.676118  1536 leader_election.cc:336] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Timed out: RequestConsensusVote RPC to 127.0.107.195:43271 timed out after 1.843s (SENT)
W20260709 12:59:05.677923  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 48654.1us
W20260709 12:59:05.680042  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 273743us
I20260709 12:59:05.682768  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:05.685113  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:05.685411  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 65195us
I20260709 12:59:05.667274  1641 rpcz_store.cc:276] 0709 12:59:03.686797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.228060 (+1541263us) service_pool.cc:224] Handling call
0709 12:59:05.255243 (+ 27183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.255725 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:05.312819 (+ 57094us) log.cc:844] Serialized 14 byte log entry
0709 12:59:05.586785 (+273966us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:05.586849 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:05.586905 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.586976 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:05.587121 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":211821,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":14455,"raft.queue_time_us":27274,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":164,"thread_start_us":190170,"threads_started":2}
I20260709 12:59:05.681542  3745 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:05.699047  3740 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:05.705407  3810 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:05.707614  3843 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:05.688647  3538 raft_consensus.cc:697] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:05.673023  3758 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:05.699725  3745 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:05.722733  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:05.714255  3810 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:05.691017  3712 consensus_queue.cc:1059] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:59:05.665022  2443 rpcz_store.cc:276] 0709 12:59:04.113439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.118675 (+  5236us) service_pool.cc:224] Handling call
0709 12:59:04.125732 (+  7057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.543084 (+1417352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:05.646756 (+103672us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54006fead4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:05.647184 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3257207680}
I20260709 12:59:05.726140  3745 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.740306  3762 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:05.740999  3762 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.741460  3762 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:05.746073  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:05.741004  3731 consensus_meta.cc:287] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.884s	user 0.011s	sys 0.017s
I20260709 12:59:05.747949  3731 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:05.729118  3729 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:05.752666  3731 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:05.755905  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 85447.2us
I20260709 12:59:05.728978  3810 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:05.729059  3549 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:05.762822  1714 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:05.764180  3549 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:05.770812  1685 leader_election.cc:336] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.902s (SENT)
I20260709 12:59:05.772573  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:05.772846  3758 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:05.734695  1686 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:05.777040  2405 leader_election.cc:336] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.587s (SENT)
I20260709 12:59:05.779886  3518 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.789254  2405 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:05.795506  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 71215.6us
I20260709 12:59:05.796981  1686 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:05.797927  3534 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:59:05.799034  1685 leader_election.cc:336] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.940s (SENT)
I20260709 12:59:05.799611  1685 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:05.800005  3731 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:05.774878  3693 consensus_meta.cc:287] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.005s
I20260709 12:59:05.802158  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 108) took 10291 ms. Trace:
I20260709 12:59:05.780812  3518 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:05.806216  3843 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:05.807260  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.807197  3843 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:05.808290  3518 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:05.810245  3778 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:05.810632  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:05.811383  1714 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:05.799036  3534 raft_consensus.cc:697] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:05.812984  3838 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:05.814807  1685 leader_election.cc:336] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.033s (SENT)
I20260709 12:59:05.815543  1685 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:05.814879  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:05.816756  3843 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:05.817070  3716 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:05.818377  3838 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:05.800684  1686 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:05.813187  3534 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:05.818858  3667 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:05.819994  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:05.820392  3359 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.821362  3667 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:05.821626  3359 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:05.822535  3778 raft_consensus.cc:2764] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:59:05.823496  3518 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:05.823890  3549 raft_consensus.cc:3055] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:05.824501  3758 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:05.824326  3538 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:05.802582  1469 rpcz_store.cc:276] 0709 12:58:55.427607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.427954 (+   347us) service_pool.cc:224] Handling call
0709 12:59:05.696257 (+10268303us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:59.121515 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:59.122239 (+   724us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:59.122293 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:58:59.122322 (+    29us) tablet.cc:662] Decoding operations
0709 12:58:59.123436 (+  1114us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:59.123547 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:59.123599 (+    52us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:58:59.213796 (+ 90197us) tablet.cc:701] Row locks acquired
0709 12:58:59.216475 (+  2679us) write_op.cc:260] PREPARE: finished
0709 12:58:59.235006 (+ 18531us) write_op.cc:270] Start()
0709 12:58:59.263510 (+ 28504us) write_op.cc:276] Timestamp: P: 1783601939234897 usec, L: 0
0709 12:58:59.267496 (+  3986us) op_driver.cc:348] REPLICATION: starting
0709 12:58:59.322856 (+ 55360us) log.cc:844] Serialized 2835 byte log entry
0709 12:59:00.104107 (+781251us) op_driver.cc:464] REPLICATION: finished
0709 12:59:00.658353 (+554246us) write_op.cc:301] APPLY: starting
0709 12:59:00.666162 (+  7809us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:00.728007 (+ 61845us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:00.753925 (+ 25918us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:01.184814 (+430889us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:01.208764 (+ 23950us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:59:01.208827 (+    63us) write_op.cc:312] APPLY: finished
0709 12:59:01.209241 (+   414us) log.cc:844] Serialized 59 byte log entry
0709 12:59:02.459249 (+1250008us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:02.467419 (+  8170us) write_op.cc:454] Released schema lock
0709 12:59:02.469674 (+  2255us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:02.505366 (+ 35692us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:02.507850 (+  2484us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2441444,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":511531,"apply.run_cpu_time_us":53616,"apply.run_wall_time_us":1841641,"num_ops":7,"prepare.queue_time_us":105251,"prepare.run_cpu_time_us":16608,"prepare.run_wall_time_us":245916,"raft.queue_time_us":482430,"raft.run_cpu_time_us":12854,"raft.run_wall_time_us":355338,"replication_time_us":773047,"thread_start_us":1721638,"threads_started":5,"wal-append.queue_time_us":833302,"wal-append.run_cpu_time_us":16429,"wal-append.run_wall_time_us":3046925}]]}
W20260709 12:59:05.847432  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 334288us
I20260709 12:59:05.855104  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:05.856060  2443 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:59:05.856274  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:05.857306  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:05.857779  2437 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:05.858551  2436 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 6: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
W20260709 12:59:05.860184  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 45427.7us
I20260709 12:59:05.859083  3729 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:05.863971  3729 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:05.848284  3838 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:05.867972  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 90998us
I20260709 12:59:05.818994  1470 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 3 to 4, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:05.850555  3549 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 12:59:05.887383  1685 leader_election.cc:336] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.034s (SENT)
W20260709 12:59:05.903228  2405 leader_election.cc:336] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.012s (SENT)
I20260709 12:59:05.852339  3731 raft_consensus.cc:697] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:05.859360  3645 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:05.918479  1470 catalog_manager.cc:5697] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 2 to 3, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
W20260709 12:59:05.927147  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.867887  3359 raft_consensus.cc:697] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:05.983093  1714 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:05.975200  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:05.991426  1572 raft_consensus.cc:2410] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:59:05.991914  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.992061  1571 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:05.993085  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:05.993813  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:05.873446  3762 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:05.909513  3810 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:06.007072  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:06.009732  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:06.018462  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 131421us
I20260709 12:59:05.987630  1470 catalog_manager.cc:5697] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:06.012475  1563 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:06.018884  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1485) took 1562 ms. Trace:
I20260709 12:59:06.009688  1571 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:06.011026  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:06.018590  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 130954us
I20260709 12:59:06.010579  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:06.009946  1567 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:06.030308  1570 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 5: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:05.995042  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:06.031461  1568 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:06.027702  1565 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:06.032586  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.028913  1644 rpcz_store.cc:276] 0709 12:59:04.456337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.491082 (+1034745us) service_pool.cc:224] Handling call
0709 12:59:05.491574 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:05.492318 (+   744us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:05.783669 (+291351us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b18002e1ce0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18cce404bc 00007f18ca18e48b 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1a8455 00007f18d0c903c7 00007f18cd2a29a7 00007f18cd2b20bf
0709 12:59:05.783905 (+   236us) log.cc:844] Serialized 14 byte log entry
0709 12:59:05.922079 (+138174us) log.cc:844] Serialized 14 byte log entry
0709 12:59:06.017557 (+ 95478us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b18002e1ce0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca125c0a 00007f18d3865219 00007f18ca1ada40 00007f18ca1a84e4 00007f18ca1a8455 00007f18cd290060 00007f18cd2a2716 00007f18cd2b3287 00007f18cd2b3208
0709 12:59:06.018250 (+   693us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:06.018345 (+    95us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:06.018438 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:06.018558 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:06.018752 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24283,"prepare.queue_time_us":30646,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":138306,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":30442,"spinlock_wait_cycles":218995200,"thread_start_us":112520,"threads_started":2}
I20260709 12:59:05.931267  3729 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:06.019122  2440 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:06.042199  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:05.921089  3758 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:06.045250  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.042236  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:06.042935  1569 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:06.058787  1572 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:59:06.059113  2437 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:59:06.060572  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:06.061272  1568 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:06.010072  3549 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:06.019443  3731 consensus_queue.cc:237] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:06.054350  1470 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 2 to 4, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:06.062013  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:06.067529  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 180558us
I20260709 12:59:06.011132  3745 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:06.069681  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:06.078603  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:06.064865  2405 leader_election.cc:336] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.126s (SENT)
I20260709 12:59:06.073693  3733 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:06.075629  3758 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:06.070258  1537 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:06.079461  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 147534us
I20260709 12:59:06.082571  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:06.083397  2438 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:06.084159  3733 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:06.038214  3645 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:06.084837  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:06.065680  3762 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:06.064682  3810 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:06.062871  3549 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:06.020009  3359 consensus_queue.cc:237] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:06.092666  1470 catalog_manager.cc:5697] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 3 to 4, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:06.080741  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:06.086871  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:06.099102  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.099225  1567 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:59:06.099479  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:06.100281  1685 leader_election.cc:336] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.160s (SENT)
I20260709 12:59:06.101081  2448 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:06.094013  3733 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:06.112953  3645 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:06.112865  3733 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:06.114673  3733 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:06.115064  2436 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 7: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
W20260709 12:59:06.115773  1685 leader_election.cc:336] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.173s (SENT)
W20260709 12:59:06.116998  1685 leader_election.cc:336] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.181s (SENT)
I20260709 12:59:06.117419  1685 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:06.119704  3745 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:06.120009  2405 leader_election.cc:336] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.286s (SENT)
I20260709 12:59:06.120646  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:06.122141  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:06.122584  3818 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.123629  2437 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:06.107928  1470 catalog_manager.cc:5697] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 3 to 4, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:06.128028  2436 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:06.128517  1470 catalog_manager.cc:5697] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
W20260709 12:59:06.122099  2405 leader_election.cc:336] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.488s (SENT)
I20260709 12:59:06.138343  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:06.139276  1571 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:06.110430  3758 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:06.140691  3758 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:06.140990  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 12:59:06.141458  2405 leader_election.cc:336] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.076s (SENT)
I20260709 12:59:06.142102  2440 raft_consensus.cc:2368] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:59:06.142194  1565 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:06.142966  1720 raft_consensus.cc:1240] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:06.144901  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:06.148741  1567 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:06.151324  1571 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:59:06.155781  3645 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:06.157330  1470 catalog_manager.cc:5697] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:06.169631  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.141052  3758 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:06.177160  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:06.178242  3549 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:06.177431  1536 leader_election.cc:336] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.546s (SENT)
I20260709 12:59:06.181308  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:06.146607  3817 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:06.188107  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 46730us
I20260709 12:59:06.150079  3745 consensus_queue.cc:1059] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 12:59:06.203014  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:06.204087  2405 leader_election.cc:336] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.516s (SENT)
I20260709 12:59:06.208559  3776 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:06.210103  2443 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:06.214598  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.198827  3729 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.215425  1721 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:06.222633  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.236369  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.242934  3729 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.243767  3729 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:06.247567  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:06.252180  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:06.254277  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 76891us
I20260709 12:59:06.255803  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.259217  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.267812  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.268671  1470 catalog_manager.cc:5697] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:06.235805  3645 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:59:06.291366  1470 catalog_manager.cc:5697] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 4, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:06.270622  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.296949  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:06.275903  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 74799.1us
W20260709 12:59:06.301426  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.287752  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:06.285509  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:06.302340  1572 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:06.278187  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.294337  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.294502  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.295255  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.271572  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:06.295804  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.296422  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.296854  3645 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:06.297677  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:06.299894  1685 leader_election.cc:336] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.182s (SENT)
I20260709 12:59:06.274519  3762 raft_consensus.cc:3055] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:06.303895  1713 raft_consensus.cc:2410] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:06.316450  1566 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.319733  3745 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.320645  3745 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:06.328994  1719 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 6: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:06.266417  3729 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:06.313472  3762 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:06.348085  3762 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:06.349678  3762 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:06.350214  1685 leader_election.cc:336] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.199s (SENT)
W20260709 12:59:06.354131  1685 leader_election.cc:336] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.242s (SENT)
W20260709 12:59:06.355448  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.356097  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.355924  1470 catalog_manager.cc:5697] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 2, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:06.357583  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.359009  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.359506  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.361516  3745 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:06.355173  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.357791  1470 catalog_manager.cc:5697] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 2, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:06.364530  3758 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:06.371543  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:06.376505  1563 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:06.374668  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:06.394207  2406 leader_election.cc:336] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.975s (SENT)
I20260709 12:59:06.392323  1470 catalog_manager.cc:5697] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 1 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:06.400050  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.428829  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:06.429286  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.434770  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:06.437783  1566 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:59:06.439852  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.440514  2405 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:06.429634  3762 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.451885  3848 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:06.468576  3848 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:06.468400  3762 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:06.469514  3745 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.469724  3848 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:06.470152  3745 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:06.471119  3762 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:06.472383  3745 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:06.451756  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.454465  3549 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:06.456857  3758 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:06.449340  3776 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 12:59:06.474570  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.481210  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.479615  1718 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
W20260709 12:59:06.499881  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.500883  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:06.503991  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.435688  3729 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:59:06.529680  1563 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:06.537319  1712 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
W20260709 12:59:06.558380  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.555218  1611 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:06.502485  3745 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:06.608012  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 52923.9us
W20260709 12:59:06.608785  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:06.629594  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.617159  3762 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:06.637764  3762 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:06.638386  3762 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:06.644325  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 154148us
I20260709 12:59:06.648118  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.649335  1718 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 12:59:06.656925  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.671754  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:06.672748  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 278534us
I20260709 12:59:06.675163  2406 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:06.679186  2406 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:06.682636  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.683521  1718 raft_consensus.cc:2368] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:59:06.678108  3549 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:06.617496  3745 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:06.693506  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.707412  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.707685  2406 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:06.710140  2406 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:06.715961  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.720398  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.729375  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.730517  1712 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:06.731161  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:06.711319  3848 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:06.742508  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:06.735304  1536 leader_election.cc:336] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.572s (SENT)
I20260709 12:59:06.714309  3712 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:06.748682  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:06.733266  3874 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.293s	user 0.000s	sys 0.002s
I20260709 12:59:06.754927  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:06.732455  3843 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:06.763242  3877 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:59:06.752847  3712 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:06.764237  3712 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:06.764963  2436 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:06.751487  3848 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:06.774621  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 60459.3us
I20260709 12:59:06.761951  3843 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:06.747201  3851 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:59:06.759455  3856 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:06.773864  3848 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:06.835124  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 47972.5us
W20260709 12:59:06.835786  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 103670us
W20260709 12:59:06.840581  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 95370us
W20260709 12:59:06.841495  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.796347  3843 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:06.850266  3359 consensus_queue.cc:1059] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:59:06.851719  3359 raft_consensus.cc:3055] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:06.852111  3359 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:06.853084  3359 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:06.855059  1686 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:06.861662  3817 consensus_queue.cc:1059] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:59:06.839810  3856 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:06.868665  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.858538  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:06.884675  3359 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:06.902544  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:06.903317  2436 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:06.906140   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:06.859570  3762 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:06.912366  3762 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:06.913117  3762 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:06.915077  3856 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:06.921451  3880 log.cc:927] Time spent T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 12:59:06.925047  3882 log.cc:927] Time spent T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:59:06.906242  3745 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:06.927006  3878 log.cc:927] Time spent T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:59:06.932543  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 45291.5us
W20260709 12:59:06.933611  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:06.941339  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.913637  3762 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:06.899850  3851 consensus_queue.cc:1059] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 12:59:06.949159  1612 connection.cc:256] RPC call timeout handler was delayed by -1.924531044000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 12:59:06.957095  1612 connection.cc:256] RPC call timeout handler was delayed by -1.7922310440000615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
W20260709 12:59:06.956435  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 114298us
W20260709 12:59:06.957474  1612 connection.cc:256] RPC call timeout handler was delayed by -1.7130310440000471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 12:59:06.957809  1612 connection.cc:256] RPC call timeout handler was delayed by -1.6851310440000589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
W20260709 12:59:06.958344  1612 connection.cc:256] RPC call timeout handler was delayed by -1.583431044000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 12:59:06.958673  1612 connection.cc:256] RPC call timeout handler was delayed by -1.581631044000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 12:59:06.958949  1612 connection.cc:256] RPC call timeout handler was delayed by -1.4817310440000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
W20260709 12:59:06.959213  1612 connection.cc:256] RPC call timeout handler was delayed by -1.4565310440000303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
W20260709 12:59:06.959479  1612 connection.cc:256] RPC call timeout handler was delayed by -1.4232310440000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 12:59:06.960336  1612 connection.cc:256] RPC call timeout handler was delayed by -1.4196310440000275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
W20260709 12:59:06.960702  1612 connection.cc:256] RPC call timeout handler was delayed by -1.418731044000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
W20260709 12:59:06.961198  1612 connection.cc:256] RPC call timeout handler was delayed by -1.3665310440000553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 12:59:06.961622  1612 connection.cc:256] RPC call timeout handler was delayed by -1.3494310440000277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 12:59:06.962041  1612 connection.cc:256] RPC call timeout handler was delayed by -1.3242310440000438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
W20260709 12:59:06.962387  1612 connection.cc:256] RPC call timeout handler was delayed by -1.3233310440000423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
W20260709 12:59:06.962787  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2342310440000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23220000000000002s for a response
W20260709 12:59:06.963214  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1811310440000398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23809999999999998s for a response
W20260709 12:59:06.963594  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1397310440000297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24270000000000003s for a response
W20260709 12:59:06.963991  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1019310440000254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2469s for a response
I20260709 12:59:06.965016  1612 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:06.970243  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.935092  3856 consensus_queue.cc:1059] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 12:59:06.985245  1536 leader_election.cc:336] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.668s (SENT)
I20260709 12:59:06.985889  1536 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:06.998121  3889 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.998142  3817 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:06.999675  3817 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:07.000958  3875 log.cc:927] Time spent T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.287s	user 0.001s	sys 0.001s
I20260709 12:59:07.004109  2436 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:07.004710  3888 raft_consensus.cc:3055] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:07.005199  3888 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:07.014482  1537 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:07.018622  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 172340us
W20260709 12:59:07.018733  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 82350.6us
W20260709 12:59:07.028882  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.039448  3645 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:07.030453  3729 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:07.056113  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.056294  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:07.056880  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:07.057894  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 77347.7us
I20260709 12:59:07.031421  3851 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:59:07.066536  1717 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:59:06.993216  3884 consensus_queue.cc:1059] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:59:07.006579  3888 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:06.999125  3889 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.055075  3892 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:59:07.074941  3762 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:07.085826  3762 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:07.086766  3762 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.067971  3895 consensus_queue.cc:1059] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:59:07.079355  3712 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.088587  3848 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.061012  3745 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:07.059017  3729 raft_consensus.cc:697] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:07.091339  3729 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.095180  3776 raft_consensus.cc:3055] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:07.095698  3776 raft_consensus.cc:740] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 12:59:07.097949  1536 leader_election.cc:336] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.735s (SENT)
W20260709 12:59:07.099191  1536 leader_election.cc:336] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.759s (SENT)
I20260709 12:59:07.099643  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:07.100189  3848 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:07.098627  3776 consensus_queue.cc:260] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:07.102321  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 48204.2us
W20260709 12:59:07.075232  3873 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.363s	user 0.000s	sys 0.003s
W20260709 12:59:07.107277  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 142437us
I20260709 12:59:07.139953  3762 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:07.115598  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:07.117585  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 50423us
I20260709 12:59:07.123116  3900 consensus_queue.cc:1059] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:07.102895  3758 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:07.106374  3359 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 12:59:07.137547  1536 leader_election.cc:336] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.828s (SENT)
W20260709 12:59:07.137506  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 70687.6us
I20260709 12:59:07.121806  3892 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:59:07.161425  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:07.139057  3549 raft_consensus.cc:3055] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:07.162644  3758 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:07.162829  3549 raft_consensus.cc:740] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:07.164098  3549 consensus_queue.cc:260] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.140347  3712 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:07.142726  3899 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.140081  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:07.173758  1718 raft_consensus.cc:606] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:07.174023  3888 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:07.138906  3889 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:07.159062  1612 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:07.138224  3906 raft_consensus.cc:3055] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:07.166097  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:07.167908  3549 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:07.176518  3843 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.177459  1612 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:07.178197  3818 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:07.178630  3818 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:07.169593  3891 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:07.179129  3843 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:07.179368  3891 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.179872  3891 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:07.180222  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:07.181336  3897 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:07.169848  3359 raft_consensus.cc:3055] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:07.169924  3900 raft_consensus.cc:3055] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:07.170720  3892 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.182724  3900 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:07.182976  3892 consensus_queue.cc:1243] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer a4be9cc90aca4dd4ad7db103062a7208 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:59:07.182667  3359 raft_consensus.cc:740] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:07.182648  3889 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:07.185745  3885 raft_consensus.cc:3055] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:07.185537  3359 consensus_queue.cc:260] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.173645  3895 consensus_queue.cc:1059] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:07.178982  3818 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:07.182228  3897 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:07.183957  3900 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.186259  3885 raft_consensus.cc:740] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:07.186458  1612 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:07.165962  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 50744.8us
I20260709 12:59:07.188592  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:07.191279  1717 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:07.172410  3905 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:59:07.195637  3889 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:07.194435  3359 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:07.196323  1536 leader_election.cc:336] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.103s (SENT)
I20260709 12:59:07.194247  3843 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:59:07.198973  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:07.190608  3895 raft_consensus.cc:3055] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:07.199944  3758 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:07.200330  3895 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:07.192378  3776 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:07.201401  3895 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.202874  3895 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:07.203926  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:07.175561  3906 raft_consensus.cc:740] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:07.206593  1570 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:07.206830  3906 consensus_queue.cc:260] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.173651  3899 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.208475  3906 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:07.210638  3900 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:07.210978  3885 consensus_queue.cc:260] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:07.218330  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.221747  3902 consensus_queue.cc:1059] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:07.223083  3892 raft_consensus.cc:3055] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:07.223503  3892 raft_consensus.cc:740] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:07.225028  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2e78d031c384616a01064318cb24f28"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:07.225735  1717 raft_consensus.cc:606] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:07.230217  3899 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:07.224573  3902 consensus_queue.cc:1059] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:59:07.241233  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:07.241601  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 55292.9us
I20260709 12:59:07.241986  1568 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:07.242571  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:07.242880  1612 leader_election.cc:400] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6.
I20260709 12:59:07.243232  1570 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:07.241763  3902 raft_consensus.cc:3055] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:59:07.249445  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 56855.5us
I20260709 12:59:07.254339  1568 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:07.256539  1568 raft_consensus.cc:1275] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:59:07.257194  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.257400  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:07.267844  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:07.268129  1565 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:07.258450  1563 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:07.261886  3891 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:07.263975  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.264683  3758 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.278908  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:07.279623  1567 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:07.282614  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:07.254552  3902 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:07.285437  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.278738  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:07.224465  3892 consensus_queue.cc:260] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.299551  1612 leader_election.cc:400] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 3. Current term is 4.
I20260709 12:59:07.299381  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:07.301608  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:07.302477  2436 raft_consensus.cc:2368] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4.
I20260709 12:59:07.304173  1568 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:07.312845  1567 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:59:07.305938  3889 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.266459  3817 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:59:07.318588  1567 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:07.276849  3905 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:59:07.294934  3899 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:07.326514  2436 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:59:07.346299  3899 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:07.299404  3892 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:07.347316  3885 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:07.327782  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:07.329569  1564 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:07.335559  3818 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.340173  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:07.346890  3899 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:07.349007  1570 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:07.353220  1565 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:07.280053  3758 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.363606  1563 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:07.354447  1572 raft_consensus.cc:2368] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:59:07.359624  3851 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.361805  1612 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:07.374691  3758 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:07.340063  3902 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.385762  3902 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:07.392975  3851 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.326635  3891 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:07.398238  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.403997  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:07.423625  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:07.435616  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.437258  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:07.438308  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:07.448568  2406 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:07.451018  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:07.451431  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:07.452286  3818 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:07.452634  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:07.453823  3913 log.cc:927] Time spent T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
W20260709 12:59:07.455004  1536 leader_election.cc:336] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Timed out: RequestConsensusVote RPC to 127.0.107.195:43271 timed out after 2.231s (SENT)
I20260709 12:59:07.455613  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:07.456418  1569 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:07.436302  3897 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.461781  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:07.463732  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 114525us
W20260709 12:59:07.464311  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.467268  3745 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.467919  3745 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.470458  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:07.471259  1717 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:07.474149  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:07.474949  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:07.459898  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:07.461452  3762 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:07.461638  3851 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:07.503752  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 55297.5us
I20260709 12:59:07.473780  3729 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:07.515345  2406 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:07.520114  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 45248.9us
W20260709 12:59:07.522717  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 67705.2us
W20260709 12:59:07.524317  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.521777  2406 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:07.530449  2406 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:07.540756  3915 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:07.541837  3903 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:07.544132  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:07.544979  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 227245us
W20260709 12:59:07.545608  1470 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58252 (request call id 216) took 11448 ms (client timeout 15000 ms). Trace:
I20260709 12:59:07.548375  3818 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:07.485700  3891 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:59:07.525676  3851 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:07.471880  3897 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.558706  1686 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:07.521359  3776 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:59:07.553398  3856 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:59:07.546123  1470 rpcz_store.cc:269] 0709 12:58:56.096948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.097249 (+   301us) service_pool.cc:224] Handling call
0709 12:59:07.545532 (+11448283us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:06.914891 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:06.915702 (+   811us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:06.915757 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:59:06.915782 (+    25us) tablet.cc:662] Decoding operations
0709 12:59:06.917186 (+  1404us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:06.917302 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:06.917342 (+    40us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:59:07.002196 (+ 84854us) tablet.cc:701] Row locks acquired
0709 12:59:07.002273 (+    77us) write_op.cc:260] PREPARE: finished
0709 12:59:07.002506 (+   233us) write_op.cc:270] Start()
0709 12:59:07.002748 (+   242us) write_op.cc:276] Timestamp: P: 1783601947002420 usec, L: 0
0709 12:59:07.002779 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:59:07.003776 (+   997us) log.cc:844] Serialized 5193 byte log entry
0709 12:59:07.141867 (+138091us) op_driver.cc:464] REPLICATION: finished
0709 12:59:07.204663 (+ 62796us) write_op.cc:301] APPLY: starting
0709 12:59:07.204769 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:07.205108 (+   339us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:07.265442 (+ 60334us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:07.332736 (+ 67294us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:07.333106 (+   370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:59:07.333164 (+    58us) write_op.cc:312] APPLY: finished
0709 12:59:07.333613 (+   449us) log.cc:844] Serialized 95 byte log entry
0709 12:59:07.334720 (+  1107us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:07.334913 (+   193us) write_op.cc:454] Released schema lock
0709 12:59:07.334995 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:07.335452 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:07.335481 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1050130,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":62465,"apply.run_cpu_time_us":4949,"apply.run_wall_time_us":130790,"num_ops":13,"prepare.queue_time_us":160436,"prepare.run_cpu_time_us":13543,"prepare.run_wall_time_us":120069,"raft.queue_time_us":103568,"raft.run_cpu_time_us":17196,"raft.run_wall_time_us":19285,"replication_time_us":138895,"thread_start_us":218760,"threads_started":4,"wal-append.queue_time_us":30986}]]}
I20260709 12:59:07.553977  3762 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:07.567036  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:07.567444  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 93429.9us
W20260709 12:59:07.567835  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.563170  3851 raft_consensus.cc:697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:07.560068  3745 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:07.574520  1536 leader_election.cc:336] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.889s (SENT)
I20260709 12:59:07.576320  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:07.563473  3818 raft_consensus.cc:697] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:07.573948  3900 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:07.585453  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:07.575125  3856 raft_consensus.cc:697] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:07.581983  3900 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.579396  3758 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:07.579871  3762 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.595949  3900 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:07.604203  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.600683  3889 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:07.605749  3851 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.611267  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:07.612497  3915 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:07.612934  3915 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:07.613358  3915 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:07.601814  3919 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:07.614585  3919 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:07.614970  3919 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:07.616796  3892 raft_consensus.cc:993] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower 338d817f94ee4c1bad162e9a5860b68a to start an election
W20260709 12:59:07.617753  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.618517  1686 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:07.593323  3888 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:59:07.626535  3906 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:07.627029  3359 raft_consensus.cc:1081] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Signalling peer 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 12:59:07.627192  3906 raft_consensus.cc:697] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:07.628415  3906 consensus_queue.cc:237] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.628576  3818 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.594127  3918 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:59:07.638775  3897 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:07.640841  2436 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:07.643474  3881 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:07.650288  3359 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.651115  3359 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.654242  3359 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:07.656016  3856 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.658229  3899 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.640480  1466 catalog_manager.cc:5697] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:07.665436  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 46277.5us
I20260709 12:59:07.654014  3921 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:07.643599  3762 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:07.664216  1717 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:59:07.670326  1718 raft_consensus.cc:606] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:07.670897  1718 raft_consensus.cc:614] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:07.671957  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:07.690418  1686 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:07.692986  3921 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:07.695514  3899 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:07.697602  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:07.698206  3905 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:07.698879  3905 raft_consensus.cc:697] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:07.700172  3905 consensus_queue.cc:237] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:07.708992  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 47631us
I20260709 12:59:07.710199  1612 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:07.714607  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:07.717005  3881 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:07.716886  3895 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:07.717783  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:07.717806  3881 raft_consensus.cc:697] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:07.719657  1536 leader_election.cc:400] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:59:07.719324  3881 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.719981  1536 leader_election.cc:403] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:07.720045  1466 catalog_manager.cc:5697] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 2 to 5, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.722918  3758 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:07.724048  3902 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:07.726573  3899 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:07.729509  3817 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:07.731185  3729 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:07.732977  3817 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:07.737708  1686 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:07.713286  3851 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:07.736937  3817 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:59:07.744053  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:07.748823  1564 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:07.744567  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:07.750326  2443 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:07.743957  3758 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:59:07.758430  3359 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:07.758589  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 86080us
I20260709 12:59:07.764564  1564 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
W20260709 12:59:07.771605  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 55920us
W20260709 12:59:07.775215  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.778475  1466 catalog_manager.cc:5697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 3, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.785885  1563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2e78d031c384616a01064318cb24f28"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:46640
I20260709 12:59:07.786480  1567 raft_consensus.cc:1240] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:07.786796  1563 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:07.787303  1563 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:07.785951  1569 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: [5.6-6.7]
I20260709 12:59:07.789409  1612 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:07.790702  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:07.799247  1685 leader_election.cc:336] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.628s (SENT)
I20260709 12:59:07.808090  1564 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:07.778086  3851 raft_consensus.cc:697] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:07.736968  3915 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.797746  3899 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:07.827754  1563 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.836660  1563 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:07.836791  3899 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:07.837841  3899 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:07.807543  3359 raft_consensus.cc:697] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:07.849491  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 129969us
W20260709 12:59:07.838536  3923 log.cc:927] Time spent T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 12:59:07.856165  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.857426  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:07.856006  1466 catalog_manager.cc:5697] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.825318  3919 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.836694  3900 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:07.869974  3758 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:07.906595  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 54378.8us
I20260709 12:59:07.901887  1466 catalog_manager.cc:5697] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 3, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:07.913273  3925 log.cc:927] Time spent T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:59:07.914752  2443 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
W20260709 12:59:07.915766  3929 log.cc:927] Time spent T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:59:07.918237  1718 raft_consensus.cc:606] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:07.918797  1718 raft_consensus.cc:614] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:07.925770  1536 leader_election.cc:336] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.907s (SENT)
I20260709 12:59:07.926416  1536 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:07.925312  1466 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.937093  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:07.909726  3758 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:07.944274  3921 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:07.944821  3921 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:07.944937  1612 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:07.945286  3921 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:07.947785  1612 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:07.952132  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 150499us
W20260709 12:59:07.959095  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 64720.7us
I20260709 12:59:07.948930  3897 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:07.964624  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.940850  3758 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:07.940050  3905 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:07.966883  1536 leader_election.cc:336] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 3.180s (SENT)
I20260709 12:59:07.970358  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:07.958423  2440 raft_consensus.cc:1240] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:07.923403  3851 consensus_queue.cc:237] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:07.960005  3762 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:07.987283  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:07.992650  1715 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:07.997938  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:07.999158  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:07.999171  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:08.003422  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:07.940523  3359 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.006632  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:07.982298  3881 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:08.000226  1715 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:08.024420  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:08.026654  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:08.027455  1612 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:08.029450  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:07.991992  3915 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:08.030656  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:07.976887  3905 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.031471  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:08.031594  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:08.033919  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:08.035176  1714 raft_consensus.cc:2410] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:08.035655  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:08.036085  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:08.036787  3897 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:08.037370  3897 raft_consensus.cc:697] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:08.038446  3897 consensus_queue.cc:237] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.040120  3905 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:08.033181  1716 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:08.047457  1715 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:07.999397  3762 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:08.051362  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:08.063160  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:08.052798  1685 leader_election.cc:336] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.752s (SENT)
W20260709 12:59:08.032306  3927 log.cc:927] Time spent T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:59:08.072393  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:08.072629  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 45263.1us
W20260709 12:59:08.075073  1685 leader_election.cc:336] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.774s (SENT)
I20260709 12:59:08.076716  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:08.077054  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:08.077057  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:08.077760  3932 log.cc:927] Time spent T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:59:08.078207  1721 raft_consensus.cc:2410] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:08.079254  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:08.080545  1714 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 6: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:08.032023  3940 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:08.085670  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:08.086966  1685 leader_election.cc:336] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.793s (SENT)
W20260709 12:59:08.087581  3926 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.191s	user 0.000s	sys 0.002s
I20260709 12:59:08.098430  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:08.108311  1686 leader_election.cc:400] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4.
I20260709 12:59:08.111615  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:08.106820  1685 leader_election.cc:336] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.807s (SENT)
I20260709 12:59:08.112533  1685 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:08.087787  3919 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:08.116508  1685 leader_election.cc:336] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.977s (SENT)
W20260709 12:59:08.117492  1685 leader_election.cc:336] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.112s (SENT)
I20260709 12:59:08.117863  1685 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:08.121984  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:08.122869  1718 raft_consensus.cc:3055] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:08.123209  1718 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:08.123271  1612 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:08.126358  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 166413us
I20260709 12:59:08.124027  1718 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.130393  1718 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:08.114166  3889 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:08.084264  3899 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:08.138679  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.147629  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:08.140493  1685 leader_election.cc:336] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.113s (SENT)
I20260709 12:59:08.120842  3906 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:08.121986  3817 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:08.150997  3937 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:59:08.151782  3938 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:59:08.153038  3921 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.156512  3900 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:08.159373  3921 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:08.143991  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:08.159906  3935 log.cc:927] Time spent T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:59:08.162997  3937 raft_consensus.cc:3055] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:08.166923  3899 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:08.142987  1536 leader_election.cc:336] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.579s (SENT)
I20260709 12:59:08.167587  1567 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:08.131546  3919 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:59:08.188678  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 45727.2us
W20260709 12:59:08.189548  2405 leader_election.cc:336] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.736s (SENT)
I20260709 12:59:08.177055  1569 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
W20260709 12:59:08.189610  1536 leader_election.cc:336] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.605s (SENT)
I20260709 12:59:08.190644  1536 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:08.193255  1536 leader_election.cc:336] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.644s (SENT)
W20260709 12:59:08.174746  1685 leader_election.cc:336] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.132s (SENT)
W20260709 12:59:08.194335  1536 leader_election.cc:336] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.674s (SENT)
I20260709 12:59:08.194939  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:08.181465  3922 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:08.208865  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 12:59:08.211000  3936 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:59:08.192960  3933 log.cc:927] Time spent T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:59:08.229022  1715 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:08.182032  3937 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:08.230700  3937 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.232295  3937 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:08.235977  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:08.236985  1717 raft_consensus.cc:606] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:08.251152  1567 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:59:08.251156  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 56841.2us
I20260709 12:59:08.252784  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:08.253480  3931 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.284s	user 0.003s	sys 0.000s
I20260709 12:59:08.253813  2443 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:08.251333  3949 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:08.239358  2405 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.096s (SENT) [suppressed 82 similar messages]
W20260709 12:59:08.252830  1536 leader_election.cc:336] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.925s (SENT)
W20260709 12:59:08.269999  1536 leader_election.cc:336] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.965s (SENT)
I20260709 12:59:08.272590  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:08.236289  3948 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:08.138020  3762 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.277050  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:08.281365  1566 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:08.281528  1571 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:08.275434  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:08.234578  3903 consensus_queue.cc:1059] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:59:08.302038  1718 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
W20260709 12:59:08.277810  1536 leader_election.cc:336] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.017s (SENT)
I20260709 12:59:08.280117  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:08.280090   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:08.259460  3922 raft_consensus.cc:697] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:08.304802  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:08.306638  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:08.310680  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:08.306013   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:59:08.320179  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 81068.4us
I20260709 12:59:08.329748  1566 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:08.329039  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:08.330685  1571 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:08.325958  2406 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:08.275027  3758 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.324746  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:08.336863  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:08.337604  1567 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:08.317626  3895 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:08.342221  3949 raft_consensus.cc:2764] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:59:08.343387  1536 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:08.313521  3942 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:08.334164  3856 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 12:59:08.350315  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 227113us
I20260709 12:59:08.351424  1612 leader_election.cc:400] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:59:08.351742  1612 leader_election.cc:403] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:08.352633  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:08.353873  3919 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:59:08.314675  3905 consensus_queue.cc:1059] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:59:08.356376  1564 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:08.347546  3903 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:08.348160  3891 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:08.380324  3891 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.380949  3891 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:08.374405  3948 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:08.382421  3922 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.384096  3905 consensus_queue.cc:1243] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer 338d817f94ee4c1bad162e9a5860b68a log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:59:08.384996  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.372529  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:08.374853  1571 raft_consensus.cc:1275] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:08.346172  3895 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.393841  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:08.398511  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:08.399595  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 73740.6us
I20260709 12:59:08.371932  3903 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.404410  1572 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:08.396953  3895 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:08.398423  3940 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:08.398942  3942 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:08.419762  3898 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:59:08.396338  3817 consensus_queue.cc:1059] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:59:08.412619  3903 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:08.429111  1536 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:08.417562  3949 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:08.433529  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 81033.8us
I20260709 12:59:08.434600  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:08.417562  3940 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:08.363629  3950 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:08.422039  3818 raft_consensus.cc:3055] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:08.439249  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:08.444945  3902 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:08.445524  3856 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.446120  3856 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.440487  3942 raft_consensus.cc:2764] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:08.442123  3818 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:08.447574  3919 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:08.441356  3940 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:08.456519  1715 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:59:08.458235  3758 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:08.461833  1612 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:08.453334  1567 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:08.464751  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:08.480399  1715 pending_rounds.cc:85] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 6
I20260709 12:59:08.487620  1715 pending_rounds.cc:107] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:59:08.488045  1715 raft_consensus.cc:2889] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:08.491700  1536 leader_election.cc:336] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.223s (SENT)
I20260709 12:59:08.478878  3902 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:08.490437  3915 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.503862  1718 raft_consensus.cc:3055] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:08.506068  1718 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:08.506978  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 45246.5us
I20260709 12:59:08.508106  1612 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:08.493887  3881 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:08.510461  1718 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.497314  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:08.497071  3950 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:08.515754  1718 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.512713  3915 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.547417  3762 consensus_queue.cc:1059] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:08.547708  1612 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:08.548789  3762 consensus_queue.cc:1243] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 338d817f94ee4c1bad162e9a5860b68a log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:08.549371  3897 raft_consensus.cc:3055] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:08.549722  3897 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:08.513576  3919 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:08.500098  3851 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:59:08.525417  3881 raft_consensus.cc:697] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:08.550432  3899 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:08.550693  3897 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.551829  3881 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.552639  3897 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:08.554088  3818 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.555536  3818 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:08.558944  3856 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:08.549829  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:08.560000  3915 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:08.560623  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:08.561595  3950 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:59:08.570993  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 80908.2us
I20260709 12:59:08.595733  1718 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:59:08.596220  1718 pending_rounds.cc:85] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 4
I20260709 12:59:08.596448  1718 pending_rounds.cc:107] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:59:08.596673  1718 raft_consensus.cc:2889] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:08.599751  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.600294  1612 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:08.593443  3899 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:08.609771  3856 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:08.610524  3359 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:08.617945  3969 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:08.619001  3359 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.620486  3903 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.621358  3359 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:08.611912  3892 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.612576  3888 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:08.614339  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 43501.4us
I20260709 12:59:08.623373  3888 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.623508  3895 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.624743  1686 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:08.625583  3895 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:08.626138  3950 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:08.625965  3918 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:08.627700  3940 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.628984  3918 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:08.629703  3918 raft_consensus.cc:697] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:08.631130  3891 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.631022  3918 consensus_queue.cc:237] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.633497  3891 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:08.606772  3905 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 12:59:08.617005  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.638797  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:08.639569  1565 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
W20260709 12:59:08.653023  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:08.653909  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 46400.3us
I20260709 12:59:08.655233  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:08.656002  1568 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:08.656750  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:08.660768  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 60574.7us
I20260709 12:59:08.657927  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:08.663642  1566 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:08.665324  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:08.669143  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.670380  1644 raft_consensus.cc:2410] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:08.625614  3888 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:08.635666  3940 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:08.676466  1686 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:08.692876  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:08.692878  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.692026  1568 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:08.702030  1642 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:59:08.703068  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:08.706459  3903 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:08.702715  3892 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:08.707634  3892 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.707995  3892 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.684643  3922 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.711031  3922 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.711489  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:08.712206  1643 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:08.713474  3922 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:08.714419  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:08.714843  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.715262  1642 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:08.715942  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.716077  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:08.716553  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:08.714469  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.710408  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.720302  1640 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:08.721446  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.722182  1647 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:59:08.724270  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:08.724982  2440 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:08.675382  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:08.740206  1566 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:08.719455  1641 raft_consensus.cc:2376] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7. Re-sending same reply.
I20260709 12:59:08.747013  1646 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:08.748056  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:08.750916  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.750247  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:08.755438  1639 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:59:08.755852  1639 pending_rounds.cc:85] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 5
I20260709 12:59:08.756055  1639 pending_rounds.cc:107] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:59:08.756263  1639 raft_consensus.cc:2889] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:08.764463  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:08.787405  3970 log.cc:927] Time spent T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:59:08.791262  1715 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:08.792196  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:08.794011  1536 leader_election.cc:336] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.091s (SENT)
I20260709 12:59:08.794348  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:08.800294  1536 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:08.801812  1647 raft_consensus.cc:3055] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:08.802235  1647 raft_consensus.cc:740] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:08.802251  1714 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:08.752415  3851 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.803311  1718 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 2.
W20260709 12:59:08.810214  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.803169  1647 consensus_queue.cc:260] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.758195  3922 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:08.832626  3922 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:08.834139  3954 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.404s	user 0.006s	sys 0.000s
I20260709 12:59:08.749419  2443 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:59:08.836781  1643 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:59:08.764317  3915 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:08.840067  3915 raft_consensus.cc:697] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:08.841192  3915 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.841650  1565 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:08.843164  1647 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:08.843489  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.844435  1642 raft_consensus.cc:2410] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:08.845189  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.845911  1642 raft_consensus.cc:2393] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:08.863873  2436 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:08.864657  3965 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.865273  3965 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.867671  3965 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:08.869943  1717 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
W20260709 12:59:08.830838  3932 log.cc:927] Time spent T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:59:08.831670  1715 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:59:08.863956  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.831290  3851 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.842101  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.842831  1641 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:08.874908  1642 raft_consensus.cc:2410] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:08.833606  3922 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.827076  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:08.878311  1638 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:08.823951  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.847182  3818 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:08.855937  3892 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.859292  1686 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:08.883358  1640 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:59:08.859612  3912 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.862202  3958 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.897516  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:08.872381  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 58633.6us
I20260709 12:59:08.876283  1639 raft_consensus.cc:3055] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:08.877588  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.827780  1644 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:59:08.904122  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:08.879313  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.884317  1567 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:08.886422  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:08.889680  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.905956  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:08.906474  1642 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:08.906754  1639 raft_consensus.cc:740] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:08.906867  1565 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:08.908355  1641 raft_consensus.cc:2410] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:08.911759  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.912678  1644 raft_consensus.cc:2393] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:08.914559  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.915685  1642 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:08.904884  1638 raft_consensus.cc:2376] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5. Re-sending same reply.
I20260709 12:59:08.919826  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.895185  3965 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:08.928594  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.921046  1647 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:08.908787  3817 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:59:08.929266  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.930124  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:08.895421  3758 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:08.924511  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:08.930428  1644 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:08.925984  3851 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:08.954883  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.931107  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.955350  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.931434  1566 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:08.954097  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:08.955955  1642 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:08.956957  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.957732  1642 raft_consensus.cc:2393] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:08.956161  1643 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:08.959829  1641 raft_consensus.cc:2393] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:08.916221  3937 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.961158  1721 raft_consensus.cc:2410] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:08.961254  1638 raft_consensus.cc:2393] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 6: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:08.964035  1640 raft_consensus.cc:2368] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:59:08.907699  3958 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:08.964668  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.965355  1642 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:08.907970  3912 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:08.966363  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.966701  3958 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:08.967243  1642 raft_consensus.cc:2410] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:08.967344  3964 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:08.968115  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:08.968533  3912 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:08.968861  1642 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:08.925824  3930 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:59:08.963653  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.970468  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.970822  1638 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:08.963280  2406 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:08.971359  1647 raft_consensus.cc:2410] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:08.969760  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.918543  3969 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:08.973306  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.971899  1642 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:08.972442  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.913877  3899 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:59:09.006299  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.960216  1639 consensus_queue.cc:260] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:09.008023  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.008746  1641 raft_consensus.cc:2410] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:59:08.927572  3965 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:09.011386  1638 raft_consensus.cc:2410] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:09.013141  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.014371  1643 raft_consensus.cc:2410] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:08.928128  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:09.004669  1565 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:09.024948  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:09.039611  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:09.044199  1563 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:09.040455  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.974651  3969 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.051695  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.052707  1638 raft_consensus.cc:2410] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:09.044143  1721 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:59:09.045593  1647 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.054783  2405 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:09.054373  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.054947  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:09.055948  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:08.974987  3936 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:59:09.056888  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.057770  1643 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
I20260709 12:59:09.060046  1639 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.911211  3942 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 12:59:09.006223  3950 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.006969  3958 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:09.017860  3965 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.006194  3964 raft_consensus.cc:697] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:09.055691  1642 raft_consensus.cc:2376] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4. Re-sending same reply.
I20260709 12:59:09.056200  1641 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:08.974772  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:08.960210  2440 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:09.045953  3888 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.970196  3937 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:09.055496  3969 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.083339  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.081122  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.086006  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.087857  1647 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:09.067209  3818 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:09.088986  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.087217  1641 raft_consensus.cc:2410] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:09.072854  1640 raft_consensus.cc:2410] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:09.067447  3958 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.090456  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.094775  1638 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:59:09.101336  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.097361  1644 raft_consensus.cc:2410] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:09.109395  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.112309  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.110531  1641 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:09.092962  3818 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.121981  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.070454  3950 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:09.095275  3958 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:09.083910  3888 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:09.142807  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.132004  3818 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:09.135514  3899 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.156445  1642 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.157091  1641 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.160384  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.161671  1647 raft_consensus.cc:2410] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:09.169394  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.171115  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.171800  1643 raft_consensus.cc:2376] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5. Re-sending same reply.
I20260709 12:59:09.172362  1638 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:09.170151  1640 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:09.175377  1644 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:59:09.166971  3982 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.249s	user 0.001s	sys 0.001s
I20260709 12:59:09.178436  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.178685  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.179158  1643 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:59:09.176259  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.179806  1647 raft_consensus.cc:2410] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:09.181095  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.186375  1638 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:59:09.187029  1638 pending_rounds.cc:85] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 5
I20260709 12:59:09.187325  1638 pending_rounds.cc:107] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:59:09.187619  1638 raft_consensus.cc:2889] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:09.191713  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.192800  1643 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.191715  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.194773  1640 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.200901  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.201304  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.201741  1643 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:09.202116  1640 raft_consensus.cc:2393] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 6: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.138352  3964 consensus_queue.cc:237] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:09.168095  3899 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:09.216713  3994 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.222265  3937 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:09.226719  3985 log.cc:927] Time spent T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:59:09.239514  3950 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:09.240202  3950 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.240639  3950 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:09.243119  1572 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:09.246186  2440 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:09.249156  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:09.249876  1569 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:59:09.256814  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:09.257799  1563 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:59:09.217444  3994 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:09.263523  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:09.258360  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.271983  1640 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.264308  1716 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:59:09.274298  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.282795  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:09.283365  1611 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:09.281356  1642 raft_consensus.cc:2410] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:09.286796  1567 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.296068  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.298082  1640 raft_consensus.cc:2393] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 12:59:09.302577  3980 log.cc:927] Time spent T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:59:09.307564  3994 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:09.308175  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.309131  1642 raft_consensus.cc:2393] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.319303  3899 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:09.320240  3899 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:09.320649  3899 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.320698  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.321835  1647 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:09.321727  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.322727  1643 raft_consensus.cc:2410] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:09.323038  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.323231  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.321103  3899 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:09.323539  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.323822  1638 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:09.324167  1643 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:09.325042  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.322515  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.326942  1646 raft_consensus.cc:2410] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:59:09.327642  3950 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:09.327911  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.328540  1647 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:09.328557  1646 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:09.334175  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:09.341462  1638 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:09.337387  1567 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:09.352124  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.353446  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.355283  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:09.305912  3986 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:59:09.358342  1647 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:09.283094  3905 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:59:09.370378  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.317664  3965 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:09.372864  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.372779  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:09.410775  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.411795  1640 raft_consensus.cc:2410] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:59:09.353627  1646 raft_consensus.cc:2410] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:09.414582  1642 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.371233  3958 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:09.430429  2443 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 7: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:09.432279  3892 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:09.432909  3969 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:09.435467  3969 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:09.441391  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 159234us
I20260709 12:59:09.381247  3905 consensus_queue.cc:1243] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer 6f381117554e49bb816791ab0a10f2b8 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:09.445405  1646 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:59:09.445806  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 110687us
W20260709 12:59:09.443746  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.447419  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:09.451767  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:09.452741  1714 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.437930  3888 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:09.455989  3914 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:09.465515  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.469674  1639 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:09.469985  1646 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:09.467386  3914 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.472409  3914 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:09.482481  1537 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:09.484604  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:09.494592  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:09.496161  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:09.497413  3930 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:09.488380  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.498900  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.499336  1642 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.499387  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.500267  1639 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.500828  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.501729  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.500077  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.502372  1638 raft_consensus.cc:2393] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.502545  1640 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.502978  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.503531  1638 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:09.476087  4001 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:09.506129  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.504127  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.498026  3930 raft_consensus.cc:697] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:09.507498  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.508502  1714 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:59:09.511857  1686 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:09.514711  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.515702  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.518550  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:09.540778  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:09.600468  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 142735us
I20260709 12:59:09.589505  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.506659  4001 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.604514  1646 raft_consensus.cc:2393] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 6: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.604815  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:09.587554  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 74491.8us
W20260709 12:59:09.603157  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 78398.5us
I20260709 12:59:09.607154  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:09.609406  1639 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:09.611105  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.612372  1647 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:09.613346  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.615818  1638 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:09.557085  3992 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:09.616806  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.571188  3958 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:09.617264  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:09.574949  3899 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:09.629426  1643 raft_consensus.cc:2368] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:59:09.531158  3965 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:09.573699  3818 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:09.632287  3818 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:09.632539  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.619429  3856 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:09.570641  3930 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:09.530589  4004 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 12:59:09.607055  4001 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:09.614804  3892 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:09.618019  1638 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.650393  3892 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.650935  3892 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:09.651173  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.651888  1638 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.617547  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.637367  1642 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:09.638569  1640 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:59:09.617372  3992 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.637949  1686 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:09.646605  3914 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:09.647904  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:09.649374  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:09.649456  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.690557  1646 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:09.656064  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.656005  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.641280  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:09.691912  1640 raft_consensus.cc:2393] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 3: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.692468  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.692816  1647 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:09.656993  1639 raft_consensus.cc:2393] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 6: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.694070  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:09.694684  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:09.695343  1715 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:09.696116  1721 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:09.697002  3984 log.cc:927] Time spent T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.509s	user 0.001s	sys 0.004s
I20260709 12:59:09.698244  3994 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:09.699170  3994 consensus_queue.cc:1243] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:59:09.699682  3994 raft_consensus.cc:3055] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:09.700014  3994 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:09.661213  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.662231  3899 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:09.701489  3994 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:09.702687  1641 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:09.703346  3994 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:09.704658  1536 leader_election.cc:336] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.240s (SENT)
I20260709 12:59:09.705189  1536 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:09.705904  3899 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.706226  2406 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:09.706514  3899 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:09.707798  4008 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:09.708086  3892 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:09.709041  3899 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:09.662539  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:09.663163  1638 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:09.676357  2405 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:09.682421  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 44566.9us
I20260709 12:59:09.720511  1715 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
W20260709 12:59:09.723270  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 47059.7us
I20260709 12:59:09.686247  4004 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:09.688421  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:09.726661  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:09.728551  1569 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:59:09.729624  1568 raft_consensus.cc:1275] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:09.729842  2448 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:09.711372  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.732641  1642 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:09.750964  1638 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:09.752646  1638 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:09.759895  1718 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 12:59:09.763207  1612 connection.cc:256] RPC call timeout handler was delayed by -2.3356396269999777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
I20260709 12:59:09.755290  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 12:59:09.763979  1612 connection.cc:256] RPC call timeout handler was delayed by -2.3095396269999355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 12:59:09.764963  1642 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:09.682829  3992 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:09.771109  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 50976.2us
W20260709 12:59:09.772506  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 67889.2us
I20260709 12:59:09.773025  1564 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:59:09.773202  1536 leader_election.cc:336] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.616s (SENT)
W20260709 12:59:09.765457  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1755396269999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2872s for a response
I20260709 12:59:09.778007  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:09.654698  3856 raft_consensus.cc:697] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:09.404191   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:09.720826  3948 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:09.787832  1612 leader_election.cc:400] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:59:09.800812  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:09.691833  3818 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:59:09.812352  3973 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:09.772429  2440 raft_consensus.cc:2368] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:59:09.772442  3995 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.764889  3899 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:09.825603  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 99742.3us
I20260709 12:59:09.826628  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:09.827170  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.827322  1612 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:09.769117  4004 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:09.825940  3973 consensus_queue.cc:1243] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer a4be9cc90aca4dd4ad7db103062a7208 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:09.839839  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:09.844055  1685 leader_election.cc:336] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.648s (SENT)
I20260709 12:59:09.844754  1685 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:09.814404  3942 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:09.845168  4008 raft_consensus.cc:697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:09.857144  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:09.858294  1565 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:09.826637  4007 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:09.787362  3881 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:59:09.831619  3949 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:09.873890  3949 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:09.878908  3949 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:09.883757  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 83018.5us
W20260709 12:59:09.892690  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 63317.2us
I20260709 12:59:09.853225  3900 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:09.841696  3899 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:09.915037  3958 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:59:09.918128  3940 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:09.918874  3998 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:09.912232  3818 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:59:09.909454  3999 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:09.909726  3906 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:59:09.930367  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:09.931382  1639 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:59:09.933296  1639 pending_rounds.cc:85] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 1
I20260709 12:59:09.933676  1639 pending_rounds.cc:107] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:59:09.895943  3900 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.840704  3995 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:09.933984  1639 raft_consensus.cc:2889] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:09.917891  1536 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:09.953821  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:09.953967  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 48882us
I20260709 12:59:09.943756  3900 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.965978  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:09.912288  3993 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:59:09.983520  3922 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:09.986479  3948 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:09.987113  3948 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:09.987510  3948 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:09.988864  1565 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:09.982583  3992 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:09.891268  3856 consensus_queue.cc:237] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:09.999127  2405 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:10.004056  2448 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:59:10.008565  1686 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:10.012213  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 46356us
I20260709 12:59:10.013432  1536 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:09.968542  4017 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:10.034750  4011 log.cc:927] Time spent T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:59:10.050747  3914 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:10.096063  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.004423  3964 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:10.010149  3968 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:10.015004  3958 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:10.022159  2444 pending_rounds.cc:85] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 5
I20260709 12:59:10.217011  2444 pending_rounds.cc:107] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:59:09.915374  4004 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:10.212476  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 199135us
I20260709 12:59:10.220291  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:10.213850  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 195553us
W20260709 12:59:10.215428  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 405046us
I20260709 12:59:10.217334  2444 raft_consensus.cc:2889] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:10.228041  1612 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:10.211650  3758 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:09.901546  4008 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:10.223503  3998 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.257197  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:10.258229  1643 raft_consensus.cc:2410] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:10.251647  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:10.253340  3940 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:10.253993  3758 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:10.268671  1612 leader_election.cc:400] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:59:10.596038  3940 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:10.240556  3994 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:10.242904  3968 raft_consensus.cc:697] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:10.236712  3958 raft_consensus.cc:697] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:10.300020  3998 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:10.592092  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 371879us
I20260709 12:59:10.623651  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:10.591485  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:10.601301  1612 leader_election.cc:403] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:10.606613  1641 raft_consensus.cc:1275] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:59:10.625801  1641 pending_rounds.cc:85] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 2
I20260709 12:59:10.626116  1641 pending_rounds.cc:107] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:59:10.626384  1641 raft_consensus.cc:2889] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:10.614382  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.624763  1645 raft_consensus.cc:2376] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5. Re-sending same reply.
I20260709 12:59:10.638466  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1547) took 1014 ms. Trace:
I20260709 12:59:10.638949  1645 rpcz_store.cc:276] 0709 12:59:09.624056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.694110 (+ 70054us) service_pool.cc:224] Handling call
0709 12:59:10.319259 (+625149us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b5800002d98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:10.638381 (+319122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39782272}
W20260709 12:59:10.623507  4026 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.406s	user 0.000s	sys 0.011s
I20260709 12:59:10.646317  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1514) took 1115 ms. Trace:
I20260709 12:59:10.647814  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:10.646842  1641 rpcz_store.cc:276] 0709 12:59:09.530651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.703366 (+172715us) service_pool.cc:224] Handling call
0709 12:59:10.338800 (+635434us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b5800002d98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:59:10.592197 (+253397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:10.645956 (+ 53759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.646231 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18225920}
I20260709 12:59:10.627122  3905 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.609302  4019 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:10.634994  3999 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.597420  3758 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:10.647146  3994 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.670957  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:10.680949  1646 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:59:10.673593  1641 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:10.678303  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:10.683874  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:10.681742  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1555) took 1054 ms. Trace:
I20260709 12:59:10.686223  1646 rpcz_store.cc:276] 0709 12:59:09.627273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.693612 (+ 66339us) service_pool.cc:224] Handling call
0709 12:59:10.670750 (+977138us) spinlock_profiling.cc:243] Waited 9.9 ms on lock 0x7b5800002d98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:10.681648 (+ 10898us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22763392}
I20260709 12:59:10.656998  3899 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:10.634033  3940 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:10.688078  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1526) took 1113 ms. Trace:
I20260709 12:59:10.691835  1641 rpcz_store.cc:276] 0709 12:59:09.575105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.656382 (+1081277us) service_pool.cc:224] Handling call
0709 12:59:10.666115 (+  9733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:10.682412 (+ 16297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.687992 (+  5580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:10.693917  1641 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:10.695509  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1528) took 1119 ms. Trace:
I20260709 12:59:10.696100  1641 rpcz_store.cc:276] 0709 12:59:09.575664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.693057 (+1117393us) service_pool.cc:224] Handling call
0709 12:59:10.693649 (+   592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:10.695164 (+  1515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.695434 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:10.697844  1641 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:10.680696  3995 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:10.713726  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1529) took 1129 ms. Trace:
I20260709 12:59:10.714644  1641 rpcz_store.cc:276] 0709 12:59:09.575929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.697202 (+1121273us) service_pool.cc:224] Handling call
0709 12:59:10.697610 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:10.705202 (+  7592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.705502 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:10.663453  3905 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:10.739403  4021 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.404s	user 0.006s	sys 0.002s
W20260709 12:59:10.739825  4022 log.cc:927] Time spent T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.410s	user 0.004s	sys 0.004s
I20260709 12:59:10.708181  3968 consensus_queue.cc:237] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:10.789144  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1521) took 1254 ms. Trace:
I20260709 12:59:10.789780  1642 rpcz_store.cc:276] 0709 12:59:09.534583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.770275 (+235692us) service_pool.cc:224] Handling call
0709 12:59:09.770716 (+   441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:09.824161 (+ 53445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:09.824212 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:09.832952 (+  8740us) log.cc:844] Serialized 52 byte log entry
0709 12:59:10.216887 (+383935us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:10.389224 (+172337us) log.cc:844] Serialized 14 byte log entry
0709 12:59:10.788303 (+399079us) log.cc:844] Serialized 14 byte log entry
0709 12:59:10.788623 (+   320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.788767 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:10.788834 (+    67us) raft_consensus.cc:1685] finished
0709 12:59:10.788854 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:10.789054 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9543,"prepare.queue_time_us":425979,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":109115,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":17548,"thread_start_us":689956,"threads_started":3,"wal-append.queue_time_us":831562}
I20260709 12:59:10.739993  3940 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:10.705147  4035 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:10.709364  3992 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:10.741285  4030 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:10.742383  4029 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:10.739138  3900 consensus_meta.cc:287] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.737s	user 0.015s	sys 0.003s
I20260709 12:59:10.717142  3995 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:59:10.744515  4018 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:10.762648  3949 consensus_meta.cc:287] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.883s	user 0.005s	sys 0.021s
I20260709 12:59:10.672731  3999 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:10.693863  3958 consensus_queue.cc:237] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:10.739173  4024 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:10.767854  3948 consensus_meta.cc:287] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.780s	user 0.017s	sys 0.020s
I20260709 12:59:10.688712  3994 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:10.771047  3905 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:10.747979  3899 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.772352  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:10.845593  1640 raft_consensus.cc:2410] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:10.772450  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:10.779807  3758 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:10.782487  3964 consensus_meta.cc:287] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.004s
I20260709 12:59:10.705914  3930 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.784684  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1520) took 1250 ms. Trace:
I20260709 12:59:10.853255  1638 rpcz_store.cc:276] 0709 12:59:09.534324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.753485 (+219161us) service_pool.cc:224] Handling call
0709 12:59:09.753829 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:09.762963 (+  9134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:09.762998 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:09.775209 (+ 12211us) log.cc:844] Serialized 52 byte log entry
0709 12:59:09.996662 (+221453us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:10.009862 (+ 13200us) log.cc:844] Serialized 14 byte log entry
0709 12:59:10.010286 (+   424us) log.cc:844] Serialized 14 byte log entry
0709 12:59:10.010427 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.010484 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:10.747530 (+737046us) raft_consensus.cc:1685] finished
0709 12:59:10.784397 (+ 36867us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:10.784604 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":368945,"prepare.queue_time_us":9812,"prepare.run_wall_time_us":173085,"raft.queue_time_us":8686,"raft.run_cpu_time_us":567,"raft.run_wall_time_us":37723,"spinlock_wait_cycles":6720896,"thread_start_us":153503,"threads_started":1,"wal-append.queue_time_us":422714}
I20260709 12:59:10.857376  1638 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
W20260709 12:59:10.794747  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 52400.3us
I20260709 12:59:10.831259  3900 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:10.860432  3900 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:10.805794  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 122010us
I20260709 12:59:10.861768  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:10.843250  4024 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:10.863273  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:10.864223  4030 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:10.864547  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:10.864648  4030 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:10.865356  4030 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:10.814205  4017 consensus_meta.cc:287] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.795s	user 0.015s	sys 0.003s
I20260709 12:59:10.866420  4017 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:10.798348  3998 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:10.845072  4001 consensus_meta.cc:287] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.167s	user 0.015s	sys 0.019s
I20260709 12:59:10.870831  4001 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:10.871057  3899 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:10.872283  1714 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 7: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:10.873306  4001 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:10.862267  3964 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:10.857942  1638 pending_rounds.cc:85] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 4
I20260709 12:59:10.874980  1536 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:10.875137  2447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 168) took 1110 ms. Trace:
I20260709 12:59:10.851989  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1550) took 1226 ms. Trace:
I20260709 12:59:10.876653  1640 rpcz_store.cc:276] 0709 12:59:09.625164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.695622 (+ 70458us) service_pool.cc:224] Handling call
0709 12:59:10.772130 (+1076508us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5800002d98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:10.851883 (+ 79753us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36461440}
I20260709 12:59:10.875933  2447 rpcz_store.cc:276] 0709 12:59:09.764415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.822837 (+ 58422us) service_pool.cc:224] Handling call
0709 12:59:10.772045 (+949208us) spinlock_profiling.cc:243] Waited 983 us on lock 0x7b5800122a98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:10.875065 (+103020us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2260224}
I20260709 12:59:10.883251  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54412 (request call id 204) took 1258 ms. Trace:
I20260709 12:59:10.883891  1714 rpcz_store.cc:276] 0709 12:59:09.616785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.616983 (+   198us) service_pool.cc:224] Handling call
0709 12:59:10.874023 (+1257040us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540025a3d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:10.875024 (+  1001us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2860243840}
I20260709 12:59:10.892475  1640 raft_consensus.cc:1240] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:10.893254  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1534) took 1315 ms. Trace:
I20260709 12:59:10.893591  1640 rpcz_store.cc:276] 0709 12:59:09.577379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.877534 (+1300155us) service_pool.cc:224] Handling call
0709 12:59:10.892294 (+ 14760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:10.892974 (+   680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.893191 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:10.873322  3899 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:10.875593  1638 pending_rounds.cc:107] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 12:59:10.901022  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2308) took 1132 ms. Trace:
I20260709 12:59:10.900126  1638 raft_consensus.cc:2917] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 12:59:10.901328  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:10.902004  1638 raft_consensus.cc:2889] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:10.882668  4029 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:10.838805  3949 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:10.895300  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 626776us
I20260709 12:59:10.879859  3940 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:10.903535  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1535) took 1325 ms. Trace:
I20260709 12:59:10.837374  4018 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:10.864660  4024 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:10.908193  1640 rpcz_store.cc:276] 0709 12:59:09.577639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.894575 (+1316936us) service_pool.cc:224] Handling call
0709 12:59:10.902846 (+  8271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:10.903081 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:10.903115 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:10.903175 (+    60us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:10.903226 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.903302 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:10.903460 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:10.932332  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:10.843990  3948 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:10.891750  3758 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:10.921977  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38580 (request call id 8) took 9242 ms. Trace:
W20260709 12:59:10.926865  1685 leader_election.cc:336] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.760s (SENT)
I20260709 12:59:10.933262  1640 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:59:10.936968  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:10.937721  1640 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:10.901736  1715 rpcz_store.cc:276] 0709 12:59:09.768718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.768881 (+   163us) service_pool.cc:224] Handling call
0709 12:59:09.817126 (+ 48245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:09.828136 (+ 11010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:09.828170 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:09.837547 (+  9377us) log.cc:844] Serialized 26 byte log entry
0709 12:59:09.936281 (+ 98734us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:09.955641 (+ 19360us) log.cc:844] Serialized 14 byte log entry
0709 12:59:09.955956 (+   315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:09.956070 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:10.900758 (+944688us) raft_consensus.cc:1685] finished
0709 12:59:10.900783 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:10.900952 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30949,"prepare.queue_time_us":20208,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":14760,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3966,"spinlock_wait_cycles":6122368,"thread_start_us":65005,"threads_started":1,"wal-append.queue_time_us":171076}
I20260709 12:59:10.935350  1570 raft_consensus.cc:1240] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:10.936136  1638 rpcz_store.cc:276] 0709 12:59:01.679519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:01.679683 (+   164us) service_pool.cc:224] Handling call
0709 12:59:02.502490 (+822807us) log.cc:844] Serialized 506 byte log entry
0709 12:59:03.132679 (+630189us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b4c00421c40. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cb564a20 00007f18cb575a29 00007f18cb57613f 00007f18cb53a2ab 00007f18cb567f3c 00007f18cb5683fe 00007f18cb7f550b 00007f18cd1f4381 00007f18cd1f226b 00007f18cd1f8d53 00007f18cd1f8cd9
0709 12:59:10.921803 (+7789124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11883,"raft.run_cpu_time_us":4353,"raft.run_wall_time_us":415626,"spinlock_wait_cycles":57843456,"thread_start_us":257347,"threads_started":2,"wal-append.queue_time_us":261623,"wal-append.run_cpu_time_us":10497,"wal-append.run_wall_time_us":1661224}
I20260709 12:59:10.939358  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:10.940382  1640 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:10.906358  4029 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:10.941401  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:10.951742  1640 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:10.955482  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1533) took 1378 ms. Trace:
W20260709 12:59:10.957607  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet 71dad2e408414d2fa4f055c6eccf5b92: Aborted: Op aborted by new leader
W20260709 12:59:10.958913  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 62553.3us
I20260709 12:59:10.933434  4040 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:10.969383  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:10.967677  1638 rpcz_store.cc:276] 0709 12:59:09.577099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.856290 (+1279191us) service_pool.cc:224] Handling call
0709 12:59:10.856799 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:10.955068 (+ 98269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.955394 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:10.970984  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:10.940006  3899 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.937367  3758 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:10.974603  1536 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:10.971670  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:10.981779  1685 leader_election.cc:336] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.798s (SENT)
W20260709 12:59:10.983991  1746 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:33273 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:33273 timed out after 15.000s (SENT)
I20260709 12:59:10.960553  4029 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:10.996428  1638 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.011845  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:11.025461  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 50999.2us
I20260709 12:59:11.026464  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:11.028137  4040 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:11.023399  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 164758us
I20260709 12:59:11.032249  4018 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:11.033833  3949 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:11.034794  3949 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:11.035112  4017 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:11.035178  3892 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:11.039826  2405 leader_election.cc:336] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.514s (SENT)
I20260709 12:59:11.044504  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1527) took 1469 ms. Trace:
I20260709 12:59:11.045785  1640 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:11.011245  1685 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:11.002609  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:11.051801  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:10.976562  3940 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:11.022961  3992 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.976157  3964 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:10.984965  3758 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:11.047019  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:11.080338  1640 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:59:11.081648  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:11.082686  1640 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:11.044991  1646 rpcz_store.cc:276] 0709 12:59:09.575411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.688822 (+1113411us) service_pool.cc:224] Handling call
0709 12:59:10.689293 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:10.689601 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:10.702867 (+ 13266us) log.cc:844] Serialized 14 byte log entry
0709 12:59:11.044139 (+341272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:11.044204 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:11.044251 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.044321 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:11.044441 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67086,"prepare.queue_time_us":27358,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":67,"thread_start_us":273739,"threads_started":1}
I20260709 12:59:11.085222  1646 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:11.086123  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1538) took 1487 ms. Trace:
I20260709 12:59:11.086603  1646 rpcz_store.cc:276] 0709 12:59:09.599228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.084548 (+1485320us) service_pool.cc:224] Handling call
0709 12:59:11.084954 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.085757 (+   803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.086013 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:11.087460  1638 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:59:11.088663  1646 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:11.089609  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1542) took 1483 ms. Trace:
I20260709 12:59:11.090799  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1536) took 1512 ms. Trace:
I20260709 12:59:11.089495  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1539) took 1490 ms. Trace:
I20260709 12:59:11.091609  1638 rpcz_store.cc:276] 0709 12:59:09.606173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.088517 (+1482344us) service_pool.cc:224] Handling call
0709 12:59:11.088898 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.089165 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:11.089208 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:11.089272 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:11.089326 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.089404 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:11.089539 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:11.091804  1640 rpcz_store.cc:276] 0709 12:59:09.577918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.083421 (+1505503us) service_pool.cc:224] Handling call
0709 12:59:11.090041 (+  6620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.090348 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:11.090391 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:11.090452 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:11.090502 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.090580 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:11.090724 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:11.093879  1638 raft_consensus.cc:3055] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:11.094421  1638 raft_consensus.cc:740] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:11.092520  1646 rpcz_store.cc:276] 0709 12:59:09.599552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.087983 (+1488431us) service_pool.cc:224] Handling call
0709 12:59:11.088420 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.089186 (+   766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.089438 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:11.096613  1640 raft_consensus.cc:1275] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:11.053558  3892 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:11.097626  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1546) took 1474 ms. Trace:
I20260709 12:59:11.098737  1640 rpcz_store.cc:276] 0709 12:59:09.623741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.094281 (+1470540us) service_pool.cc:224] Handling call
0709 12:59:11.094662 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.097224 (+  2562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.097543 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:11.107481  1646 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:11.108247  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1553) took 1481 ms. Trace:
I20260709 12:59:11.108932  1646 rpcz_store.cc:276] 0709 12:59:09.626408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.095815 (+1469407us) service_pool.cc:224] Handling call
0709 12:59:11.096199 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.107925 (+ 11726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.108171 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:11.110390  1640 raft_consensus.cc:1275] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:11.095572  1638 consensus_queue.cc:260] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:11.112130  1638 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:11.112802  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1556) took 1485 ms. Trace:
I20260709 12:59:11.114032  1640 rpcz_store.cc:276] 0709 12:59:09.627630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.108145 (+1480515us) service_pool.cc:224] Handling call
0709 12:59:11.109301 (+  1156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.111653 (+  2352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.112709 (+  1056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:10.990017  3899 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:11.129709  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 102028us
I20260709 12:59:11.133775  1638 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:59:11.134284  1638 pending_rounds.cc:85] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 2
I20260709 12:59:11.134533  1638 pending_rounds.cc:107] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:59:11.134420  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:11.134865  1638 raft_consensus.cc:2889] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:11.060868  3940 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:11.135902  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1545) took 1517 ms. Trace:
I20260709 12:59:11.138127  1638 rpcz_store.cc:276] 0709 12:59:09.618865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.093265 (+1474400us) service_pool.cc:224] Handling call
0709 12:59:11.093706 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.135607 (+ 41901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.135839 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:11.106890  3892 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:11.137734  3940 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:11.140362  3892 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:11.141542  1536 leader_election.cc:400] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:59:11.141922  1536 leader_election.cc:403] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:11.107102  3902 consensus_queue.cc:1059] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:59:11.143955  1638 pending_rounds.cc:85] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 5
I20260709 12:59:11.144629  1638 pending_rounds.cc:107] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:59:11.144953  1638 raft_consensus.cc:2889] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:11.149425  4044 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:59:11.076963  3900 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:59:11.153913  3948 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:11.156833  3948 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:59:11.074213  3912 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 12:59:11.075232  3965 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 12:59:11.165200  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1530) took 1589 ms. Trace:
W20260709 12:59:11.123566  4037 log.cc:927] Time spent T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 12:59:11.165781  1641 rpcz_store.cc:276] 0709 12:59:09.576242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.715796 (+1139554us) service_pool.cc:224] Handling call
0709 12:59:10.744104 (+ 28308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:10.744617 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:10.744662 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:10.745372 (+   710us) log.cc:844] Serialized 26 byte log entry
0709 12:59:10.961696 (+216324us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:10.973022 (+ 11326us) log.cc:844] Serialized 14 byte log entry
0709 12:59:10.990487 (+ 17465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.990580 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:11.164922 (+174342us) raft_consensus.cc:1685] finished
0709 12:59:11.164947 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:11.165123 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17071,"prepare.queue_time_us":11042,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":115754,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":4129,"spinlock_wait_cycles":12310272,"thread_start_us":215770,"threads_started":1,"wal-append.queue_time_us":351825}
I20260709 12:59:11.167490  2444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 431) took 1400 ms. Trace:
I20260709 12:59:11.168924  3899 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:11.167922  2444 rpcz_store.cc:276] 0709 12:59:09.767013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.842023 (+ 75010us) service_pool.cc:224] Handling call
0709 12:59:09.893281 (+ 51258us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:59:10.247914 (+354633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:10.247946 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:59:10.299293 (+ 51347us) log.cc:844] Serialized 78 byte log entry
0709 12:59:10.743758 (+444465us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:10.743818 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.743930 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:11.167199 (+423269us) raft_consensus.cc:1685] finished
0709 12:59:11.167221 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:11.167421 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1500,"raft.queue_time_us":99,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":12383,"thread_start_us":103541,"threads_started":1,"wal-append.queue_time_us":241540}
I20260709 12:59:11.079499  3992 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:11.097627  3994 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:11.177794  1714 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:11.180612  3999 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:11.181895  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:11.182687  2444 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:11.182690  1646 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:59:11.184022  1646 pending_rounds.cc:85] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 2
I20260709 12:59:11.184260  1646 pending_rounds.cc:107] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:59:11.184489  1646 raft_consensus.cc:2889] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:11.184816  1646 pending_rounds.cc:107] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:59:11.185101  1646 raft_consensus.cc:2889] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:11.184607  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:11.186683  3900 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:11.187117  3900 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.187443  3900 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:11.143839  3902 raft_consensus.cc:3055] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:11.190380  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 98984.1us
I20260709 12:59:11.074476  3905 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.115s
I20260709 12:59:11.139711  3949 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:11.078452  3922 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 12:59:11.189384  3856 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:11.194357  3902 raft_consensus.cc:740] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:11.220058  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 78656.7us
I20260709 12:59:11.224098  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:11.224436  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:11.225031  1568 raft_consensus.cc:2368] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:59:11.229566  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:11.230014  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:11.230645  1568 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:11.231035  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:11.232074  1572 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:11.237520  1566 raft_consensus.cc:2410] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:11.244964  1647 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:11.248368  1571 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:59:11.244791  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:11.252115  1568 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:11.252763  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:11.253163  1568 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:11.253844  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.212131  3949 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:11.245338  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:11.257450  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:11.258282  1564 raft_consensus.cc:2410] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:59:11.258934  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1516) took 1717 ms. Trace:
I20260709 12:59:11.259267  1647 rpcz_store.cc:276] 0709 12:59:09.533248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.710547 (+177299us) service_pool.cc:224] Handling call
0709 12:59:11.242843 (+1532296us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b5800002d98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:59:11.244547 (+  1704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.250273 (+  5726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.250538 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126982016}
I20260709 12:59:11.236671  4040 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:11.263186  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:11.264103  1572 raft_consensus.cc:2410] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:11.264222  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:11.263240  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:11.210239  4004 consensus_queue.cc:1059] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:59:11.265497  1566 raft_consensus.cc:2410] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:11.266907  1569 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:11.239183  3930 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:11.272626  3992 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:11.273227  3902 consensus_queue.cc:260] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:11.293045  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:11.228806  3948 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:59:11.226532  3856 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:11.296377  3856 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:11.296748  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:11.276139  3817 raft_consensus.cc:3055] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:11.278518  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1532) took 1701 ms. Trace:
I20260709 12:59:11.282380  4030 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:11.288264  1565 raft_consensus.cc:1240] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:11.257596  3949 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:11.321255  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.312608  1568 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:11.306281  1642 rpcz_store.cc:276] 0709 12:59:09.576830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.798608 (+1221778us) service_pool.cc:224] Handling call
0709 12:59:10.799145 (+   537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:10.800923 (+  1778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:10.800967 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:10.817279 (+ 16312us) log.cc:844] Serialized 26 byte log entry
0709 12:59:11.040335 (+223056us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:11.040376 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.040460 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:11.278167 (+237707us) raft_consensus.cc:1685] finished
0709 12:59:11.278203 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:11.278428 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":197627,"threads_started":1,"wal-append.queue_time_us":367658}
I20260709 12:59:11.324266  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:11.338765  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:11.354839  1572 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:11.307126  3817 raft_consensus.cc:740] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:11.365868  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 116673us
I20260709 12:59:11.328648  3930 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:11.363848  2440 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 7: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:11.385612  1568 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:59:11.386874  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:11.387512  1568 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.392616  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:11.394212  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:11.395198  1571 raft_consensus.cc:2410] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:11.391347  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:11.403409  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:11.377362  3942 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:11.379181  4060 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 12:59:11.405205  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 203030us
I20260709 12:59:11.410223  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:11.409411  3942 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:11.377684  3930 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:11.403712  3992 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:11.410892  1571 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:11.427204  4060 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:11.473130  3902 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.473658  4060 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:11.436537  4061 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:11.475311  3930 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:11.447484  2405 leader_election.cc:336] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.013s (SENT)
I20260709 12:59:11.475586  4061 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:11.414685  4066 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 12:59:11.424283  4062 log.cc:927] Time spent T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:59:11.477903  4061 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:11.478191  4027 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 1.256s	user 0.004s	sys 0.003s
I20260709 12:59:11.479504  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2309) took 1709 ms. Trace:
I20260709 12:59:11.480480  1571 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:11.479902  1721 rpcz_store.cc:276] 0709 12:59:09.770089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.770481 (+   392us) service_pool.cc:224] Handling call
0709 12:59:09.770759 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:09.784780 (+ 14021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:09.784822 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:09.785260 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 12:59:10.197415 (+412155us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:10.197467 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.197560 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:11.477438 (+1279878us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:11.479175 (+  1737us) raft_consensus.cc:1685] finished
0709 12:59:11.479199 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:11.479438 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18388,"raft.queue_time_us":22183,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":13322,"spinlock_wait_cycles":25216768,"thread_start_us":214408,"threads_started":1,"wal-append.queue_time_us":379074}
I20260709 12:59:11.482733  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:11.456928  4035 consensus_meta.cc:287] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.642s	user 0.016s	sys 0.000s
I20260709 12:59:11.485997  4035 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:11.487151  1466 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58260 (request call id 211) took 16365 ms (client timeout 15000 ms). Trace:
I20260709 12:59:11.430831  1470 catalog_manager.cc:5697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:11.509289  1470 catalog_manager.cc:5697] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:11.511173  1470 catalog_manager.cc:5697] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:11.442579  3940 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:11.415473  2440 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:11.437633  3758 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:11.442598  4028 log.cc:927] Time spent T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.772s	user 0.000s	sys 0.003s
I20260709 12:59:11.462137  3992 raft_consensus.cc:697] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:11.463724  2437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 166) took 1807 ms. Trace:
I20260709 12:59:11.466763  3900 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:11.468762  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:11.469105  4030 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:11.469456  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:11.433336  1568 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:11.438611  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:11.458863  3942 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:11.491608  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.525966  2437 rpcz_store.cc:276] 0709 12:59:09.656111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.662195 (+  6084us) service_pool.cc:224] Handling call
0709 12:59:11.463523 (+1801328us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54001586d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:11.463665 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3238374784}
I20260709 12:59:11.571983  3940 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:11.572139  3758 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:11.463248   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:11.574036  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1523) took 2038 ms. Trace:
I20260709 12:59:11.574510  1639 rpcz_store.cc:276] 0709 12:59:09.535123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.932497 (+397374us) service_pool.cc:224] Handling call
0709 12:59:09.932996 (+   499us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:10.000635 (+ 67639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:10.000718 (+    83us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:10.001220 (+   502us) log.cc:844] Serialized 52 byte log entry
0709 12:59:10.222391 (+221171us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:10.656784 (+434393us) log.cc:844] Serialized 14 byte log entry
0709 12:59:10.953618 (+296834us) log.cc:844] Serialized 14 byte log entry
0709 12:59:10.953985 (+   367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:10.954141 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:11.441931 (+487790us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:11.524129 (+ 82198us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b4800220158. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d21c1aa1 00007f18d21b8b37 00007f18d21b89ca 00007f18d22b026f 00007f18d22aff37 00007f18d22c455c 00007f18d22c4508 00007f18d22c4488 00007f18d22c4443 00007f18d22c36ec 00007f18d11eda96
0709 12:59:11.573798 (+ 49669us) raft_consensus.cc:1685] finished
0709 12:59:11.573830 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:11.573971 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18829,"prepare.queue_time_us":458718,"prepare.run_cpu_time_us":186,"prepare.run_wall_time_us":5844,"raft.queue_time_us":91623,"raft.run_cpu_time_us":5461,"raft.run_wall_time_us":793495,"spinlock_wait_cycles":80135424,"thread_start_us":726512,"threads_started":3,"wal-append.queue_time_us":612842}
W20260709 12:59:11.499763  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:11.576840  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 167009us
I20260709 12:59:11.578545  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:11.579407  1642 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:11.500160  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1525) took 1925 ms. Trace:
I20260709 12:59:11.500026  4029 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:11.505844  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1524) took 1963 ms. Trace:
I20260709 12:59:11.506820  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:11.444798  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:11.511639  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:11.512476  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:11.617259  4029 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:11.439370  3892 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:11.513767  1571 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:59:11.516345  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1560) took 1887 ms. Trace:
I20260709 12:59:11.516575  1470 catalog_manager.cc:5697] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 3 to 7, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:11.520484  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1522) took 1985 ms. Trace:
I20260709 12:59:11.489364  3817 consensus_queue.cc:260] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:11.524688  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:11.508427  1466 rpcz_store.cc:269] 0709 12:58:55.121911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.122174 (+   263us) service_pool.cc:224] Handling call
0709 12:59:11.487049 (+16364875us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:08.191828 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:08.207355 (+ 15527us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:08.207402 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:59:08.207425 (+    23us) tablet.cc:662] Decoding operations
0709 12:59:08.208341 (+   916us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:08.208411 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:08.208455 (+    44us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:59:08.209058 (+   603us) tablet.cc:701] Row locks acquired
0709 12:59:08.209080 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:59:08.209267 (+   187us) write_op.cc:270] Start()
0709 12:59:08.209405 (+   138us) write_op.cc:276] Timestamp: P: 1783601948209207 usec, L: 0
0709 12:59:08.209431 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:59:08.250761 (+ 41330us) log.cc:844] Serialized 2482 byte log entry
0709 12:59:08.618906 (+368145us) op_driver.cc:464] REPLICATION: finished
0709 12:59:08.854412 (+235506us) write_op.cc:301] APPLY: starting
0709 12:59:08.854512 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:08.854725 (+   213us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:08.854862 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:08.855745 (+   883us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:08.855993 (+   248us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:59:08.856046 (+    53us) write_op.cc:312] APPLY: finished
0709 12:59:08.856323 (+   277us) log.cc:844] Serialized 53 byte log entry
0709 12:59:08.856540 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:08.856696 (+   156us) write_op.cc:454] Released schema lock
0709 12:59:08.856746 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:08.857422 (+   676us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:08.857452 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":209305,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":235131,"apply.run_cpu_time_us":2744,"apply.run_wall_time_us":2745,"num_ops":6,"prepare.queue_time_us":177888,"prepare.run_cpu_time_us":4472,"prepare.run_wall_time_us":65303,"replication_time_us":389557,"thread_start_us":222030,"threads_started":2}]]}
I20260709 12:59:11.496946  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:11.582149  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:11.534157  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:11.599037  1643 rpcz_store.cc:276] 0709 12:59:09.542870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.299821 (+756951us) service_pool.cc:224] Handling call
0709 12:59:10.604816 (+304995us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:10.891059 (+286243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:10.891113 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:10.900590 (+  9477us) log.cc:844] Serialized 26 byte log entry
0709 12:59:11.056369 (+155779us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:11.111105 (+ 54736us) log.cc:844] Serialized 14 byte log entry
0709 12:59:11.505402 (+394297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.505508 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:11.505559 (+    51us) raft_consensus.cc:1685] finished
0709 12:59:11.505582 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:11.505766 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":393874,"prepare.queue_time_us":67501,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":490177,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":10320,"thread_start_us":402128,"threads_started":2,"wal-append.queue_time_us":222143}
I20260709 12:59:11.571026  3992 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:11.656515  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:12.045926  4048 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:12.047092  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 390705us
I20260709 12:59:11.650882  3999 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:11.638697  1714 raft_consensus.cc:2393] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:12.049249  1719 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:11.648346  1566 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 7: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 12:59:11.651044  4069 log.cc:927] Time spent T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:59:12.051152  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:11.618742  1646 rpcz_store.cc:276] 0709 12:59:09.629094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.110026 (+1480932us) service_pool.cc:224] Handling call
0709 12:59:11.110635 (+   609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:11.185584 (+ 74949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.516094 (+330510us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b5400219154. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:11.516277 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164752128}
I20260709 12:59:11.619912  1470 catalog_manager.cc:5697] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 3 to 5, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 5 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:11.580540  1645 rpcz_store.cc:276] 0709 12:59:09.574713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.653371 (+1078658us) service_pool.cc:224] Handling call
0709 12:59:10.653884 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:10.791780 (+137896us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:10.825576 (+ 33796us) log.cc:844] Serialized 14 byte log entry
0709 12:59:10.963062 (+137486us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:10.969038 (+  5976us) log.cc:844] Serialized 26 byte log entry
0709 12:59:10.969224 (+   186us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:11.011888 (+ 42664us) log.cc:844] Serialized 14 byte log entry
0709 12:59:11.499239 (+487351us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b1800221ec0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca125c0a 00007f18d3865219 00007f18d116c58f 00007f18ca1ab571 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd
0709 12:59:11.499667 (+   428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.499765 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:11.499901 (+   136us) raft_consensus.cc:1685] finished
0709 12:59:11.499919 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:11.500077 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":574902,"prepare.queue_time_us":52094,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":24420,"raft.queue_time_us":575013,"raft.run_cpu_time_us":635,"raft.run_wall_time_us":53313,"spinlock_wait_cycles":13153664,"thread_start_us":257027,"threads_started":2,"wal-append.queue_time_us":237481}
I20260709 12:59:12.054772  1639 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:12.054100  1470 catalog_manager.cc:5697] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:11.650570  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 212062us
I20260709 12:59:12.055787  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:12.056473  1639 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:59:12.055953  1470 catalog_manager.cc:5697] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 3 to 7, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:11.861306  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.048054  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:11.650674  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:12.048067  1644 rpcz_store.cc:276] 0709 12:59:09.534864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.815488 (+280624us) service_pool.cc:224] Handling call
0709 12:59:09.831783 (+ 16295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:09.832087 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:09.852263 (+ 20176us) log.cc:844] Serialized 14 byte log entry
0709 12:59:11.244174 (+1391911us) spinlock_profiling.cc:243] Waited 989 us on lock 0x7b18000a9de0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18cce404bc 00007f18ca18e48b 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1aac02 00007f18cce3220b 00007f18cce37d23 00007f18cce3823a
0709 12:59:11.513919 (+269745us) log.cc:844] Serialized 14 byte log entry
0709 12:59:11.519956 (+  6037us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:11.520040 (+    84us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:11.520116 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.520224 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:11.520396 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":467175,"prepare.queue_time_us":24616,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":93,"raft.queue_time_us":289889,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":7451,"spinlock_wait_cycles":4012160,"thread_start_us":39936,"threads_started":1,"wal-append.queue_time_us":151359}
I20260709 12:59:12.067023  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:11.618993  1685 leader_election.cc:336] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.510s (SENT)
W20260709 12:59:12.068537  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 449548us
I20260709 12:59:12.070168  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:12.071270  1639 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:12.074761  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:12.075596  1645 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:12.075790  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:12.076570  1568 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 7: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:12.078300  4045 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:12.078898  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:12.079106  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:12.079208  3940 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.079559  1572 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:12.079813  1569 raft_consensus.cc:2393] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:12.079890  3940 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.080909  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:12.081664  1569 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:12.082147  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1552) took 2297 ms. Trace:
I20260709 12:59:12.082300  4015 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.082527  1570 rpcz_store.cc:276] 0709 12:59:09.770833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.914228 (+143395us) service_pool.cc:224] Handling call
0709 12:59:09.948734 (+ 34506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:10.938464 (+989730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.067640 (+1129176us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b540031c9d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:12.067829 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2268372352}
I20260709 12:59:12.075052  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:12.084743  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:12.085019  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:11.963124  4071 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.445s	user 0.000s	sys 0.002s
I20260709 12:59:12.095126  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 171) took 1151 ms. Trace:
I20260709 12:59:12.095160  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:12.095376  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:12.092140  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.082877  4015 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:12.093039  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:12.096159  1717 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:59:12.058512  1470 catalog_manager.cc:5697] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:11.598551  3899 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.097446  1566 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:11.650837  3998 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.109236  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:12.050407  3758 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.110411  3758 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.098263  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:12.098448  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:12.112970  1566 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:12.091991  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0815890110000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 12:59:12.099790  1571 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:12.095700  1638 rpcz_store.cc:276] 0709 12:59:10.964350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.139860 (+175510us) service_pool.cc:224] Handling call
0709 12:59:11.143587 (+  3727us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:11.506039 (+362452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:11.506184 (+   145us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:11.514938 (+  8754us) log.cc:844] Serialized 52 byte log entry
0709 12:59:11.834606 (+319668us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:12.073474 (+238868us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.073961 (+   487us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.094794 (+ 20833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.094881 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:12.094925 (+    44us) raft_consensus.cc:1685] finished
0709 12:59:12.094937 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:12.095068 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":507126,"prepare.queue_time_us":244310,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"raft.queue_time_us":364988,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":5449,"thread_start_us":319201,"threads_started":1,"wal-append.queue_time_us":525429}
I20260709 12:59:12.102835  1563 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:12.102087  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:12.115701  1572 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:12.115794  1566 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:11.660269  3892 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:12.109475  3998 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.104708  1470 catalog_manager.cc:5697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 4 to 6, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 6 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:12.121342  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:12.121975  1644 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:12.122104  1470 catalog_manager.cc:5697] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 1 to 3, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:12.125458  1639 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:11.732808  3995 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.084482  1646 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:12.064460  4007 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.117496  3940 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:12.058102  4048 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.631884  3918 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:59:12.116688  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.119367  1572 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:59:12.105734  1565 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:12.040669  3900 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:12.041399  4030 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:59:12.120604  3817 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:12.102491  3915 consensus_queue.cc:1175] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "338d817f94ee4c1bad162e9a5860b68a" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:59:12.138835  3902 consensus_meta.cc:287] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.665s	user 0.014s	sys 0.000s
I20260709 12:59:12.139186  3918 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:12.127794  1571 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:11.610762  3949 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.132226  1612 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:12.135088  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:12.107672  4029 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.140422  4015 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:12.106999  4002 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.142416  1714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:12.155901  1714 raft_consensus.cc:606] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:12.156355  1714 raft_consensus.cc:614] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:12.135421  3758 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:12.147475  1643 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:12.148213  1612 leader_election.cc:400] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:59:12.161582  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:12.120097  3899 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.135986  4048 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:12.144320  3998 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:12.171531  1564 raft_consensus.cc:2393] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:12.132591  3995 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.132869  4007 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:12.175653  1567 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:12.182720  1642 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:12.158391  4029 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:12.158758  4002 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.188265  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:12.190418  3994 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.189759  1713 raft_consensus.cc:606] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:12.191172  1713 raft_consensus.cc:614] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:12.192577  1643 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:12.193550  1643 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:12.199878  1643 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:12.205979  3995 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:12.206254  4029 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:12.208105  3949 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:12.211593  1643 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:12.195201  3994 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.216694  1643 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:12.217191  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:12.299815  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 229091us
I20260709 12:59:12.301717  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:12.320166  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 172) took 1354 ms. Trace:
I20260709 12:59:12.326844  3915 consensus_queue.cc:1059] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:12.328722  4004 raft_consensus.cc:3055] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:12.329100  3902 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.320842  1641 rpcz_store.cc:276] 0709 12:59:10.965499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.167842 (+202343us) service_pool.cc:224] Handling call
0709 12:59:11.168254 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:11.599136 (+430882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:11.599170 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:11.637825 (+ 38655us) log.cc:844] Serialized 26 byte log entry
0709 12:59:12.154891 (+517066us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b180019cd20. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca18de07 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1aac02 00007f18cce3220b 00007f18cce37d23 00007f18cce380d1 00007f18cd253a0f
0709 12:59:12.313014 (+158123us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:12.313302 (+   288us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.313471 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.313545 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:12.319762 (+  6217us) raft_consensus.cc:1685] finished
0709 12:59:12.319889 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:12.320077 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":430412,"prepare.queue_time_us":576,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":431191,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":20378,"spinlock_wait_cycles":2848512,"thread_start_us":157936,"threads_started":1,"wal-append.queue_time_us":660290}
W20260709 12:59:12.339768  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 270630us
I20260709 12:59:12.344141  1645 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:12.349253  2406 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:12.347106  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:12.329159  4004 raft_consensus.cc:740] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:12.362185  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:12.362481  2405 leader_election.cc:336] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 3.094s (SENT)
I20260709 12:59:12.345775  3892 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:12.302567  3995 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.322710  4045 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:12.346066  3998 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:12.355576  3900 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:12.354506  3999 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:12.363802  3918 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:12.363977  4080 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:59:12.396616  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.354424  3902 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:12.418393  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:12.430230  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:12.423506  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 62776.3us
I20260709 12:59:12.431463  1715 raft_consensus.cc:2410] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:12.390794  4007 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:12.397783  3892 raft_consensus.cc:697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:12.383327  3895 consensus_queue.cc:1059] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:59:12.381847  3995 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.443526  1714 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:59:12.444128  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 68257.6us
I20260709 12:59:12.445297  2405 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:12.446612  4008 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:12.447137  4008 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:12.447602  4008 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:12.421561  4094 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.422269  3856 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:59:12.430675  4042 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:12.422609  4004 consensus_queue.cc:260] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.503564  4100 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:12.504971  4100 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.459337  3992 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:59:12.481228  3900 raft_consensus.cc:697] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:12.507503  4083 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.475669  4094 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:12.537515  4089 log.cc:927] Time spent T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:59:12.535025  4076 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:59:12.556236  4105 raft_consensus.cc:3055] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:12.544699  4091 log.cc:927] Time spent T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:59:12.557144  4083 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.508566  3999 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.562796  4103 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:59:12.559653  3856 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.564019  3902 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:12.563612  3900 consensus_queue.cc:237] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.556242  4100 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:59:12.576327  3817 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:12.577957  3992 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:12.532339  4086 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 12:59:12.586841  4097 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:59:12.587958  4077 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:59:12.588739  4085 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:59:12.594287  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 170) took 1653 ms. Trace:
I20260709 12:59:12.608246  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:12.609865  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 448310us
I20260709 12:59:12.565364  4105 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:12.620298  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:12.629925  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 195438us
I20260709 12:59:12.635293  1569 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:12.512789  3892 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:12.637487  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:12.612850  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:12.638439  1612 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:12.668805  1717 raft_consensus.cc:606] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:12.669401  1717 raft_consensus.cc:614] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:12.637107  1640 rpcz_store.cc:276] 0709 12:59:10.941052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.116240 (+175188us) service_pool.cc:224] Handling call
0709 12:59:11.116631 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:11.654514 (+537883us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:11.654562 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:12.053843 (+399281us) log.cc:844] Serialized 26 byte log entry
0709 12:59:12.342300 (+288457us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:12.342345 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.342426 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:12.593870 (+251444us) raft_consensus.cc:1685] finished
0709 12:59:12.593902 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:12.594191 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":537345,"raft.queue_time_us":537741,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"thread_start_us":223736,"threads_started":1,"wal-append.queue_time_us":264064}
I20260709 12:59:12.651271  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:12.671584  1567 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:12.633049  3964 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.652843  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:12.651196  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:12.676882  1644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.027s	sys 0.045s
I20260709 12:59:12.677218  1570 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
W20260709 12:59:12.677815  1644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.027s	sys 0.045s
I20260709 12:59:12.681407  1686 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:12.647521  3940 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.651011  4030 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:12.702265  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 125214us
I20260709 12:59:12.703229  1685 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:12.628904  3856 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:12.676880  4015 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:12.672923  4081 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.716415  4112 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:12.720471  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1571) took 1103 ms. Trace:
I20260709 12:59:12.722098  1638 rpcz_store.cc:276] 0709 12:59:11.617065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.150340 (+533275us) service_pool.cc:224] Handling call
0709 12:59:12.150712 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:12.151051 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.151078 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:12.151540 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:59:12.330466 (+178926us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:12.357698 (+ 27232us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.358000 (+   302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.358128 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:12.720153 (+362025us) raft_consensus.cc:1685] finished
0709 12:59:12.720181 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:12.720385 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49144,"prepare.run_wall_time_us":1797,"raft.queue_time_us":932,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":5971,"spinlock_wait_cycles":13120768,"thread_start_us":154872,"threads_started":1,"wal-append.queue_time_us":249120}
I20260709 12:59:12.686441  4007 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:12.695449  4048 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:12.678911  3895 consensus_queue.cc:1059] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:59:12.739391  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1568) took 1159 ms. Trace:
I20260709 12:59:12.741659  3856 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:12.741180  1639 rpcz_store.cc:276] 0709 12:59:11.579715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.126178 (+546463us) service_pool.cc:224] Handling call
0709 12:59:12.126567 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:12.131355 (+  4788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.131388 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:12.146738 (+ 15350us) log.cc:844] Serialized 26 byte log entry
0709 12:59:12.330431 (+183693us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:12.429046 (+ 98615us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.429257 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.429341 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:12.739119 (+309778us) raft_consensus.cc:1685] finished
0709 12:59:12.739149 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:12.739319 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27318,"prepare.queue_time_us":195623,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":863,"raft.queue_time_us":256363,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":24639,"thread_start_us":205344,"threads_started":2,"wal-append.queue_time_us":204831}
W20260709 12:59:12.742986  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 104661us
I20260709 12:59:12.744143  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:12.684693  3964 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.744289  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:12.739954  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 62343.9us
I20260709 12:59:12.744810  1713 raft_consensus.cc:606] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:12.746192  1713 raft_consensus.cc:614] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:12.745349  4112 raft_consensus.cc:697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:12.756368  3758 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.756994  4112 consensus_queue.cc:237] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.757223  3758 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.760365  3758 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:12.755685  4083 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:12.714380  4030 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:12.714114  3940 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.709685  4107 consensus_queue.cc:1059] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
W20260709 12:59:12.774149  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 71018.2us
I20260709 12:59:12.787734  4083 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:12.795713  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 48913.4us
I20260709 12:59:12.744558  4015 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.799629  2406 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:12.806442  1563 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:12.773000  4103 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:12.815711  3964 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:12.740796  4081 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.796697  3758 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:12.809521  4103 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:12.827443  4107 raft_consensus.cc:3055] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:12.803499  4083 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.833292  4103 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:12.737484  4105 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.807180  4015 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:12.867218  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
W20260709 12:59:12.865428  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 168160us
I20260709 12:59:12.870180  1713 raft_consensus.cc:606] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:12.843432  4107 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:12.872934  4107 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.873426  4081 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:12.874410  4094 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:12.874529  4107 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:12.876050  3992 raft_consensus.cc:3055] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:12.876550  3992 raft_consensus.cc:740] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:12.876827  4015 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:12.878459  4105 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:12.831883  3856 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:59:12.879209   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:12.833861  3758 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.866243  4099 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:12.885763   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:12.887632  1567 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:12.888482  1565 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:12.889106  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:12.897696  4125 consensus_queue.cc:1059] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:59:12.898927  4125 raft_consensus.cc:3055] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:12.900884  4125 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:12.901902  4125 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.908455  4002 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:12.910707  3994 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:12.913980  4008 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:12.914889  4096 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.371s	user 0.002s	sys 0.008s
W20260709 12:59:12.919876  4087 log.cc:927] Time spent T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
I20260709 12:59:12.920784  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:12.892937  1571 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:12.877569  3992 consensus_queue.cc:260] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:12.951054  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:12.964155  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:12.896052  4099 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:12.965742  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:12.966742  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.979091  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:12.980477  4125 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:12.980731  4007 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:12.984139  3940 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:13.008034  1717 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:12.992834  2444 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:13.007648  1713 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:13.238077  1715 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:13.237779  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:13.051775  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 252237us
W20260709 12:59:12.977036  4087 log.cc:927] Time spent T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.055s	user 0.003s	sys 0.000s
I20260709 12:59:13.250079  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:13.250751  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:13.244891  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:13.252125  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 240539us
W20260709 12:59:13.253027  1536 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.502s (SENT) [suppressed 21 similar messages]
I20260709 12:59:12.976064  4099 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:13.262002  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:13.265591  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:13.286836  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:12.987851  3992 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:13.005976  4124 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:13.294580  4124 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.309618  4124 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:13.295171  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:13.312433  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:13.295473  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:13.315511  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:13.317067  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:13.292076  4119 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:13.319633  4119 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.294656  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:13.323947  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:13.294835  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:13.296468  1563 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:13.327049  3758 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:13.327987  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:12.991806  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:13.340240  4083 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:13.341879  1686 consensus_peers.cc:597] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36627e4c13c74e8a9fd501f26c7aff53. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:13.350904  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 95997.9us
W20260709 12:59:13.358968  1564 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.024s	sys 0.052s
I20260709 12:59:13.359400  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:13.359629  1564 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.024s	sys 0.052s
W20260709 12:59:13.358843  4087 log.cc:927] Time spent T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:59:13.331120  4119 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:13.363186  1564 raft_consensus.cc:1240] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:13.364634  1563 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:13.366539  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.459052  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:13.460201  1721 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
W20260709 12:59:13.469026  4135 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:59:13.473135  3995 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:13.480396  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:13.490897  4133 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:59:13.512741  1721 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:13.547756  1566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.013s	sys 0.062s
W20260709 12:59:13.548159  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:13.548312  1566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.013s	sys 0.062s
W20260709 12:59:13.551103  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 178420us
I20260709 12:59:13.548359  4015 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:13.580464  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:13.581089  3899 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:13.560353  3902 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:59:13.582399  4129 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:13.586324  4132 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.599169  3949 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.582322  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:13.588724  4125 consensus_meta.cc:287] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.002s
I20260709 12:59:13.594736  4146 raft_consensus.cc:993] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 12:59:13.597371  4008 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:13.562698  4015 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:13.587939  4107 consensus_meta.cc:287] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.713s	user 0.015s	sys 0.000s
I20260709 12:59:13.557456  4100 consensus_queue.cc:1059] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:59:13.563475  4098 consensus_queue.cc:1059] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:59:13.631634  4108 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:59:13.640139  4015 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:13.632181  3758 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:13.641165  2440 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:13.641283  3758 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.634235  2438 raft_consensus.cc:1240] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:13.604012  4083 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:13.643688  3758 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:13.643337  4083 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.634466  4144 consensus_queue.cc:1059] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:59:13.646344  4100 raft_consensus.cc:3055] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:13.605616  3915 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:59:13.628067  4132 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.629691  3949 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.650693  3949 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:13.651633  4105 consensus_meta.cc:287] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.773s	user 0.015s	sys 0.000s
I20260709 12:59:13.651402  3949 consensus_queue.cc:1059] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:13.652320  1717 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:13.653278  4132 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:13.662461  4132 consensus_queue.cc:1059] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:13.663736  4132 raft_consensus.cc:3055] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:13.664162  4132 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:13.664628  3918 raft_consensus.cc:3055] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:13.665105  3918 raft_consensus.cc:740] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:13.665184  4132 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:13.666412  4132 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:13.666465  4083 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:13.672348  4099 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:13.674628  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:13.677393  4098 raft_consensus.cc:3055] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:13.677958  4098 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:13.679006  4098 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:13.680688  4098 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:13.639703  4103 consensus_meta.cc:287] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.755s	user 0.010s	sys 0.001s
I20260709 12:59:13.646795  4100 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:13.683060  4100 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.633102  4125 raft_consensus.cc:1081] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Signalling peer 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 12:59:13.685120  4100 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:13.683084  4107 raft_consensus.cc:3055] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:13.686707  4107 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:13.687839  4107 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.689543  4107 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:13.683965  1713 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
W20260709 12:59:13.692696  2405 leader_election.cc:336] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.853s (SENT)
W20260709 12:59:13.694046  2405 leader_election.cc:336] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.964s (SENT)
I20260709 12:59:13.695890  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:13.699378  1715 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:13.712375  1718 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
W20260709 12:59:13.731163  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 124157us
I20260709 12:59:13.690474  3918 consensus_queue.cc:260] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.714432  4134 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 12:59:13.738570  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.742730  1566 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:13.704841  4103 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.731230  4099 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:13.746470  1572 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:59:13.747220  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:13.750883  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.751169  1565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:46640
W20260709 12:59:13.751561  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.752112  1565 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:13.752609  1565 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.753266  4113 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.759191  1570 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:59:13.761006  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:13.766472  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2278) took 2112 ms. Trace:
I20260709 12:59:13.767226  1716 raft_consensus.cc:1240] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:13.766983  1643 rpcz_store.cc:276] 0709 12:59:11.654363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.238336 (+583973us) service_pool.cc:224] Handling call
0709 12:59:12.606692 (+368356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:12.675039 (+ 68347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.675084 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:12.678036 (+  2952us) log.cc:844] Serialized 26 byte log entry
0709 12:59:12.719522 (+ 41486us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:12.737149 (+ 17627us) log.cc:844] Serialized 14 byte log entry
0709 12:59:13.765892 (+1028743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.765999 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.766166 (+   167us) raft_consensus.cc:1685] finished
0709 12:59:13.766195 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.766393 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1028406,"prepare.queue_time_us":20628,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":1716,"raft.queue_time_us":1156633,"thread_start_us":98798,"threads_started":2,"wal-append.queue_time_us":109838}
I20260709 12:59:13.761118  3918 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:13.779963  1565 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.753839  4113 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.791996  1565 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:13.798862  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 1.0546e+06us
I20260709 12:59:13.800173  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:13.771682  4115 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:13.801970  1612 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:13.816179  4120 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:13.816610  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2283) took 2160 ms. Trace:
I20260709 12:59:13.817360  4123 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:13.818125  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 173) took 2852 ms. Trace:
I20260709 12:59:13.818508  1647 rpcz_store.cc:276] 0709 12:59:10.965828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.265768 (+299940us) service_pool.cc:224] Handling call
0709 12:59:11.286607 (+ 20839us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:11.638092 (+351485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:11.638171 (+    79us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:12.050082 (+411911us) log.cc:844] Serialized 52 byte log entry
0709 12:59:12.372999 (+322917us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:12.494962 (+121963us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.819463 (+324501us) log.cc:844] Serialized 14 byte log entry
0709 12:59:12.919070 (+ 99607us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:13.817573 (+898503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.817661 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.817851 (+   190us) raft_consensus.cc:1685] finished
0709 12:59:13.817869 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.818010 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2377389,"prepare.queue_time_us":175027,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":102,"raft.queue_time_us":1567840,"raft.run_cpu_time_us":445,"raft.run_wall_time_us":17986,"spinlock_wait_cycles":27246848,"thread_start_us":657572,"threads_started":3,"wal-append.queue_time_us":382441}
I20260709 12:59:13.821946  4094 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:13.822103  4045 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.822546  4094 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.822633  4045 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.823648  4042 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:13.824225  4042 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:13.824777  3995 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.826800  3998 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:13.826102  4048 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.827495  4153 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:59:13.828114  4048 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:13.831741  4150 log.cc:927] Time spent T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:59:13.817025  1641 rpcz_store.cc:276] 0709 12:59:11.656040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.340191 (+684151us) service_pool.cc:224] Handling call
0709 12:59:12.346600 (+  6409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:12.346825 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:12.596185 (+249360us) log.cc:844] Serialized 14 byte log entry
0709 12:59:13.816180 (+1219995us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:13.816244 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:13.816291 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.816372 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.816548 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1074134,"prepare.queue_time_us":187903,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":1041978,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":381892,"threads_started":2,"wal-append.queue_time_us":286280}
I20260709 12:59:13.833014  4084 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:13.834617  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:13.835434  4084 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:13.839165  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:13.854230  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:13.856613  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 54758.5us
I20260709 12:59:13.857501  1612 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:13.858878  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:13.856617  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:13.861780  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:13.866765  4115 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:13.867084  4094 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:13.869894  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:13.874280  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:13.871505  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:13.876595  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:13.814404  4109 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:13.881037  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:13.882954  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:13.889184  1571 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:13.825315  3995 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:13.894407  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:13.864439  4120 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:13.900863  4094 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:13.901283  4158 ts_tablet_manager.cc:933] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:13.901423  4045 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:13.903982  1612 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:13.894114  4115 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:13.912688  4042 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:13.895906  4119 raft_consensus.cc:3055] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:13.914789  4045 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:13.915653  3995 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:13.941861  1571 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:13.902595  4048 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:13.916064  1612 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:13.952159  4115 raft_consensus.cc:697] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:13.952581  4048 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:13.953613  4115 consensus_queue.cc:237] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:13.962818  4103 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:13.962832  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 46869.3us
I20260709 12:59:13.965745  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:13.971819  1612 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:13.962962  4151 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:59:13.940330  4119 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 12:59:13.993320  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 114288us
I20260709 12:59:13.973337  4042 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:13.992641  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:13.981194  4113 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:13.980199  3758 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:13.994005  4048 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:14.002504  1612 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:14.010728  4161 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:14.008459  4119 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:13.997936  4029 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.000527  4132 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:14.005016  4155 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:59:14.024632  4132 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:14.027119  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 161390us
I20260709 12:59:14.008776  4113 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:14.005133  3758 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.004060  3949 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.012265  4083 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:59:14.017634  4119 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:14.032958  1563 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:59:14.014518  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:14.037524  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:14.048815  1714 raft_consensus.cc:3055] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:14.049154  1714 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:14.009881  4158 tablet_copy_client.cc:323] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 12:59:14.050083  1714 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.051182  1714 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.052663  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet 36627e4c13c74e8a9fd501f26c7aff53 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 12:59:14.053447  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet 36627e4c13c74e8a9fd501f26c7aff53 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-36627e4c13c74e8a9fd501f26c7aff53
I20260709 12:59:14.014645  4084 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.054396  4084 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.064080  1730 tablet_copy_source_session.cc:215] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:14.046092  3949 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.043658  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1589) took 1151 ms. Trace:
I20260709 12:59:14.067160  1567 rpcz_store.cc:276] 0709 12:59:12.889049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.897539 (+  8490us) service_pool.cc:224] Handling call
0709 12:59:13.671759 (+774220us) spinlock_profiling.cc:243] Waited 8.62 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:59:13.671997 (+   238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:13.672452 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.672483 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:13.673033 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:59:13.761986 (+ 88953us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:13.762030 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.762124 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.032790 (+270666us) raft_consensus.cc:1685] finished
0709 12:59:14.032816 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.040722 (+  7906us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19393,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":3601,"spinlock_wait_cycles":19826944,"thread_start_us":88517,"threads_started":1,"wal-append.queue_time_us":141771}
W20260709 12:59:14.069438  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 55496.3us
I20260709 12:59:14.070590  1612 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:14.046788  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.066570  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.075587  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2319) took 1023 ms. Trace:
I20260709 12:59:14.077592  3949 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:14.079847  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:14.076188  1720 rpcz_store.cc:276] 0709 12:59:13.052559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.052728 (+   169us) service_pool.cc:224] Handling call
0709 12:59:14.066386 (+1013658us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:14.075484 (+  9098us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11579648}
I20260709 12:59:14.078712  3949 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:59:14.077581  1612 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:14.085860  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:14.041575  4103 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.093302  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.095850  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.096091  1641 raft_consensus.cc:2376] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7. Re-sending same reply.
I20260709 12:59:14.100567  1643 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:14.036538  4029 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.103101  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:14.103790  1638 raft_consensus.cc:2376] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7. Re-sending same reply.
I20260709 12:59:14.104519  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.105304  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.105967  1638 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:59:14.107303  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.107893  1638 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:59:14.109309  1638 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:14.110611  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.111330  1641 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:59:14.086404  4113 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:14.079556  4161 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:14.095548  3995 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:14.121894  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.124436  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.129408  1641 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:59:14.124814  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:14.130282  1640 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:14.130393  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:14.132381  1642 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:14.133096  1719 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:14.136695  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2317) took 1123 ms. Trace:
I20260709 12:59:14.125309  1714 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
I20260709 12:59:14.119699  1639 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:14.134292  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 125187us
W20260709 12:59:14.149050  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.101671  4103 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.145020  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:14.170531  1642 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:14.169536  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:14.143846  4113 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:14.173337  4113 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.137352  1719 rpcz_store.cc:276] 0709 12:59:13.012968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.013140 (+   172us) service_pool.cc:224] Handling call
0709 12:59:14.079657 (+1066517us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:14.136627 (+ 56970us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9666304}
I20260709 12:59:14.142467  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.119295  4042 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:14.086640  4048 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 12:59:14.146281  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:14.180979  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:14.181511  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.183866  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.185031  1645 raft_consensus.cc:2393] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:14.185459  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.149363  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.186434  1639 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 1.
W20260709 12:59:14.151289  4140 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.600s	user 0.003s	sys 0.001s
W20260709 12:59:14.153234  4157 log.cc:927] Time spent T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.324s	user 0.000s	sys 0.002s
I20260709 12:59:14.223780  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:14.224817  1639 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:14.133955  3995 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:14.166646  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.176478  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:14.186611  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:14.172281  4132 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:14.190434  1564 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:14.200275  1638 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:14.177868  4083 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:14.165764  1640 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:14.135604  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1570) took 2555 ms. Trace:
I20260709 12:59:14.234500  1645 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:14.188808  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:14.234757  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 58377us
I20260709 12:59:14.235904  1641 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:59:14.236217  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.236758  1642 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:14.232486  3995 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:14.237558  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.237893  2440 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:14.238487  4030 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:14.240984  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:14.224026  1720 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:14.278317  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.247624  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:14.318176  1719 raft_consensus.cc:2393] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 2: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:14.324898  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:14.325506  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.315215  1644 rpcz_store.cc:276] 0709 12:59:11.580260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.134962 (+554702us) service_pool.cc:224] Handling call
0709 12:59:12.147108 (+ 12146us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:12.148131 (+  1023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.148166 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:12.159065 (+ 10899us) log.cc:844] Serialized 52 byte log entry
0709 12:59:12.678348 (+519283us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:12.704740 (+ 26392us) log.cc:844] Serialized 14 byte log entry
0709 12:59:13.750170 (+1045430us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b1800006880. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca125c0a 00007f18d3865219 00007f18ca1ada40 00007f18ca1a84e4 00007f18ca1a8455 00007f18cd290060 00007f18cd2a2716 00007f18cd2b3287 00007f18cd2b3208
0709 12:59:13.991433 (+241263us) log.cc:844] Serialized 14 byte log entry
0709 12:59:14.102557 (+111124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.102648 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.135384 (+ 32736us) raft_consensus.cc:1685] finished
0709 12:59:14.135403 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.135547 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54472,"prepare.queue_time_us":199967,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":114,"raft.queue_time_us":1067240,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":21835,"spinlock_wait_cycles":3356928,"thread_start_us":856677,"threads_started":4,"wal-append.queue_time_us":795111,"wal-append.run_cpu_time_us":2603,"wal-append.run_wall_time_us":1046892}
I20260709 12:59:14.331724  1638 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:14.331794  1642 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
W20260709 12:59:14.288272  2405 leader_election.cc:336] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.923s (SENT)
I20260709 12:59:14.330816  1566 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
W20260709 12:59:14.333333  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 45146.3us
I20260709 12:59:14.241724  3758 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:14.263521  1639 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:14.256350  1564 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:14.341799  1645 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:14.337072  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:14.348791  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.349786  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:14.349226  4174 log.cc:927] Time spent T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:59:14.352519  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.352969  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:14.334410  4104 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.791s	user 0.010s	sys 0.011s
I20260709 12:59:14.355752  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:14.357481  1638 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
W20260709 12:59:14.335745  4100 consensus_meta.cc:287] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.650s	user 0.004s	sys 0.021s
W20260709 12:59:14.357470  4104 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.814s	user 0.011s	sys 0.012s
I20260709 12:59:14.251865  4179 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:14.333544  4029 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:14.366444  1714 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:14.369392  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:14.364482  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.361497  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:14.369765  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.359269  3758 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:14.371775  1645 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:14.369302  4179 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:14.375698  4004 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:14.379722  1642 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:59:14.351665  4176 consensus_queue.cc:1059] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:59:14.397723  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2330) took 1242 ms. Trace:
I20260709 12:59:14.362990  4030 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:14.406253  1716 rpcz_store.cc:276] 0709 12:59:13.155163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.338532 (+183369us) service_pool.cc:224] Handling call
0709 12:59:13.339069 (+   537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.767681 (+428612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.397263 (+629582us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54001a9854. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:14.397581 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984055168}
I20260709 12:59:14.410245  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.410812  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.484441  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.458786  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.487129  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:14.417771  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 48450.8us
I20260709 12:59:14.487571  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.399319  3758 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:14.486613  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.704238  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:14.468811  4029 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:14.714381  4029 raft_consensus.cc:697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:14.714846  4134 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:14.715478  4029 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.716228  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:14.713030  3758 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.721692  2406 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:14.505115  1685 leader_election.cc:336] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.537s (SENT)
I20260709 12:59:14.725622  1685 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:14.536463  4107 consensus_meta.cc:287] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.835s	user 0.013s	sys 0.006s
I20260709 12:59:14.703490  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:14.458508  3895 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:59:14.690451  4119 consensus_meta.cc:287] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.642s	user 0.015s	sys 0.000s
W20260709 12:59:14.547852  4159 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:59:14.404989  4179 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:14.696260  1640 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:14.415454  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.734848  1642 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:14.735097  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.735854  1640 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:14.634799  4015 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.612534  4045 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:14.688345  4103 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:14.730428  1645 raft_consensus.cc:2376] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6. Re-sending same reply.
I20260709 12:59:14.740000  4045 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.740393  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.741351  1645 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:14.742478  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.696579  1641 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:14.743180  1645 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:14.743861  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.744238  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.744611  1641 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:14.472180  4030 raft_consensus.cc:697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 12:59:14.731660  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 201402us
I20260709 12:59:14.729907  4132 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:14.709247  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:14.747948  1718 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2318) took 1734 ms (client timeout 1763 ms). Trace:
W20260709 12:59:14.737031  1612 connection.cc:256] RPC call timeout handler was delayed by -1.797360819000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 12:59:14.748417  1718 rpcz_store.cc:269] 0709 12:59:13.013332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.014102 (+   770us) service_pool.cc:224] Handling call
0709 12:59:13.480188 (+466086us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:14.747746 (+1267558us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54003403d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:14.747872 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345071232}
I20260709 12:59:14.735873  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:14.736831  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.729897  3902 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:14.691303  3995 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.736057  4134 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:14.738587  4015 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:14.728184  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 223140us
W20260709 12:59:14.756597  1685 leader_election.cc:336] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.738s (SENT)
I20260709 12:59:14.731076  1644 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:14.745592  1639 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:14.734441  3895 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:14.750828  1640 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:14.740334  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:14.752449  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:14.747255  4045 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:14.761768  4045 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.762408  4045 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:14.764845  4045 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:14.765502  4045 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.765992  4045 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.768564  4045 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:14.750727  1642 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.772022  4015 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:14.752019  4161 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:14.773536  4161 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.776046  4161 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:14.751734  4048 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.778605  4048 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:14.785063  1642 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2.
W20260709 12:59:14.757562  4042 consensus_meta.cc:287] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.571s	user 0.012s	sys 0.002s
I20260709 12:59:14.787353  1712 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
W20260709 12:59:14.789814  4098 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.000s	sys 0.004s
I20260709 12:59:14.794499  3999 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.796116  4119 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:14.796561  3999 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.796658  4119 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.791827  4042 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:14.752267  4132 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:14.794068  4184 log.cc:927] Time spent T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
I20260709 12:59:14.813014   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:14.806529  4084 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:14.805176  4048 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:14.820976  4175 log.cc:927] Time spent T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.546s	user 0.003s	sys 0.000s
I20260709 12:59:14.821595  4119 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:14.809180  4132 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:14.797686  4098 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.000s	sys 0.005s
I20260709 12:59:14.793120  4134 raft_consensus.cc:697] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:14.824251  3895 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:14.825415  4134 consensus_queue.cc:237] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:14.805771  4030 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:14.843538  1713 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2325) took 1701 ms (client timeout 2199 ms). Trace:
W20260709 12:59:14.844126  1713 rpcz_store.cc:269] 0709 12:59:13.141880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.323580 (+181700us) service_pool.cc:224] Handling call
0709 12:59:14.843294 (+1519714us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54003ab454. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:14.843457 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763041152}
W20260709 12:59:14.837781  4113 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.010s	sys 0.015s
I20260709 12:59:14.855314  1638 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
W20260709 12:59:14.861392  1612 connection.cc:256] RPC call timeout handler was delayed by -1.2330608190000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2606s for a response
I20260709 12:59:14.843287  4132 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:14.866369  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 108672us
W20260709 12:59:14.859225  4113 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.011s	sys 0.015s
I20260709 12:59:14.872713  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:14.874279  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.875115  1640 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:14.870797  1643 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:14.874177  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:14.877592  1645 raft_consensus.cc:2376] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4. Re-sending same reply.
I20260709 12:59:14.878188  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.878458  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:14.878973  1645 raft_consensus.cc:2376] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7. Re-sending same reply.
W20260709 12:59:14.879583  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 150898us
I20260709 12:59:14.879990  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:14.879870  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:14.870362  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 148755us
I20260709 12:59:14.878839  1643 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:14.883554  1644 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:14.883622  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:14.861961  4117 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.885463  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:14.887318  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:14.887600  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:14.862174  4042 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:14.888932  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:14.889284  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:14.891651  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.892302  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:14.892625  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:14.892514  1642 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:14.890322  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:14.894559  1567 raft_consensus.cc:2393] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:14.894907  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:14.896252  1565 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:14.897750  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:14.898269  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:14.888944  1685 leader_election.cc:336] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.765s (SENT)
I20260709 12:59:14.900460  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:14.901422  1572 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:59:14.894979  4110 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.012s	sys 0.024s
I20260709 12:59:14.909837  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:14.909898  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.911907  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:14.911811  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:14.914008  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.902302  4081 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:14.915870  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.916426  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.919140  1713 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:59:14.907898  4110 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.012s	sys 0.024s
I20260709 12:59:14.917179  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.915920  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:14.920862  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:14.885383  4132 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:14.890044  4117 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:14.936700  4187 log.cc:927] Time spent T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:59:14.937211  3995 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:14.915501  4083 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:14.953816  1685 leader_election.cc:336] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.924s (SENT)
I20260709 12:59:14.898697  4042 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:14.924425  4030 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:14.976527  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:14.916088  4176 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:59:14.936753  4119 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:14.980086  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:14.986306  1645 raft_consensus.cc:2376] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4. Re-sending same reply.
I20260709 12:59:14.988582  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:14.925274  4084 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 12:59:14.997584  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 76844.5us
I20260709 12:59:14.998546  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:14.999126  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:14.953181  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:15.002024  1612 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:14.926016  4153 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:59:15.007866  1612 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:14.960625  4083 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:15.012638  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:15.013823  1570 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 12:59:14.975416  4195 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.022557  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:14.982149  3995 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:15.024802  1685 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:14.993377  4030 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:15.016145  4109 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:15.014642  4048 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:15.005273  4119 raft_consensus.cc:697] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 12:59:15.043792  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 47848.1us
I20260709 12:59:15.019667  4113 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:15.024744  3949 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:15.025038  4083 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:15.004732  4194 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:15.049980  3949 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:15.040195  4098 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:15.066828  4098 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:15.067289  4098 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:15.068115  4117 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:15.030072  4195 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.076833  3758 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.066170  3949 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.078306  4119 consensus_queue.cc:237] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.080785  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:15.106617  1644 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:15.083118  4132 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:15.084013  4195 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:15.087584  3999 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:15.092936  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:15.094204  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:15.064322  4179 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:15.098119  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:15.127071  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.127439  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:15.128356  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:15.128494  1569 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:15.129007  1644 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:59:15.100374  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:15.113430  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:15.125586  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:15.130892  1640 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.130708  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:15.131071  1568 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:15.132182  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:15.135510  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:15.136164  1714 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
W20260709 12:59:15.120900  4181 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.433s	user 0.002s	sys 0.002s
I20260709 12:59:15.142959  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:15.134626  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 346529us
I20260709 12:59:15.084483  4030 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.148749  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:15.149576  1719 raft_consensus.cc:2376] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6. Re-sending same reply.
W20260709 12:59:15.157593  1685 leader_election.cc:336] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.168s (SENT)
W20260709 12:59:15.201010  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 52470.6us
I20260709 12:59:15.202798  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:59:15.204584  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 47077us
W20260709 12:59:15.206488  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 54577.9us
I20260709 12:59:15.209146  4153 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:15.212109  1638 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:59:15.214111  1638 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:59:15.215623  1712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2320) took 2162 ms (client timeout 1502 ms). Trace:
I20260709 12:59:15.216444  1638 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:59:15.216082  1712 rpcz_store.cc:269] 0709 12:59:13.052889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.053018 (+   129us) service_pool.cc:224] Handling call
0709 12:59:13.834414 (+781396us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:15.215419 (+1381005us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b54002dc654. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:15.215525 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143934720}
I20260709 12:59:15.135437  4042 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:15.221334  1640 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
W20260709 12:59:15.200290  4201 log.cc:927] Time spent T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:59:15.248814  1686 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:15.271030  1640 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:15.272822  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:15.273718  1640 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:15.278811  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:15.279575  1712 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
W20260709 12:59:15.281702  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 51419.6us
I20260709 12:59:15.229477  4213 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:15.284695  4084 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:15.273052  4186 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:59:15.286787  4134 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.277938  4188 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:59:15.294509  4213 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 12:59:15.317940  4207 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:59:15.313040  4084 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.318886  4084 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:15.321071  4206 log.cc:927] Time spent T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:59:15.329034  3758 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:15.297116  4156 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:59:15.317771  4213 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:15.337970  2406 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:15.284590  4192 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:59:15.343153  3940 raft_consensus.cc:3055] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:15.373643  3940 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:15.374645  3940 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.375905  3940 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.338315  4134 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:15.381090  4134 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:15.339720  4179 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:15.356609  4083 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.354043  4098 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:15.390946  4213 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:15.396145  4213 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:15.458842  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2284) took 1333 ms. Trace:
W20260709 12:59:15.468926  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 177444us
I20260709 12:59:15.476336  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 240) took 1377 ms. Trace:
I20260709 12:59:15.542474  1716 rpcz_store.cc:276] 0709 12:59:14.098947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.466798 (+367851us) service_pool.cc:224] Handling call
0709 12:59:14.467305 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:14.791349 (+324044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.791383 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:14.791434 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:14.791469 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.475515 (+684046us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400302354. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:15.475643 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.476054 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":744578432}
I20260709 12:59:15.489686  4004 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.547171  4004 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.468305  1685 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:59:15.551883  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 84126us
W20260709 12:59:15.473322  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 135342us
I20260709 12:59:15.554227  4134 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:15.555156  4134 raft_consensus.cc:697] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:15.555217  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:15.479573  3758 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:15.558686  4156 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:15.559448  4156 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.559923  4156 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:15.480314  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:15.557802  4015 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:15.434499  1536 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:15.564153  4015 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.564725  4015 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:15.485347  3949 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.439409  1565 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:15.569100  3949 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:15.489938  4098 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:15.469966  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:15.573448  1647 raft_consensus.cc:2376] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6. Re-sending same reply.
I20260709 12:59:15.575093  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:15.536230  1646 rpcz_store.cc:276] 0709 12:59:14.125665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.125843 (+   178us) service_pool.cc:224] Handling call
0709 12:59:14.126224 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:14.142220 (+ 15996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.143148 (+   928us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.163226 (+ 20078us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.399100 (+235874us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:14.399164 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.399823 (+   659us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.976174 (+576351us) spinlock_profiling.cc:243] Waited 9.58 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:15.283543 (+307369us) raft_consensus.cc:1685] finished
0709 12:59:15.283583 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.458390 (+174807us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8285,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":26867,"spinlock_wait_cycles":22033152,"thread_start_us":221456,"threads_started":1,"wal-append.queue_time_us":518093}
I20260709 12:59:15.576898  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:15.577260  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:15.578490  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:15.579474  1645 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:15.580399  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:15.580672  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:15.581387  1715 raft_consensus.cc:2376] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4. Re-sending same reply.
W20260709 12:59:15.582245  4082 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.229s	user 0.012s	sys 0.022s
W20260709 12:59:15.582880  4082 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.282s	user 0.012s	sys 0.022s
W20260709 12:59:15.523577  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.558780  3758 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:15.486317  4083 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:15.585278  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:15.586537  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 246768us
I20260709 12:59:15.589772  4015 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:15.591979  4158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36627e4c13c74e8a9fd501f26c7aff53. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:15.498605  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 56526.5us
I20260709 12:59:15.466921  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:15.565651  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 131826us
I20260709 12:59:15.598889  1645 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:15.468989  1638 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:15.594192  3949 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:15.650393  3949 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:15.651229  3949 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:15.655256  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 47196.6us
I20260709 12:59:15.603765  1646 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:15.610014  4015 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:15.611264  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:15.604081  1647 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:59:15.614689  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 109) took 7622 ms. Trace:
W20260709 12:59:15.615900  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.617238  4132 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:15.658659  4132 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.661365  4132 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:15.657764  1470 rpcz_store.cc:276] 0709 12:59:07.928592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.939976 (+ 11384us) service_pool.cc:224] Handling call
0709 12:59:15.527045 (+7587069us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:12.476942 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:12.528674 (+ 51732us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:12.530688 (+  2014us) write_op.cc:435] Acquired schema lock
0709 12:59:12.534639 (+  3951us) tablet.cc:662] Decoding operations
0709 12:59:12.714029 (+179390us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:12.721770 (+  7741us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:12.730407 (+  8637us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:59:12.755413 (+ 25006us) tablet.cc:701] Row locks acquired
0709 12:59:12.755443 (+    30us) write_op.cc:260] PREPARE: finished
0709 12:59:12.755666 (+   223us) write_op.cc:270] Start()
0709 12:59:12.755835 (+   169us) write_op.cc:276] Timestamp: P: 1783601952755599 usec, L: 0
0709 12:59:12.755857 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:59:12.756670 (+   813us) log.cc:844] Serialized 3984 byte log entry
0709 12:59:12.905055 (+148385us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18ca18e0ac 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1aac02 00007f18cce3220b
0709 12:59:13.772129 (+867074us) op_driver.cc:464] REPLICATION: finished
0709 12:59:13.995766 (+223637us) write_op.cc:301] APPLY: starting
0709 12:59:14.000538 (+  4772us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:14.029214 (+ 28676us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:14.036358 (+  7144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:14.234888 (+198530us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:14.355567 (+120679us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:59:14.359478 (+  3911us) write_op.cc:312] APPLY: finished
0709 12:59:14.425191 (+ 65713us) log.cc:844] Serialized 77 byte log entry
0709 12:59:14.493333 (+ 68142us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:14.521595 (+ 28262us) write_op.cc:454] Released schema lock
0709 12:59:14.542671 (+ 21076us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:14.597994 (+ 55323us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:14.598032 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":636030,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":200412,"apply.run_cpu_time_us":7040,"apply.run_wall_time_us":607473,"num_ops":10,"prepare.queue_time_us":288054,"prepare.run_cpu_time_us":36345,"prepare.run_wall_time_us":572665,"raft.queue_time_us":191088,"raft.run_cpu_time_us":38512,"raft.run_wall_time_us":172037,"replication_time_us":998877,"spinlock_wait_cycles":35110784,"thread_start_us":751825,"threads_started":4,"wal-append.queue_time_us":608439,"wal-append.run_cpu_time_us":107117,"wal-append.run_wall_time_us":2158564}]]}
I20260709 12:59:15.627475  3758 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:15.627756  4048 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:15.638348  1643 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:15.664763  1686 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:15.640383  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:15.667271  4082 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:15.667829  4082 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.668285  4082 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:15.645040  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:15.646791  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:15.626435  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 160164us
I20260709 12:59:15.557097  4134 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:15.690739  3758 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:15.691412  3758 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:15.691938  3758 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:15.690896  1642 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:59:15.706705  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:15.708009  2440 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:15.709200  3758 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.710902  1647 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:15.713231  3758 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:15.719358  1537 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:15.733666  1645 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:15.740871  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:15.727511  3758 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:15.748030  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 98196.4us
I20260709 12:59:15.714037  4084 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:15.756937  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 203321us
I20260709 12:59:15.754560  1612 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:15.745219  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:15.762813  1641 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.008s	sys 0.010s
I20260709 12:59:15.753325  3758 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:15.782905  1641 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.009s	sys 0.011s
W20260709 12:59:15.784509  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 138035us
I20260709 12:59:15.773720  3758 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:15.785851  4048 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:15.776633  4098 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:15.796473  4004 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:15.808903  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:15.819032  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 146622us
I20260709 12:59:15.777145  4104 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:59:15.813199  3940 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:15.829032  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 140028us
I20260709 12:59:15.834925  4130 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 12:59:15.840694  1640 consensus_meta.cc:287] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.017s
I20260709 12:59:15.831826  4132 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:15.844568  4042 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.844726  4132 raft_consensus.cc:697] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:15.845448  1612 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:15.850208  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 49104us
I20260709 12:59:15.847218  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:15.855388  1646 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:15.845510  4042 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.859995  1715 raft_consensus.cc:1240] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:15.862315  4104 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:15.863826  4004 raft_consensus.cc:3055] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:15.864464  4004 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:15.837229  3949 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.865417  4132 consensus_queue.cc:237] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.867892  3949 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:15.841771  3940 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:15.849685  1640 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:15.871491  4161 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:15.871780  4225 log.cc:927] Time spent T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.111s	user 0.001s	sys 0.001s
I20260709 12:59:15.872347  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:15.873251  1715 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:15.878208  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:15.879395  4153 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:15.879966  4153 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.880471  4153 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.882355  1685 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:15.882948  3892 consensus_queue.cc:1059] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:15.883718  3940 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:15.884270  3892 raft_consensus.cc:3055] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:15.884747  3892 raft_consensus.cc:740] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:15.887656  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:15.888836  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1583) took 1015 ms. Trace:
I20260709 12:59:15.889320  4004 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.889245  1641 rpcz_store.cc:276] 0709 12:59:14.873474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.873658 (+   184us) service_pool.cc:224] Handling call
0709 12:59:14.874001 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:14.874440 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:14.874471 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.884577 (+ 10106us) log.cc:844] Serialized 26 byte log entry
0709 12:59:15.047049 (+162472us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:15.320307 (+273258us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b4800220158. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d21c1aa1 00007f18d21b8b37 00007f18d21b89ca 00007f18d22b026f 00007f18d22aff37 00007f18d22c455c 00007f18d22c4508 00007f18d22c4488 00007f18d22c4443 00007f18d22c36ec 00007f18d11eda96
0709 12:59:15.801047 (+480740us) log.cc:844] Serialized 14 byte log entry
0709 12:59:15.848743 (+ 47696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.861474 (+ 12731us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:15.861511 (+    37us) raft_consensus.cc:1685] finished
0709 12:59:15.888549 (+ 27038us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.888758 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20132,"prepare.queue_time_us":65573,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":14806,"raft.run_cpu_time_us":3963,"raft.run_wall_time_us":440491,"spinlock_wait_cycles":12586752,"thread_start_us":828663,"threads_started":2,"wal-append.queue_time_us":248603}
I20260709 12:59:15.891291  4004 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:15.891881  4084 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:15.891623  4098 consensus_queue.cc:1175] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "338d817f94ee4c1bad162e9a5860b68a" responder_term: 7 status { last_received { term: 7 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 7 index: 3 } }
I20260709 12:59:15.900708  4084 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:15.901428  4084 raft_consensus.cc:697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:15.901975  4116 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:15.902815  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:15.903208  4084 consensus_queue.cc:237] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.899812  3892 consensus_queue.cc:260] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.905054  3892 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:15.906476  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:15.908324  1536 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:15.909968  1536 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:15.910295  3940 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:15.912725  3940 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:15.913165  3940 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:15.917960  4104 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:15.904989  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:15.910699  4119 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:15.883034  4042 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:15.911206  4130 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.889259  1612 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:15.920339  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 69507.5us
I20260709 12:59:15.938292  1716 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:15.939998  4212 consensus_queue.cc:1059] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:15.920176  4119 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:15.947893  4119 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:15.948072  3940 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.945446  1469 catalog_manager.cc:5697] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 4 to 5, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:15.947072  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:15.926007  3949 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:15.951746  1715 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 12:59:15.953456  3949 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:15.953522  4186 raft_consensus.cc:3055] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:15.954540  4186 raft_consensus.cc:740] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:15.961232  2405 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:15.964581  4015 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:15.965445  4015 raft_consensus.cc:697] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:15.966831  4015 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:15.967618  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:15.968545  1611 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:15.969956  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:15.970518  4161 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:15.971019  1712 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:59:15.971550  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:15.971971  3940 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:15.973383  1611 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:15.954044  3949 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:15.973443  2438 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:15.955744  4186 consensus_queue.cc:260] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:15.974336  1469 catalog_manager.cc:5697] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
W20260709 12:59:15.976863  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 67032.2us
I20260709 12:59:15.977608  4161 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:15.963418  4042 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:15.938369  4130 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:15.918824  4104 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:15.985105  4130 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:15.986963  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:15.991349  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:15.994114  1564 raft_consensus.cc:1240] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:15.978255  1469 catalog_manager.cc:5697] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 2 to 5, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:15.998241  4104 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:15.999893  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.999671  1469 catalog_manager.cc:5697] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 4 to 5, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:16.002368  4186 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:16.002970  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:16.003875  1563 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.004037  1469 catalog_manager.cc:5697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 1 to 2, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.005302  3940 consensus_queue.cc:1059] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:16.006524  3940 raft_consensus.cc:3055] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:16.007190  3940 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:16.006851  1469 catalog_manager.cc:5697] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 1 to 5, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:16.008375  3940 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:16.008908  1469 catalog_manager.cc:5697] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 4 to 5, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:16.011193  4153 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.012794  1718 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:16.014605  1536 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:16.016135  4030 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:16.016589  4030 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:16.016782  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:16.017032  4030 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:16.017997  4179 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:16.018461  4179 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:16.018860  4179 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:16.021334  3758 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:16.022722  1565 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:16.024130  3758 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:16.026746  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 137656us
I20260709 12:59:16.030400  3900 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:16.031405  3900 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:15.999958  4082 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.034106  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:16.034435  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:15.962383  4156 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.042790  3940 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:16.045699  1563 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:16.050107  4048 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:16.053336  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:16.054895  1721 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:59:16.055902  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.062583  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:16.054878  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:16.045600  4082 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:16.045006  4153 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:16.066183  3949 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.056917  4130 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.062978  4084 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:16.081348  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 47430.5us
I20260709 12:59:16.085181  1469 catalog_manager.cc:5697] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 3 to 4, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 4 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.084993  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:16.058107  4030 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.072304  3900 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:16.093897  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:16.109184  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:16.107712  1564 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.092540  4130 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.113032  1469 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 1 to 2, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:16.127673  1469 catalog_manager.cc:5697] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 1 to 4, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:16.122540  4179 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.129618  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:16.142736  3949 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:16.142373  1469 catalog_manager.cc:5697] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 1 to 5, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:16.143539  1565 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:16.152305  1563 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:16.143656  4119 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:16.124754  4156 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:16.148804  4158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42646 (request call id 444) took 2409 ms. Trace:
I20260709 12:59:16.159026  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:16.160082  1571 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:16.159714  1469 catalog_manager.cc:5697] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:16.122485  4048 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:16.103802  4084 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:16.153685  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 63382.6us
I20260709 12:59:16.157708  1564 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:16.159191  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:16.168430  1469 catalog_manager.cc:5697] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:16.119910  4153 consensus_queue.cc:1059] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:59:16.170698  4153 raft_consensus.cc:3055] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:16.171137  4153 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:16.172389  4179 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:16.172276  4153 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.127725  4104 consensus_queue.cc:1059] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:59:16.145820  4130 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:16.165246  4119 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:16.157505  4132 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.162518  3892 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.144016  4030 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:16.173770  4082 raft_consensus.cc:3055] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:16.170383  1469 catalog_manager.cc:5697] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 1 to 4, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:16.181483  1611 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:16.174278  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:16.176196  4132 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:16.179585  4084 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:16.188673  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:16.203682  1611 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:16.204250  4161 raft_consensus.cc:2764] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:59:16.182816  4082 raft_consensus.cc:740] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:16.175568  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:16.174010  4153 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:16.195533  1686 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:16.206890  4132 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:16.207294  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:16.178984  3892 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.208839  4042 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:16.209627  4042 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:16.210151  3892 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:16.210952  1569 raft_consensus.cc:2393] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 5: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:16.210862  4084 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:16.211195  1611 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:16.211686  4084 raft_consensus.cc:697] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:16.212644  4161 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:16.213114  4161 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:16.213577  4161 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.212920  4084 consensus_queue.cc:237] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.176863  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:16.205703  4082 consensus_queue.cc:260] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:16.217953  2437 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:16.220568  1721 pending_rounds.cc:85] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 4
I20260709 12:59:16.228197  1721 pending_rounds.cc:107] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 12:59:16.228605  1721 raft_consensus.cc:2917] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 12:59:16.229079  1721 raft_consensus.cc:2889] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:16.229816  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:54408 (request call id 9) took 5054 ms. Trace:
W20260709 12:59:16.231119  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.218959  1611 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:16.239938  1686 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:16.243492  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:16.187083  1469 catalog_manager.cc:5697] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 1 to 5, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:16.223380  4082 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:16.230506  1721 rpcz_store.cc:276] 0709 12:59:11.175409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.175593 (+   184us) service_pool.cc:224] Handling call
0709 12:59:11.188679 (+ 13086us) log.cc:844] Serialized 506 byte log entry
0709 12:59:11.299128 (+110449us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b1800117820. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1ab522 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd 000000000038f354 000000000038f199 00007f18ca18e83a
0709 12:59:16.229675 (+4930547us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20127,"raft.run_cpu_time_us":2196,"raft.run_wall_time_us":47525,"spinlock_wait_cycles":37035904,"thread_start_us":35444,"threads_started":1,"wal-append.queue_time_us":81438,"wal-append.run_cpu_time_us":2604,"wal-append.run_wall_time_us":1068317}
I20260709 12:59:16.240597  3892 consensus_queue.cc:1059] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
W20260709 12:59:16.257956  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet 36627e4c13c74e8a9fd501f26c7aff53: Aborted: Op aborted by new leader
I20260709 12:59:16.258162  4048 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:16.263021  4042 consensus_queue.cc:1059] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:16.266330  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:16.268050  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:16.246556  4116 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:16.246883  4104 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:16.276945  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:16.277849  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:16.224009  4156 consensus_queue.cc:1059] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:59:16.278839  1716 consensus_queue.cc:237] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:16.286384  4104 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:16.288275  4048 raft_consensus.cc:3055] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:16.301306  4116 raft_consensus.cc:697] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:16.310899  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 68514.1us
I20260709 12:59:16.309958  4156 raft_consensus.cc:3055] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:16.315088  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 62467.2us
I20260709 12:59:16.312445  4104 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:16.324486  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.311996  4048 raft_consensus.cc:740] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:16.316371  4156 raft_consensus.cc:740] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:16.161149  4158 rpcz_store.cc:276] 0709 12:59:13.739200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.739429 (+   229us) service_pool.cc:224] Handling call
0709 12:59:13.901734 (+162305us) ts_tablet_manager.cc:934] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
0709 12:59:15.589394 (+1687660us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:16.019568 (+430174us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:16.019726 (+   158us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:16.147326 (+127600us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:16.147749 (+   423us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:16.148515 (+   766us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:16.148659 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":33494,"tablet-copy.queue_time_us":152931,"thread_start_us":185577,"threads_started":2}
I20260709 12:59:16.315279  4161 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.355701  4249 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:16.354398  4004 raft_consensus.cc:3055] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:16.357877  4048 consensus_queue.cc:260] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.358681  4004 raft_consensus.cc:740] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:16.359256  4048 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.353114   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:16.371775  4161 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:16.375221  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:16.376250  1565 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:16.378525  1564 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:16.377524  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:16.379598  1568 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:16.380244  1571 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:16.381225  4030 consensus_queue.cc:1059] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.381740  4116 consensus_queue.cc:237] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.382700  4119 raft_consensus.cc:3055] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:16.383234  4119 raft_consensus.cc:740] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:16.384503  4119 consensus_queue.cc:260] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.349067  3949 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:16.386307  1536 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:16.386536  3949 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:16.386348  1565 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:16.389285  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:16.389659  3949 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:16.378547  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:16.416699  1563 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
W20260709 12:59:16.422991  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 154524us
I20260709 12:59:16.439965  1567 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:16.441596  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 124811us
I20260709 12:59:16.420651  3949 raft_consensus.cc:2764] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:59:16.452411  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.411389  4042 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:16.440966  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:16.510887  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:16.443671  4132 raft_consensus.cc:2764] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:59:16.430814  4158 tablet_copy_client.cc:806] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:16.461787  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:16.453481  4161 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:16.485548  4042 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.532493  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:16.539340  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:16.539409  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:16.545145  4247 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:16.545626  4241 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:59:16.546025  1719 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.546391  4161 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.549525  4161 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:16.450484  4156 consensus_queue.cc:260] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.550729  4256 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:16.551484  4256 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:16.554198  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.560456  4042 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:16.562117  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:16.563217  1714 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:16.574720  1719 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:16.577939  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:16.579799  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.567389  4158 tablet_copy_client.cc:670] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:16.543462  1712 raft_consensus.cc:2376] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6. Re-sending same reply.
I20260709 12:59:16.583045  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:16.584117  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:16.584399  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:16.585357  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:16.583148  1713 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:16.586330  4247 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:16.586827  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:16.587054  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:16.587013  4247 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.589738  4247 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:16.596630  4104 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.598670  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:16.599205  4104 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:16.601902  4004 consensus_queue.cc:260] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.603068  4004 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:16.608793  4226 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:16.609577  4226 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:16.609951  4119 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.612020  4226 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:16.612435  1716 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:16.615272  1715 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:16.620159  1712 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:16.621809  1567 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 12:59:16.579418  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:16.624801  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 45499.8us
I20260709 12:59:16.625622  1686 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:16.624337  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 235147us
I20260709 12:59:16.630131  4030 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:16.626983  4098 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:16.630954  4030 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:16.634313  4030 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:16.646066  4156 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:16.553944  4256 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:16.671837  1714 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:16.677767  4098 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:16.688268  4098 raft_consensus.cc:697] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:16.689248  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:16.702739  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:16.675823  4179 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:16.716374  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.716882  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:16.699240  4212 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:59:16.719128  4158 tablet_copy_client.cc:538] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:16.722379  4179 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.723519  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:16.724512  1718 raft_consensus.cc:606] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:16.724937  4179 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:16.743067  1564 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:16.744444  1569 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:16.745857  4261 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:16.746343  1571 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:16.746798  4261 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:16.748898  1714 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:16.689291  4098 consensus_queue.cc:237] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:16.713898  4119 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:16.717800  2440 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:16.759771  1571 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:16.780438  1686 consensus_peers.cc:597] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17d2c95439be4ced872760603b0ae02b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:16.780818  4249 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:16.782157  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 43781.3us
I20260709 12:59:16.738698  4256 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:16.751760  4226 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:59:16.799081  4161 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:16.837544  1537 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:16.799228  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:16.821895  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.829118  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:16.903764  1571 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:16.891461  1714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:16.905256  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:16.907001  1572 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:16.799345  4048 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:16.919766  4179 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:16.909090  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 71694.3us
W20260709 12:59:16.909860  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.924152  1717 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:16.750042  4261 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:16.901553  2405 leader_election.cc:336] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.623s (SENT)
I20260709 12:59:16.932126  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:16.907943  4161 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.884691  4042 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.829514  3900 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.821102  4119 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:16.799293  4186 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:16.829041  4247 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:16.943539  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 114515us
I20260709 12:59:16.925845  4179 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:16.949208  4212 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:16.961454  3940 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:16.961632  1570 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:16.940510  4161 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:16.962283  3940 raft_consensus.cc:697] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:16.962179  4262 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:59:16.962823  4161 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.963384  4161 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.963459  3940 consensus_queue.cc:237] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.828606  4260 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.975379  4042 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.978271  4265 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.965816  4161 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:16.928110  4004 consensus_queue.cc:1059] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 12:59:16.981473  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 70934.3us
I20260709 12:59:16.950407  4261 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:16.932799  4082 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:59:16.937549  4048 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:16.969800  4179 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:16.828765  4249 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.988265  3900 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.953404  4256 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.016189  1714 raft_consensus.cc:606] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:17.016785  1714 raft_consensus.cc:614] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:16.990923  4161 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:16.970914  4247 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:17.030500  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.968338  4186 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:17.002878  4110 raft_consensus.cc:3055] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:16.983879  4156 consensus_queue.cc:1059] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:59:17.003156  4082 raft_consensus.cc:3055] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:17.016485  4042 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:17.000015  4261 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:16.996989  4098 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:59:17.051235  3949 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.051498  3999 consensus_queue.cc:1059] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:59:17.052843  4186 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:17.001963  4260 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:17.040961  4119 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.043372  4082 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:17.054032  1568 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:17.059033  4161 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:17.054675  3900 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:17.054955  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.055130  4042 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:17.061322  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:17.035271  4110 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:17.004511  4104 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:59:16.978936  4265 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.066864  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:17.090248  3999 raft_consensus.cc:3055] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:17.072551  4253 consensus_queue.cc:1059] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:59:17.090828  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.090849  3999 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:17.091862  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.091296  4253 raft_consensus.cc:3055] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:17.097821  1642 raft_consensus.cc:2410] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:17.073993  4251 raft_consensus.cc:3055] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:59:17.108600  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 47339.4us
I20260709 12:59:17.107733  3940 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:59:17.117976  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.117976  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:17.119429  1641 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:17.116204  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 137425us
I20260709 12:59:17.096495  4253 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:17.072703  3949 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:17.123056  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.123013  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:17.121268  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:17.127661  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.113461  4251 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:17.129524  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.135799  4276 ts_tablet_manager.cc:933] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:17.135352  4082 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.137135  1638 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:17.134433  1639 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:17.092525  3999 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.139034  4110 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.151000  4270 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:17.151773  4270 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.153450  4048 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:17.153301  4253 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.155000  4253 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:17.156342  4255 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:59:17.158869  4247 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:17.160370  4161 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:17.152083  4110 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.162196  4261 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:17.167582  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:17.170310  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 60106.3us
I20260709 12:59:17.175195  1536 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:17.120795  4042 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:17.184042  1643 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 12:59:17.182425  4256 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:17.185148  1639 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:17.187230  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:17.193993  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:17.193681  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.195271  1646 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:17.205670  1638 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.179292  4030 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:17.218835  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:17.188849  4158 tablet_bootstrap.cc:492] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:59:17.222105  1718 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.186262  4161 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:17.226994  4042 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:17.227329  4273 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 12:59:17.227926  3758 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:17.234170  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.239210  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.241268  1712 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:17.244167  1641 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:17.188472  3940 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:59:17.248867  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.255501  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:17.255897  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 110016us
W20260709 12:59:17.259148  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 72016.9us
I20260709 12:59:17.260156  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:17.238797  4161 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.264874  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.270901  1645 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:17.271974  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.271416  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.224098  4251 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.274653  4251 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:17.234494  4179 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:17.331691  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.287492  1712 raft_consensus.cc:2393] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:17.318284  1641 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:17.359993  1719 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:17.362557  1639 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:17.257575  3758 raft_consensus.cc:697] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:17.366757  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.342723  4260 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:17.381978  1611 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:17.321431  3892 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:17.396744  1639 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:59:17.375572  1568 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:17.349016  4283 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:17.372771  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:17.382251  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:17.398002  1645 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:17.398164  1646 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:17.383361  4266 log.cc:927] Time spent T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.421s	user 0.002s	sys 0.000s
I20260709 12:59:17.384485  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.277387  4265 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:17.347034  3949 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:17.307665  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 47613.4us
W20260709 12:59:17.385260  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.401052  1641 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:17.401752  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:17.403174  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:17.403733  1536 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:17.404119  1641 raft_consensus.cc:2410] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:17.396229  4042 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:17.382226  4268 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:17.406409  4042 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:17.412854  4042 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.414177  4268 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.419479  4161 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:17.408375  3949 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:17.406471  4283 raft_consensus.cc:697] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:17.420691  3949 raft_consensus.cc:697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:17.421422  4283 consensus_queue.cc:237] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.421696  3949 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:17.407441  3892 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:17.412952  4264 log.cc:927] Time spent T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.503s	user 0.005s	sys 0.000s
I20260709 12:59:17.427587  4249 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:17.431365  4270 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:17.436244  1638 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:17.438512  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:17.445262  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.522557  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
W20260709 12:59:17.520730  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.519261  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:17.538146  1719 raft_consensus.cc:606] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:17.461534  1645 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
W20260709 12:59:17.449019  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 45369.9us
I20260709 12:59:17.538576  1719 raft_consensus.cc:614] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:17.539019  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:17.442234  1718 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:59:17.442044  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:17.473616  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:17.513161  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 230137us
I20260709 12:59:17.540304  1639 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:17.441957  1638 raft_consensus.cc:2368] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:59:17.499236  1565 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:17.539270  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:17.540807  1641 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:17.545555  1611 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:17.563313  1639 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
W20260709 12:59:17.545784  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:17.541396  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:17.565099  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.461009  4030 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:17.568533  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.568917  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.405830  4276 tablet_copy_client.cc:323] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 12:59:17.539036  1646 raft_consensus.cc:2410] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:17.572541  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.501756  4255 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.427640  3892 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:17.515350  3758 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.575220  1645 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:17.575706  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.576239  1611 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:17.592396  1639 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:17.581323  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:17.581741  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:17.605100  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.606158  1641 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:17.665776  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.665956  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.666923  1639 raft_consensus.cc:2376] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 2. Re-sending same reply.
I20260709 12:59:17.667416  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:17.669687  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:17.670463  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.672936  1720 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:17.674105  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.676187  1713 raft_consensus.cc:2393] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:17.680060  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.680886  1712 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
W20260709 12:59:17.689795  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 113678us
I20260709 12:59:17.689550  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.697507  1640 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:17.592340  4270 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:17.597846  4030 raft_consensus.cc:697] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:17.710799  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:17.712241  1717 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:17.724107  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.702442  4260 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:17.695618  4179 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:17.707974  4270 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.746335  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:17.764298  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:17.765573  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:17.731904  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:17.768674  1571 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:17.772509  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.773727  1719 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:17.775168  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.776492  1718 raft_consensus.cc:2410] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:59:17.779824  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 241162us
W20260709 12:59:17.781927  2405 leader_election.cc:336] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.174s (SENT)
I20260709 12:59:17.782382  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:17.782684  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:17.783327  1718 raft_consensus.cc:606] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:17.796885  1718 raft_consensus.cc:614] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:17.781785  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.744633  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:17.798034  1565 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:17.751394  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:17.790937  1571 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:17.591485  4255 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.808411  1716 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 12:59:17.742715  4286 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 12:59:17.741808  4289 log.cc:927] Time spent T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:59:17.745857  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:17.743486  4288 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:59:17.731146  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:17.739637  4284 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:17.877717  4030 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.878523  4284 raft_consensus.cc:697] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:17.879603  4284 consensus_queue.cc:237] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.881174  4042 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.815560  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:17.748332  4082 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.785583  4270 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:17.862601  1645 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:17.876168  4226 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:17.784881  4260 raft_consensus.cc:697] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:17.793450  4268 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:17.936756  4260 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:17.959162  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.966682  1647 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:59:17.941908  1644 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:17.985493  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:17.993628  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:17.940037  4255 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:18.170140  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.994434  1645 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:59:18.389902  2405 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.002s	sys 0.010s
I20260709 12:59:18.512692  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1636) took 1147 ms. Trace:
W20260709 12:59:18.083657  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.083503  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:18.020704  2448 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:18.279064  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:18.516819  2405 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.005s	sys 0.010s
I20260709 12:59:18.091189  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:18.518137  1647 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:18.277408  4161 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.569312  4161 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:18.572634  4161 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:18.573604  4161 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:18.180832  4300 log.cc:927] Time spent T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:59:18.089269  4268 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:18.336671  4309 log.cc:927] Time spent T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:59:18.617479  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:18.576769  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:18.513435  1645 rpcz_store.cc:276] 0709 12:59:17.365376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.935269 (+569893us) service_pool.cc:224] Handling call
0709 12:59:17.986197 (+ 50928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.512349 (+526152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.512606 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:18.514285  1641 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:18.621114  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1642) took 1189 ms. Trace:
I20260709 12:59:18.621611  1641 rpcz_store.cc:276] 0709 12:59:17.431730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.976043 (+544313us) service_pool.cc:224] Handling call
0709 12:59:18.621022 (+644979us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:18.120347  4281 log.cc:927] Time spent T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 12:59:18.601123  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 819211us
W20260709 12:59:18.623179  1565 consensus_meta.cc:287] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.797s	user 0.009s	sys 0.006s
I20260709 12:59:18.624373  1565 raft_consensus.cc:2410] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:59:18.040383  4301 log.cc:927] Time spent T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:59:18.628954  1647 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
W20260709 12:59:18.596853  1536 connection.cc:256] RPC call timeout handler was delayed by -1.6116707680000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
I20260709 12:59:18.631210  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:18.631356  1536 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.519s (SENT) [suppressed 27 similar messages]
I20260709 12:59:18.615162  4255 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.646920  1641 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:18.648038  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1641) took 1216 ms. Trace:
I20260709 12:59:18.648453  1641 rpcz_store.cc:276] 0709 12:59:17.431371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.639927 (+1208556us) service_pool.cc:224] Handling call
0709 12:59:18.640412 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.647626 (+  7214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.647950 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:18.650564  1641 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:59:18.651098  1641 pending_rounds.cc:85] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 2
I20260709 12:59:18.651409  1641 pending_rounds.cc:107] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:59:18.651887  1641 raft_consensus.cc:2889] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:18.652777  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:18.653697  1645 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 6: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:18.652997  4321 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:18.659910  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:18.656237  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.669538  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1643) took 1224 ms. Trace:
I20260709 12:59:18.669981  1641 rpcz_store.cc:276] 0709 12:59:17.432050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.649448 (+1217398us) service_pool.cc:224] Handling call
0709 12:59:18.649919 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.656011 (+  6092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.656394 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:18.673514  1645 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:18.681082  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1644) took 1248 ms. Trace:
I20260709 12:59:18.681707  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:18.681808  1645 rpcz_store.cc:276] 0709 12:59:17.432337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.655257 (+1222920us) service_pool.cc:224] Handling call
0709 12:59:18.673009 (+ 17752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.674617 (+  1608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.680978 (+  6361us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:18.684473  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet 17d2c95439be4ced872760603b0ae02b from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 12:59:18.685264  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet 17d2c95439be4ced872760603b0ae02b from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-17d2c95439be4ced872760603b0ae02b
I20260709 12:59:18.686748  1641 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 8: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:18.688516  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:18.627877  4268 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:18.659114  4042 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:18.625039  4161 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:18.703213  1645 raft_consensus.cc:1240] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:18.704419  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2335) took 1208 ms. Trace:
I20260709 12:59:18.704891  1645 rpcz_store.cc:276] 0709 12:59:17.496058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.687329 (+1191271us) service_pool.cc:224] Handling call
0709 12:59:18.702928 (+ 15599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.704042 (+  1114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.704334 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:18.693882  4297 log.cc:927] Time spent T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.955s	user 0.006s	sys 0.029s
I20260709 12:59:18.664901  4255 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:18.669111  4321 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:18.718437  1640 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:18.719138  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:18.720125  1647 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:18.720598  1645 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:18.718437  4042 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:18.722010  4042 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:18.717118  4119 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.724640  4042 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:18.724753  4119 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:18.725312  4042 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:18.728159  4119 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:18.729832  4270 consensus_meta.cc:287] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.803s	user 0.011s	sys 0.001s
I20260709 12:59:18.730432  4270 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:18.733409  4255 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:18.734686  1642 raft_consensus.cc:2368] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7.
I20260709 12:59:18.736332  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2334) took 1240 ms. Trace:
I20260709 12:59:18.736722  1642 rpcz_store.cc:276] 0709 12:59:17.495679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.576298 (+1080619us) service_pool.cc:224] Handling call
0709 12:59:18.736102 (+159804us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400394754. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:18.736266 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263149312}
I20260709 12:59:18.739500  1641 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:18.737880  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:18.740167  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2338) took 1230 ms. Trace:
I20260709 12:59:18.740447  1642 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:59:18.740568  1645 rpcz_store.cc:276] 0709 12:59:17.509604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.714881 (+1205277us) service_pool.cc:224] Handling call
0709 12:59:18.720268 (+  5387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.720940 (+   672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.740095 (+ 19155us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:18.745859  1567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1691) took 1838 ms (client timeout 1632 ms). Trace:
I20260709 12:59:18.718127  4323 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.749506  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 1432) took 1527 ms. Trace:
W20260709 12:59:18.738948  4082 consensus_meta.cc:287] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.814s	user 0.014s	sys 0.000s
W20260709 12:59:18.747797  1685 connection.cc:256] RPC call timeout handler was delayed by -1.0695810400000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 12:59:18.752136  1685 connection.cc:256] RPC call timeout handler was delayed by -1.0351876749999747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:59:18.746381  1567 rpcz_store.cc:269] 0709 12:59:16.904766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.904917 (+   151us) service_pool.cc:224] Handling call
0709 12:59:18.743010 (+1838093us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400015c54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:18.743191 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1436189056}
I20260709 12:59:18.750119  1640 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:18.749478  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:18.718218  4284 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:18.752393  1685 connection.cc:256] RPC call timeout handler was delayed by -1.0290810399999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
I20260709 12:59:18.750216  1717 rpcz_store.cc:276] 0709 12:59:17.219335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.219750 (+   415us) service_pool.cc:224] Handling call
0709 12:59:18.746964 (+1527214us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b5400300cd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:18.747104 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084072320}
I20260709 12:59:18.725826  4042 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:18.755548  4318 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:59:18.757434  4042 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:18.754165  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:18.751789  4323 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:18.761369  1642 raft_consensus.cc:2410] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:18.762946  4323 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:18.757578  4321 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:18.758196  4284 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:18.755069  4305 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.752897  1645 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:18.760063  1730 tablet_copy_source_session.cc:215] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:18.787175  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:18.788849  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:18.789584  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:18.789986  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.791812  1644 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:18.804281  1644 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:18.804571  4268 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:18.805665  1644 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:18.786250  4082 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:18.806509  4082 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:18.807109  4270 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:18.809322  4161 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:18.809450  4082 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:18.810657  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.813525  4284 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:18.797068  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1710) took 1323 ms. Trace:
I20260709 12:59:18.814280  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1634) took 1537 ms. Trace:
I20260709 12:59:18.814502  4084 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:18.814815  4116 consensus_queue.cc:1059] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:18.796038  4305 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:18.815701  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:18.816397  1638 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:18.816622  4116 raft_consensus.cc:3055] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:18.816996  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2333) took 1323 ms. Trace:
I20260709 12:59:18.817077  4116 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:18.817425  1638 rpcz_store.cc:276] 0709 12:59:17.494108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.815373 (+1321265us) service_pool.cc:224] Handling call
0709 12:59:18.816911 (+  1538us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:18.814715  1639 rpcz_store.cc:276] 0709 12:59:17.277015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.813289 (+1536274us) service_pool.cc:224] Handling call
0709 12:59:18.813663 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.813888 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:18.813914 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:18.813963 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:18.814009 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.814100 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:18.814215 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:18.764951  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2339) took 1247 ms. Trace:
W20260709 12:59:18.825071  1685 leader_election.cc:336] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.747s (SENT)
W20260709 12:59:18.825773  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.814296  1566 rpcz_store.cc:276] 0709 12:59:17.472518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.543576 (+ 71058us) service_pool.cc:224] Handling call
0709 12:59:17.544154 (+   578us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:17.547228 (+  3074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:17.547253 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:17.579907 (+ 32654us) log.cc:844] Serialized 506 byte log entry
0709 12:59:17.967923 (+388016us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:17.967982 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:17.968090 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:18.794410 (+826320us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b2400155288. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0319c4 00007f18ca02facb 00007f18ca1eadc9 00007f18ca1eaa55 00007f18ca1e9fb0 00007f18cce60488 00007f18cce60be8 00007f18cce38398 00007f18cce3376a 00007f18cce32bb6
0709 12:59:18.795489 (+  1079us) raft_consensus.cc:1685] finished
0709 12:59:18.795510 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:18.795760 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53441792,"thread_start_us":302117,"threads_started":1,"wal-append.queue_time_us":318040}
I20260709 12:59:18.825124  1647 rpcz_store.cc:276] 0709 12:59:17.517848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.720789 (+1202941us) service_pool.cc:224] Handling call
0709 12:59:18.748693 (+ 27904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.764533 (+ 15840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:18.764573 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:18.764629 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:18.764670 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.764747 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:18.764884 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1517,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127}
W20260709 12:59:18.826803  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:18.838560  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 207227us
W20260709 12:59:18.839339  1536 connection.cc:256] RPC call timeout handler was delayed by -1.4550707679999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 12:59:18.839779  1536 connection.cc:256] RPC call timeout handler was delayed by -1.3721263300000146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260709 12:59:18.840207  1536 connection.cc:256] RPC call timeout handler was delayed by -1.3119707679999806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
I20260709 12:59:18.842320  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:18.849256  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:18.850239  1567 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:18.854498  1685 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:18.814306  4252 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:18.859550  1536 connection.cc:256] RPC call timeout handler was delayed by -1.2273707680000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
W20260709 12:59:18.865368  1536 connection.cc:256] RPC call timeout handler was delayed by -1.2191263299999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
I20260709 12:59:18.863471  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2336) took 1367 ms. Trace:
I20260709 12:59:18.861112  1611 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:18.866205  1641 rpcz_store.cc:276] 0709 12:59:17.496326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.687619 (+1191293us) service_pool.cc:224] Handling call
0709 12:59:18.739284 (+ 51665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.741939 (+  2655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.863282 (+121343us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b5400394750. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:18.863403 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117924224}
I20260709 12:59:18.871013  1641 raft_consensus.cc:1240] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:59:18.842703  4317 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:59:18.872923  1536 connection.cc:256] RPC call timeout handler was delayed by -1.2165707679999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
I20260709 12:59:18.879859  1611 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:59:18.882388  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 245712us
I20260709 12:59:18.882771  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:18.884009  1641 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:18.883522  1566 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:18.886693  1645 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
W20260709 12:59:18.890535  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 99063us
I20260709 12:59:18.864946  4260 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:18.897189  1612 connection.cc:256] RPC call timeout handler was delayed by -2.17830225299997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 12:59:18.897847  1612 connection.cc:256] RPC call timeout handler was delayed by -2.1141143169999737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
W20260709 12:59:18.898432  1612 connection.cc:256] RPC call timeout handler was delayed by -1.9875022529999455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 12:59:18.898955  1612 connection.cc:256] RPC call timeout handler was delayed by -1.9470022529999369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 12:59:18.899078  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 63928.1us
W20260709 12:59:18.899822  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:18.899482  1612 connection.cc:256] RPC call timeout handler was delayed by -1.8324143169999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 12:59:18.877826  4270 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:18.901654  1536 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:18.896205  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:18.881965  4030 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:18.900641  1612 connection.cc:256] RPC call timeout handler was delayed by -1.7352143169999863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 12:59:18.903271  1612 connection.cc:256] RPC call timeout handler was delayed by -1.3269022529999575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2698s for a response
I20260709 12:59:18.905459  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:18.886723  4268 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:18.907244  4268 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.907673  4268 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:18.910231  4161 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:18.910925  4161 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:18.891467  4212 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.915880  4212 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:18.818367  4116 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:18.880824  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:18.919018  1612 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:18.878183  4262 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:18.933421  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.873936  4252 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:18.936955  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:18.902071  4270 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:18.958729  4270 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:18.959971  4212 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:18.901043  4260 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:18.962777  4276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d2c95439be4ced872760603b0ae02b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:18.963835  1639 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:59:18.923830  4030 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:18.975955  4030 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:18.976855  4333 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:18.954795  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:18.955852  1718 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:18.956600  4305 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:18.956841  1714 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:59:18.981782  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 62879.6us
I20260709 12:59:18.957065  4331 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:18.923076  4042 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.983961  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:18.986240  1721 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:18.957280  4084 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:18.989823  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:18.987524  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:18.991487  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:18.988627  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 83763.9us
I20260709 12:59:18.992268  1715 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:18.997603  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:18.998432  1721 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:19.000281  1714 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:19.001819  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:19.004956  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:19.005738  1567 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:19.014807  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:19.015591  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:19.018653  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:19.019961  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 122871us
I20260709 12:59:19.021826  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:19.022392  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:19.022675  1640 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:19.022863  4328 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.023029  1644 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:19.023505  4328 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.021816  1566 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:18.992473  4042 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.005954  4331 raft_consensus.cc:697] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:19.027959  1645 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:19.030479  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:19.037039  4084 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.037590  4110 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.038250  4098 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.038874  4098 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:19.039981  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:19.040130  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:19.038190  4110 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.041128  1611 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:19.038156  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:19.042160  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:19.042542  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:19.010465  4321 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:19.042925  1721 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:19.043213  1714 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:19.041369  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:19.045449  1720 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:19.049969  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:19.037770  4084 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.058781  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:19.047996  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:19.044818  4337 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 12:59:19.070312  1685 leader_election.cc:336] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.015s (SENT)
I20260709 12:59:19.071126  1685 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:19.077939  4342 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:19.078567  4342 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.078939  4342 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:19.027071  4331 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.082233  4323 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:19.084586  4323 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.085517  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:19.086997  4323 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:19.087148  1536 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:19.087687  4323 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:19.088099  4323 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:19.088480  4323 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:19.088529  1536 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:19.089715  4119 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:19.090143  4119 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:19.090559  4119 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:19.094321  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.095438  4161 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:19.096251  4328 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:19.052649  4333 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:19.053828  4334 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:19.105033  1714 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:19.059765  4262 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:59:19.115481  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 87166.7us
I20260709 12:59:19.120886  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:19.102669  4333 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:19.136693  4333 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:19.143038  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1640) took 1712 ms. Trace:
I20260709 12:59:19.143532  1646 rpcz_store.cc:276] 0709 12:59:17.430987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.020385 (+589398us) service_pool.cc:224] Handling call
0709 12:59:18.514860 (+494475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.716745 (+201885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:18.716768 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:18.716798 (+    30us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:18.716827 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.142777 (+425950us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540010e354. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:19.142826 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:19.142967 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463785856}
I20260709 12:59:19.154650  4270 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.156595  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:19.160552  4098 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:19.134202  4042 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:19.141709  4260 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:19.126120  4305 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:19.162786  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:19.163585  2438 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:19.163918  2444 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:19.165279  4084 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:19.166149  4334 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:19.166535  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:19.166985  4252 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:19.123031  4262 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:19.166590  4334 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:19.168274  4334 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:19.169003  4338 raft_consensus.cc:993] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 12:59:19.169378  4262 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:19.169505  4338 raft_consensus.cc:1081] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Signalling peer 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 12:59:19.169728  3999 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.165792  4226 consensus_queue.cc:1059] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:59:19.162873  4320 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:59:19.170622  4312 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:19.171268  4186 raft_consensus.cc:3055] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:19.171654  4186 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:19.171710  4312 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:19.172207  4312 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:19.135809  4348 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:19.131896  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:19.165385  4119 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:19.174855  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.117982  4323 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:19.185526  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 53800.2us
I20260709 12:59:19.166535  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:19.192937  1647 raft_consensus.cc:2376] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6. Re-sending same reply.
W20260709 12:59:19.187111  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.187489  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:19.194412  1646 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 12:59:19.189320  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:19.190618  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:19.195300  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 91541.1us
I20260709 12:59:19.195529  1645 raft_consensus.cc:2376] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7. Re-sending same reply.
I20260709 12:59:19.184013  4226 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:59:19.198705  1686 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:19.200042  1686 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:19.200770  4350 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:19.201285  4350 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.201658  4350 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.203405  4252 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:19.203926  4252 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:19.204334  4252 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:19.183111  4312 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:19.207134  4312 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:19.184352  4348 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:19.209077  4348 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:19.210533  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:19.211310  1640 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:19.216114  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:19.221534  2444 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:19.225548  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:19.226527  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:19.223049  1537 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:19.236053  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:19.195640  3892 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:19.230921  1644 raft_consensus.cc:2376] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8. Re-sending same reply.
I20260709 12:59:19.239430  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:19.241462  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:19.241353  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 177709us
W20260709 12:59:19.242342  1685 leader_election.cc:336] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.030s (SENT)
I20260709 12:59:19.242784  1685 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:19.249423  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:19.252110  1647 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:19.261147  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:19.242811  3892 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.268076  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:19.270427  1571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:46640
I20260709 12:59:19.260386  4084 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:19.271415  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:19.272020  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:19.183971  4186 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:19.244544  4331 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:19.287449  4352 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:19.221315  4262 raft_consensus.cc:2955] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 12:59:19.289849  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 47536.6us
I20260709 12:59:19.290918  1719 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:19.277679  1571 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.286203  4339 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
W20260709 12:59:19.293375  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.316565  1571 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:19.300310  2406 leader_election.cc:336] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.505s (SENT)
I20260709 12:59:19.253337  4284 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:59:19.286217  3892 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:19.320678  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 199926us
I20260709 12:59:19.340118  1536 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:19.341853  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:19.350488  4333 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.352077  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:19.354022  1612 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:19.355379  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:19.355963  1642 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:19.356564  4260 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:19.356629  4161 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:19.357450  4260 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:19.360693  1712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:19.361522  1712 raft_consensus.cc:606] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:19.361913  1712 raft_consensus.cc:614] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:19.363862   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:19.364596  4158 tablet_bootstrap.cc:492] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:59:19.368901  4323 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:19.306849  4186 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:19.299528  4331 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.307040  4258 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.301486  4084 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:19.384208  4268 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:19.373965  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.307368  4119 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:19.304625  4116 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:19.316660  4342 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.448550  4342 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:19.375396  4351 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:19.375790  3758 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:19.370309  4350 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.449576  3758 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:19.450166  3758 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.451507  4350 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:19.438119  4084 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:19.370299  4333 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:19.381619  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.461714  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 122163us
I20260709 12:59:19.370383   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:19.405612  4331 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:19.307786  2440 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:19.393590  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:19.402458  2405 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:19.460249  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 121800us
I20260709 12:59:19.460904  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:19.389542  2438 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:19.457463  4158 tablet_bootstrap.cc:492] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
W20260709 12:59:19.462975  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.484160  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 86791.5us
I20260709 12:59:19.486757  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:19.487502  1567 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 12:59:19.490283  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:19.466642  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:19.495225  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:19.495966  1567 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:19.502738  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:19.504689  4158 ts_tablet_manager.cc:1403] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 2.365s	user 0.038s	sys 0.017s
I20260709 12:59:19.465754  4351 raft_consensus.cc:697] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:19.506438  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:19.487385  4212 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:19.512300  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:19.512974  1569 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.515336  4212 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:19.511682  4252 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.518123  4212 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:19.520116  4252 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:19.461335  4258 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:19.522188  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:19.522981  1572 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:19.524936  4258 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:19.526227  1565 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:19.526604  4260 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.515467  4353 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:19.527177  4260 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.527818  4333 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:19.528625  4333 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.494201  4352 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:19.533291  4352 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:19.533737  4352 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:19.537199  3999 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:19.537778  3999 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.538211  3999 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:19.538671  4260 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:19.538581  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:19.539634  2443 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:19.543100  4255 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:19.541379  1537 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:19.546813  1718 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
W20260709 12:59:19.549600  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 83060us
I20260709 12:59:19.561800  4353 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:19.563829  4353 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.564327  4353 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:19.562661  4351 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:19.510766  4276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42646 (request call id 462) took 2454 ms. Trace:
I20260709 12:59:19.566560  4276 rpcz_store.cc:276] 0709 12:59:17.056627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.056805 (+   178us) service_pool.cc:224] Handling call
0709 12:59:17.136166 (+ 79361us) ts_tablet_manager.cc:934] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
0709 12:59:18.903041 (+1766875us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:19.203818 (+300777us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:19.203986 (+   168us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:19.501237 (+297251us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:19.501604 (+   367us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:19.501989 (+   385us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:19.506608 (+  4619us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":37406,"tablet-copy.queue_time_us":78200,"thread_start_us":171325,"threads_started":2}
I20260709 12:59:19.568075  4276 tablet_copy_client.cc:806] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:19.568200  4110 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:19.568753  4276 tablet_copy_client.cc:670] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:19.572322  3892 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.575239  4333 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:19.460182  4334 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.580813  1564 raft_consensus.cc:1240] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:19.581010  1572 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:19.587162  1686 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:19.583006  4334 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:19.590021  1685 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:19.592926  1567 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:19.594890  4110 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:19.595708  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:19.602993  1536 leader_election.cc:400] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5.
I20260709 12:59:19.603168  4268 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:19.604188  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:19.605229  4323 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:19.605453  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:19.605659  4323 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:19.606200  4323 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.606287  4350 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:19.606680  4116 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:19.607281  4116 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.607590  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:19.608148  4350 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:19.608572  4350 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:19.608935  4350 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:19.609468  4116 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:19.609838  4252 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:19.610433  4252 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:19.611469  4110 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:19.611446  4252 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.612646  4110 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.616739  4276 tablet_copy_client.cc:538] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:19.627970  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:19.629074  1564 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:19.620540  4255 consensus_queue.cc:1059] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:59:19.638856  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 48906us
I20260709 12:59:19.639408  1686 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:19.643445  1569 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:19.645839  1686 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:19.565440  4158 raft_consensus.cc:359] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 5 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.654636  4158 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:59:19.655511  4158 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:19.648375  4338 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:59:19.658959  3892 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:19.658573  1571 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:19.659260  4158 ts_tablet_manager.cc:1434] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.154s	user 0.004s	sys 0.007s
I20260709 12:59:19.660877  1571 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:19.661597  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-36627e4c13c74e8a9fd501f26c7aff53 received from {username='slave'} at 127.0.0.1:54412
I20260709 12:59:19.662087  4283 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:19.648684  4342 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:19.662743  4283 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:19.663277  4283 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.662855  4342 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:19.664223  4342 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.662204  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-36627e4c13c74e8a9fd501f26c7aff53 on tablet 36627e4c13c74e8a9fd501f26c7aff53 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:19.666421  4328 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:19.668219  1566 raft_consensus.cc:1240] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:19.669133  2437 raft_consensus.cc:2410] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:19.670945  4098 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:19.648779  4082 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:19.672334  4082 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.672709  4082 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.673486  4084 raft_consensus.cc:3055] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:19.674088  4084 raft_consensus.cc:740] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:19.674994  4084 consensus_queue.cc:260] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.676179  4084 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:19.676963  4283 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.680248  4283 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:19.662287  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 56912.9us
I20260709 12:59:19.687427  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:19.689363  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 43627us
W20260709 12:59:19.694416  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 44281.5us
I20260709 12:59:19.656993  4212 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:19.709677  1685 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:59:19.713761  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.722502  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:19.723644  1566 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:19.703436  4098 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:19.580813  4352 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:19.712821  4334 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:19.694074  3999 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:19.751616  3999 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:19.725684  4268 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.745414  1712 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:19.747138  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:19.754900  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:19.734624  4252 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:19.762874  4252 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:19.763295  4252 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.765184  4342 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.766383  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:19.768270  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:19.768877  1638 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:19.770869  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:19.761359  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:19.715121  4305 consensus_queue.cc:1059] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:59:19.773275  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:19.774319  4258 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:19.761539  4212 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:19.762398  4334 raft_consensus.cc:2764] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:59:19.775918  4352 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:19.777729  4348 consensus_meta.cc:287] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.568s	user 0.021s	sys 0.005s
I20260709 12:59:19.778201  4348 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.779304  1570 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:19.779989  3758 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:19.781383  4348 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:19.780121  4334 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:19.782480  4334 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:19.782867  4334 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.792435  4082 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.794456  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:19.798753  4362 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:59:19.797618  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.796123  4342 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:19.800220  4344 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:59:19.800628  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:19.804694  4276 tablet_bootstrap.cc:492] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:59:19.805282  4258 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:19.805761  4258 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:19.806188  4258 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:19.809286  1536 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:19.741709  2438 raft_consensus.cc:1240] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:19.842386  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:19.842696  2406 leader_election.cc:336] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.003s (SENT)
W20260709 12:59:19.813333  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 55140.6us
I20260709 12:59:19.843222  1569 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.818023  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:19.843321  2406 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:19.814781  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:19.817204  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:19.847155  1571 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:19.831117  1566 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:19.805282  4348 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:19.848613  4212 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:19.853633  4363 log.cc:927] Time spent T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:59:19.853454  4270 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:19.857342  4366 log.cc:927] Time spent T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:59:19.860117  1569 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:19.861526  1686 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:19.862821  3758 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:19.863269  4305 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:19.863862  4305 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:19.863682  4353 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:19.868435  4353 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:19.868188  4305 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.842588  4084 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:19.884032  4350 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:19.885594  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 70401.6us
I20260709 12:59:19.887327  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:19.888803  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:19.889564  2440 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:19.890444  4323 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.891706  1563 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:19.893047  4323 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:19.831022  1638 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 12:59:19.834919  1536 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:19.908206  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:19.886674  3892 consensus_queue.cc:1059] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:59:19.806187  4082 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:19.920140  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:19.922564  2405 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:19.923064  1569 raft_consensus.cc:2368] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9.
W20260709 12:59:19.923552  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 88844.8us
I20260709 12:59:19.925174  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:19.892921  1467 catalog_manager.cc:5697] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 5 to 6, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:19.936106  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 92450.6us
I20260709 12:59:19.980988  1571 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 12:59:19.877485  4331 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:19.812182  4283 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:19.928671  3758 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:19.812446  4268 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:19.944980  4360 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:19.994124  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 69046.4us
I20260709 12:59:19.996841  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:19.921706  4305 consensus_queue.cc:1059] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:59:19.997689  1638 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:19.978012  4284 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:19.995518  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:20.012439  1536 leader_election.cc:400] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7.
I20260709 12:59:20.002597  1611 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:20.014196  1686 leader_election.cc:400] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9.
I20260709 12:59:20.003939  1467 catalog_manager.cc:5697] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 3 to 4, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
W20260709 12:59:20.008157  1469 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58250 (request call id 195) took 13168 ms (client timeout 15000 ms). Trace:
I20260709 12:59:19.986908  4338 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:20.014592  1686 leader_election.cc:403] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:59:20.025923  1611 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:20.032547  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:20.033409  1639 raft_consensus.cc:2376] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7. Re-sending same reply.
I20260709 12:59:20.043867  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:20.044770  1646 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 2.
I20260709 12:59:20.044092  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:20.046151  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:20.046155  1645 raft_consensus.cc:2410] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:20.050436  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:20.051783  1641 raft_consensus.cc:2393] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 7: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:20.055285  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:20.055346  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:20.056388  1638 raft_consensus.cc:2376] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7. Re-sending same reply.
I20260709 12:59:20.057325  1646 raft_consensus.cc:2393] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 7: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:20.059609  1611 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:20.061693  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:20.001276  4270 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.063846  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:20.069389  1638 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:20.069622  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:20.071188  1536 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:20.072031  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:20.072701  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:20.018850  4260 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:20.073480  1641 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:20.018492  3758 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:20.075829  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:20.076383  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:20.079109  1640 raft_consensus.cc:2376] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7. Re-sending same reply.
I20260709 12:59:20.029402  4360 raft_consensus.cc:697] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 12:59:20.016462  1469 rpcz_store.cc:269] 0709 12:59:06.863083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:06.863250 (+   167us) service_pool.cc:224] Handling call
0709 12:59:20.008052 (+13144802us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:16.780034 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:16.780893 (+   859us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:16.780970 (+    77us) write_op.cc:435] Acquired schema lock
0709 12:59:16.780987 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:16.839448 (+ 58461us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:16.839540 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:16.839576 (+    36us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:59:16.840826 (+  1250us) tablet.cc:701] Row locks acquired
0709 12:59:16.840882 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:59:16.841101 (+   219us) write_op.cc:270] Start()
0709 12:59:16.841285 (+   184us) write_op.cc:276] Timestamp: P: 1783601956841014 usec, L: 0
0709 12:59:16.841307 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:59:16.902771 (+ 61464us) log.cc:844] Serialized 5965 byte log entry
0709 12:59:17.751739 (+848968us) op_driver.cc:464] REPLICATION: finished
0709 12:59:18.452979 (+701240us) write_op.cc:301] APPLY: starting
0709 12:59:18.459510 (+  6531us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:18.511469 (+ 51959us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:18.511693 (+   224us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:18.599113 (+ 87420us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:18.599486 (+   373us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:59:18.599540 (+    54us) write_op.cc:312] APPLY: finished
0709 12:59:18.600057 (+   517us) log.cc:844] Serialized 107 byte log entry
0709 12:59:18.743273 (+143216us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:18.753226 (+  9953us) write_op.cc:454] Released schema lock
0709 12:59:18.779591 (+ 26365us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:18.814373 (+ 34782us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:18.814408 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":628290,"apply.run_cpu_time_us":26087,"apply.run_wall_time_us":388831,"num_ops":15,"prepare.queue_time_us":458230,"prepare.run_cpu_time_us":15820,"prepare.run_wall_time_us":322553,"raft.queue_time_us":293173,"raft.run_cpu_time_us":13320,"raft.run_wall_time_us":264163,"replication_time_us":889704,"spinlock_wait_cycles":24320,"thread_start_us":985601,"threads_started":5,"wal-append.queue_time_us":359750,"wal-append.run_cpu_time_us":22583,"wal-append.run_wall_time_us":2395946}]]}
I20260709 12:59:20.031442  4350 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:20.088140  1611 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:20.015863  4352 consensus_queue.cc:1059] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:59:20.067410  4255 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:20.067721  4338 raft_consensus.cc:697] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:20.068073  4321 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:20.075165  4333 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:20.032747  4348 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:59:20.082369  3758 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.108443  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:20.109341  1641 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:20.110700  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:20.068849  4283 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:20.115429  1569 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:20.118024  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:20.079891  4119 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:59:20.091620  4305 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:20.113826  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:20.111482  1646 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:20.077153  4270 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.110535  4333 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.111953  3758 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:20.109498  4353 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:20.133258  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:20.101786  4098 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:20.136067  2440 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:20.142128  1537 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:20.090442  4252 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.121780  4260 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:20.152769  1639 raft_consensus.cc:2376] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4. Re-sending same reply.
I20260709 12:59:20.139750  1467 catalog_manager.cc:5697] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 3 to 4, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:20.119562  4321 raft_consensus.cc:697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:20.158525  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:20.158783  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:20.159611  1644 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:20.138195  4333 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:20.137867  4353 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:20.195436  1641 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:20.149832  4284 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:20.203387  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 49896.3us
I20260709 12:59:20.154459  4260 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:20.158998  4305 raft_consensus.cc:697] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:20.230881  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 159774us
I20260709 12:59:20.205312  4353 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.236379  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:20.133639  4360 consensus_queue.cc:237] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:20.237643  4252 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:20.227455  4260 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:20.242678  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:20.243464  1647 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.245486  4116 raft_consensus.cc:3055] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:20.246002  4116 raft_consensus.cc:740] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:20.246943  4116 consensus_queue.cc:260] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:20.247259  4353 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.248484  4116 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:20.223203  4363 log.cc:927] Time spent T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:59:20.190749  4262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:54408 (request call id 10) took 3889 ms. Trace:
W20260709 12:59:20.258937  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 170906us
I20260709 12:59:20.231832  3758 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.232470  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:20.145071  4334 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.262338  1536 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:20.224542  4331 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:20.264745  4283 consensus_queue.cc:1059] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:20.230435  4284 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:20.277056  1646 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:20.249867  4353 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:20.276321  3758 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:20.301803  1646 raft_consensus.cc:1240] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: [7.7-8.8]
I20260709 12:59:20.297966  1647 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:20.307108  1570 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:20.310776  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.298085  1643 raft_consensus.cc:2955] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:20.179153  4338 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:20.323043  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 60833.1us
I20260709 12:59:20.293663  4119 consensus_queue.cc:1059] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 12:59:20.340384  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.342032  1571 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:20.344265  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:20.345543  1569 raft_consensus.cc:2393] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:20.346112  3758 consensus_queue.cc:1059] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:20.347770  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:20.351099  1639 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:20.322883  4331 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:20.294333  4371 consensus_queue.cc:1059] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:59:20.353854  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:20.354919  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:20.356829  3758 raft_consensus.cc:3055] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:20.357770  1564 raft_consensus.cc:2368] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 10. Current term is 11.
I20260709 12:59:20.360172  3758 raft_consensus.cc:740] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:20.269047  4098 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.364605  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:20.370464  1569 raft_consensus.cc:2368] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 6. Current term is 7.
I20260709 12:59:20.340337  4353 raft_consensus.cc:3055] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:20.371873  4353 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:20.371918  4284 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:20.372900  4353 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.259053  4262 rpcz_store.cc:276] 0709 12:59:16.265927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.272750 (+  6823us) service_pool.cc:224] Handling call
0709 12:59:16.346748 (+ 73998us) log.cc:844] Serialized 506 byte log entry
0709 12:59:20.153485 (+3806737us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5202,"raft.queue_time_us":12770,"raft.run_cpu_time_us":2522,"raft.run_wall_time_us":37925,"thread_start_us":94812,"threads_started":1}
I20260709 12:59:20.374226  4331 raft_consensus.cc:697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 12:59:20.375308  4372 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:59:20.375404  4331 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:20.376929  4375 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:59:20.378306  4374 raft_consensus.cc:3055] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:20.378870  4374 raft_consensus.cc:740] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:20.384820  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:20.353250  1642 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:20.361465  3758 consensus_queue.cc:260] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.386807  3758 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:20.391799  1563 raft_consensus.cc:2393] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:59:20.363583  4258 consensus_meta.cc:287] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.004s
I20260709 12:59:20.395097  1566 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:20.360239  4369 raft_consensus.cc:3055] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:20.403750  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:20.414117  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:20.416572  1569 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:20.321640  4321 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.380129  4374 consensus_queue.cc:260] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:20.445209  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:20.446314  1715 raft_consensus.cc:1275] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:20.451411  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:20.453229  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:20.455186  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:20.456720  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:20.408200  4270 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:20.403815  4369 raft_consensus.cc:740] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:20.424506  4353 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:20.425539  4378 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:20.476475  1569 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:20.355166  4305 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:20.414765  4258 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.533756  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:20.647092  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet cbe76ebe20be4546bed4f95e2ee090bd: Illegal state: Replica 66344ad7cd844754b2c81cc689a709b0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:20.639838  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:20.640396  1566 raft_consensus.cc:1240] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:20.650343  4369 consensus_queue.cc:260] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.499784  4378 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.679860  1644 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:20.581321   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:20.684557  1568 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:59:20.555526  1565 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:20.683429  4382 log.cc:927] Time spent T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.265s	user 0.002s	sys 0.000s
I20260709 12:59:20.699184  1715 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:20.704188  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:20.704967  1715 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:20.705695  1536 connection.cc:256] RPC call timeout handler was delayed by -1.2555629120000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 12:59:20.706187  1536 connection.cc:256] RPC call timeout handler was delayed by -1.2051629120000484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 12:59:20.706489  1536 connection.cc:256] RPC call timeout handler was delayed by -1.2015629120000426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 12:59:20.706784  1536 connection.cc:256] RPC call timeout handler was delayed by -1.0116629120000198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 12:59:20.699180  4276 tablet_bootstrap.cc:700] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Time spent opening tablet: real 0.226s	user 0.003s	sys 0.000s
I20260709 12:59:20.710316  4378 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:20.711817  4255 consensus_meta.cc:287] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.003s
I20260709 12:59:20.712839  4268 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:20.715476  4110 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.742700  4110 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.745339  4110 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:20.747107  4260 consensus_meta.cc:287] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.001s
I20260709 12:59:20.747785  4260 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.715253  4392 consensus_queue.cc:1059] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:20.734825  4258 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:20.724723  4255 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9.
I20260709 12:59:20.755517  3999 raft_consensus.cc:3055] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:20.708446  4323 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.775619  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:20.756116  4333 consensus_meta.cc:287] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 12:59:20.767814  1715 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
W20260709 12:59:20.789714  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 97963.5us
I20260709 12:59:20.756294  4350 raft_consensus.cc:3055] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:20.756498  4260 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:20.757157  3999 raft_consensus.cc:740] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:20.811110  1571 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:59:20.824188  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.791703  4255 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.836869  1570 raft_consensus.cc:1240] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:20.836091  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:20.834182  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 58730.4us
I20260709 12:59:20.838800  4331 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:20.840515  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:20.796126  4350 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:20.844836  1565 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:20.785866  4323 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.847678  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:20.792201  4333 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.869320  1645 raft_consensus.cc:2393] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 7: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:20.850358  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:20.849639  4379 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:20.833318  4082 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:20.870748  4082 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.871830  4226 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.872373  4226 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:20.872965  4082 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:20.842828  4255 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:20.873559  4116 consensus_meta.cc:287] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.006s
I20260709 12:59:20.874222  4357 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:20.874796  4357 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:20.875911  4333 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:20.877015  4357 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:20.880100  4255 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:20.853832  3999 consensus_queue.cc:260] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.881184  3999 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.850399  4284 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:20.882467  4284 raft_consensus.cc:697] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:20.883489  4284 consensus_queue.cc:237] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.884490  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:20.856460  4323 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:20.858404  4258 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:20.859061  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 703894us
I20260709 12:59:20.859412  4212 consensus_queue.cc:1059] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:20.904294  4212 raft_consensus.cc:3055] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:20.904815  4212 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:20.866214  4350 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:20.866228  4312 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:20.894093  1685 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:59:20.907864  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.908306  1685 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:20.911150  1685 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:20.912696  1685 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:20.913055  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:20.914587  1685 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:59:20.915186  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 62837.2us
I20260709 12:59:20.918708  1685 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:20.919082  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:20.920095  1685 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:20.904981  4334 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:20.917143  4323 raft_consensus.cc:2764] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:20.917649  4312 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:20.905912  4212 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:20.916121  4370 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:20.916301  4328 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:20.923151  4082 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:20.916836  4116 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:20.922644  4119 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
W20260709 12:59:21.005157  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 85143.5us
I20260709 12:59:21.032110  1685 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:21.006702  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 163930us
W20260709 12:59:21.007031  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 88025.1us
I20260709 12:59:20.917690  4392 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:20.917852  1712 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 12:59:21.018350  4356 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:59:21.057472  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 190015us
I20260709 12:59:21.011525  4331 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:21.058712  2406 leader_election.cc:400] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 6. Current term is 7.
I20260709 12:59:21.022584  1713 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:21.059681  1685 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:21.052855  4348 raft_consensus.cc:3055] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:21.051613  4226 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:21.061769  4400 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.061961  4348 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:21.027598  4328 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.062685  4328 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.062479  4400 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:21.063138  4348 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.064316  4348 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:21.065474  4400 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:21.020893  4098 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:21.060122  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:21.066538  1713 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:21.066358  4098 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:21.068584  4353 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:21.019889  4405 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:21.071079  4393 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:21.071636  4393 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.072006  4393 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:21.073541  4407 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:59:21.075379  4405 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.071084  4353 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.075830  4405 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:21.077520  4353 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:21.079476  4312 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:21.079787  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.081519  1685 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:21.083791  1685 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:21.070609  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.071969  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:21.085063  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:21.021700  4384 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:21.086112  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 178224us
I20260709 12:59:21.086812  1536 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:21.021767  4370 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.025030  4350 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:21.088814  4379 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:59:21.124140  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:21.116040  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:21.087848  4116 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:21.060672  4305 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:21.131296  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:21.058694  4082 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:21.129498  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:21.128614  1713 raft_consensus.cc:2410] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:21.134199  1685 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:21.023908  4339 consensus_queue.cc:1059] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 12:59:21.118767  4312 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:21.138388  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.120612  4400 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.119761  4186 consensus_queue.cc:1059] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:59:21.119904  4370 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:21.139279  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:21.161582  1643 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:21.139835  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.139920  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:21.140517  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.163602  1565 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:21.141124  1638 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:21.142033  1571 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:21.142882  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.143467  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:21.144163  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.165429  1647 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.165771  1567 raft_consensus.cc:2410] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:21.157238  1563 raft_consensus.cc:2393] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:21.146245  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:21.143788  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.157452  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.166731  1639 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:21.167045  1713 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:59:21.144541  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.146435  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.144817  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:21.143227  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:21.080710  4393 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.133960  4353 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:21.172951  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:21.173527  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.174580  1567 raft_consensus.cc:2393] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:21.174821  1640 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:21.174855  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.175552  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:21.168772  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:21.145609  4348 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:21.139060  4398 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:21.178217  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:21.179441  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.180166  1571 raft_consensus.cc:2393] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:21.180343  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.180883  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:21.181136  1570 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:21.182473  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:21.183139  1643 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:21.183820  4405 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.184613  1718 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:21.186254  1564 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:21.186640  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.185973  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.191303  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:21.195814  1647 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:21.195827  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.197986  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.156401  4116 raft_consensus.cc:697] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:21.202400  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:21.203508  1644 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:21.205857  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.206437  1571 raft_consensus.cc:2410] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 12:59:21.206838  1564 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:21.207692  1639 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:21.208784  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.202490  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.210634  1721 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:21.211834  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.213474  1565 raft_consensus.cc:2410] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:21.173206  4255 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:21.216354  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:21.218150  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:21.218540  1646 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.218802  1640 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:21.221046  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:21.216781  1643 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:21.224220  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.226482  4410 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:21.215234  4353 raft_consensus.cc:697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:21.208204  4405 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:21.202842  4348 raft_consensus.cc:697] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:21.267623  4348 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.268859  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.186836  4333 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:59:21.162078  4400 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.272332  4116 consensus_queue.cc:237] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.272923  4400 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:21.229480  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.193663  4357 consensus_queue.cc:1059] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:59:21.147063  4082 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.261929  1565 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:21.264925  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:21.280260  1639 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:21.274957  1564 raft_consensus.cc:2410] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:21.275085  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.289482  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.225795  4255 raft_consensus.cc:697] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:21.299090  1640 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
W20260709 12:59:21.299948  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 142048us
I20260709 12:59:21.235491  4098 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:21.239362  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:21.290730  4409 raft_consensus.cc:3055] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:21.318655  1639 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:21.297834  1638 raft_consensus.cc:1275] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:21.302982  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:21.314885  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.303561  1643 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.300436  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:21.303213  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.313287  1646 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:21.316143  1644 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:21.302556  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.313326  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:21.324036  1572 raft_consensus.cc:2393] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:21.324506  1571 raft_consensus.cc:2393] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:21.334263  1644 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 12:59:21.334412  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.341867  1611 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:21.265913  4328 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.355950  1640 raft_consensus.cc:1240] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:59:21.359601  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.364665  1644 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:21.317076  4409 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:21.394858  1717 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:21.401072  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.402338  1564 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:21.381376  4284 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.384809  4333 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:21.507627  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:21.514314  1717 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:21.518321  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.536674  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.539992  1718 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:21.389636  4400 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:21.548677  1721 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:21.536002  1643 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:21.519584  4333 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:21.561532  4333 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.563361  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:21.517309  4393 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:21.550375  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:21.574788  4414 log.cc:927] Time spent T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
W20260709 12:59:21.578990  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 237210us
I20260709 12:59:21.580413  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:21.581471  1611 leader_election.cc:336] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Timed out: RequestConsensusVote RPC to 127.0.107.195:43271 timed out after 1.802s (SENT)
I20260709 12:59:21.507181  4370 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.468254  4255 consensus_queue.cc:237] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.562938  4350 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.519295  4284 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.612668  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:21.613651  1717 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:21.623086  4328 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:21.542246  4353 consensus_queue.cc:237] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.556586  4400 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:21.632798  1564 raft_consensus.cc:2368] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 12:59:21.633894  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.636243  1721 raft_consensus.cc:2393] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:21.641314  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:21.649334  1638 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:21.652684  1645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1678) took 1518 ms (client timeout 1666 ms). Trace:
W20260709 12:59:21.653312  1645 rpcz_store.cc:269] 0709 12:59:20.130826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.132871 (+  2045us) service_pool.cc:224] Handling call
0709 12:59:21.648778 (+1515907us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b5400219b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:21.648988 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1690018048}
I20260709 12:59:21.656165  1720 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:21.553550  4409 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:21.656761  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:21.659597  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.661319  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:21.649299  4276 log.cc:927] Time spent T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.072s	user 0.004s	sys 0.000s
I20260709 12:59:21.663125  1564 raft_consensus.cc:2393] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:21.615233  4350 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.675732  4284 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:21.681421  4400 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:21.665953  4422 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:21.702553  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.709663  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.692080  4431 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:21.693434  4422 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:21.718181  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.718442  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.723656  1569 raft_consensus.cc:2393] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:21.730436  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1682) took 1587 ms. Trace:
I20260709 12:59:21.731021  1641 rpcz_store.cc:276] 0709 12:59:20.142886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.269248 (+126362us) service_pool.cc:224] Handling call
0709 12:59:20.341123 (+ 71875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:20.486728 (+145605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:20.486785 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:20.581632 (+ 94847us) log.cc:844] Serialized 26 byte log entry
0709 12:59:20.727090 (+145458us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:20.805117 (+ 78027us) log.cc:844] Serialized 14 byte log entry
0709 12:59:20.805508 (+   391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.805591 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:20.805631 (+    40us) raft_consensus.cc:1685] finished
0709 12:59:20.805642 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:21.730146 (+924504us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b5400430650. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:21.730351 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12780,"prepare.queue_time_us":133050,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":66676,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":34851,"spinlock_wait_cycles":164334336,"thread_start_us":292689,"threads_started":3,"wal-append.queue_time_us":89452}
I20260709 12:59:21.732352  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.735529  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.736528  1570 raft_consensus.cc:2368] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6.
I20260709 12:59:21.716885  4431 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:21.745908  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.746170  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.749617  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.751343  1570 raft_consensus.cc:2393] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:21.752363  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.753237  1570 raft_consensus.cc:2368] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7.
I20260709 12:59:21.753973  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.766685  1721 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:21.698268  4348 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.770193  1570 raft_consensus.cc:3055] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:21.770932  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.772528  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.772759  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:21.775056  4350 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:21.777798  4276 tablet_bootstrap.cc:492] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:59:21.778604  1646 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:21.751035  4383 raft_consensus.cc:3055] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:21.784497  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.788784  1564 raft_consensus.cc:2410] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:21.787364  4339 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.789386  1611 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:21.789821  4339 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:21.773265  1570 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:21.793323  4339 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:21.787360  4383 raft_consensus.cc:740] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:21.789594  4400 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:21.794486  4400 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:21.794708  4383 consensus_queue.cc:260] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.796126  4383 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:21.796985  4400 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:21.797653  4400 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:21.793010  1570 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.751259  4353 raft_consensus.cc:476] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 12:59:21.799696  1570 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.750155  4422 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:21.803383  4370 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:21.815481  4384 consensus_meta.cc:287] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.708s	user 0.014s	sys 0.000s
I20260709 12:59:21.816259  4384 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:21.825373  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:21.827412  4312 consensus_meta.cc:287] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.005s
I20260709 12:59:21.828097  4312 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:21.829794  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.831375  4356 raft_consensus.cc:3055] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:21.839623  4356 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:21.840801  4356 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:21.842648  4356 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:21.785400  4333 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.801465  4400 raft_consensus.cc:697] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:21.852290  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:21.853302  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2395) took 1403 ms. Trace:
I20260709 12:59:21.853691  1715 rpcz_store.cc:276] 0709 12:59:20.450539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.851973 (+1401434us) service_pool.cc:224] Handling call
0709 12:59:21.853227 (+  1254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:21.855149  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.855835  1715 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
W20260709 12:59:21.856732  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 992240us
I20260709 12:59:21.838425  4276 tablet_bootstrap.cc:492] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 12:59:21.853754  4400 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.836652  4360 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:21.856986  1715 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:21.859593  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.873556  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:21.860221  2405 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:21.874656  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2404) took 1191 ms. Trace:
I20260709 12:59:21.863621  1714 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:21.865252  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.875910  1571 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:21.899561  4312 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:21.900207  4312 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.900588  4312 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:21.902997  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:21.903704  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2398) took 1452 ms. Trace:
I20260709 12:59:21.875070  1718 rpcz_store.cc:276] 0709 12:59:20.683068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.198678 (+515610us) service_pool.cc:224] Handling call
0709 12:59:21.874490 (+675812us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b54002dc154. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:21.874594 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188105472}
I20260709 12:59:21.904148  1715 rpcz_store.cc:276] 0709 12:59:20.451515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.856482 (+1404967us) service_pool.cc:224] Handling call
0709 12:59:21.856818 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:21.872355 (+ 15537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.903619 (+ 31264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:21.906100  1564 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:21.908285  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.910033  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:21.801838  4348 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:21.859195  3999 consensus_queue.cc:1175] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a4be9cc90aca4dd4ad7db103062a7208" responder_term: 4 status { last_received { term: 4 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 4 index: 4 } }
I20260709 12:59:21.911756  1715 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:21.911010  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:21.913722  1712 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54412 (request call id 293) took 1545 ms (client timeout 1765 ms). Trace:
I20260709 12:59:21.918016  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1463) took 1032 ms. Trace:
I20260709 12:59:21.910646  4084 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:21.919095  4084 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:21.902498  4305 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.902480  4360 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:21.922524  4305 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:21.924705  4360 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:21.931142  4333 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:21.931914  1718 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:21.932631  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1459) took 1147 ms. Trace:
I20260709 12:59:21.932957  1718 rpcz_store.cc:276] 0709 12:59:20.786198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.907768 (+1121570us) service_pool.cc:224] Handling call
0709 12:59:21.931504 (+ 23736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:21.932344 (+   840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.932562 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:21.933630  4431 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:21.913516  4276 ts_tablet_manager.cc:1403] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 2.109s	user 0.021s	sys 0.059s
I20260709 12:59:21.935775  1718 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:21.937057  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1465) took 1050 ms. Trace:
W20260709 12:59:21.917620  1712 rpcz_store.cc:269] 0709 12:59:20.368701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.368927 (+   226us) service_pool.cc:224] Handling call
0709 12:59:21.913489 (+1544562us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b540025b7d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:21.913651 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062884224}
I20260709 12:59:21.937505  1718 rpcz_store.cc:276] 0709 12:59:20.886329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.933785 (+1047456us) service_pool.cc:224] Handling call
0709 12:59:21.935511 (+  1726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:21.936758 (+  1247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.936983 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:21.939687  1568 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:21.924793  4305 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:21.902851  4392 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:21.942402  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 298) took 1040 ms. Trace:
I20260709 12:59:21.952211  1718 rpcz_store.cc:276] 0709 12:59:20.902492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.938570 (+1036078us) service_pool.cc:224] Handling call
0709 12:59:21.941885 (+  3315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:21.942097 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:21.942123 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:21.942166 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:21.942197 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.942250 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:21.942347 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:21.953934  4392 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:21.943213  1571 raft_consensus.cc:1275] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:59:21.939227  4212 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:21.956722  4392 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:21.963948  4409 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:21.915369  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.965322  4392 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.965979  4392 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.968298  4392 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:21.969677  4392 consensus_queue.cc:1059] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:21.971984  4398 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:21.972275  4419 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:21.973182  1571 pending_rounds.cc:85] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 2
I20260709 12:59:21.973503  1571 pending_rounds.cc:107] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:59:21.973765  1571 raft_consensus.cc:2889] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:21.973977  4419 raft_consensus.cc:3055] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:21.974470  4419 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:21.974766  4418 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.350s	user 0.000s	sys 0.004s
I20260709 12:59:21.945765  1568 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:59:21.976734  1568 pending_rounds.cc:85] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 3
I20260709 12:59:21.977021  1568 pending_rounds.cc:107] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:59:21.977275  1568 raft_consensus.cc:2889] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:21.942760  1715 rpcz_store.cc:276] 0709 12:59:20.885753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.911273 (+1025520us) service_pool.cc:224] Handling call
0709 12:59:21.911572 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:21.917692 (+  6120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.917952 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:21.975703  1566 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:21.980587  1715 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:21.980638  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.981966  1712 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:21.911149  4432 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:21.983907  1564 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:59:21.987680  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 165399us
I20260709 12:59:21.975394  4419 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:21.992794  4419 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.993316  4431 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:21.996378  4431 consensus_queue.cc:1059] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:21.997246  4431 consensus_queue.cc:1243] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:59:21.997830  4431 raft_consensus.cc:3055] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:21.985252  4360 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:59:21.999735  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 1468) took 1112 ms. Trace:
I20260709 12:59:22.000195  1714 rpcz_store.cc:276] 0709 12:59:20.887130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.084735 (+197605us) service_pool.cc:224] Handling call
0709 12:59:21.999507 (+914772us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54003ab454. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:21.999664 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1684567424}
I20260709 12:59:22.001499  1717 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:21.941234  4084 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:22.009147  4084 consensus_queue.cc:1059] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
W20260709 12:59:22.010562  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.036630  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:22.033893  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 1474) took 1145 ms. Trace:
I20260709 12:59:22.029418  1714 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:22.028332  4353 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.047859  4353 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.042725  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:22.050582  1712 raft_consensus.cc:2393] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:22.051630  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:22.052246  1712 raft_consensus.cc:2376] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7. Re-sending same reply.
I20260709 12:59:22.053068  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2388) took 1625 ms. Trace:
I20260709 12:59:22.053231  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:22.047163  1721 rpcz_store.cc:276] 0709 12:59:20.888748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.644963 (+756215us) service_pool.cc:224] Handling call
0709 12:59:22.033665 (+388702us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b54001a9d54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:22.033819 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79432960}
I20260709 12:59:22.056202  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 1473) took 1167 ms. Trace:
I20260709 12:59:21.985913  4398 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:59:22.056615  1713 rpcz_store.cc:276] 0709 12:59:20.888498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.190490 (+301992us) service_pool.cc:224] Handling call
0709 12:59:22.056004 (+865514us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54002dc654. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:22.056140 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1162061568}
I20260709 12:59:22.056633  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:22.057928  1721 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:22.057824  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:21.997658  4276 raft_consensus.cc:359] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 4 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.029384  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:22.046681  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.047462  1563 raft_consensus.cc:2393] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:22.056897  4353 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:22.061311  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:22.053539  1720 rpcz_store.cc:276] 0709 12:59:20.427453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.427692 (+   239us) service_pool.cc:224] Handling call
0709 12:59:21.637307 (+1209615us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:59:21.647310 (+ 10003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:21.656726 (+  9416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:22.052779 (+396053us) spinlock_profiling.cc:243] Waited 8.58 ms on lock 0x7b54003403d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:22.052998 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37031424}
I20260709 12:59:22.062696  1714 raft_consensus.cc:2376] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8. Re-sending same reply.
I20260709 12:59:22.062950  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:22.043601  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.063714  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:22.064661  1611 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:22.064839  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:22.067629  1686 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:22.021014  4333 consensus_queue.cc:1059] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:59:22.072602  1638 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:22.073436  1642 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:59:22.023686  4384 consensus_queue.cc:1059] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:59:22.080973  1642 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:59:22.074003  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:22.067451  1611 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:22.044348  4371 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.004765  4431 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:22.083043  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:22.083616  1639 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:22.087664  4110 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:22.088089  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:22.088563  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:22.089345  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.091005  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:22.091699  1646 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:22.092613  4348 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:22.093425  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:22.094177  1643 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:59:22.094367  4371 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:22.084383  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:22.096665  1647 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:22.096894  1638 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:22.097628  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.003334  4432 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:22.083910  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:22.098752  1642 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:22.088089  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:22.104420  1645 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:22.089432  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:22.109457  1639 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 5: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:22.126511  1721 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:59:22.129498  1686 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:22.132848  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:22.085090  4321 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:22.141834  1644 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 3.
I20260709 12:59:22.145001  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:22.147307  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:22.147781  4417 raft_consensus.cc:3055] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:22.148154  1718 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:22.148233  4417 raft_consensus.cc:740] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:22.149573  1718 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:22.149200  4417 consensus_queue.cc:260] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.150816  4417 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:22.152073  4116 raft_consensus.cc:3055] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:22.152539  4116 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:22.155723  1718 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:22.153487  4116 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.157720  4116 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:22.161036  3999 raft_consensus.cc:3055] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:22.161648  3999 raft_consensus.cc:740] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:22.086549  4398 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:22.192581  1714 raft_consensus.cc:1240] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:22.165403  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:22.192754  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:22.193427  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1418) took 1045 ms. Trace:
I20260709 12:59:22.166460  1645 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
W20260709 12:59:22.174592  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.193859  1567 rpcz_store.cc:276] 0709 12:59:21.148298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.194897 (+ 46599us) service_pool.cc:224] Handling call
0709 12:59:22.165242 (+970345us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:22.193363 (+ 28121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7346432}
I20260709 12:59:22.176442  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2394) took 1726 ms. Trace:
I20260709 12:59:22.196934  1717 rpcz_store.cc:276] 0709 12:59:20.450022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.790223 (+1340201us) service_pool.cc:224] Handling call
0709 12:59:22.001313 (+211090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:22.001964 (+   651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:22.176155 (+174191us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54003ab450. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:22.176354 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484544256}
I20260709 12:59:22.198665  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:22.183298  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:22.200302  1717 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:22.124152  4333 consensus_queue.cc:1243] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:22.203692  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:22.235476  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.245599  1638 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:22.246222  4431 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.246872  4371 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:22.247745  4431 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:22.250939  3999 consensus_queue.cc:260] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.252691  3999 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:22.252986  4374 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:22.258219  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 61762.3us
I20260709 12:59:22.260084  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:22.264578  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 197172us
I20260709 12:59:22.275113  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:22.276127  1639 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:22.145149  1646 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:22.192407  4398 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.203415  4321 raft_consensus.cc:697] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:22.287706  1713 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:22.289584  1611 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:22.232364  4082 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:22.288757  1715 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:59:22.299542  1717 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:22.194093  4400 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:22.273590  4186 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.203061  4383 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 12:59:22.281035  4276 raft_consensus.cc:740] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:59:22.313161  1639 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:22.319108  1611 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:22.170181  4393 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.130s
I20260709 12:59:22.137655  4423 consensus_queue.cc:1048] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.165s
I20260709 12:59:22.303812  1646 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:22.327304  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:22.306969  4398 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:22.315207  4333 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:59:22.307570  4082 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:22.359015  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.351115  4321 consensus_queue.cc:237] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.364436  2440 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:22.285851  4312 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:22.374755  4353 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.386312  4353 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.388837  4353 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:22.389218  4431 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:22.389586  4348 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:22.390673  4276 consensus_queue.cc:260] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
W20260709 12:59:22.393018  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.393689  4276 ts_tablet_manager.cc:1434] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.459s	user 0.008s	sys 0.003s
I20260709 12:59:22.395457  4432 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:22.396598  4432 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:22.397234  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.397665  1643 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:22.397243  4432 raft_consensus.cc:697] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:22.398857  4432 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.408063  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:22.410270  1639 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:22.326020  4186 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:22.432209  1647 raft_consensus.cc:3055] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:22.437024  2437 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:22.377509  4082 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:22.455291  4353 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.492980  4353 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.494271  2438 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:22.490330  4312 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:22.502753  4353 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:22.488457  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:22.516381  1640 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:22.501555  4398 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:22.518994  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.520241  4368 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:22.521135  4368 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:22.524412  4368 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:22.389897  4431 raft_consensus.cc:697] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:22.528492  4431 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.496937  4258 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:22.524365  4398 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:22.489708  1647 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:22.573945  1647 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.574445  4439 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:22.574957  4439 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:22.575270  1647 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:22.533282  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 212271us
I20260709 12:59:22.575887  4439 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:22.577288  4439 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:22.579051  4443 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:22.584759  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:22.585623  1567 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:22.586915  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:22.589133  1572 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:22.590502  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:22.593983  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.597467  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:22.547686  4409 consensus_meta.cc:287] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.010s
I20260709 12:59:22.327808  4400 raft_consensus.cc:697] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:22.599421  4400 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.599783  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:22.601615  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:22.553778  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:22.554634  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 235619us
I20260709 12:59:22.605829  4258 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:22.606462  4258 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:22.607264  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.609462  4258 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:22.610627  4409 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.496348  4186 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:22.557523  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:22.560444  4082 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.455543  4369 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:22.626587  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:22.627545  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:22.644469  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:22.631564  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:22.645526  1570 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
W20260709 12:59:22.645679  1721 consensus_meta.cc:287] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.000s
W20260709 12:59:22.642576  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.644999  1717 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:22.611151  4409 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:22.696785  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 54314.9us
I20260709 12:59:22.697556  1721 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:22.686640  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:22.690483  1572 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:22.691404  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:22.687037  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:22.689469  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:22.702808  2437 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:59:22.702966  2444 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
W20260709 12:59:22.703789  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 146324us
W20260709 12:59:22.667313  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.638005  1567 raft_consensus.cc:1240] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:22.704336  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 111851us
W20260709 12:59:22.692757  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.705121  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:22.705389  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.707499  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:22.701699  1712 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:22.706619  1537 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:22.710798  1647 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:22.721091  1717 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 12:59:22.722435  1470 catalog_manager.cc:5697] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.728164  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-17d2c95439be4ced872760603b0ae02b received from {username='slave'} at 127.0.0.1:54412
I20260709 12:59:22.739249  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-17d2c95439be4ced872760603b0ae02b on tablet 17d2c95439be4ced872760603b0ae02b with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:22.728448  4258 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:22.729524  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:22.735535  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.737145  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:22.745704  1565 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:22.735431  1685 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:22.738005  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:22.748518  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:22.747495  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1578117729999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 12:59:22.752218  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1304899290000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2788s for a response
W20260709 12:59:22.752657  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1012001729999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 12:59:22.753314  1612 leader_election.cc:336] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.504s (SENT)
I20260709 12:59:22.754328  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:22.725924  1470 catalog_manager.cc:5697] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 3 to 4, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.760607  1470 catalog_manager.cc:5697] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.755673  2405 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:22.763993  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:22.779332  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:22.742704  4422 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:59:22.741741  4323 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:59:22.794575  1467 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58252 (request call id 217) took 11995 ms (client timeout 15000 ms). Trace:
W20260709 12:59:22.791172  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 84614us
I20260709 12:59:22.763162  1470 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 4 to 5, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194), now has a pending config: VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193), VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194), VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195), NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:22.802945  1470 catalog_manager.cc:5697] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.806989  1565 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:22.808341  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:22.742537  4441 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:22.741500  2443 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:22.759245  4398 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:22.761776  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:22.765847  4368 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:22.769963  4351 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:22.783140  4284 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:22.778122  4360 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:22.783493  4374 consensus_meta.cc:287] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.005s
I20260709 12:59:22.736035  4443 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:59:22.753832  4429 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 12:59:22.830916  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.841058  1571 raft_consensus.cc:3055] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:22.847792  1571 raft_consensus.cc:740] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:22.774441  3999 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:59:22.810968  4312 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:22.816789  4398 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:22.795096  4348 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:59:22.822103  4284 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:22.795044  1467 rpcz_store.cc:269] 0709 12:59:10.799120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:10.836116 (+ 36996us) service_pool.cc:224] Handling call
0709 12:59:22.794486 (+11958370us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:20.630241 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:20.747035 (+116794us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:20.747087 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:59:20.747111 (+    24us) tablet.cc:662] Decoding operations
0709 12:59:20.747856 (+   745us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:20.747917 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:20.747946 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:59:20.748354 (+   408us) tablet.cc:701] Row locks acquired
0709 12:59:20.748376 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:59:20.748592 (+   216us) write_op.cc:270] Start()
0709 12:59:20.748737 (+   145us) write_op.cc:276] Timestamp: P: 1783601960748517 usec, L: 0
0709 12:59:20.748762 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:59:20.749569 (+   807us) log.cc:844] Serialized 1317 byte log entry
0709 12:59:21.142142 (+392573us) op_driver.cc:464] REPLICATION: finished
0709 12:59:21.340188 (+198046us) write_op.cc:301] APPLY: starting
0709 12:59:21.345858 (+  5670us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:21.385518 (+ 39660us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:21.506957 (+121439us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:21.559384 (+ 52427us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:21.559592 (+   208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:59:21.559638 (+    46us) write_op.cc:312] APPLY: finished
0709 12:59:21.559880 (+   242us) log.cc:844] Serialized 35 byte log entry
0709 12:59:21.560076 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:21.560216 (+   140us) write_op.cc:454] Released schema lock
0709 12:59:21.560262 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:21.560735 (+   473us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:21.560762 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":625551,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":160085,"apply.run_cpu_time_us":3535,"apply.run_wall_time_us":244390,"num_ops":3,"prepare.queue_time_us":200874,"prepare.run_cpu_time_us":20154,"prepare.run_wall_time_us":345035,"raft.queue_time_us":66939,"raft.run_cpu_time_us":14010,"raft.run_wall_time_us":64563,"replication_time_us":393094,"thread_start_us":262291,"threads_started":4,"wal-append.queue_time_us":217320,"wal-append.run_cpu_time_us":13504,"wal-append.run_wall_time_us":1578006}]]}
W20260709 12:59:22.856451  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 92570.2us
I20260709 12:59:22.839321  4360 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:22.848722  1571 consensus_queue.cc:260] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:22.868325  1571 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:22.849828  1470 catalog_manager.cc:5697] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 4 to 7, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:22.858980  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.794261  4098 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:22.878718  4445 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:59:22.866688  4284 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:22.852229  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 105577us
I20260709 12:59:22.891803  1536 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:22.893828  1470 catalog_manager.cc:5697] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 3 to 7, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195), no longer has a pending config: VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193), VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194), VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195), NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.896656  4082 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:22.793586  4328 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:22.862377  1685 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:22.874431  4360 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:22.849537  4432 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:22.900132  1685 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:22.906847  1685 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:22.895183  4409 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:22.859737  4398 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:22.902411  1571 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:59:22.949330  1571 pending_rounds.cc:85] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 2
I20260709 12:59:22.949653  1571 pending_rounds.cc:107] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:59:22.949936  1571 raft_consensus.cc:2889] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:22.897158  1470 catalog_manager.cc:5697] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 4, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 4 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:22.823837  4351 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:22.898645  4328 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.901522  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:22.960924  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 59474.1us
I20260709 12:59:22.940495  1685 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:22.855376  4312 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:22.946260  1716 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:22.919275   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:22.951915  1470 catalog_manager.cc:5697] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 4 to 5, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.962304  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:22.989482  1470 catalog_manager.cc:5697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.992027  1470 catalog_manager.cc:5697] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:22.904758  4384 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:22.992496  4328 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:22.995376  1470 catalog_manager.cc:5697] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 2 to 5, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:23.006639  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 66241.5us
W20260709 12:59:23.013890  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 207547us
I20260709 12:59:23.014456  1685 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:59:23.015892  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:23.022007  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 59809.2us
I20260709 12:59:23.016018  1470 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.958885  4351 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:23.021711  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 267096us
I20260709 12:59:22.947067  4098 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:22.963413  4255 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:23.022969  1686 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:23.025174  1536 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:22.988560  4338 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.942092  4348 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:23.030205  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 157976us
I20260709 12:59:22.965708  4453 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:23.032197  1716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2400) took 2570 ms (client timeout 1918 ms). Trace:
W20260709 12:59:23.047664  1716 rpcz_store.cc:269] 0709 12:59:20.452067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.456385 (+  4318us) service_pool.cc:224] Handling call
0709 12:59:23.021724 (+2565339us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b540013ced4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:23.021973 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5490627968}
I20260709 12:59:23.033705  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:23.049537  1564 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:23.035941  1470 catalog_manager.cc:5697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 3 to 6, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.963692  4405 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:59:23.051249  1470 catalog_manager.cc:5697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 2 to 5, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.001214  4312 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.031116  1685 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:23.062570  1470 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 4 to 5, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:23.027002  4450 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:59:23.038803  1536 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:23.026221  4116 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:23.029294  4441 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:23.045612  2405 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:23.043045  4258 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:23.086585  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.043144  4384 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:22.948464  4432 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:23.042418  1612 leader_election.cc:336] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.528s (SENT)
I20260709 12:59:23.058712  4252 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:59:23.049878  4255 raft_consensus.cc:697] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:23.077544  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 46515.5us
I20260709 12:59:23.047192  3999 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:23.078022  1470 catalog_manager.cc:5697] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.091645  4409 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:59:23.084373  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.079811  4098 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:23.062526  4353 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:59:23.053973  4338 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:23.132462  1612 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:23.077322  1564 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:23.136649  1470 catalog_manager.cc:5697] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.095839  4116 raft_consensus.cc:697] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:23.154390  1470 catalog_manager.cc:5697] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 4 to 5, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.157421  1470 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.130868  4370 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:23.160907  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 129691us
I20260709 12:59:23.098938  4348 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:23.132288  4384 raft_consensus.cc:697] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:23.182715  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0539899290000676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28730000000000006s for a response
I20260709 12:59:23.180330  4440 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:23.188793  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 135300us
W20260709 12:59:23.184420  1612 connection.cc:256] RPC call timeout handler was delayed by -1.0040001730000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
I20260709 12:59:23.160060  3999 raft_consensus.cc:697] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:23.099502  4284 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:23.168263  4449 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.435s	user 0.005s	sys 0.000s
I20260709 12:59:23.178555  4409 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:23.194526  1686 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:23.151993  4405 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 12:59:23.196935  4454 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:59:23.196749  4284 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:23.142554  4463 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.179405  1470 catalog_manager.cc:5697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 2 to 5, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.163434  4116 consensus_queue.cc:237] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:23.194257  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.197527  4400 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.193203  4370 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:23.282827  4400 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:23.284459  4370 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:23.285339  4400 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:23.286257  4467 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:59:23.286490  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:23.287462  1569 raft_consensus.cc:2410] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:23.273775  1470 catalog_manager.cc:5697] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 2 to 4, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:23.291149  1470 catalog_manager.cc:5697] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.281395  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:23.295861  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:23.297451  4438 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:23.298553  4438 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:23.298293  4348 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:23.277139  4455 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:23.302767  4455 raft_consensus.cc:697] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:23.302304  3999 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:23.303966  4455 consensus_queue.cc:237] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:23.305655  4384 consensus_queue.cc:237] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:23.307874  1612 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:23.238523  4084 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:23.326020  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:23.331854  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:23.332374  1642 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:23.336699  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:23.336364  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 288678us
I20260709 12:59:23.322633  4321 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:23.344177  1640 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:23.342494  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:23.345275  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.345207  1643 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
W20260709 12:59:23.347424  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.349095  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:23.349851  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:23.351459  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:23.351572  1640 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:59:23.359664  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 320996us
I20260709 12:59:23.360680  1536 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:23.363734  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.275943  4463 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:23.309456  4351 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:23.368975  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:23.331406  4084 raft_consensus.cc:697] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:23.336359  4400 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:23.381752  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 246569us
I20260709 12:59:23.239214  4255 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:23.359292  4323 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:23.396486  1717 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:23.343751  4258 raft_consensus.cc:697] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:23.342576  4441 raft_consensus.cc:697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:23.373400  4353 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:59:23.390601  4369 consensus_meta.cc:287] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.700s	user 0.007s	sys 0.006s
I20260709 12:59:23.400331  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:23.365674  4438 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:23.398221  1713 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:23.406569  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:23.412807  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:23.413906  1714 raft_consensus.cc:2393] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 3: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 12:59:23.419240  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.344376  4409 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:23.445514  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.404935  4432 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:23.415966  4400 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:23.426939  4369 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.399493  4360 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:23.461702  4431 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
W20260709 12:59:23.508839  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 157462us
I20260709 12:59:23.512014  1612 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:23.452714  4353 raft_consensus.cc:697] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:23.513624  1719 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:23.409787  4323 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:23.416353  4477 consensus_queue.cc:1059] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
W20260709 12:59:23.513413  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 135961us
I20260709 12:59:23.516724  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:23.467417  4400 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:23.469544  4432 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.537695  1715 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:23.463451  4438 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:59:23.458220  4473 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:59:23.510756  4284 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:23.579761  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 57187.2us
W20260709 12:59:23.564220  1612 leader_election.cc:336] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.964s (SENT)
I20260709 12:59:23.519397  4082 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.522993  4305 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.544416  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:23.508196  4369 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:23.584908  1612 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:23.461117  4084 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:23.592154  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:23.530047  4321 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:23.591866  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:23.572573  4470 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:23.609709  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 44261.3us
I20260709 12:59:23.612825  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:23.614339  1569 raft_consensus.cc:2410] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:23.522939  4487 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:23.618956  2436 raft_consensus.cc:1240] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:23.606396  4454 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:59:23.627538  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:23.633569  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:23.634570  1570 raft_consensus.cc:2410] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:23.530011  4400 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.635742  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:23.531193  4258 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:23.530956  4441 consensus_queue.cc:237] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:23.573819  4432 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:23.630420  4321 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.604321  4082 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:23.605690  4305 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:23.638119  4431 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:23.659395  4472 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:59:23.651638  4351 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:23.668598  4471 log.cc:927] Time spent T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:59:23.626134  4470 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:23.677306  4473 raft_consensus.cc:3055] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:23.678083  4463 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:23.635941  4353 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:23.794400  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1806) took 1090 ms. Trace:
I20260709 12:59:23.678920  4486 consensus_queue.cc:1059] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 12:59:23.673019  4321 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:23.715162  4473 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:23.795032  1572 rpcz_store.cc:276] 0709 12:59:22.703892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.704166 (+   274us) service_pool.cc:224] Handling call
0709 12:59:22.752973 (+ 48807us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:23.027829 (+274856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:23.027858 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:23.045209 (+ 17351us) log.cc:844] Serialized 26 byte log entry
0709 12:59:23.324137 (+278928us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:23.324188 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.324268 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:23.794137 (+469869us) raft_consensus.cc:1685] finished
0709 12:59:23.794160 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.794328 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9451,"raft.queue_time_us":60401,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":8433,"thread_start_us":519867,"threads_started":2,"wal-append.queue_time_us":344295}
I20260709 12:59:23.773723  4360 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:23.796983  4328 consensus_meta.cc:287] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.769s	user 0.010s	sys 0.006s
I20260709 12:59:23.805861  4495 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:23.867199  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 303014us
W20260709 12:59:23.868957  1612 leader_election.cc:336] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.009s (SENT)
I20260709 12:59:23.877784  4473 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:23.879482  4473 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:23.882011  4470 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:23.883327  4312 consensus_meta.cc:287] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.812s	user 0.014s	sys 0.000s
I20260709 12:59:23.883837  4312 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:23.885243  2437 raft_consensus.cc:2393] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:23.886761  3999 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:23.887595  4481 log.cc:927] Time spent T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 12:59:23.806310  4082 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:23.869655  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:23.830513  4323 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:23.831986  4369 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:23.947322  4284 raft_consensus.cc:697] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:23.951655  4488 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:59:23.951309  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 82405.7us
W20260709 12:59:23.952953  1685 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.614s (SENT) [suppressed 62 similar messages]
I20260709 12:59:23.933332  4495 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:23.970392  4500 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:59:23.949055  4284 consensus_queue.cc:237] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:23.972076  4312 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:23.834761  4328 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:24.002120  4431 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.002832  4431 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:24.004305  4484 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 12:59:24.005611  4469 raft_consensus.cc:3055] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:24.006300  4469 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:24.007406  4469 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:24.009210  4469 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:24.010413  4476 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 12:59:24.012212  4491 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 12:59:24.018918  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.019215  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:24.019691  1641 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:24.020641  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.020692  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:24.017354  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.021433  1638 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.021649  1639 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:24.022311  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.022651  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:24.024343  1643 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:23.933933  3999 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:24.049849  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.061674  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 108736us
I20260709 12:59:24.065659  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:24.066563  1716 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:59:24.068712  1644 raft_consensus.cc:1275] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:59:24.068843  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:24.069603  1716 raft_consensus.cc:606] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:24.014710  4507 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.074874  1685 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:24.108587  4507 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:24.050392  4432 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:24.129900  4082 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:24.130790  4082 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:24.133468  4082 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:24.137151  4489 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 12:59:24.155546  1645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1711) took 1952 ms (client timeout 1614 ms). Trace:
W20260709 12:59:24.156235  1645 rpcz_store.cc:269] 0709 12:59:22.202957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.203300 (+   343us) service_pool.cc:224] Handling call
0709 12:59:24.155180 (+1951880us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b540010e354. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:24.155439 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1802972032}
I20260709 12:59:24.158772  1565 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:24.203776  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 128998us
I20260709 12:59:24.204618  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.217119  1685 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:24.223122  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:24.224236  2440 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:24.224023  1685 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:24.226686  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:59:24.227754  1612 leader_election.cc:336] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.550s (SENT)
I20260709 12:59:24.228307  1612 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:24.232120  1685 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:24.217680  4398 consensus_meta.cc:287] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.250s	user 0.018s	sys 0.000s
I20260709 12:59:24.206615  4321 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:24.241113  1612 leader_election.cc:336] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 3.056s (SENT)
I20260709 12:59:24.243691  4514 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:24.244228  4514 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.244696  4514 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:24.245340  4328 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:24.247262  4474 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:24.247814  4474 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:24.248199  4338 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:24.237823  4082 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 12:59:24.250310  1719 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2402) took 3567 ms (client timeout 2014 ms). Trace:
W20260709 12:59:24.250754  1719 rpcz_store.cc:269] 0709 12:59:20.682470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.884167 (+201697us) service_pool.cc:224] Handling call
0709 12:59:24.250079 (+3365912us) spinlock_profiling.cc:243] Waited 2.53 s on lock 0x7b5400229054. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:24.250211 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5822760320}
I20260709 12:59:24.248217  4474 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:24.252416  4495 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:24.253341  4516 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:24.254141  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.254474  4312 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:24.254879  4312 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.255308  4312 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:24.235334  4369 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 12:59:24.254966  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.251292  4502 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 12:59:24.261466  4462 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 1.121s	user 0.000s	sys 0.003s
I20260709 12:59:24.262809  4431 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:24.263612  4506 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:24.265211  3999 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:24.267048  2436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 485) took 1622 ms. Trace:
I20260709 12:59:24.267253  4328 consensus_queue.cc:1048] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.267591  2436 rpcz_store.cc:276] 0709 12:59:22.644661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.766244 (+121583us) service_pool.cc:224] Handling call
0709 12:59:22.852524 (+ 86280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.619461 (+766937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.266713 (+647252us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b5400156b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:24.266940 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267436928}
W20260709 12:59:24.268805  4400 consensus_meta.cc:287] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.000s
I20260709 12:59:24.269326  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:24.308403  1719 raft_consensus.cc:606] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:24.308784  1719 raft_consensus.cc:614] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:24.271540  1685 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:24.265169  4514 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:24.244230  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.289507  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.303376  4480 log.cc:927] Time spent T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.499s	user 0.002s	sys 0.000s
W20260709 12:59:24.305603  4512 log.cc:927] Time spent T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:59:24.307106  4368 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:24.307350  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.345849  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.347168  2440 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:24.346824  1536 connection.cc:256] RPC call timeout handler was delayed by -1.7562634689999754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
I20260709 12:59:24.334841  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:24.343909  1611 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:59:24.347765  1536 connection.cc:256] RPC call timeout handler was delayed by -1.45926346899995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
W20260709 12:59:24.348556  1536 connection.cc:256] RPC call timeout handler was delayed by -1.3728634689999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
W20260709 12:59:24.348897  1536 connection.cc:256] RPC call timeout handler was delayed by -1.3701634689999764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 12:59:24.349298  1536 connection.cc:256] RPC call timeout handler was delayed by -1.2477634689999491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
W20260709 12:59:24.349650  1536 connection.cc:256] RPC call timeout handler was delayed by -1.2324634689999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 12:59:24.351603  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:24.362358  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.349762  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:24.364033  2440 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:24.363368  1646 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:24.365216  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.366266  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.367049  1646 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:24.330634  4502 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:24.370786  1536 connection.cc:256] RPC call timeout handler was delayed by -1.1793634689999521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
I20260709 12:59:24.379138  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.330302  4439 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:24.468381  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.469132  1638 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:24.469996  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.371035  4432 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:24.369225  4488 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:24.488227  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.489830  1638 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
W20260709 12:59:24.490213  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.490474  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:24.310936  4398 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:24.475692  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:24.491941  1568 raft_consensus.cc:2393] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:24.442369  1646 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:24.476449  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:24.493194  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:24.477504  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:24.476362  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:24.494839  1566 raft_consensus.cc:2393] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:24.488322  2440 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:24.493114  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.495803  1646 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:24.347191  4431 consensus_queue.cc:1059] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 12:59:24.494719  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:24.480074  1570 raft_consensus.cc:1217] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 12:59:24.332320  4400 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:24.582309  4400 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:24.488345  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:24.582935  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:24.488243  4405 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.014s	sys 0.008s
I20260709 12:59:24.583549  1643 raft_consensus.cc:1240] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:24.583841  4405 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.015s	sys 0.009s
I20260709 12:59:24.584303  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:24.585497  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:24.539813  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.541316  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.590586  1638 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:24.591081  1570 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:59:24.363902  4368 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:24.542744  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:24.544394  1612 leader_election.cc:336] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.534s (SENT)
I20260709 12:59:24.470068  4441 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:24.545343  1685 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:59:24.604784  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 59580.9us
I20260709 12:59:24.605261  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:24.539245  4480 log.cc:927] Time spent T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:59:24.492668  4432 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.554873  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.609228  2436 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:24.609524  1646 raft_consensus.cc:2410] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:59:24.488219  4323 consensus_queue.cc:1059] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 12:59:24.431952  4084 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.444644  4439 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:24.563123  4510 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.563862  4475 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:24.564985  4508 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:59:24.566272  4523 log.cc:927] Time spent T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:59:24.568455  4469 consensus_meta.cc:287] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.559s	user 0.013s	sys 0.004s
I20260709 12:59:24.553889  4431 consensus_queue.cc:1243] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:24.572803  4509 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:24.576749  4474 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:24.578653  4473 consensus_meta.cc:287] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.699s	user 0.010s	sys 0.004s
I20260709 12:59:24.579535  4409 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:24.579303  4312 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:24.497870  1564 raft_consensus.cc:2410] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:59:24.589784  4518 log.cc:927] Time spent T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.248s	user 0.000s	sys 0.000s
I20260709 12:59:24.591712  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:24.635347  1638 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
W20260709 12:59:24.635679  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 160017us
I20260709 12:59:24.435745  4507 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:24.599300  1721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.016s	sys 0.029s
W20260709 12:59:24.638785  1721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.017s	sys 0.029s
I20260709 12:59:24.601393  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 227) took 1016 ms. Trace:
I20260709 12:59:24.603137  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:24.640398  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 96065.1us
W20260709 12:59:24.641477  1612 leader_election.cc:336] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.634s (SENT)
I20260709 12:59:24.641817  1638 raft_consensus.cc:1240] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:24.642769  1612 leader_election.cc:336] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.671s (SENT)
I20260709 12:59:24.643404  1638 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:24.643457  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:24.606283  1570 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:24.645704  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:24.489207  4488 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.590973  4497 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.616838  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:24.654834  2440 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:24.655654  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:24.616784  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:24.619158  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 392526us
I20260709 12:59:24.614739  4370 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:24.665227  4370 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.614584  4432 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.627836  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:24.629165  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.702987  1646 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
W20260709 12:59:24.703718  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.627655  1569 raft_consensus.cc:2410] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:24.636209  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:24.724977  2440 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:24.727238  1564 raft_consensus.cc:2410] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:59:24.603209  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 233916us
I20260709 12:59:24.637802  1641 raft_consensus.cc:1275] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:24.617337  4082 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.731135  4082 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:24.732035  4468 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 1.554s	user 0.000s	sys 0.004s
I20260709 12:59:24.732708  4312 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:24.720788  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:24.648327  1638 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:24.639518  1563 rpcz_store.cc:276] 0709 12:59:23.584887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.585015 (+   128us) service_pool.cc:224] Handling call
0709 12:59:23.585408 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:23.585660 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:23.613276 (+ 27616us) log.cc:844] Serialized 14 byte log entry
0709 12:59:24.588110 (+974834us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b180042ff40. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18cce404bc 00007f18ca18e48b 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1aac02 00007f18cce3220b 00007f18cce37d23 00007f18cce3823a
0709 12:59:24.600866 (+ 12756us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:24.600949 (+    83us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:24.601024 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.601133 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:24.601311 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12416,"prepare.queue_time_us":27942,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":15585,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":9031,"spinlock_wait_cycles":26395008,"thread_start_us":33325,"threads_started":1,"wal-append.queue_time_us":89997}
I20260709 12:59:24.605576  1685 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:24.610590  4441 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:24.665863  4370 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.619757  4084 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:24.718892  1646 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:24.720769  4368 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:24.721563  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:24.769474  1566 raft_consensus.cc:2368] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6.
I20260709 12:59:24.656030  4488 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:24.663504  4497 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:24.722991  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 64115us
I20260709 12:59:24.704672  1537 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:24.791555  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 86993.5us
I20260709 12:59:24.731477  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:24.666906  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:24.623764  4475 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:24.646817  4409 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:24.755358  4422 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:24.621519  4510 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:24.767602  2444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 487) took 1989 ms. Trace:
I20260709 12:59:24.767843  1641 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:24.770681  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:24.645041  4262 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:24.782434  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 176934us
I20260709 12:59:24.749708  1638 raft_consensus.cc:3055] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:24.636874  4509 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:25.114846  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:25.222816  1685 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:59:24.808142  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.223605  1638 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:59:24.921253  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.114907  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:25.113353  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 470581us
W20260709 12:59:25.227649  1612 leader_election.cc:336] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.686s (SENT)
I20260709 12:59:25.228178  1612 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:24.915613  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:25.229437  1612 leader_election.cc:336] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.714s (SENT)
I20260709 12:59:25.230290  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:25.231712  1612 leader_election.cc:336] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.720s (SENT)
I20260709 12:59:25.232978  1568 raft_consensus.cc:2410] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:59:25.034001  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 304708us
I20260709 12:59:25.139040  4398 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:25.221782  2444 rpcz_store.cc:276] 0709 12:59:22.777856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.781068 (+  3212us) service_pool.cc:224] Handling call
0709 12:59:22.781449 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:22.903324 (+121875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:22.903371 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:22.904038 (+   667us) log.cc:844] Serialized 26 byte log entry
0709 12:59:23.030989 (+126951us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:59:23.031037 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.031121 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:24.731374 (+1700253us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:24.733447 (+  2073us) raft_consensus.cc:1685] finished
0709 12:59:24.733469 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:24.767498 (+ 34029us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4800,"raft.queue_time_us":31841,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":8072,"spinlock_wait_cycles":5459200,"thread_start_us":247917,"threads_started":2,"wal-append.queue_time_us":224317}
I20260709 12:59:25.233269  1685 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:25.226003  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:25.163642  4440 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:25.230610  1566 raft_consensus.cc:2410] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:25.250494  1568 raft_consensus.cc:3055] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:25.252858  1563 raft_consensus.cc:2410] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:25.256778  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:25.256326  1568 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:25.224591  1638 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:25.262827  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:25.263320  1612 leader_election.cc:336] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.731s (SENT)
I20260709 12:59:25.266461  1563 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:24.830787  4368 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:25.268577  1565 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:59:25.270490  1565 pending_rounds.cc:85] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 3
I20260709 12:59:25.270886  1565 pending_rounds.cc:107] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:59:25.271194  1565 raft_consensus.cc:2889] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:25.241680  4082 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:24.841306  4466 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.258812  1568 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:25.139432  4506 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:25.272554  1568 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:24.801846  4469 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:25.264055  1638 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:24.803228  4098 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:25.165796  4474 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:25.264217  1567 raft_consensus.cc:3055] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:25.273697  1563 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:25.295475  1567 raft_consensus.cc:740] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:25.262553  4439 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:25.263058  4398 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:25.294100  1570 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:59:25.294243  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:25.299938  1570 pending_rounds.cc:85] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 3
I20260709 12:59:25.301888  1566 raft_consensus.cc:2368] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
W20260709 12:59:25.305759  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 473543us
I20260709 12:59:24.840806  4338 consensus_queue.cc:1059] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.439s
I20260709 12:59:24.928809  4443 consensus_queue.cc:1059] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.368s
I20260709 12:59:25.287253  4082 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:25.285665  4368 raft_consensus.cc:697] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:25.303529  1570 pending_rounds.cc:107] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:59:25.342612  1570 raft_consensus.cc:2889] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:25.314263  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:25.310200  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.026s	sys 0.074s
W20260709 12:59:25.344301  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.026s	sys 0.075s
I20260709 12:59:25.304785  1567 consensus_queue.cc:260] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:25.310765  1686 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:25.346796  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.325279  4474 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:25.303292  4431 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.010s	sys 0.026s
I20260709 12:59:25.292447  4469 raft_consensus.cc:697] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:25.272047  4466 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:25.355865  1567 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:25.303982  4453 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.263535  4440 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:25.359930  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:25.366048  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 101737us
W20260709 12:59:25.370630  1612 leader_election.cc:336] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.744s (SENT)
I20260709 12:59:25.372589  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:25.376335  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 65709.1us
I20260709 12:59:25.321826  4082 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.321939  4441 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:25.377597  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:25.358335  4431 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.011s	sys 0.027s
I20260709 12:59:25.384945  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:25.356264  4474 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.300226  4098 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:25.355391  4422 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:25.308890  4398 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:25.390043  1566 raft_consensus.cc:2393] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:25.419194  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:25.366364  4084 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:25.348534  4544 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:25.390918  1712 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:25.359154  4506 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:25.394575  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:25.403384  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:25.404724  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:25.431314  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:25.412928  1638 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
W20260709 12:59:25.387534  4432 consensus_meta.cc:287] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.000s
I20260709 12:59:25.423718  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:25.424566  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 53965.2us
I20260709 12:59:25.450289  1566 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
W20260709 12:59:25.450464  1612 leader_election.cc:336] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.757s (SENT)
I20260709 12:59:25.450911  1612 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:25.384577  4082 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:25.376255  4453 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:25.432327  1687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.002s	sys 0.023s
I20260709 12:59:25.439854  1638 pending_rounds.cc:85] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 5
I20260709 12:59:25.400034  4474 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:25.442601  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:25.442601  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:25.444283  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:25.445667  1713 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:25.442557  1567 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:59:25.381012  4497 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:25.506531  1640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.009s	sys 0.024s
W20260709 12:59:25.527088  1640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.010s	sys 0.024s
I20260709 12:59:25.527746  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:25.529595  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:25.532346  1638 pending_rounds.cc:107] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:59:25.420480  4443 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:25.532842  1567 pending_rounds.cc:85] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 5
I20260709 12:59:25.534504  1638 raft_consensus.cc:2889] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:25.513782  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 63363.3us
I20260709 12:59:25.533172  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:25.463160  4252 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.034s	sys 0.016s
I20260709 12:59:25.605067  1567 pending_rounds.cc:107] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 6.6
W20260709 12:59:25.655423  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:25.531890  1687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.002s	sys 0.035s
I20260709 12:59:25.682732  4409 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:25.623761  1566 raft_consensus.cc:2410] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:25.693704  1567 raft_consensus.cc:2889] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:25.602458  1612 leader_election.cc:336] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.798s (SENT)
I20260709 12:59:25.603948  1720 raft_consensus.cc:1240] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:25.687934  1568 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:25.433439  4542 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:25.465562  4422 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:25.701926  1716 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:25.705854  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1473) took 1113 ms. Trace:
I20260709 12:59:25.707034  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:25.703639  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1743) took 1333 ms. Trace:
W20260709 12:59:25.513154  4536 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:59:25.707526  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1472) took 1115 ms. Trace:
I20260709 12:59:25.440568  4539 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:25.721818  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:25.723866  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1749) took 1229 ms. Trace:
I20260709 12:59:25.447641  4547 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:25.732599  1638 rpcz_store.cc:276] 0709 12:59:24.369978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.749109 (+379131us) service_pool.cc:224] Handling call
0709 12:59:24.749525 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.703259 (+953734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.703555 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:25.733357  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:25.509492  4475 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:25.732357  1567 rpcz_store.cc:276] 0709 12:59:24.592117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.263784 (+671667us) service_pool.cc:224] Handling call
0709 12:59:25.264082 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.705547 (+441465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.705787 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:25.731974  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:25.805961  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.508671  4554 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.738646  1568 rpcz_store.cc:276] 0709 12:59:24.591744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.249933 (+658189us) service_pool.cc:224] Handling call
0709 12:59:25.250349 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.707254 (+456905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.707471 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:25.777817  1713 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:25.856297  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:25.512303  4510 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:25.702993  4429 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.004s	sys 0.009s
W20260709 12:59:25.699997  4252 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.041s	sys 0.030s
W20260709 12:59:25.873152  2437 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 191) took 3086 ms (client timeout 2717 ms). Trace:
I20260709 12:59:25.535118  4321 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:25.736145  4537 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:25.808178  4409 consensus_queue.cc:1059] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:59:25.508827  4440 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:25.808580  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:25.699717  4431 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:25.810817  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:25.901988  1566 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:25.911419  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:25.823699  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.857139  1568 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:25.917622  1716 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:25.862317  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:25.867273  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.887068  2444 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:25.856277  4443 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:25.874114  2437 rpcz_store.cc:269] 0709 12:59:22.769214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.769542 (+   328us) service_pool.cc:224] Handling call
0709 12:59:25.855644 (+3086102us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54005181d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:25.855907 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473914624}
W20260709 12:59:25.797497  4529 log.cc:927] Time spent T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.631s	user 0.004s	sys 0.007s
I20260709 12:59:25.777966  4544 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:25.892697  4557 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:25.899417  4562 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 12:59:25.736056  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 133615us
W20260709 12:59:25.943956  1612 leader_election.cc:336] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.802s (SENT)
I20260709 12:59:25.944489  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:25.510486  4509 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:25.536441  4466 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:25.808491  4535 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:25.878552  4422 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:25.869336  4429 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.005s	sys 0.009s
I20260709 12:59:25.890368  4547 raft_consensus.cc:697] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:25.469748  4432 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:25.955261  4305 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:25.964557  4547 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:25.961037  4535 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:25.497002  4469 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:25.949664  4552 log.cc:927] Time spent T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:59:25.951308  4557 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:25.952365  4374 raft_consensus.cc:3055] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:25.956110  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:25.930867  4431 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:25.801465  4539 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:25.942287  4443 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:25.902676  4537 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:25.879736  4554 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:26.008488  4535 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:26.023350  4557 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:26.023729  4537 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:26.056401  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:25.807369  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.068766  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1751) took 1529 ms. Trace:
I20260709 12:59:26.070992  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1746) took 1627 ms. Trace:
W20260709 12:59:26.071237  1563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.040s	sys 0.054s
W20260709 12:59:26.071868  1563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.040s	sys 0.054s
I20260709 12:59:26.071587  1646 rpcz_store.cc:276] 0709 12:59:24.443667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.790983 (+347316us) service_pool.cc:224] Handling call
0709 12:59:25.167408 (+376425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.167936 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.167981 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:25.169970 (+  1989us) log.cc:844] Serialized 26 byte log entry
0709 12:59:25.356940 (+186970us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:25.357521 (+   581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.373457 (+ 15936us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.070348 (+696891us) raft_consensus.cc:1685] finished
0709 12:59:26.070393 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.070727 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13412,"raft.queue_time_us":112870,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":14247,"thread_start_us":186077,"threads_started":1,"wal-append.queue_time_us":304009}
I20260709 12:59:26.063657  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:26.069388  1638 rpcz_store.cc:276] 0709 12:59:24.539138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.788587 (+1249449us) service_pool.cc:224] Handling call
0709 12:59:25.789090 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.789419 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.789459 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:25.802562 (+ 13103us) log.cc:844] Serialized 26 byte log entry
0709 12:59:26.067724 (+265162us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:26.067894 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.068072 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.068123 (+    51us) raft_consensus.cc:1685] finished
0709 12:59:26.068136 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.068434 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":264337,"threads_started":1,"wal-append.queue_time_us":213852}
W20260709 12:59:26.066212  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.076079  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:26.068308  1644 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 6: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 12:59:26.064837  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 120696us
I20260709 12:59:26.080073  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1498) took 2015 ms. Trace:
W20260709 12:59:26.081183  1612 leader_election.cc:336] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.809s (SENT)
W20260709 12:59:26.084353  1612 leader_election.cc:336] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.828s (SENT)
I20260709 12:59:26.085093  1567 raft_consensus.cc:2368] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7.
W20260709 12:59:25.955138  2406 leader_election.cc:336] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.634s (SENT)
I20260709 12:59:26.084190  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:25.903810  2438 raft_consensus.cc:1240] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:25.472947  4368 consensus_queue.cc:237] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:26.087670  2444 raft_consensus.cc:2393] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:26.103019  4429 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:26.091715  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:26.091740  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 136478us
I20260709 12:59:26.109257  4429 raft_consensus.cc:3055] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:26.109272  4255 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:26.109766  4429 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:25.989233  4374 raft_consensus.cc:740] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:26.085137  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:26.091785  1563 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:25.987313  4098 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:26.090651  1566 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:26.105291  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:26.110174  4255 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.092873  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:26.080819  1721 rpcz_store.cc:276] 0709 12:59:24.064779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.064927 (+   148us) service_pool.cc:224] Handling call
0709 12:59:24.091060 (+ 26133us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:24.091514 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:24.091545 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:24.092111 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:59:24.639190 (+547079us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:24.639236 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.639326 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.079184 (+1439858us) raft_consensus.cc:1685] finished
0709 12:59:26.079245 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.079668 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":590,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":546666,"threads_started":1,"wal-append.queue_time_us":907661}
I20260709 12:59:25.963141  4422 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:26.121443  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:26.111923  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:26.101763  4431 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:26.111088  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:26.124703  4539 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:26.126252  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.115352  4429 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:26.127889  1567 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:26.130975  4510 consensus_queue.cc:1059] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:26.132676  4510 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.128191  4422 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:26.115506  4374 consensus_queue.cc:260] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:26.140023  4537 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:26.140573  4554 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:26.122596  4255 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:26.140096  4510 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:26.142261  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:26.140431  4563 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:26.143509  1563 raft_consensus.cc:2410] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:26.144342  4510 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:26.144205  4563 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:26.146958  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:26.150074  4432 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:26.153499  4443 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:26.161732  4537 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:26.164552  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1471) took 1672 ms. Trace:
I20260709 12:59:26.165052  1570 rpcz_store.cc:276] 0709 12:59:24.491687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.258780 (+767093us) service_pool.cc:224] Handling call
0709 12:59:25.293543 (+ 34763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.343437 (+ 49894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.164093 (+820656us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b54002b6e50. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:26.164354 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79021952}
I20260709 12:59:26.167352  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:26.168483  1571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1452) took 1692 ms (client timeout 1720 ms). Trace:
W20260709 12:59:26.168910  1571 rpcz_store.cc:269] 0709 12:59:24.476242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.476494 (+   252us) service_pool.cc:224] Handling call
0709 12:59:26.166969 (+1690475us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:26.168387 (+  1418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12732160}
I20260709 12:59:26.171124  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:26.172212  1572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1453) took 1695 ms (client timeout 1731 ms). Trace:
W20260709 12:59:26.619989  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.616076  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.363416  1719 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:26.383924  1566 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:26.182164  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:26.173560  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 51065.4us
W20260709 12:59:26.637198  4528 log.cc:927] Time spent T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 1.759s	user 0.007s	sys 0.014s
W20260709 12:59:26.516243  1568 consensus_meta.cc:287] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.600s	user 0.016s	sys 0.008s
I20260709 12:59:26.176146  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:26.426645  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1826) took 1008 ms. Trace:
W20260709 12:59:26.633234  1572 rpcz_store.cc:269] 0709 12:59:24.476794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.477050 (+   256us) service_pool.cc:224] Handling call
0709 12:59:26.170697 (+1693647us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:26.172154 (+  1457us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29063040}
I20260709 12:59:26.179869  1686 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:26.431525  4520 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 1.874s	user 0.015s	sys 0.009s
W20260709 12:59:26.642786  4541 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 1.580s	user 0.009s	sys 0.003s
I20260709 12:59:25.779049  1647 rpcz_store.cc:276] 0709 12:59:24.494500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.308828 (+814328us) service_pool.cc:224] Handling call
0709 12:59:25.355617 (+ 46789us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.391124 (+ 35507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.391157 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:25.391739 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:59:25.601322 (+209583us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:25.704467 (+103145us) log.cc:844] Serialized 14 byte log entry
0709 12:59:25.723478 (+ 19011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.723573 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:25.723624 (+    51us) raft_consensus.cc:1685] finished
0709 12:59:25.723640 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:25.723796 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92017,"prepare.queue_time_us":91197,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":6751,"raft.queue_time_us":96292,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":31748,"thread_start_us":135270,"threads_started":1,"wal-append.queue_time_us":261684}
I20260709 12:59:26.641219  1570 rpcz_store.cc:276] 0709 12:59:25.418739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.223361 (+804622us) service_pool.cc:224] Handling call
0709 12:59:26.425465 (+202104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.426008 (+   543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:26.426071 (+    63us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:26.426172 (+   101us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:26.426224 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.426320 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.426523 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:26.183265  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1729) took 2162 ms. Trace:
I20260709 12:59:26.619359  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:26.222116  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1741) took 1864 ms. Trace:
I20260709 12:59:26.348261  4502 raft_consensus.cc:993] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower 338d817f94ee4c1bad162e9a5860b68a to start an election
W20260709 12:59:26.573225  4455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.873s	user 0.030s	sys 0.014s
W20260709 12:59:26.222296  4082 consensus_meta.cc:287] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.717s	user 0.013s	sys 0.009s
W20260709 12:59:26.250332  4488 consensus_meta.cc:287] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 1.417s	user 0.018s	sys 0.009s
W20260709 12:59:26.515367  1644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1745) took 2080 ms (client timeout 1943 ms). Trace:
I20260709 12:59:26.647303  1643 rpcz_store.cc:276] 0709 12:59:24.020379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.025542 (+  5163us) service_pool.cc:224] Handling call
0709 12:59:24.025887 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:24.584153 (+558266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.182520 (+1598367us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54002c42d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:26.183001 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281529216}
W20260709 12:59:26.268419  4348 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 12:59:26.269631  4474 consensus_meta.cc:287] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.664s	user 0.017s	sys 0.004s
I20260709 12:59:26.654263  1568 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:26.658859  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 231) took 2641 ms. Trace:
I20260709 12:59:26.660957  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1833) took 1061 ms. Trace:
W20260709 12:59:26.661767  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 577507us
W20260709 12:59:26.256425  4370 consensus_meta.cc:287] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.466s	user 0.015s	sys 0.003s
W20260709 12:59:26.662431  4455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.021s	user 0.035s	sys 0.014s
I20260709 12:59:26.640640  4429 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:26.635058  4563 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:26.267426  4338 raft_consensus.cc:3055] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:59:26.273334  4400 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:59:26.517827  4398 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:26.675177  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.675307  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:26.675629  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.304503  4453 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:26.180572  4537 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:26.663311  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 483648us
I20260709 12:59:26.666577  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:26.648245  4374 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:26.270006  4353 raft_consensus.cc:3055] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:26.648883  1641 rpcz_store.cc:276] 0709 12:59:24.357941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.730439 (+372498us) service_pool.cc:224] Handling call
0709 12:59:24.736123 (+  5684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.227357 (+491234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.221483 (+994126us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b540035c850. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:26.221807 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12262272}
I20260709 12:59:26.669394  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1828) took 1206 ms. Trace:
I20260709 12:59:26.668862  1567 rpcz_store.cc:276] 0709 12:59:25.589103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.130254 (+541151us) service_pool.cc:224] Handling call
0709 12:59:26.650161 (+519907us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:26.671568  1571 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:26.253345  4431 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:26.644528  4255 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:26.663177  1564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1469) took 2172 ms (client timeout 2254 ms). Trace:
I20260709 12:59:26.674703  4338 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:26.426491  4514 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:26.678465  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 1834) took 1089 ms. Trace:
I20260709 12:59:26.681195  4443 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:26.682099  3999 raft_consensus.cc:1081] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Signalling peer 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 12:59:26.676617  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:26.683928  1612 leader_election.cc:336] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.898s (SENT)
I20260709 12:59:26.692654  1569 rpcz_store.cc:276] 0709 12:59:25.463027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.175568 (+712541us) service_pool.cc:224] Handling call
0709 12:59:26.669319 (+493751us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:26.663846  1644 rpcz_store.cc:269] 0709 12:59:24.434469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.469713 (+ 35244us) service_pool.cc:224] Handling call
0709 12:59:26.514896 (+2045183us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54002b93d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:26.515180 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3396272896}
W20260709 12:59:26.698731  1564 rpcz_store.cc:269] 0709 12:59:24.490900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.618585 (+2127685us) service_pool.cc:224] Handling call
0709 12:59:26.663097 (+ 44512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:26.701187  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1830) took 1108 ms. Trace:
I20260709 12:59:26.701418  1568 rpcz_store.cc:276] 0709 12:59:25.589445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.855981 (+266536us) service_pool.cc:224] Handling call
0709 12:59:26.676188 (+820207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:26.702041  4443 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.703290  1571 rpcz_store.cc:276] 0709 12:59:25.588137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.264509 (+676372us) service_pool.cc:224] Handling call
0709 12:59:26.662147 (+397638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.695646 (+ 33499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.696776 (+  1130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:26.671029  4488 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:26.707839  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:26.709055  1564 raft_consensus.cc:2368] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7.
I20260709 12:59:26.708112  4443 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:26.710139  4255 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:26.710909  1612 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:26.695303  4353 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:26.672256  4474 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:26.669672  4082 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:26.674785  4370 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:26.720191  4533 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:26.720839  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:26.668555  1640 rpcz_store.cc:276] 0709 12:59:24.017016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.034624 (+ 17608us) service_pool.cc:224] Handling call
0709 12:59:24.035122 (+   498us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:59:24.203443 (+168321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:24.203476 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:59:24.204171 (+   695us) log.cc:844] Serialized 78 byte log entry
0709 12:59:24.296423 (+ 92252us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b4800220158. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d21c1aa1 00007f18d21b8b37 00007f18d21b89ca 00007f18d22b026f 00007f18d22aff37 00007f18d22c455c 00007f18d22c4508 00007f18d22c4488 00007f18d22c4443 00007f18d22c36ec 00007f18d11eda96
0709 12:59:24.461413 (+164990us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:24.753074 (+291661us) log.cc:844] Serialized 14 byte log entry
0709 12:59:25.527741 (+774667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.527925 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.436223 (+908298us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18000daf80. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1792a6 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db
0709 12:59:26.437012 (+   789us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:26.644405 (+207393us) raft_consensus.cc:1685] finished
0709 12:59:26.644434 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.658539 (+ 14105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17288,"prepare.queue_time_us":328215,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":381,"raft.queue_time_us":590328,"raft.run_cpu_time_us":4109,"raft.run_wall_time_us":77883,"spinlock_wait_cycles":46351232,"thread_start_us":1202350,"threads_started":3,"wal-append.queue_time_us":407953}
W20260709 12:59:26.720877  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.722291  1572 raft_consensus.cc:2410] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:59:26.719199  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:26.724380  1567 raft_consensus.cc:2368] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7.
W20260709 12:59:26.730952  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.733161  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:26.733399  4431 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:26.734808  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 84796.1us
I20260709 12:59:26.736395  1536 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:26.736837  4431 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:26.737246  1718 raft_consensus.cc:1240] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:26.737418  4455 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:26.737596  4501 consensus_queue.cc:1059] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
W20260709 12:59:26.749715  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.729575  4255 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.757242  1571 raft_consensus.cc:3055] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:26.757746  1571 raft_consensus.cc:740] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:26.758910  1571 consensus_queue.cc:260] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:26.760056  1571 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:26.763168  4576 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:59:26.740480  4453 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:26.770161  4370 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:26.772148  4338 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:26.775424  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1837) took 1146 ms. Trace:
I20260709 12:59:26.776036  1568 rpcz_store.cc:276] 0709 12:59:25.631981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.714207 (+1082226us) service_pool.cc:224] Handling call
0709 12:59:26.774382 (+ 60175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.774814 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:26.774860 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:26.774955 (+    95us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:26.775020 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.775103 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.775266 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:26.765611  4495 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:26.779016  4495 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.779373  4082 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:26.779564  4495 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:26.781296  4474 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:26.795673  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 53277.5us
I20260709 12:59:26.801371  4360 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 12:59:26.802577  4522 log.cc:927] Time spent T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 2.083s	user 0.000s	sys 0.017s
W20260709 12:59:26.805481  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 49089.1us
I20260709 12:59:26.809931  1717 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:26.807077  2406 leader_election.cc:336] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.540s (SENT)
I20260709 12:59:26.814945  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:26.745653  4537 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:26.795404  4474 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.793411  4082 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:26.818387  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 134754us
I20260709 12:59:26.823518  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1838) took 1046 ms. Trace:
I20260709 12:59:26.800238  4255 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:26.824062  1564 rpcz_store.cc:276] 0709 12:59:25.777645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.709799 (+932154us) service_pool.cc:224] Handling call
0709 12:59:26.739195 (+ 29396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.814185 (+ 74990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:26.814218 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:26.818040 (+  3822us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:26.823240 (+  5200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.823321 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.823456 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14092,"raft.queue_time_us":23549}
I20260709 12:59:26.812023  4453 consensus_queue.cc:1059] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:59:26.834173  1536 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:26.827349  4338 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:26.835206  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1731) took 2786 ms. Trace:
I20260709 12:59:26.840464  1713 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:26.845835  4574 consensus_queue.cc:1059] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:26.840157  1639 rpcz_store.cc:276] 0709 12:59:24.035546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.042522 (+  6976us) service_pool.cc:224] Handling call
0709 12:59:24.043092 (+   570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:24.051860 (+  8768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:24.051907 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:24.052512 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 12:59:24.371485 (+318973us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:24.371531 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.371612 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.801616 (+2430004us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:26.803782 (+  2166us) raft_consensus.cc:1685] finished
0709 12:59:26.803801 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.820812 (+ 17011us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8203,"raft.queue_time_us":164713,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6164,"spinlock_wait_cycles":33828096,"thread_start_us":318557,"threads_started":1,"wal-append.queue_time_us":572264}
I20260709 12:59:26.837250  4488 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:26.847754  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.849298  1612 leader_election.cc:336] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.962s (SENT)
I20260709 12:59:26.857789  4252 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.858594  4252 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:26.860211  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:26.866628  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 49375us
I20260709 12:59:26.867322  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:26.841212  4360 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:26.869587  2440 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:26.873443  4398 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:26.873570  4441 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:26.874068  4398 raft_consensus.cc:697] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:26.874675  4573 log.cc:927] Time spent T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.849s	user 0.004s	sys 0.000s
I20260709 12:59:26.874827  4548 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.875365  4398 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:26.877545  4252 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:26.834641  4353 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:26.878875  4457 raft_consensus.cc:3055] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:26.879308  4457 raft_consensus.cc:740] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:26.880635  4457 consensus_queue.cc:260] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:26.879392  4353 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:26.883598  4525 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 2.164s	user 0.001s	sys 0.022s
I20260709 12:59:26.884442  4255 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:26.871692  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:26.875602  4548 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:26.871300  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:26.885939  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1497) took 2821 ms. Trace:
I20260709 12:59:26.886433  1715 rpcz_store.cc:276] 0709 12:59:24.064363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.064550 (+   187us) service_pool.cc:224] Handling call
0709 12:59:24.064995 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:24.068850 (+  3855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:24.068884 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:24.085595 (+ 16711us) log.cc:844] Serialized 26 byte log entry
0709 12:59:24.369109 (+283514us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:24.369161 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.369234 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.882569 (+2513335us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:26.885284 (+  2715us) raft_consensus.cc:1685] finished
0709 12:59:26.885315 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.885663 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3339,"raft.queue_time_us":3472,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":45512,"spinlock_wait_cycles":112205184,"thread_start_us":183879,"threads_started":1,"wal-append.queue_time_us":496606}
I20260709 12:59:26.888113  4548 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:26.894172  4550 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 1.386s	user 0.005s	sys 0.006s
I20260709 12:59:26.896806  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1748) took 2411 ms. Trace:
I20260709 12:59:26.897250  4488 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:26.897275  1645 rpcz_store.cc:276] 0709 12:59:24.484848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.122519 (+637671us) service_pool.cc:224] Handling call
0709 12:59:25.125933 (+  3414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.135942 (+ 10009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.135991 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:25.136905 (+   914us) log.cc:844] Serialized 26 byte log entry
0709 12:59:25.375933 (+239028us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:25.376194 (+   261us) log.cc:844] Serialized 14 byte log entry
0709 12:59:25.425236 (+ 49042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.425360 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.893084 (+1467724us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:26.896161 (+  3077us) raft_consensus.cc:1685] finished
0709 12:59:26.896287 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.896573 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58244,"prepare.queue_time_us":14703,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":178220,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":38886,"spinlock_wait_cycles":354371968,"thread_start_us":238607,"threads_started":1,"wal-append.queue_time_us":371252}
I20260709 12:59:26.902478  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1457) took 2420 ms. Trace:
I20260709 12:59:26.902985  1565 rpcz_store.cc:276] 0709 12:59:24.481464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.227645 (+746181us) service_pool.cc:224] Handling call
0709 12:59:25.228088 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.271725 (+ 43637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.901965 (+1630240us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b54003ce6d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:26.902268 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92080512}
W20260709 12:59:26.901677  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 65393.6us
I20260709 12:59:26.906148  2438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 488) took 4048 ms. Trace:
I20260709 12:59:26.906783  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2425) took 1496 ms. Trace:
I20260709 12:59:26.906637  2438 rpcz_store.cc:276] 0709 12:59:22.857889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.861285 (+  3396us) service_pool.cc:224] Handling call
0709 12:59:25.868212 (+3006927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.098750 (+230538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.905666 (+806916us) spinlock_profiling.cc:243] Waited 2.88 s on lock 0x7b54005181d0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:26.905888 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6635368320}
I20260709 12:59:26.907359  1718 rpcz_store.cc:276] 0709 12:59:25.410643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.413552 (+  2909us) service_pool.cc:224] Handling call
0709 12:59:25.414007 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.748266 (+1334259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.906493 (+158227us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400065754. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:26.906709 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3031951744}
W20260709 12:59:26.897401  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.909436  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.909821  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.909873  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:26.910702  4457 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:26.914235  4537 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:26.916847  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 122484us
I20260709 12:59:26.834786  4474 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:26.954212  1566 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:26.886488  1713 raft_consensus.cc:606] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:26.971839  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:26.974225  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.974874  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2419) took 1583 ms. Trace:
I20260709 12:59:26.978201  1713 raft_consensus.cc:614] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:26.854494  4082 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:26.978956  1719 rpcz_store.cc:276] 0709 12:59:25.391722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.392723 (+  1001us) service_pool.cc:224] Handling call
0709 12:59:25.393190 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.651703 (+1258513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.974522 (+322819us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b5400065c54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:26.974806 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2230044928}
I20260709 12:59:26.992592  1571 raft_consensus.cc:1275] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:59:26.993296  1571 pending_rounds.cc:85] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 3
I20260709 12:59:27.007591  1566 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:26.997656  1571 pending_rounds.cc:107] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:59:27.008615  1571 raft_consensus.cc:2889] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:27.015841  1721 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:27.020744  4585 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.980679  4443 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.028537  4443 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:27.030488  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:27.030866  4082 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:27.034188  4469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.014s	sys 0.010s
W20260709 12:59:27.034713  4469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.014s	sys 0.010s
W20260709 12:59:27.040146  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.058187  4537 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:27.058648  4575 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.333s	user 0.003s	sys 0.001s
I20260709 12:59:27.059144  4537 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.062480  2444 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:27.062542  4537 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:27.084725  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1848) took 1024 ms. Trace:
I20260709 12:59:27.084717  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1831) took 1496 ms. Trace:
I20260709 12:59:27.085963  1571 rpcz_store.cc:276] 0709 12:59:25.588495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.712609 (+1124114us) service_pool.cc:224] Handling call
0709 12:59:26.747111 (+ 34502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.084383 (+337272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.084636 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:27.087983  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:27.089182  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:27.090142  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:27.089996  1571 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:27.091564  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:27.084753  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1851) took 1005 ms. Trace:
W20260709 12:59:27.092681  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 224224us
I20260709 12:59:27.097319  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:27.092566  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:27.087004  1563 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:27.021662  4585 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.092453  1565 rpcz_store.cc:276] 0709 12:59:26.079361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.905094 (+825733us) service_pool.cc:224] Handling call
0709 12:59:26.905407 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.905721 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:26.969453 (+ 63732us) log.cc:844] Serialized 14 byte log entry
0709 12:59:27.084207 (+114754us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:27.084307 (+   100us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:27.084383 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.084484 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.084664 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57818,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":2856,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":2596,"thread_start_us":143511,"threads_started":2}
W20260709 12:59:27.114343  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 127677us
I20260709 12:59:27.121594  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c55d053b55024621933828292867f0e6"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:27.110749  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:27.124419  2444 raft_consensus.cc:2393] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:27.121735  1571 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.129715  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:27.137297  1570 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:27.138417  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:27.136906  1713 raft_consensus.cc:606] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:27.142307  1713 raft_consensus.cc:614] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:27.143450  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:27.144721  1572 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:27.148547  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:27.150007  1565 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.124588  4082 consensus_queue.cc:1059] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:59:27.164516  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:27.165277  1569 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.162714  4474 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:27.185694  2443 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEARNER]: Advancing to term 5
W20260709 12:59:27.193915  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.196092  4439 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.196700  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff20dea159284907b41e95b640800f50"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:27.196907  4439 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.197409  1713 raft_consensus.cc:606] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:27.197865  1713 raft_consensus.cc:614] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:27.199734   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:59:27.205492  4374 consensus_meta.cc:287] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.003s
W20260709 12:59:27.211665  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.214190  4212 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.218657  4212 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:27.219307  4537 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:27.219959  4537 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:27.221850  4212 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:27.223093  4537 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:27.223592  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:27.225245  4466 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:27.225713  4466 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.226125  4466 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:27.223011  4585 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:27.226715  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:27.234549  1571 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:27.235569  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:27.235989  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.236155  1571 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:27.240514  4537 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:27.248564  2406 leader_election.cc:336] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.910s (SENT)
W20260709 12:59:27.250427  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.256675  1714 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
W20260709 12:59:27.252887  1612 leader_election.cc:336] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.086s (SENT)
I20260709 12:59:27.261734  1565 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:27.265771  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1852) took 1186 ms. Trace:
I20260709 12:59:27.267227  2437 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:27.267657  4439 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:27.283792  1569 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:27.245255  4537 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.278407  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:27.293018  1565 raft_consensus.cc:3055] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:27.293521  1565 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:27.266471  1572 rpcz_store.cc:276] 0709 12:59:26.079894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.145665 (+1065771us) service_pool.cc:224] Handling call
0709 12:59:27.146042 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.146432 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:27.146811 (+   379us) log.cc:844] Serialized 14 byte log entry
0709 12:59:27.265025 (+118214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:27.265343 (+   318us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:27.265420 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.265530 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.265690 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":801,"prepare.queue_time_us":1663,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":9239,"thread_start_us":82467,"threads_started":1}
W20260709 12:59:27.294512  4587 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 12:59:27.300722  4591 log.cc:927] Time spent T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:59:27.301656  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2421) took 1899 ms. Trace:
I20260709 12:59:27.309262  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:27.085852  1564 rpcz_store.cc:276] 0709 12:59:26.060652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.838196 (+777544us) service_pool.cc:224] Handling call
0709 12:59:26.854416 (+ 16220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.916078 (+ 61662us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:59:26.986880 (+ 70802us) log.cc:844] Serialized 14 byte log entry
0709 12:59:27.084424 (+ 97544us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:27.084474 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:59:27.084515 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.084577 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.084673 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47748,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":2039,"thread_start_us":139830,"threads_started":2}
I20260709 12:59:27.291352  1569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:46640
I20260709 12:59:27.305984  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:27.306269  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1823) took 1918 ms. Trace:
W20260709 12:59:27.307457  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 64761.2us
I20260709 12:59:27.311273  1717 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:27.298012  4439 consensus_queue.cc:1059] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:59:27.312321  4439 raft_consensus.cc:3055] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:27.312796  4439 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:27.309702  1720 rpcz_store.cc:276] 0709 12:59:25.402511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.402656 (+   145us) service_pool.cc:224] Handling call
0709 12:59:25.446085 (+ 43429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.706667 (+260582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.289918 (+1583251us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540025a8d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:27.301420 (+ 11502us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362436480}
I20260709 12:59:27.311031  1563 rpcz_store.cc:276] 0709 12:59:25.391363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.158893 (+767530us) service_pool.cc:224] Handling call
0709 12:59:26.653349 (+494456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.108652 (+455303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.305977 (+197325us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b540031bfd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:27.306206 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880367360}
I20260709 12:59:27.315922  1569 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:27.315802  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1842) took 1258 ms. Trace:
I20260709 12:59:27.316603  1569 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.280614  4495 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.329838   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:59:27.317342  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 64621.2us
I20260709 12:59:27.316643  1568 rpcz_store.cc:276] 0709 12:59:26.057135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.777337 (+720202us) service_pool.cc:224] Handling call
0709 12:59:26.777923 (+   586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:26.968413 (+190490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:26.968444 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:26.987729 (+ 19285us) log.cc:844] Serialized 26 byte log entry
0709 12:59:27.115077 (+127348us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:27.115125 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.115209 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:27.313359 (+198150us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b48000b0958. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d21c1aa1 00007f18d21b8b37 00007f18d21b89ca 00007f18d22b026f 00007f18d22aff37 00007f18d22c455c 00007f18d22c4508 00007f18d22c4488 00007f18d22c4443 00007f18d22c36ec 00007f18d11eda96
0709 12:59:27.315432 (+  2073us) raft_consensus.cc:1685] finished
0709 12:59:27.315454 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.315727 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11939,"raft.queue_time_us":20409,"raft.run_cpu_time_us":4253,"raft.run_wall_time_us":492168,"spinlock_wait_cycles":4568448,"thread_start_us":250988,"threads_started":2,"wal-append.queue_time_us":160098}
I20260709 12:59:27.321120  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:27.322511  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:27.333777  1718 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:27.323503  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:27.334389  4474 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:27.335098  1715 raft_consensus.cc:2393] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:27.315856  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:27.335793  4506 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:59:27.336182  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.336741  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:27.336974  4510 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:27.337702  4510 raft_consensus.cc:697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:27.338268  4321 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:27.338879  4321 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.338883  4510 consensus_queue.cc:237] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.341534  4284 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:27.323482  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:27.342310  4321 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:27.325984  4473 raft_consensus.cc:3055] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:27.343215  4473 raft_consensus.cc:740] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 12:59:27.343590  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.344147  4579 log.cc:927] Time spent T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.206s	user 0.004s	sys 0.000s
W20260709 12:59:27.344460  1612 leader_election.cc:336] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.205s (SENT)
I20260709 12:59:27.345016  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:27.326927  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:27.336387  4506 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:27.347476  4506 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:27.344585  4473 consensus_queue.cc:260] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:27.348342  4284 raft_consensus.cc:697] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:27.324317  1567 raft_consensus.cc:3055] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:27.350394  1567 raft_consensus.cc:740] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:27.350850  4284 consensus_queue.cc:237] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.351842  4398 raft_consensus.cc:3055] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:27.352295  4398 raft_consensus.cc:740] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:27.354370  4585 consensus_queue.cc:1059] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:27.327345  2440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42636 (request call id 454) took 1217 ms. Trace:
I20260709 12:59:27.355351  4353 raft_consensus.cc:3055] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:27.355911  4353 raft_consensus.cc:740] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:27.357144  4353 consensus_queue.cc:260] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.357606  4585 consensus_queue.cc:1059] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:27.358439  4353 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.358698  4585 consensus_queue.cc:1243] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer 6f381117554e49bb816791ab0a10f2b8 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:27.359465  4585 raft_consensus.cc:3055] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:27.359830  4585 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:27.360060  4537 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:27.360904  4585 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:27.363411  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:27.364121  1720 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.349833  4473 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:27.353411  4398 consensus_queue.cc:260] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:27.367101  4398 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:27.370462  4258 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:27.355566  2440 rpcz_store.cc:276] 0709 12:59:26.109489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.111360 (+  1871us) service_pool.cc:224] Handling call
0709 12:59:27.327124 (+1215764us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54006a2554. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:27.327250 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714584832}
W20260709 12:59:27.347913  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.377403  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:27.377921  4506 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.378240  2437 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.378605  4506 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.379376  4258 consensus_queue.cc:1059] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:27.380151  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:27.380555  4258 raft_consensus.cc:3055] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:27.381012  4258 raft_consensus.cc:740] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:27.351440  1567 consensus_queue.cc:260] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:27.382927  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 47820.8us
I20260709 12:59:27.383734  1686 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:27.331970  4495 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:27.398420  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.395049  1537 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:27.401836  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:27.388435  4506 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:27.387965  4537 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:27.416042  1567 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.394212  4585 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:27.412115  4321 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:27.424288  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.427367  4477 raft_consensus.cc:2764] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:27.427990  4374 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:27.428535  1686 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:27.429243  4469 consensus_queue.cc:1059] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.430125  4469 consensus_queue.cc:1243] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:27.430433  4338 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:27.430686  4469 raft_consensus.cc:3055] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:27.430943  4338 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.431166  4469 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:27.431435  4338 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:27.432267  4469 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.433692  4469 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.313958  4439 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.434855  4439 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.435698  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:27.440248  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:27.392765  4488 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:27.442729  2406 leader_election.cc:336] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.005s (SENT)
I20260709 12:59:27.388044  4258 consensus_queue.cc:260] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.407193  4255 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:27.422968  4321 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.445716  1686 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:27.445709  2406 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:27.453346  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 108948us
W20260709 12:59:27.453646  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.459951  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.457958  1720 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:27.451753  1565 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.461221  1686 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:27.467247  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:27.468202  1686 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:27.450590  4502 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:27.453342  4477 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:27.456547  4255 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:27.473527  4495 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:27.478907  1467 catalog_manager.cc:5697] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 9, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.478039  4495 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:27.481988  4495 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.486465  1565 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.488132  1467 catalog_manager.cc:5697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.489084  2437 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:27.491811  1467 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 6, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 6 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.474310  1569 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.424736  4506 consensus_queue.cc:1059] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:59:27.466315  4082 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:59:27.505409  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 100555us
I20260709 12:59:27.452844  4488 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.471751  4457 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:27.511111  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 68422.1us
I20260709 12:59:27.448102  4466 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.474241  4443 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:27.472620  4502 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.474390  4474 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:27.505641  1612 leader_election.cc:336] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.244s (SENT)
I20260709 12:59:27.517776  1612 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:27.512471  1569 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:27.495000  4255 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.515601  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:27.527122  1685 connection.cc:256] RPC call timeout handler was delayed by -1.4989300949999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 12:59:27.537770  1685 connection.cc:256] RPC call timeout handler was delayed by -1.2658300950000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260709 12:59:27.517656  4258 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:27.538241  1685 connection.cc:256] RPC call timeout handler was delayed by -1.2640300950000096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
I20260709 12:59:27.520387  1467 catalog_manager.cc:5697] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 6, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 6 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:27.547744  2406 leader_election.cc:336] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.108s (SENT)
I20260709 12:59:27.517879  4502 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.517417  4474 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.513803  4082 raft_consensus.cc:697] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:27.552572  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.556955  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 78214.7us
I20260709 12:59:27.527663  4506 consensus_queue.cc:1243] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:59:27.560201  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 44702.1us
I20260709 12:59:27.527508  4284 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:27.567898  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.579339  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:27.555964  4474 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:27.569458  4284 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:27.561146  4443 raft_consensus.cc:697] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:27.578761  4321 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:27.575944  1467 catalog_manager.cc:5697] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 3 to 5, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
W20260709 12:59:27.591089  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 70899.2us
I20260709 12:59:27.587898  4284 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:27.585384  4477 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:27.602174  4321 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.583860  4601 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:27.614936  4488 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:27.615726  1685 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:27.616699  4602 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:27.617204  4602 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.617564  4602 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.618710  1467 catalog_manager.cc:5697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 2 to 3, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:27.620541  1467 catalog_manager.cc:5697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 8, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:27.626139  4601 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.627173  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:27.628381  4477 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:27.628924  4601 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:27.629088  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:27.630278  4477 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:27.630705  4477 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:27.631076  4477 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:27.634382  4082 consensus_queue.cc:237] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:27.638212  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 114153us
I20260709 12:59:27.642853  4477 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:27.626397  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 129115us
I20260709 12:59:27.617826  1685 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:59:27.594658  4595 log.cc:927] Time spent T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
I20260709 12:59:27.628671  4602 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.652704  4602 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:27.658776  4443 consensus_queue.cc:237] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.662925  4466 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:27.670171  4537 raft_consensus.cc:3055] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:27.670872  4537 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:27.672145  4537 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.676306  4284 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:27.678026  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.689734  4284 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:27.687201  4599 log.cc:927] Time spent T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:59:27.692191  1467 catalog_manager.cc:5697] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 6, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 6 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:27.694253  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 89764.1us
W20260709 12:59:27.695330  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.686367  4457 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:27.698189  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.700976  1470 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58260 (request call id 212) took 11536 ms (client timeout 15000 ms). Trace:
W20260709 12:59:27.723210  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 75319.4us
I20260709 12:59:27.729426  1567 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 12:59:27.731498  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.727906  4602 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:27.732956  4602 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.733371  4602 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.730468  1467 catalog_manager.cc:5697] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 3 to 6, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 6 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.730547  1567 pending_rounds.cc:85] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 3
I20260709 12:59:27.673990  4537 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:27.747781  1467 catalog_manager.cc:5697] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 4 to 5, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:27.750005  1567 pending_rounds.cc:107] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:59:27.720295  4601 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.757550  1567 raft_consensus.cc:2889] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:27.759567  1612 leader_election.cc:336] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.254s (SENT)
W20260709 12:59:27.760978  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 132031us
W20260709 12:59:27.765874  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 148130us
I20260709 12:59:27.780015  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:27.781631  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 1841) took 1725 ms. Trace:
I20260709 12:59:27.768221  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:27.782212  1567 rpcz_store.cc:276] 0709 12:59:26.056666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.739323 (+682657us) service_pool.cc:224] Handling call
0709 12:59:26.791519 (+ 52196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.324199 (+532680us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b5400353f20. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd20fdc0 00007f18cd29a1c0 00007f18cd29b231 00007f18cd297d8f 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c
0709 12:59:27.767824 (+443625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.781548 (+ 13724us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109075328}
I20260709 12:59:27.805076  1467 catalog_manager.cc:5697] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 3 to 4, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 4 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:27.811671  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.747396  4338 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:27.836313  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 89184us
W20260709 12:59:27.887072  1612 connection.cc:256] RPC call timeout handler was delayed by -2.0552238660000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2717s for a response
W20260709 12:59:27.887651  1612 connection.cc:256] RPC call timeout handler was delayed by -2.0147356109999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 12:59:27.888074  1612 connection.cc:256] RPC call timeout handler was delayed by -1.9616356109999629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 12:59:27.888463  1612 connection.cc:256] RPC call timeout handler was delayed by -1.8626356109999733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 12:59:27.888859  1612 connection.cc:256] RPC call timeout handler was delayed by -1.6916356109999811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 12:59:27.889256  1612 connection.cc:256] RPC call timeout handler was delayed by -1.6214356109999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 12:59:27.837141  4497 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:59:27.836788  1467 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
W20260709 12:59:27.850463  2406 leader_election.cc:336] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.107s (SENT)
W20260709 12:59:27.856129  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.856488  4374 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:27.858235  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:27.860759  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.785977  4506 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.788067  4606 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:27.767565  4601 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:27.896306  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.871809  4473 consensus_meta.cc:287] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.001s
W20260709 12:59:27.906616  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 126693us
I20260709 12:59:27.826648  4353 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:27.907729  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.923548  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:27.939484  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:27.944466  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 160482us
I20260709 12:59:27.955088  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:27.955844  1563 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:27.955971  1571 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:27.947453  1467 catalog_manager.cc:5697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 3 to 4, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 4 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.960312  1570 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:27.960731  1569 raft_consensus.cc:2410] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:27.922868  4605 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:27.928937  4488 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:27.974789  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 124421us
W20260709 12:59:27.981575  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.722568  1470 rpcz_store.cc:269] 0709 12:59:16.164341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.164556 (+   215us) service_pool.cc:224] Handling call
0709 12:59:27.700707 (+11536151us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:23.830728 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:23.875717 (+ 44989us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:23.875769 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:59:23.875793 (+    24us) tablet.cc:662] Decoding operations
0709 12:59:23.936005 (+ 60212us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:23.936095 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:23.936138 (+    43us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:59:23.939219 (+  3081us) tablet.cc:701] Row locks acquired
0709 12:59:23.939249 (+    30us) write_op.cc:260] PREPARE: finished
0709 12:59:23.939491 (+   242us) write_op.cc:270] Start()
0709 12:59:23.939693 (+   202us) write_op.cc:276] Timestamp: P: 1783601963939416 usec, L: 0
0709 12:59:23.939723 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:59:23.941374 (+  1651us) log.cc:844] Serialized 9290 byte log entry
0709 12:59:25.113256 (+1171882us) op_driver.cc:464] REPLICATION: finished
0709 12:59:25.535611 (+422355us) write_op.cc:301] APPLY: starting
0709 12:59:25.600601 (+ 64990us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:25.655220 (+ 54619us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:25.684297 (+ 29077us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:26.013320 (+329023us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:26.128568 (+115248us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 12:59:26.128696 (+   128us) write_op.cc:312] APPLY: finished
0709 12:59:26.129727 (+  1031us) log.cc:844] Serialized 158 byte log entry
0709 12:59:26.248661 (+118934us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:26.249331 (+   670us) write_op.cc:454] Released schema lock
0709 12:59:26.249439 (+   108us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:26.250439 (+  1000us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:26.250486 (+    47us) write_op.cc:454] Released schema lock
0709 12:59:26.982476 (+731990us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
Metrics: {"mutex_wait_us":114496,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":347524,"apply.run_cpu_time_us":44107,"apply.run_wall_time_us":744798,"num_ops":23,"prepare.queue_time_us":328923,"prepare.run_cpu_time_us":24803,"prepare.run_wall_time_us":243796,"raft.queue_time_us":719536,"raft.run_cpu_time_us":11506,"raft.run_wall_time_us":382369,"replication_time_us":1056496,"spinlock_wait_cycles":26901760,"thread_start_us":925706,"threads_started":5,"wal-append.queue_time_us":797755,"wal-append.run_cpu_time_us":48706,"wal-append.run_wall_time_us":1511386}]]}
W20260709 12:59:27.994812  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.997748  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 46265.1us
I20260709 12:59:27.905840  4506 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.997807  1467 catalog_manager.cc:5697] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:27.987673  4605 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:28.012723  4605 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:28.013084  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.013831  1644 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:28.015743  4502 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:27.993336  4488 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:28.020565  4488 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:27.996935  4469 consensus_meta.cc:287] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.007s
I20260709 12:59:28.021854  1572 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:28.023537  4601 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:28.025962  1645 raft_consensus.cc:1275] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:28.004510  1467 catalog_manager.cc:5697] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 6, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 6 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:28.013355  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.025365  1572 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:28.033164  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:28.077757  1639 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:28.030560  4477 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:28.079123  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 114558us
I20260709 12:59:28.085939  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:28.087618  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.094884  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.100728  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.081051  1572 pending_rounds.cc:85] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 4
I20260709 12:59:28.101778  1572 pending_rounds.cc:107] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:59:28.102169  1572 raft_consensus.cc:2889] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:28.083160  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:28.086190  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.108762  1643 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:28.109443  1647 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:28.116743  1641 raft_consensus.cc:2410] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:28.118726  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:28.092582  4585 consensus_meta.cc:287] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.006s
I20260709 12:59:28.008649  4082 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:59:28.131433  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:28.133034  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.133324  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:28.134038  1646 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:28.119596  1645 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:28.135172  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:28.136047  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.136715  1645 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:28.122187  4443 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:59:28.134858  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:28.139660  1639 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:28.140579  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:28.141233  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:28.147972  2443 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:28.136631  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:28.150071  1646 raft_consensus.cc:2410] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:28.148849  1643 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:28.150588  4606 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:59:28.154654  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 48479us
I20260709 12:59:28.160867  1644 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:28.103588  4605 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:59:28.164120  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 46073us
I20260709 12:59:28.104314  4502 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:28.164919  1467 catalog_manager.cc:5697] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 4 to 5, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 5 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:28.202651  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.203289  1645 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:28.204736  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:28.205773  4258 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.220784  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.232921  1643 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.174163  4338 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:28.224291  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 95087.2us
I20260709 12:59:28.234568  1645 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:28.182835  4606 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:59:28.221896  4360 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.206211  4611 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 12:59:28.238029  4474 consensus_meta.cc:287] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.002s
W20260709 12:59:28.240782  4255 consensus_meta.cc:287] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.002s
I20260709 12:59:28.259611  1467 catalog_manager.cc:5697] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 6, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 6 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:28.266490  1643 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:28.266774  1467 catalog_manager.cc:5697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 1 to 2, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:28.254366  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:28.271430  1611 leader_election.cc:336] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Timed out: RequestConsensusVote RPC to 127.0.107.195:43271 timed out after 1.714s (SENT)
I20260709 12:59:28.280023  1685 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:28.286708  1644 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:28.287058  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.269290  4619 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:28.243753  4258 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:28.287550  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.244968  4605 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:28.299062  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.311213  1638 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:28.312795  1643 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:28.258033  4474 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:28.315464  4627 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:28.319000  4610 log.cc:927] Time spent T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.326s	user 0.000s	sys 0.002s
W20260709 12:59:28.320683  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.324079  4473 raft_consensus.cc:1027] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: attempt to promote peer 6f381117554e49bb816791ab0a10f2b8: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260709 12:59:28.331959  4615 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:59:28.342638  4602 consensus_meta.cc:287] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.609s	user 0.013s	sys 0.000s
I20260709 12:59:28.343384  4602 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:28.269045  4502 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:59:28.254688  4360 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:28.268235  4255 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:28.275298  4374 consensus_queue.cc:1059] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:59:28.364147  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:28.364892  1641 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
W20260709 12:59:28.365906  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 128668us
I20260709 12:59:28.351378  1563 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:28.360150   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:28.360666  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:28.275056  4443 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:59:28.367789  1645 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:28.355527  1644 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:28.362030  1467 catalog_manager.cc:5697] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 6, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 6 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:28.380874  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 115085us
I20260709 12:59:28.395835  1467 catalog_manager.cc:5697] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:28.372548  4602 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:28.405192  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.407219  1638 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.411705  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:28.417630  1467 catalog_manager.cc:5697] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:28.404542  1643 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:28.413861  1611 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:28.430096  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.431107  1645 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:59:28.431066  1467 catalog_manager.cc:5697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:28.447278  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.448091  1646 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:59:28.456470  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.447018  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:28.464360  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.465112  1644 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:28.466264  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 75811.6us
W20260709 12:59:28.467360  1685 leader_election.cc:336] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.614s (SENT)
I20260709 12:59:28.441490  1467 catalog_manager.cc:5697] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 4 to 5, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 5 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:28.473029  1645 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:28.439585  4601 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:28.477988  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.479261  1643 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:28.440110  4613 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:28.492130  4613 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:28.481278  4601 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.495042  4601 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:28.497614  4360 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:28.486248  4619 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:28.498701  4619 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:28.501401  4619 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:28.504421  1612 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:28.504815  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.482800  4474 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:28.448601  4626 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:59:28.491290  4255 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:28.522661  4497 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.542233  4613 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:28.542809  4497 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:28.550163  4474 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:28.551015  4474 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:28.551469  4258 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:28.552210  4474 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:28.553287  4605 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:28.554039  4605 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:28.554836  4506 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:28.517076  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:28.475189  4537 consensus_meta.cc:287] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.707s	user 0.014s	sys 0.000s
W20260709 12:59:28.506507  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 59606.8us
I20260709 12:59:28.545706  4497 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:28.540416  1638 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:28.562476  1645 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:59:28.573879  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 122866us
W20260709 12:59:28.574209  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.582423  1720 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:28.585788  1643 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
W20260709 12:59:28.586390  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 119061us
I20260709 12:59:28.533238  1644 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:28.591552  1572 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:28.603068  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:28.607688  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 101654us
I20260709 12:59:28.620679  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:28.621506  1565 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:28.616413  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:28.607105  1647 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:59:28.626603  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.628382  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.628716  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:28.629483  1720 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:59:28.630287  1642 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:59:28.633623  1567 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:28.630771  1642 pending_rounds.cc:85] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 4
I20260709 12:59:28.636379  1642 pending_rounds.cc:107] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:59:28.636642  1642 raft_consensus.cc:2889] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:28.579316  4360 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:28.650744  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:28.651841  1564 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.607291  4506 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:59:28.652510  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.652244  1612 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:28.644580  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:28.661630  1646 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:28.664824  1719 raft_consensus.cc:1275] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:28.665273  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:28.664067  4457 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:28.666106  1572 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:28.666385  4457 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.666842  4457 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.674190  2437 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:28.674472  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:28.684280  1537 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:28.695874  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.696822  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.697212  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:28.697954  1568 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:28.699760  1686 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:28.708348  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 56182.2us
I20260709 12:59:28.712258  4255 consensus_queue.cc:1059] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:28.715816  1686 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:28.717137  4338 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:28.717636  4338 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:28.718837  4370 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:28.719367  4370 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:28.719780  4370 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.722991  1565 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:28.723625  4338 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:28.728592  1570 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:59:28.734251  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.683763  4506 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:28.709435  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:28.697335  4353 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:28.658890  4360 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:28.743525  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.751530  1639 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:28.752610  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.753492  1646 raft_consensus.cc:2393] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:28.701898  4474 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:59:28.769147  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.745885  4353 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.753302  4640 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:28.748868  4495 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.774631  1639 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:28.782810  4353 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:28.800017  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.819037  1643 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:28.802975  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.780895  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 65184.6us
I20260709 12:59:28.793009  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:28.812960  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.821898  4648 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.822603  4648 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:28.801496  4469 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.802752  4640 raft_consensus.cc:697] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:28.857959  1643 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 12:59:28.864607  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:28.870229  1643 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:28.848439  4506 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.879220  4457 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:28.881728  4457 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:28.868237  4497 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.870078  4605 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:28.886072  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.827427  4495 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:28.887029  1645 raft_consensus.cc:2376] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8. Re-sending same reply.
I20260709 12:59:28.888650  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:28.889793  1716 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.859903  4469 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:28.899751  4644 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:59:28.899989  4469 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:28.901099  4502 raft_consensus.cc:3055] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:28.901582  4502 raft_consensus.cc:740] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:28.902544  4502 consensus_queue.cc:260] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:28.906159  1716 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:28.907500  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:28.908417  4631 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:28.871959  4601 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:28.915110  1639 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
W20260709 12:59:28.921064  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.890555  4497 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:28.928287  4497 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:28.928941  4497 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.931021  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.931732  1647 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 12:59:28.931907  1639 raft_consensus.cc:2393] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 4: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:28.929510  4497 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:28.877696  4506 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:28.941668  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:28.944240  1643 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:59:28.943421  1640 raft_consensus.cc:2393] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 7: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:28.944298  1564 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:28.945489  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.946779  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.947391  1643 raft_consensus.cc:2376] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8. Re-sending same reply.
I20260709 12:59:28.948469  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:28.949635  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:28.942356  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:28.950516  1639 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:28.951361  1643 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.974336  1643 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:28.915647  4502 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:28.983028  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.995301  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:28.986510  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:28.998075  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:28.999028  1720 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:28.983394  4631 raft_consensus.cc:697] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:29.004153  4360 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:29.008260  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.008797  4506 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:29.009907  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.010679  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.011446  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.012267  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:29.014173  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.942368  4640 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:29.015072  4649 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:59:29.026645  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:29.029640  4634 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.535s	user 0.000s	sys 0.007s
W20260709 12:59:29.036754  2406 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.658s (SENT) [suppressed 39 similar messages]
I20260709 12:59:29.039638  4497 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:29.052802  1717 raft_consensus.cc:2368] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:59:29.053557  1718 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:29.053689  1720 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:29.055027  4650 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:29.054996  4636 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.555s	user 0.007s	sys 0.000s
I20260709 12:59:29.056828  4601 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:29.015125  4495 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:29.022908  4631 consensus_queue.cc:237] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:29.070408  1712 raft_consensus.cc:2376] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6. Re-sending same reply.
I20260709 12:59:28.982506  4370 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:29.078938  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.080679  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.083973  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.090418  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.102726  1712 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:29.103865  4648 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:29.094619  4353 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:29.107900  4353 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:29.061961  4338 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:29.110352  4338 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:29.111101  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:29.112805  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.089484  4650 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:29.114640  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:29.116524  4650 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:29.119670  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.121003  1718 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:29.121500  1719 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:59:29.122467  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:29.128407  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 91697us
I20260709 12:59:29.131692  4370 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:29.132066  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:29.136691  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 199372us
I20260709 12:59:29.138736  1563 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:29.140211  1714 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:29.143056  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:29.143860  2438 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:29.147356  2443 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
W20260709 12:59:29.150234  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.150588  4633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.017s	sys 0.024s
W20260709 12:59:29.150951  4633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.017s	sys 0.024s
W20260709 12:59:29.151808  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.153319  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.156677  2405 leader_election.cc:336] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.824s (SENT)
I20260709 12:59:29.158366  2438 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:29.168234  4650 raft_consensus.cc:1027] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: attempt to promote peer 6f381117554e49bb816791ab0a10f2b8: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:59:29.170994  1537 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:29.172245  1537 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:29.173128  4650 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:29.173626  4650 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.173995  4650 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:29.176383  4653 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.165s	user 0.000s	sys 0.002s
I20260709 12:59:29.178537  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:29.179360  2438 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:29.196846  1611 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:29.206228  4601 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:29.206784  4601 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.207260  4601 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:29.208158  4647 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.194s	user 0.002s	sys 0.000s
I20260709 12:59:29.208803  4613 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.209326  4613 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:29.210870  4255 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:29.211495  4613 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:29.209339  4353 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:29.206847  4652 log.cc:927] Time spent T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.196s	user 0.002s	sys 0.000s
W20260709 12:59:29.218161  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.218750  2406 leader_election.cc:336] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.824s (SENT)
I20260709 12:59:29.219427  2406 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:29.222553  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.223301  1569 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:29.225147  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:29.225220  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:29.212764  4353 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:29.200114  4477 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:29.229224  1611 leader_election.cc:400] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:59:29.229594  1611 leader_election.cc:403] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:29.230985  1686 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:29.239920  1685 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:29.238459  1611 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:29.254712  1685 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:29.234766  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:29.263698  1612 connection.cc:256] RPC call timeout handler was delayed by -1.9020062700000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2939s for a response
I20260709 12:59:29.265887  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:29.267436  1568 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:29.268512  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.270073  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:29.271533  1564 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:59:29.271901  1564 pending_rounds.cc:85] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 7
I20260709 12:59:29.272181  1564 pending_rounds.cc:107] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:59:29.272646  1564 raft_consensus.cc:2889] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:29.267664  1686 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:29.274760  1567 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:29.266886  4627 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 12:59:29.277159  4657 log.cc:927] Time spent T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.266s	user 0.002s	sys 0.000s
I20260709 12:59:29.277359  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:29.263613  4606 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:29.278573  4626 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:29.278671  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:29.279170  4626 raft_consensus.cc:697] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:29.279745  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:29.280201  4626 consensus_queue.cc:237] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:29.280969  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:29.281605  1563 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 12:59:29.282222  2443 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:29.282476  4637 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:29.248538  4659 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:29.241889  4506 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5.
I20260709 12:59:29.282270  4474 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:29.284600  4506 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:29.285257  4474 raft_consensus.cc:697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:29.286291  4474 consensus_queue.cc:237] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:29.251587  4477 raft_consensus.cc:697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:29.288554  4477 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:29.289229  4353 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:29.290133  4495 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:29.290704  4495 raft_consensus.cc:697] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:29.282335  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:29.291476  4398 consensus_queue.cc:1059] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:29.291920  1564 raft_consensus.cc:2410] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:59:29.291761  4495 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:29.292905  4650 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:29.263857  4619 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:29.295135  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:29.295316  1685 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:29.259948  4616 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:59:29.298717  1569 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:29.310711  1568 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
W20260709 12:59:29.348242  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.351302  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:29.351948  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.352303  1566 raft_consensus.cc:2368] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10.
I20260709 12:59:29.300997  4648 raft_consensus.cc:3055] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:29.355962  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:29.359493  1612 leader_election.cc:336] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.518s (SENT)
I20260709 12:59:29.361347  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:29.360863  1612 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:29.319010  4611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.007s	sys 0.018s
I20260709 12:59:29.364260  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:29.372064  4374 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:29.372931  4374 raft_consensus.cc:697] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:29.379844  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.388340  4443 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:29.391256  1686 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:29.391242  4255 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:29.393692  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:29.394702  1567 raft_consensus.cc:2410] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:59:29.316259  4606 raft_consensus.cc:697] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:29.398023  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:29.393436  1565 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:29.407063  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:29.397387  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:29.408912  1569 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:29.402712  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.403019  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.403301  1567 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:29.403426  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:29.305871  4605 consensus_queue.cc:1059] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 12:59:29.370391  4611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.007s	sys 0.019s
I20260709 12:59:29.360986  4648 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:29.393867  4255 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:29.472143  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:29.475674  1566 raft_consensus.cc:2410] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:59:29.317134  4607 consensus_queue.cc:1059] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 12:59:29.476513  1568 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
W20260709 12:59:29.519110  2406 leader_election.cc:336] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.859s (SENT)
I20260709 12:59:29.520208  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:29.520660  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:29.523825  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 174473us
I20260709 12:59:29.423626  4659 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:29.523833  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:29.526871  2406 leader_election.cc:336] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.140s (SENT)
I20260709 12:59:29.530893  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.532092  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:29.533421  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.530682  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 245190us
W20260709 12:59:29.535580  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 186893us
I20260709 12:59:29.536931  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:29.536085  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 240771us
I20260709 12:59:29.538354  1685 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:29.541589  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:29.543287  1612 leader_election.cc:336] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.577s (SENT)
W20260709 12:59:29.544021  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.544579  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.547533  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.540439  1685 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:29.554965  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.406180  4374 consensus_queue.cc:237] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:29.565289  2406 leader_election.cc:336] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.206s (SENT)
I20260709 12:59:29.571733  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:29.556005  4502 consensus_meta.cc:287] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.001s
I20260709 12:59:29.568284  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:29.534933  4255 raft_consensus.cc:697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:29.555627  4602 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:29.594105  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:29.601482  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.555397  4082 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:59:29.579962  4611 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:29.575610  4650 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:29.574579  4671 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:29.615854  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 72628us
I20260709 12:59:29.617842  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.575174  4619 raft_consensus.cc:697] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:29.625370  1718 raft_consensus.cc:1240] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:29.621668  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:29.633250  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:29.637705  1570 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:29.640213  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:29.620604  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:29.647071  2443 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:29.651685  1714 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:59:29.570787  4606 consensus_queue.cc:237] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:29.612440  4602 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:29.655069  4602 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:29.580228  4648 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:29.612936  4631 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:29.657142  4648 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:29.593433  4637 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:59:29.658390  4671 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.658943  4671 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:29.672077  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:29.679163  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.684594  1570 raft_consensus.cc:2368] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6.
I20260709 12:59:29.685809  1718 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 6: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 12:59:29.688551  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 101262us
I20260709 12:59:29.693818  1718 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:59:29.690734  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 155130us
I20260709 12:59:29.695724  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.696408  1717 raft_consensus.cc:1217] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Deduplicated request from leader. Original: 5.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 12:59:29.697127  1717 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:29.703985  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:29.707828  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 105225us
W20260709 12:59:29.692557  4665 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:59:29.742413  1685 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:29.744786  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.748835  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.754115  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:29.774518  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:29.776819  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:29.789027  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:29.789861  1714 raft_consensus.cc:3055] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:29.790271  1714 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:29.749269  4607 raft_consensus.cc:3055] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:29.792585  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:29.748241  4398 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:29.747248  4611 raft_consensus.cc:697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:29.791795  1714 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:29.802119  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 131639us
W20260709 12:59:29.802495  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.800388  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.810670  1714 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:29.827723  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:29.828473  1719 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:29.828819  1717 raft_consensus.cc:2393] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:29.739862  4255 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:29.832185  4666 log.cc:927] Time spent T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 12:59:29.833595  4686 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:29.842954  4686 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:29.835284  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:29.836071  1686 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:29.825675  4668 log.cc:927] Time spent T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 12:59:29.837495  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:29.796578  4607 raft_consensus.cc:740] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:29.801349  4672 consensus_queue.cc:1059] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:59:29.855713  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:29.865309  1714 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:29.824906  4353 raft_consensus.cc:1027] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: attempt to promote peer 6f381117554e49bb816791ab0a10f2b8: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:59:29.785840  4619 consensus_queue.cc:237] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:29.973083  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.954605  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.888801  1612 leader_election.cc:336] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.742s (SENT)
I20260709 12:59:29.895766  1686 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:29.999013  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:29.914163  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.976912  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.000535  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.907248  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:29.959192  4678 log.cc:927] Time spent T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 12:59:29.908006  4683 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 12:59:29.908927  4677 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:59:30.044026  1718 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:29.873755  4671 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:30.045680  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:30.030946  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:30.021143  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 484206us
I20260709 12:59:30.030542  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:30.021742  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:30.031358  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:30.035168  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 139565us
I20260709 12:59:30.013506  1719 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:30.050956  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:30.042881  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.943114  4672 raft_consensus.cc:3055] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:29.944202  4673 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:29.938225  4650 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.021611  1713 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:30.067692  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:30.046666  4606 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:30.054282  4672 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:30.070006  4606 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.070462  4606 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:30.070901  4650 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.071512  4686 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:30.073082  4650 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:30.076052  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.076930  1719 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:30.077351  2443 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 12:59:30.035490  4688 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:30.078135  1721 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:30.078012  4688 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.079010  1718 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:29.969378  4607 consensus_queue.cc:260] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.080399  4607 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:30.080680  4688 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:30.067121  4673 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.081298  4672 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:30.081573  4663 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.544s	user 0.002s	sys 0.002s
I20260709 12:59:30.082249  4673 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:30.082546  4672 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:30.084275  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:30.049469  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:30.085114  1564 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:30.049966  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:30.050385  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:30.047539  2405 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:59:30.058270  4676 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.342s	user 0.000s	sys 0.002s
I20260709 12:59:30.088826  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.059850  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:30.060622  4693 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:30.042236  4611 consensus_queue.cc:237] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:30.063181  4684 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:59:30.065212  4601 consensus_meta.cc:287] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.857s	user 0.007s	sys 0.006s
I20260709 12:59:30.081547  4626 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:30.052177  2438 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.005s	sys 0.009s
I20260709 12:59:30.088826  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:30.114776  2438 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.005s	sys 0.009s
I20260709 12:59:30.058833  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:30.094489  1686 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:30.113003  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 65603.8us
I20260709 12:59:30.117475  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:30.123821  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:30.127439  4659 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:30.129839  4473 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:30.132238  2405 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:30.145028  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:30.134191  4605 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.011s	sys 0.009s
W20260709 12:59:30.150429  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.154621  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.014s	sys 0.010s
I20260709 12:59:30.120884  4687 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:30.155821  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 297402us
I20260709 12:59:30.157644  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:30.161588  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.015s	sys 0.011s
I20260709 12:59:30.167213  1718 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:30.142874  4637 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:30.117057  4601 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.192283  4601 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:30.154642  4631 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:30.195508  4631 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:30.196075  4631 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:30.204066  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:30.205030  1714 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:59:30.206374  4634 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 12:59:30.208983  4648 consensus_meta.cc:287] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.000s
I20260709 12:59:30.134737  4398 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:30.212430  1612 leader_election.cc:336] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.877s (SENT)
I20260709 12:59:30.212954  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:30.210249  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 76588.9us
W20260709 12:59:30.213943  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 56404.2us
I20260709 12:59:30.186951  4696 raft_consensus.cc:2764] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
W20260709 12:59:30.159581  4605 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.012s	sys 0.009s
I20260709 12:59:30.215916  1718 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:30.228382  1716 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:30.218465  4477 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:30.234987  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:30.218189  4497 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:30.241881  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:30.224321  4398 raft_consensus.cc:697] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:30.228586  4353 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:30.230086  4687 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:30.242362  4650 consensus_queue.cc:1059] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:59:30.243117  4605 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:30.276180  1715 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:30.280180  4713 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:30.293082   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:30.287744  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 66965.3us
I20260709 12:59:30.272245  4477 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:30.271979  4709 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:59:30.317468  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 105070us
I20260709 12:59:30.272485  4353 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.245919  4700 consensus_queue.cc:1059] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:59:30.289518  4601 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:59:30.275792  4687 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:30.344236  4712 log.cc:927] Time spent T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 12:59:30.346290  1612 leader_election.cc:336] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.892s (SENT)
W20260709 12:59:30.347564  1612 leader_election.cc:336] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.892s (SENT)
W20260709 12:59:30.348377  1612 connection.cc:256] RPC call timeout handler was delayed by -1.8012062700000229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30510000000000004s for a response
W20260709 12:59:30.348925  1612 leader_election.cc:336] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.955s (SENT)
I20260709 12:59:30.349287  1612 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:30.350281  1570 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:30.353705  1570 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:59:30.354195  1570 pending_rounds.cc:85] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 2
I20260709 12:59:30.354511  1570 pending_rounds.cc:107] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:59:30.354801  1570 raft_consensus.cc:2889] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:30.313421  4607 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:59:30.365139  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.368395  1714 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:30.369524  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.365998  1718 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:30.366011  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.373447  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.358644  4701 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:30.377533  1714 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:59:30.378903  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.376911  1721 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:30.380237  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:30.385452  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.386271  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.392843  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 43951.7us
I20260709 12:59:30.395295  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:30.396400  1714 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:30.359325  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 88300us
I20260709 12:59:30.359921  4601 consensus_queue.cc:1243] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:30.407533  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:30.409614  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:30.422946  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.424038  1721 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:30.392177  4605 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:30.364050  4398 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:30.462329  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.464507  1563 raft_consensus.cc:3055] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:30.432919  4716 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:30.464897  1563 raft_consensus.cc:740] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:30.452095  4711 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:59:30.466195  4711 consensus_queue.cc:1243] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer 338d817f94ee4c1bad162e9a5860b68a log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:59:30.466971  4627 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.433701  4697 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:59:30.467516  4627 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:30.435251  4714 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:30.469514  4714 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:30.470978  4687 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:30.471848  4714 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:30.472134  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.436549  4706 log.cc:927] Time spent T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:59:30.394809  4477 raft_consensus.cc:697] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:30.450802  1714 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 12:59:30.445562  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:30.456632  4353 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:30.457715  1612 leader_election.cc:336] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.060s (SENT)
I20260709 12:59:30.459837  4611 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:30.469789  4627 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:30.455384  4639 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:30.465737  1563 consensus_queue.cc:260] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.472922  1537 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:30.482041  2440 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:30.484854  2436 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:30.497298  1563 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:30.469610  4606 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:30.509758  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.512343  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:30.513527  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.513929  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:30.525434  4719 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:30.526278  4719 raft_consensus.cc:697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:30.527318  4719 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:30.530366  4721 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.530956  4721 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:30.526289  4353 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:59:30.534437  1716 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:30.534423  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2440) took 1011 ms. Trace:
I20260709 12:59:30.535602  1720 rpcz_store.cc:276] 0709 12:59:29.523324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.523545 (+   221us) service_pool.cc:224] Handling call
0709 12:59:30.534226 (+1010681us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b5400186ad4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:30.534360 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1785708928}
I20260709 12:59:30.537619  1564 pending_rounds.cc:85] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 3
I20260709 12:59:30.537957  1564 pending_rounds.cc:107] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:59:30.538249  1564 raft_consensus.cc:2889] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:30.542407  4718 raft_consensus.cc:3055] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:30.543144  4718 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:30.544080  4718 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.544402  4607 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:30.545277  4607 consensus_queue.cc:1243] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:30.448735  4673 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:30.450803  4605 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:30.549439  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 91762.4us
W20260709 12:59:30.549984  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.545609  4718 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:30.557372  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:30.557745  1563 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:59:30.559271  1563 pending_rounds.cc:85] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 3
I20260709 12:59:30.560475  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:30.561057  1563 pending_rounds.cc:107] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:59:30.561205  1716 raft_consensus.cc:606] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:30.561645  1716 raft_consensus.cc:614] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:30.561439  1563 raft_consensus.cc:2889] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:30.562742  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:30.570171  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.554852  4709 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 12:59:30.638437  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.640043  1612 leader_election.cc:336] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.243s (SENT)
W20260709 12:59:30.640391  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.640609  1612 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:30.641913  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:30.642637  1716 raft_consensus.cc:606] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:30.645083  4724 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:59:30.638211  4607 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.651008  4607 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.651379  4701 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:30.655913  1720 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:30.630095  4721 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:30.519906  4477 consensus_queue.cc:237] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.638182  4673 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:30.709218  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 69215.1us
W20260709 12:59:30.713495  1612 leader_election.cc:336] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.737s (SENT)
I20260709 12:59:30.714139  1612 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:30.715677  1612 leader_election.cc:336] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.931s (SENT)
I20260709 12:59:30.716264  1612 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:30.720841  4631 consensus_meta.cc:287] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.008s
I20260709 12:59:30.722532  4701 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:30.723623  4701 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:30.724730  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 206734us
I20260709 12:59:30.701551  4601 consensus_queue.cc:1059] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:59:30.754618  4601 consensus_queue.cc:1243] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:30.755048  4607 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:30.738768  4683 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:59:30.721660  4631 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:30.761813  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 62520.8us
W20260709 12:59:30.764228  1685 leader_election.cc:336] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.599s (SENT)
I20260709 12:59:30.742640  4722 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:30.773535  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:30.774869  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:30.775913  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:30.786540  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 70902.2us
W20260709 12:59:30.788771  1612 connection.cc:256] RPC call timeout handler was delayed by -1.1487062700000479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3776s for a response
I20260709 12:59:30.788550  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:30.791726  1685 leader_election.cc:336] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.670s (SENT)
I20260709 12:59:30.792258  1685 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:30.778586  4353 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:30.779142  4606 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:30.779942  4700 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:30.756827  4709 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:30.802644  4729 log.cc:927] Time spent T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:59:30.771111  4723 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:59:30.806200  4601 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:30.806842  4691 log.cc:927] Time spent T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.972s	user 0.002s	sys 0.007s
I20260709 12:59:30.773043  4722 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.806919  4601 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.809250  4722 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:30.796593  4353 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.809259  4601 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:30.810294  4605 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:30.810014  4353 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:30.811894  4631 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:30.791198  4672 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.812819  4672 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:30.815248  4672 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:30.796221  4607 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:30.817416  4607 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.819954  4607 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:30.797823  4690 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:30.822366  4736 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.823047  4736 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.823738  4700 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.824290  4700 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:30.825426  4736 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:30.828344  1685 leader_election.cc:336] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.681s (SENT)
I20260709 12:59:30.829926  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.830950  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.831393  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.831915  1716 raft_consensus.cc:2393] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:30.830993  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.832072  1720 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:30.833835  1712 raft_consensus.cc:1240] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:30.834074  1714 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:30.842039  4353 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.844756  4353 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:30.855298  1611 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:30.857522  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 1537) took 1104 ms. Trace:
I20260709 12:59:30.858383  1717 rpcz_store.cc:276] 0709 12:59:29.746498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.747567 (+  1069us) service_pool.cc:224] Handling call
0709 12:59:30.850534 (+1102967us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b540013c9d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:30.850702 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112644992}
I20260709 12:59:30.860227  4607 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:30.862668  4607 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.863149  4607 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:30.879334  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.891703  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:30.879413  4640 raft_consensus.cc:3055] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:30.893404  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.894438  4353 consensus_queue.cc:1059] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:30.893427  4640 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:30.895650  1612 leader_election.cc:400] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7.
I20260709 12:59:30.895974  4353 raft_consensus.cc:3055] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:30.896462  4353 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:30.895999  4640 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.896938  4736 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:30.897634  4640 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:30.900278  2440 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:30.902268  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:30.902901  2436 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:30.903749  4506 raft_consensus.cc:3055] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:30.904060  1570 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:30.904186  4506 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:30.905148  4506 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.906307  4497 raft_consensus.cc:3055] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:30.906711  4497 raft_consensus.cc:740] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:30.907630  4497 consensus_queue.cc:260] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:30.908881  4497 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:30.915423  1537 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:30.931248  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:30.931957  2437 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:30.932698  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:30.933385  2444 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:30.934815  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.936429  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.936663  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:30.936887  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:30.937281  1718 raft_consensus.cc:2376] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8. Re-sending same reply.
W20260709 12:59:30.939158  1685 leader_election.cc:336] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.750s (SENT)
I20260709 12:59:30.939666  1685 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:30.897435  4353 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:30.948024  1685 leader_election.cc:336] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.816s (SENT)
I20260709 12:59:30.948572  1685 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:30.951160  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:30.952601  1612 leader_election.cc:400] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7.
I20260709 12:59:30.952955  1612 leader_election.cc:403] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:30.945735  4370 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:30.958827  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:30.959542  1720 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:30.951889  1718 raft_consensus.cc:2376] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8. Re-sending same reply.
I20260709 12:59:30.934278  4723 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:30.969787  2437 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:30.941197  4506 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:30.988294  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.987931  4607 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.877919  4700 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:30.927989  4687 consensus_queue.cc:1059] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:59:30.929774  4709 consensus_queue.cc:1059] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:59:30.998239  2444 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:30.981951  4374 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:30.981767  4723 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.980059  4736 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7.
W20260709 12:59:30.998152  4725 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.276s	user 0.002s	sys 0.001s
I20260709 12:59:30.997351  4353 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:31.010447  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 66972.5us
I20260709 12:59:31.009734  4709 consensus_queue.cc:1243] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:31.003027  4723 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:31.022351  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.028497  4398 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:59:31.068320  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.071514  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 51170.2us
W20260709 12:59:31.061444  4693 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.013s	sys 0.009s
I20260709 12:59:31.018667  4627 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:59:31.087766  2444 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:31.092397  2437 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:31.104861  1720 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
W20260709 12:59:31.085460  4739 log.cc:927] Time spent T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:59:31.076840  4740 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 12:59:31.075153  4693 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.013s	sys 0.009s
I20260709 12:59:31.113756  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:31.081190  4607 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:31.115669  1686 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:31.118849  1686 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:31.116606  4370 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:31.125247  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:31.108371  4718 consensus_queue.cc:1059] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:59:31.122501  4338 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:31.131951  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:31.138170  1565 raft_consensus.cc:3055] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:31.143998  1565 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:31.144413  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:31.145131  1565 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:31.139442  1568 raft_consensus.cc:3055] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:31.147538  1568 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:31.147776  4744 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:31.148504  4744 raft_consensus.cc:697] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:31.148962  1568 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:31.149549  4744 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:31.122776  4353 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:59:31.154120  1563 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:31.150255  1568 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:31.124032  4255 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:31.155356  1565 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:31.135493  4607 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:31.177860  1612 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:31.182318  4627 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:31.182760  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:31.192580  1720 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:31.200302  4736 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:31.206470  1612 leader_election.cc:400] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6.
I20260709 12:59:31.175236  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:31.230756  4745 log.cc:927] Time spent T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:59:31.172564  4338 raft_consensus.cc:697] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:31.232131  4338 consensus_queue.cc:237] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:31.218544  4687 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:31.234732  4687 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:31.236194  4687 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:31.169054  4255 raft_consensus.cc:697] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:31.238971  4255 consensus_queue.cc:237] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:31.167268  4700 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:31.245247  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.244765  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:31.248966  1720 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
W20260709 12:59:31.258479  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.266111  1612 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:31.267851  1568 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:59:31.268329  1568 pending_rounds.cc:85] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 4
I20260709 12:59:31.268599  1568 pending_rounds.cc:107] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:59:31.268925  1568 raft_consensus.cc:2889] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:31.220589  4693 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:31.243129  4353 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:31.278479  4353 raft_consensus.cc:697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:31.279860  4353 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:31.270852  4607 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:31.285100  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 109983us
I20260709 12:59:31.292214  1612 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:31.302183  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.310308  1612 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:31.311231  4736 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:31.313449  1612 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:31.315196  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:31.317061  1612 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:31.319483  4640 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:31.314260  4506 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:31.321616  4736 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:31.301064  4607 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:31.290380  4693 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:31.350271  4693 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:31.351665  4721 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 12:59:31.354717  4750 log.cc:927] Time spent T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 12:59:31.334698  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.331920  4640 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:31.369153  4723 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:31.372139  4723 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:31.376580  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.387053  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:31.387948  2440 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:31.398257  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.411765  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 94767.6us
I20260709 12:59:31.413511  1612 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:31.416623  2440 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
W20260709 12:59:31.423713  4730 log.cc:927] Time spent T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.705s	user 0.000s	sys 0.005s
W20260709 12:59:31.429242  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.437638  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:31.441067  1717 raft_consensus.cc:1240] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:59:31.442772  1537 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:31.444691  4723 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:31.445317  4723 raft_consensus.cc:697] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:31.446219  4607 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:31.446300  4640 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:31.446327  4723 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:31.456125  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2455) took 1621 ms. Trace:
I20260709 12:59:31.456660  1712 rpcz_store.cc:276] 0709 12:59:29.835003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.836641 (+  1638us) service_pool.cc:224] Handling call
0709 12:59:29.837032 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:30.836348 (+999316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.455750 (+619402us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b5400236c54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:31.456046 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2291664512}
I20260709 12:59:31.444118  1612 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:31.469542  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:31.470896  1612 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:31.472605  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:31.497699  1647 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 8. Ops: [6.6-6.6]
I20260709 12:59:31.489789  4607 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:31.514853  1645 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:31.516637  1638 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:31.517540  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:31.517865  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:31.518316  1642 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:31.518234  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:31.519302  1638 raft_consensus.cc:2410] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:31.518541  1641 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:31.499720  4757 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:31.521939  1647 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:31.527384  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.528185  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.489064  4640 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:31.499446  4736 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:31.538946  1645 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:31.539098  1640 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:31.544988  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 299539us
I20260709 12:59:31.548211  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:31.548436  1638 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:31.553580  1715 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:59:31.557763  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.565587  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:31.565712  1713 raft_consensus.cc:1275] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:59:31.571054  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.573045  1712 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:31.550859  4353 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:31.575918  4353 raft_consensus.cc:697] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:31.577121  4353 consensus_queue.cc:237] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:31.582213  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.551029  4744 consensus_queue.cc:1059] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:59:31.606236  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:31.609338  1638 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:59:31.611039  4744 consensus_queue.cc:1243] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:59:31.611588  1685 leader_election.cc:336] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.064s (SENT)
W20260709 12:59:31.550035  4676 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.428s	user 0.000s	sys 0.005s
I20260709 12:59:31.612102  1685 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:31.613085  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 45818.7us
I20260709 12:59:31.614296  4651 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:31.619217  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:31.620090  1638 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:31.626032  1570 pending_rounds.cc:85] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 3
I20260709 12:59:31.626506  1570 pending_rounds.cc:107] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:59:31.626789  1570 raft_consensus.cc:2889] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:31.628613  4255 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:31.632894  1571 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:31.635775  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:31.636809  1638 raft_consensus.cc:2410] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:59:31.637041  4650 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:31.642556  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:31.643365  1716 raft_consensus.cc:606] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:31.655586  1685 leader_election.cc:336] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.179s (SENT)
I20260709 12:59:31.656291  1685 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:31.654457  4687 consensus_queue.cc:1048] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:59:31.665495  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:31.673518  1720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:31.674412  1720 raft_consensus.cc:606] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:31.676707  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:31.681514  1712 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:59:31.684829  1685 leader_election.cc:336] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.181s (SENT)
I20260709 12:59:31.690578  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:31.691692  1638 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:31.649821  4744 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:59:31.673075  4255 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.716873  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:31.662118  4736 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.722766  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:31.730765  1643 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:31.723628  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:31.732187  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.732287  1639 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 8: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:31.730011  1638 raft_consensus.cc:2393] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:31.733669  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:31.734295  1638 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:31.737020  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:31.743146  1639 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:31.737020  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:31.748924  1647 raft_consensus.cc:2410] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:59:31.717635  4637 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:31.756078  1639 raft_consensus.cc:1240] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:31.761654  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:31.763073  1644 raft_consensus.cc:2410] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 12:59:31.773782  4756 log.cc:927] Time spent T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.426s	user 0.010s	sys 0.000s
I20260709 12:59:31.773973  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:31.748394  4473 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 12:59:32.127301  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:32.126945  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 357589us
W20260709 12:59:31.990828  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.793680  1643 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:31.852628  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:31.832454  1638 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:31.779870  1720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:31.942391  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.322448  1647 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:31.913381  4752 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:59:32.337721  1714 raft_consensus.cc:1240] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:32.327090  1720 raft_consensus.cc:606] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:32.325866  1644 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
W20260709 12:59:31.811834  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.318358  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.352836  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.244179  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.353700  1638 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 8: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:32.354473  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:32.354900  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.352298  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.356590  1639 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 3.
I20260709 12:59:32.353727  1640 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
W20260709 12:59:32.366552  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:32.367167  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.367426  1647 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:32.368351  1719 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:59:31.916464  4766 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 12:59:31.775662  4764 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:59:32.368897  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:31.878630  4477 raft_consensus.cc:3055] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:32.369799  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:32.378789  1639 raft_consensus.cc:2376] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7. Re-sending same reply.
I20260709 12:59:31.823489  4607 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.371938  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:32.366302  4757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.004s	sys 0.026s
I20260709 12:59:32.376724   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:59:31.917318  4753 log.cc:927] Time spent T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:59:32.376994  1638 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:32.377003  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.379482  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:32.370280  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.351737  4716 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.749192  4736 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:32.385135  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.386472  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:32.399703  1643 raft_consensus.cc:2376] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8. Re-sending same reply.
I20260709 12:59:31.739496  4255 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:32.369665  4502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.013s	sys 0.020s
I20260709 12:59:32.384104  1647 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:32.371057  4637 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:32.383213  4694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.000s	sys 0.021s
I20260709 12:59:32.401207  1639 raft_consensus.cc:2410] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:59:32.402631  1685 leader_election.cc:336] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.569s (SENT)
I20260709 12:59:32.364728  4640 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.409327  1569 raft_consensus.cc:3055] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:59:32.394461  4757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.004s	sys 0.026s
I20260709 12:59:32.378589  4477 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:32.411746  1569 raft_consensus.cc:740] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:32.422009  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.429957  1643 raft_consensus.cc:2410] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:59:32.428978  1569 consensus_queue.cc:260] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:32.433092  1642 raft_consensus.cc:2410] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:59:32.412572  4694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.000s	sys 0.021s
I20260709 12:59:32.433504  1569 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:32.443490  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:32.403810  4502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.013s	sys 0.021s
I20260709 12:59:32.382807  4633 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:59:32.456215  1643 raft_consensus.cc:2410] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:59:32.391444  4607 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:32.456668  1638 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:32.464723  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.473556  1644 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:32.480340  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:32.407593  4716 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:32.426100  4637 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:32.485903  1716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.021s	sys 0.075s
I20260709 12:59:32.489707  1645 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:32.491154  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:32.492254  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.494582  1644 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 8: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:32.494657  1638 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:32.495553  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:32.493876  1716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.022s	sys 0.075s
I20260709 12:59:32.496186  1644 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:32.497058  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.497608  1644 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
W20260709 12:59:32.500768  1685 leader_election.cc:336] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.637s (SENT)
I20260709 12:59:32.434190  4640 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:32.495687  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.503458  1638 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:32.506287  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.502554  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:32.506867  1638 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:32.507063  1643 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:32.509081  2443 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEARNER]: Advancing to term 6
I20260709 12:59:32.511363  4716 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:32.512630  4255 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:32.514341  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:32.515918  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:32.516228  4736 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:32.516733  2436 raft_consensus.cc:2393] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:32.519622  4637 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:32.521301  4767 log.cc:927] Time spent T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:59:32.525465  2440 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:32.527292  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.534344  1644 raft_consensus.cc:2410] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:59:32.509824  4607 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:32.557142  4774 log.cc:927] Time spent T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:59:32.560859  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2399) took 1066 ms. Trace:
I20260709 12:59:32.583213  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.582866  1646 rpcz_store.cc:276] 0709 12:59:31.494908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.495182 (+   274us) service_pool.cc:224] Handling call
0709 12:59:31.517990 (+ 22808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.518280 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:31.635308 (+117028us) log.cc:844] Serialized 14 byte log entry
0709 12:59:32.560085 (+924777us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:32.560152 (+    67us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:32.560205 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.560620 (+   415us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.560794 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":470992,"prepare.queue_time_us":168572,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":903,"thread_start_us":509898,"threads_started":3,"wal-append.queue_time_us":778867}
I20260709 12:59:32.507707  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:32.546597  4637 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.584045  1644 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:32.585737  1638 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 8: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:32.569311  2443 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:59:32.586155  2443 pending_rounds.cc:85] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 4
I20260709 12:59:32.592908  2443 pending_rounds.cc:107] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:59:32.595715  2443 raft_consensus.cc:2889] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:32.597380  1643 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
W20260709 12:59:32.598027  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 216676us
I20260709 12:59:32.598656  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:32.601717  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.607656  1643 raft_consensus.cc:2393] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:32.617278  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.639684  1641 raft_consensus.cc:1240] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:32.561185  4607 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:32.648649  1646 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
W20260709 12:59:32.650318  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 43698.2us
I20260709 12:59:32.642894  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:32.661489  1644 raft_consensus.cc:2376] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8. Re-sending same reply.
I20260709 12:59:32.663167  4781 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:32.667840  1647 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:59:32.670975  1536 leader_election.cc:336] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.530s (SENT)
I20260709 12:59:32.641937  4700 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.686725  1536 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:32.688489  1536 leader_election.cc:336] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.584s (SENT)
I20260709 12:59:32.689010  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:32.678051  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 722592us
I20260709 12:59:32.679370  1643 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:32.594739  4637 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:32.642373  4757 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:32.673367  4719 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:59:32.691092  4719 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:32.690929  4757 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:32.691694  4719 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:32.681890  1646 raft_consensus.cc:1275] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:32.684715  1640 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:59:32.596903  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.682514  1644 raft_consensus.cc:1275] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:59:32.692065  1536 leader_election.cc:336] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.654s (SENT)
I20260709 12:59:32.657310  4607 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:32.698570  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.710247  1640 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:32.641240  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:32.711282  1685 leader_election.cc:336] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.663s (SENT)
I20260709 12:59:32.712672  1647 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:32.713630  1638 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:32.716313  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:32.716513  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:32.718616  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:32.704459  4773 log.cc:927] Time spent T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:59:32.726179  4757 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:32.726922  4757 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.727434  4757 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:32.729739  4757 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:32.730620   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:59:32.719735  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.734264  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:32.743153  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 73916.2us
I20260709 12:59:32.743342  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:32.738394  1612 connection.cc:256] RPC call timeout handler was delayed by -2.1288031880000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 12:59:32.748399  1612 connection.cc:256] RPC call timeout handler was delayed by -1.9605031880000183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
W20260709 12:59:32.748728  1612 connection.cc:256] RPC call timeout handler was delayed by -1.4025031879999688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24409999999999998s for a response
I20260709 12:59:32.702606  4700 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:32.762882  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.763154  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.720567  4781 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:32.739658  4775 log.cc:927] Time spent T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:59:32.763664  1643 raft_consensus.cc:2376] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6. Re-sending same reply.
I20260709 12:59:32.763616  1644 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
W20260709 12:59:32.746817  4776 log.cc:927] Time spent T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:59:32.752285  1685 leader_election.cc:336] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 3.002s (SENT)
I20260709 12:59:32.782192  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:32.795975  1685 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:32.796787  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.797406  1643 raft_consensus.cc:2376] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9. Re-sending same reply.
I20260709 12:59:32.798280  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:32.770372  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:32.774744  4783 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:59:32.784170  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:32.764595  4791 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:32.784987  4637 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:32.785336  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:32.819732  2440 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:32.820271  1644 raft_consensus.cc:2368] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8.
I20260709 12:59:32.786828  4607 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:32.756583  4640 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:32.789079  4719 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:32.778513  4771 log.cc:927] Time spent T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.286s	user 0.002s	sys 0.000s
I20260709 12:59:32.791221  4781 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:32.802251  2443 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:32.821533  1647 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:32.822635  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:32.830672  1643 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
W20260709 12:59:32.836584  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 84372.4us
I20260709 12:59:32.837353  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.838400  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:32.839655  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.856026  1638 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:32.856945  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.857455  1638 raft_consensus.cc:2376] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8. Re-sending same reply.
I20260709 12:59:32.845194  1646 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:32.854300  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.854300  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:32.814873  4717 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:32.861177  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.862102  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:32.849889  4637 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:32.865115  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:32.863270  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.863595  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:32.869613  1646 raft_consensus.cc:2376] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6. Re-sending same reply.
I20260709 12:59:32.870260  1643 raft_consensus.cc:2410] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:59:32.834806  4782 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.850276  4607 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.851902  4719 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:32.869123  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.857401  4700 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:32.863235  4788 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.868992  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.877594  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.878583  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2485) took 1136 ms. Trace:
I20260709 12:59:32.874771  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:32.859347  4791 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:32.876109  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:32.959688  1640 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:32.916828  1647 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 8: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 12:59:32.970384  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 71822us
I20260709 12:59:32.973070  1647 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:32.913318  1713 rpcz_store.cc:276] 0709 12:59:31.742391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.743813 (+  1422us) service_pool.cc:224] Handling call
0709 12:59:31.766485 (+ 22672us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:32.433882 (+667397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.433950 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:32.451357 (+ 17407us) log.cc:844] Serialized 26 byte log entry
0709 12:59:32.691732 (+240375us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:32.691783 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.819933 (+128150us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54002dc654. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:32.819993 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.868236 (+ 48243us) raft_consensus.cc:1685] finished
0709 12:59:32.868260 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.878501 (+ 10241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12529,"raft.queue_time_us":2114,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":1533750528,"thread_start_us":218454,"threads_started":1,"wal-append.queue_time_us":381815}
I20260709 12:59:32.979907  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2484) took 1328 ms. Trace:
W20260709 12:59:32.979648  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 138453us
I20260709 12:59:32.980388  1716 rpcz_store.cc:276] 0709 12:59:31.651676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.652221 (+   545us) service_pool.cc:224] Handling call
0709 12:59:31.652639 (+   418us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:31.680634 (+ 27995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.680673 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:31.697778 (+ 17105us) log.cc:844] Serialized 52 byte log entry
0709 12:59:32.496289 (+798511us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:32.683363 (+187074us) log.cc:844] Serialized 14 byte log entry
0709 12:59:32.683761 (+   398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.683866 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.979601 (+295735us) raft_consensus.cc:1685] finished
0709 12:59:32.979628 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.979833 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36564,"prepare.queue_time_us":287741,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":28640,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":23999,"thread_start_us":888425,"threads_started":2,"wal-append.queue_time_us":806389}
I20260709 12:59:32.888957  4798 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:32.995929  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:32.998234  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:32.888334  4719 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:32.999362  1564 pending_rounds.cc:85] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 2
I20260709 12:59:33.039013  1564 pending_rounds.cc:107] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:59:33.039324  1564 raft_consensus.cc:2889] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:33.015545  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:32.870980  4717 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:32.884693  4607 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:32.962558  4788 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:33.024605  2437 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:32.880191  4782 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:32.969762  4797 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.041191  4716 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:33.058786  2440 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:32.992547  4473 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:59:33.074878  4473 consensus_queue.cc:1243] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer 6f381117554e49bb816791ab0a10f2b8 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:33.074935  1638 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:33.076051  4788 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:33.015673  4798 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:33.077376  4651 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:33.077929  4651 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:33.078445  4798 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:33.078723  4782 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:33.079450  4716 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:33.080224  4651 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:33.082129  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:33.087796  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 225798us
W20260709 12:59:33.096271  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.105577  1713 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:33.106488  1720 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:33.135237  4607 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:33.138206  4802 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.138489  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:33.139243  2436 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:33.138988  4802 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:33.140535  4800 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:33.141156  4800 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:33.141580  4802 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:33.143591  4800 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:33.145780  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:33.147578  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:33.145871  1537 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:33.118742  4757 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.161136  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:33.161854  1643 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.167018  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:33.081780  4797 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:33.145318  4716 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:33.174804  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.176491  1566 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:33.115875  4782 consensus_queue.cc:1059] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:59:33.154640  4353 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:33.179527  4800 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:33.182685  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:33.186031  1643 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:33.190088  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:33.190793  1643 raft_consensus.cc:2376] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5. Re-sending same reply.
I20260709 12:59:33.191790  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:33.195472  1643 raft_consensus.cc:2376] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6. Re-sending same reply.
I20260709 12:59:33.196995  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:33.197592  1643 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.180011  4606 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:33.205717  4719 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:33.205519  4606 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:33.209373  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.202832  4637 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:59:33.180583  4353 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.215670  4353 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:33.172089  4757 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:33.183092  4800 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:33.265211  1685 leader_election.cc:336] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 3.374s (SENT)
I20260709 12:59:33.266304  1685 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:33.270109  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 82032.2us
I20260709 12:59:33.263043  4793 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.279663  4793 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:33.215909  4717 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:33.286165  4793 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:33.204566  4370 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 12:59:33.288599  1642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2418) took 1567 ms (client timeout 1530 ms). Trace:
I20260709 12:59:33.272804  4606 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:33.277671  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:33.277446  4477 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:33.262625  4719 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:33.289213  1642 rpcz_store.cc:269] 0709 12:59:31.720933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.721056 (+   123us) service_pool.cc:224] Handling call
0709 12:59:33.288362 (+1567306us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b540003a554. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:33.288519 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597983104}
I20260709 12:59:33.288656  2443 pending_rounds.cc:85] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 6
I20260709 12:59:33.296082  2443 pending_rounds.cc:107] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:59:33.296456  2443 raft_consensus.cc:2889] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:33.296514  1685 leader_election.cc:336] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.801s (SENT)
W20260709 12:59:33.297598  1685 leader_election.cc:336] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.809s (SENT)
I20260709 12:59:33.300088  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.301136  1563 raft_consensus.cc:2410] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:59:33.302465  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:33.303429  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.304288  1643 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:33.305789  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:33.306269  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 522148us
I20260709 12:59:33.307246  1536 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:33.306334  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:33.308650  1643 raft_consensus.cc:2376] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8. Re-sending same reply.
I20260709 12:59:33.310719  4793 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:33.314404  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:33.315479  1642 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:33.316524  4797 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:33.316536  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:33.317763  1642 raft_consensus.cc:2376] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5. Re-sending same reply.
I20260709 12:59:33.308894  4695 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:33.309950  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:33.322396  1643 raft_consensus.cc:2376] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5. Re-sending same reply.
I20260709 12:59:33.323484  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:33.318728  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:33.323513  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:33.325166  1643 raft_consensus.cc:2376] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8. Re-sending same reply.
I20260709 12:59:33.326016  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:33.326116  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:33.326503  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:33.297418  4338 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:33.333285  1644 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:33.328203  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:33.328398  1536 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:33.344038  1536 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:33.330035  1643 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:33.335563  4800 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:33.335958  4780 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:33.337721  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:33.332976  4786 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:33.345817  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:33.346076  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:33.353195  1643 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:33.347752  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:33.356711  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:33.357957  4794 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:33.358484  4794 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:33.358881  4794 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:33.362150  1645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2432) took 1516 ms (client timeout 1578 ms). Trace:
W20260709 12:59:33.362675  1645 rpcz_store.cc:269] 0709 12:59:31.845483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.942074 (+ 96591us) service_pool.cc:224] Handling call
0709 12:59:33.361880 (+1419806us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002184d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:33.362046 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367413632}
I20260709 12:59:33.364313  1645 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:33.346722  4788 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:33.327651  4477 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:33.366145  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.333410  4607 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:33.298604  4719 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:33.372740  4719 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:33.347570  1640 raft_consensus.cc:2376] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5. Re-sending same reply.
I20260709 12:59:33.346109  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:33.365739  4803 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:33.351943  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:33.327231  4797 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:33.381282  1644 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:33.383255  1644 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:33.387693  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.389518  1642 raft_consensus.cc:2410] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:59:33.348971  4473 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:33.392501  1645 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:33.394713  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.395073  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:33.400892  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 54930.6us
I20260709 12:59:33.398480  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:33.398520  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:33.402043  1716 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 12:59:33.402578  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.350698  4782 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:33.416244  4782 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:33.417685  4736 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:33.320919  4695 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:33.394081  4502 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:33.416637  4719 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:33.417778  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.460673  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:33.460948  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.461925  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.462837  1570 raft_consensus.cc:2410] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:59:33.462790  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.463783  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.464706  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:33.451905  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 48304.6us
I20260709 12:59:33.453280  1638 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:33.420878  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2417) took 1700 ms. Trace:
I20260709 12:59:33.455449  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:33.377828  4803 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:33.455854  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:33.465404  2437 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:33.471176  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.471764  1572 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 12:59:33.472070  1642 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:59:33.472433  1642 pending_rounds.cc:85] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 5
I20260709 12:59:33.472680  1642 pending_rounds.cc:107] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:59:33.472548  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:33.472926  1642 raft_consensus.cc:2889] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:33.466881  1641 rpcz_store.cc:276] 0709 12:59:31.720610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.721520 (+   910us) service_pool.cc:224] Handling call
0709 12:59:31.738719 (+ 17199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:32.648288 (+909569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.420596 (+772308us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54002b93d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:33.420807 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000007040}
I20260709 12:59:33.477664  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:33.450940  4782 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:33.490670  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.496093  1638 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:33.497790  1638 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:33.500015  1638 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:33.491446  1712 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 12:59:33.512135  1640 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:33.478286  4803 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.534708  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:33.581600  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 46985us
W20260709 12:59:33.589675  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.609102  4786 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.609938  4786 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:33.613271  4786 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:33.620455  1467 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58250 (request call id 196) took 9990 ms. Trace:
I20260709 12:59:33.616102  1466 catalog_manager.cc:5697] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.514603  4082 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:33.465186  4353 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:33.518633  4791 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:33.514794  4757 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:33.646672  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 244948us
I20260709 12:59:33.501288  4736 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 12:59:33.496618  4780 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 12:59:33.516477  4723 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:33.470634  4502 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:33.639405  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 2011) took 1866 ms. Trace:
I20260709 12:59:33.504666  4797 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 12:59:33.667076  1568 rpcz_store.cc:276] 0709 12:59:31.772916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.782128 (+  9212us) service_pool.cc:224] Handling call
0709 12:59:31.830391 (+ 48263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.830714 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:31.869752 (+ 39038us) log.cc:844] Serialized 14 byte log entry
0709 12:59:33.374382 (+1504630us) log.cc:844] Serialized 14 byte log entry
0709 12:59:33.639000 (+264618us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:33.639058 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:33.639115 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.639189 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.639336 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3055472,"prepare.queue_time_us":1545637,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":97,"raft.queue_time_us":7618,"raft.run_cpu_time_us":378,"raft.run_wall_time_us":32345,"thread_start_us":263408,"threads_started":1}
I20260709 12:59:33.670261  1641 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:59:33.680034  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 224429us
I20260709 12:59:33.682283  2405 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:33.658798  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:33.581295  4697 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:33.645277  4778 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:33.635637  4082 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:33.693060  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.662686  1564 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:33.630623  4816 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:33.708921  1713 raft_consensus.cc:1275] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:33.695004  1642 raft_consensus.cc:1275] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:33.695868  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.701669  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:33.704020  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:33.692293  2405 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:33.714457  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:33.717401  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:33.719995  1716 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
W20260709 12:59:33.728062  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.733194  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:33.735572  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:33.655154  4793 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:59:33.735687  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:33.707639  4082 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:33.708178  4816 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:33.682547  4723 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:33.653771  4791 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:33.622036  1467 rpcz_store.cc:276] 0709 12:59:23.631254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.641897 (+ 10643us) service_pool.cc:224] Handling call
0709 12:59:33.620349 (+9978452us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:29.017103 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:29.017854 (+   751us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:29.017909 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:59:29.017929 (+    20us) tablet.cc:662] Decoding operations
0709 12:59:29.019876 (+  1947us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:29.019973 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:29.020010 (+    37us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:59:29.021946 (+  1936us) tablet.cc:701] Row locks acquired
0709 12:59:29.022005 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:59:29.075334 (+ 53329us) write_op.cc:270] Start()
0709 12:59:29.097290 (+ 21956us) write_op.cc:276] Timestamp: P: 1783601969046989 usec, L: 0
0709 12:59:29.098568 (+  1278us) op_driver.cc:348] REPLICATION: starting
0709 12:59:29.105214 (+  6646us) log.cc:844] Serialized 9053 byte log entry
0709 12:59:29.835547 (+730333us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b54004254d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd293e28 00007f18d0cce581 00007f18d0ccdd58 00007f18d0cd29f1 00007f18d0cd29a9 00007f18d0cd2939 00007f18d0cd2901 00007f18d0cd1b2d 000000000038f354 000000000038f199
0709 12:59:30.110564 (+275017us) op_driver.cc:464] REPLICATION: finished
0709 12:59:30.314704 (+204140us) write_op.cc:301] APPLY: starting
0709 12:59:30.323788 (+  9084us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:30.353455 (+ 29667us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:30.353497 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:30.484743 (+131246us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:30.485373 (+   630us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 12:59:30.485428 (+    55us) write_op.cc:312] APPLY: finished
0709 12:59:30.550999 (+ 65571us) log.cc:844] Serialized 158 byte log entry
0709 12:59:30.562224 (+ 11225us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:30.562454 (+   230us) write_op.cc:454] Released schema lock
0709 12:59:30.562535 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:30.638992 (+ 76457us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:30.642677 (+  3685us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":67875,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":162055,"apply.run_cpu_time_us":12179,"apply.run_wall_time_us":312519,"num_ops":23,"prepare.queue_time_us":194233,"prepare.run_cpu_time_us":31532,"prepare.run_wall_time_us":818694,"raft.queue_time_us":26769,"raft.run_cpu_time_us":19102,"raft.run_wall_time_us":130684,"replication_time_us":1009604,"spinlock_wait_cycles":8217472,"thread_start_us":343094,"threads_started":4,"wal-append.queue_time_us":366424,"wal-append.run_cpu_time_us":16708,"wal-append.run_wall_time_us":2203967}]]}
I20260709 12:59:33.770907  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:33.707998  4697 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:33.792670   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:33.772405  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:33.797740  1612 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:33.772028  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.755981  4816 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:33.780887  4777 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.802668  4777 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:33.805066  4777 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:33.782099  4736 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:33.840149  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 329281us
I20260709 12:59:33.781491  4353 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:33.781953  4813 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:33.853986  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:33.781919  4502 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:33.856194  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 413067us
I20260709 12:59:33.771909  4828 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:33.806272  4695 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:33.784377  4697 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:33.869081  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.880607  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 82955.5us
I20260709 12:59:33.881527  1612 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:33.887609  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:33.889005  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:33.855690  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 139153us
I20260709 12:59:33.840863  4607 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:33.812783  4821 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:33.898903  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 45163.7us
I20260709 12:59:33.904053  1612 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:33.844107  4777 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:33.916514  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:33.911522  1536 leader_election.cc:336] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.102s (SENT)
I20260709 12:59:33.920795  1612 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:33.854825  4813 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:33.927735  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:33.928706  1568 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:59:33.931651  1536 leader_election.cc:336] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.186s (SENT)
W20260709 12:59:33.938702  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.868199  4828 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:33.872208  4700 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:33.853106  4736 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:33.913288  4370 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:59:33.959414  1536 leader_election.cc:336] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.191s (SENT)
I20260709 12:59:33.958387  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:33.903949  4793 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:33.968327  1612 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:33.966526  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:33.928217  4821 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:33.973718  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 81216.2us
I20260709 12:59:33.939155  4813 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:33.960790  4784 log.cc:927] Time spent T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:59:33.952226  4797 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:33.938110  4829 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:34.006072  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 46677.8us
W20260709 12:59:34.010671  1536 leader_election.cc:336] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.204s (SENT)
I20260709 12:59:33.957726  4828 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:34.028479  4353 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:33.970527  4607 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:33.963439  4370 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:59:34.038290  1647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.012s	sys 0.015s
W20260709 12:59:34.041399  1647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.012s	sys 0.016s
I20260709 12:59:34.008508  4793 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:59:34.061760  1572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.010s	sys 0.034s
W20260709 12:59:34.062407  1572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.011s	sys 0.034s
I20260709 12:59:34.043068  4370 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:33.981875  4700 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:34.091053  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:34.092028  2437 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:34.094655  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 110649us
W20260709 12:59:34.094118  4820 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
W20260709 12:59:34.104923  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 136704us
I20260709 12:59:34.109369  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:34.110842  4840 log.cc:927] Time spent T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:59:34.111577  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:34.113474  4830 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:59:34.115063  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1820) took 1305 ms. Trace:
I20260709 12:59:34.115504  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1827) took 1238 ms. Trace:
I20260709 12:59:34.115897  1644 rpcz_store.cc:276] 0709 12:59:32.877075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.384198 (+507123us) service_pool.cc:224] Handling call
0709 12:59:33.386465 (+  2267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:33.694629 (+308164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:33.694665 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:33.718007 (+ 23342us) log.cc:844] Serialized 26 byte log entry
0709 12:59:33.921484 (+203477us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:33.965929 (+ 44445us) log.cc:844] Serialized 14 byte log entry
0709 12:59:33.966640 (+   711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.966747 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:34.115272 (+148525us) raft_consensus.cc:1685] finished
0709 12:59:34.115296 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.115443 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21902,"prepare.queue_time_us":48709,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":88307,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":32579,"thread_start_us":394080,"threads_started":2,"wal-append.queue_time_us":303458}
W20260709 12:59:34.113900  4477 consensus_meta.cc:287] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.747s	user 0.012s	sys 0.000s
W20260709 12:59:34.119295  4782 consensus_meta.cc:287] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.603s	user 0.013s	sys 0.000s
I20260709 12:59:34.119814  4782 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.120144  4607 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:34.120967  1570 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:34.121430  4794 consensus_meta.cc:287] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.762s	user 0.011s	sys 0.001s
I20260709 12:59:34.093732  4723 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:34.122939  4782 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:34.127019  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 2026) took 1129 ms. Trace:
W20260709 12:59:34.130117  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 50689.3us
W20260709 12:59:34.115129  4831 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:59:34.115525  1643 rpcz_store.cc:276] 0709 12:59:32.809406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.354220 (+544814us) service_pool.cc:224] Handling call
0709 12:59:33.354735 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:33.399785 (+ 45050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:33.399818 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:33.435104 (+ 35286us) log.cc:844] Serialized 26 byte log entry
0709 12:59:33.740374 (+305270us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:33.740435 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.740540 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:34.114813 (+374273us) raft_consensus.cc:1685] finished
0709 12:59:34.114836 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.114998 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117762,"raft.queue_time_us":24019,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":13411,"thread_start_us":240399,"threads_started":1,"wal-append.queue_time_us":385467}
I20260709 12:59:34.134234  4791 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:34.082901  4697 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 12:59:34.140786  4832 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:59:34.144989  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 215102us
I20260709 12:59:34.146914  4736 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:34.131922  1612 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:34.151191  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:34.127991  1567 rpcz_store.cc:276] 0709 12:59:32.997292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.997417 (+   125us) service_pool.cc:224] Handling call
0709 12:59:33.022195 (+ 24778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:33.022430 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:33.692486 (+670056us) log.cc:844] Serialized 14 byte log entry
0709 12:59:34.126573 (+434087us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:34.126665 (+    92us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:34.126722 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.126801 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.126947 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":500968,"prepare.queue_time_us":456352,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":112986,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":553415,"threads_started":2}
I20260709 12:59:34.155046  4736 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:34.158108  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 147457us
I20260709 12:59:34.164075  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:34.165107  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:34.162499  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.176783  1536 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.997s (SENT) [suppressed 52 similar messages]
I20260709 12:59:34.176896  1643 raft_consensus.cc:2376] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9. Re-sending same reply.
W20260709 12:59:34.166769  1685 leader_election.cc:336] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.906s (SENT)
I20260709 12:59:34.170689  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:34.164614  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1822) took 1327 ms. Trace:
I20260709 12:59:34.179560  2437 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
W20260709 12:59:34.181902  1685 leader_election.cc:336] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.909s (SENT)
I20260709 12:59:34.178913  1639 rpcz_store.cc:276] 0709 12:59:32.837789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.360234 (+522445us) service_pool.cc:224] Handling call
0709 12:59:33.360536 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:33.379795 (+ 19259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:33.379830 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:33.380386 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:59:33.711990 (+331604us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:33.748011 (+ 36021us) log.cc:844] Serialized 14 byte log entry
0709 12:59:33.748430 (+   419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.748571 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:34.164320 (+415749us) raft_consensus.cc:1685] finished
0709 12:59:34.164347 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.164516 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98557,"prepare.queue_time_us":35455,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":19536,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":32541,"spinlock_wait_cycles":11965696,"thread_start_us":254759,"threads_started":1,"wal-append.queue_time_us":724369}
I20260709 12:59:34.176437  1644 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:34.185055  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:34.186741  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.187613  1644 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:34.193289  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.194337  1638 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:34.196218  1638 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:59:34.165624  4822 log.cc:927] Time spent T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 12:59:34.198987  1638 raft_consensus.cc:1275] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:34.200129  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.198827  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.203922  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.204344  1642 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:34.204355  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.205672  1643 raft_consensus.cc:2376] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9. Re-sending same reply.
I20260709 12:59:34.206017  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.200873  1537 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:34.208900  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.209342  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.213222  1639 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:34.214123  4723 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:34.214751  4723 raft_consensus.cc:697] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:34.215096  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.215713  4723 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:34.216354  4797 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:34.218814  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.219691  1640 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 8: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:34.220419  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.220666  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.221277  1639 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:34.226611  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.227337  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:34.228834  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.153182  4700 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:34.121945  4794 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:34.235328  2436 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:59:34.236161  1566 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:34.236725  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1817) took 1453 ms. Trace:
I20260709 12:59:34.237135  4794 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:34.237690  1564 raft_consensus.cc:1240] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:34.172075  4851 consensus_queue.cc:1059] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:59:34.239116  4851 consensus_queue.cc:1243] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 338d817f94ee4c1bad162e9a5860b68a log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:34.239790  4851 raft_consensus.cc:3055] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:34.237365  1647 rpcz_store.cc:276] 0709 12:59:32.783320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.986327 (+203007us) service_pool.cc:224] Handling call
0709 12:59:33.366917 (+380590us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:33.383945 (+ 17028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:33.384007 (+    62us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:33.405472 (+ 21465us) log.cc:844] Serialized 52 byte log entry
0709 12:59:33.801696 (+396224us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4800220158. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d21c1aa1 00007f18d21b8b37 00007f18d21b89ca 00007f18d22b026f 00007f18d22aff37 00007f18d22c455c 00007f18d22c4508 00007f18d22c4488 00007f18d22c4443 00007f18d22c36ec 00007f18d11eda96
0709 12:59:34.042221 (+240525us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:34.042294 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.042414 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:34.142149 (+ 99735us) raft_consensus.cc:1685] finished
0709 12:59:34.142182 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.236537 (+ 94355us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54002184d0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:34.236664 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27474,"raft.queue_time_us":16530,"raft.run_cpu_time_us":5009,"raft.run_wall_time_us":403572,"spinlock_wait_cycles":910279680,"thread_start_us":560976,"threads_started":1,"wal-append.queue_time_us":651747}
I20260709 12:59:34.240157  4851 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:34.241139  4851 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:34.244305  4803 consensus_meta.cc:287] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.005s
I20260709 12:59:34.244999  4803 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.247095  1612 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:34.172124  4607 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 12:59:34.268146  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 80911.1us
I20260709 12:59:34.183506  4687 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.256999  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:34.213209  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:34.275239  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 62096.9us
I20260709 12:59:34.278419  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:34.278553  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:34.280445  4794 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:34.280920  4794 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.277125  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:34.281255  4794 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:34.282639  1566 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:59:34.283066  1566 pending_rounds.cc:85] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 4
I20260709 12:59:34.281994  2437 raft_consensus.cc:2955] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEARNER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:34.283291  1566 pending_rounds.cc:107] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:59:34.283618  1566 raft_consensus.cc:2889] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:34.286835  4082 consensus_meta.cc:287] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.519s	user 0.014s	sys 0.000s
I20260709 12:59:34.287437  4082 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:34.290444  4687 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:34.292348  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 118320us
I20260709 12:59:34.297483  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:34.300280  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:34.301303  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:34.301406  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:34.227494  1643 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:34.263087  1612 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:34.264182  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.302920  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:34.303112  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 43484.6us
I20260709 12:59:34.303810  1565 raft_consensus.cc:2410] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:34.301578  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:34.272027  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:34.272505  4788 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:34.304113  1685 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:34.307755  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:34.308552  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:34.309293  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:34.319943  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:34.336320  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:34.338662  1685 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:34.302603  4851 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:34.349745  1565 raft_consensus.cc:1240] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:34.349782  1685 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:34.306452  4757 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:34.356869  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:34.358273  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:34.294384  4816 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:34.285398  4607 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:34.400528  1714 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:34.395846  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 46201us
I20260709 12:59:34.344983  4814 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:34.357236  4687 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:34.427165  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 49124.1us
I20260709 12:59:34.428540  4353 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:34.368251  4800 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:34.431468  1717 raft_consensus.cc:1240] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:34.433470  1646 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:34.380666  4700 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:34.421355  4802 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:34.398208  4788 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:34.441395  4819 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:59:34.454226  1536 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:34.422482  4613 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.425897  4814 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.382573  4370 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:34.455480  4353 consensus_queue.cc:1048] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:34.507133  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:34.460368  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 44326.5us
I20260709 12:59:34.511646  2436 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:34.433250  4800 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:34.523051  4082 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:34.539660  1537 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:34.542574  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 88408.3us
I20260709 12:59:34.543609  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:34.545228  4353 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:34.545825  4353 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:34.546311  4353 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:34.459236  4802 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.552224  1646 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:34.441318  4798 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:59:34.596724  1716 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 10. Current term is 11. Ops: []
W20260709 12:59:34.597234  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 197680us
I20260709 12:59:34.572563  4778 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:34.602612  4816 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:34.603500  4370 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:34.604365  4744 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:34.605343  4607 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:34.606087  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:34.606945  4799 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:34.607370  1536 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:34.509795  4814 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:34.611716  1536 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:34.505822  4687 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.121s
I20260709 12:59:34.615777  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:34.517956  4757 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:34.537657  4800 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:34.600272  4353 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:34.599431  4813 consensus_meta.cc:287] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.005s
I20260709 12:59:34.595896  4791 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:34.579258  4802 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:34.570878  4700 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:34.524475  4797 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 12:59:34.543097  4477 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 12:59:34.518394  4613 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.616459  4778 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.614802  4803 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:34.608873  4722 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:59:34.697628  4778 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:34.634581  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 232437us
I20260709 12:59:34.701239  1685 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:34.630787  2447 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:34.618160  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:34.640589  4353 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:34.616626  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:34.707168  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 90625.5us
I20260709 12:59:34.708150  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:34.664572  4828 consensus_meta.cc:287] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.000s
I20260709 12:59:34.617027  4786 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:34.715670  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 97628.6us
I20260709 12:59:34.630733  4796 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:34.616832  4782 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:34.637128  4757 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:34.668277  4858 log.cc:927] Time spent T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:59:34.670195  4859 log.cc:927] Time spent T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 12:59:34.670954  4855 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:59:34.640189  4813 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:34.639751  4791 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:34.632222  4799 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:59:34.633019  4854 log.cc:927] Time spent T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:59:34.660506  4700 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.680343  4800 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.616946  4780 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:34.711784  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:34.717742  4082 consensus_queue.cc:1059] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:34.720474  4338 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:34.717941  4803 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:34.771410  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 59724.9us
I20260709 12:59:34.771894  2438 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:34.714799  4722 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:34.778277  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:34.530318  4788 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.720752  4607 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:34.782128  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.757944  4791 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:34.783238  1638 raft_consensus.cc:2376] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9. Re-sending same reply.
I20260709 12:59:34.715107  4794 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.812096  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:34.730634  4474 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:59:34.722041  4651 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:59:34.785590  2406 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:34.718231  4828 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:34.719684  4786 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.813658  4082 raft_consensus.cc:3055] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:34.828883  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:34.829768  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:34.831779  4082 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:34.832636  4082 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.772640  4338 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:34.782769  4782 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:34.760393  4802 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:34.820045  4859 log.cc:927] Time spent T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:59:34.837486  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:34.774386  4803 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:34.841207  4082 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:34.854316  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 89250.2us
I20260709 12:59:34.857085  2440 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:34.866559  4700 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:34.869985  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:34.870903  4353 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:34.871989  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:34.829207  4723 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:34.873463  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:34.876287  1569 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:34.839337  4722 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:34.845243  4862 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:34.726325  4867 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:59:34.726614  4796 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:34.847434  4338 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:34.782473  4849 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:59:34.769680  4814 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.885691  4353 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:34.867502  4786 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:34.879806  4837 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:34.855769  4866 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:34.874210  4803 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:34.896263  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:34.839365  4697 consensus_queue.cc:1059] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:59:34.898939  4353 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.821007  4607 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.893268  4687 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:34.905768  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 114524us
I20260709 12:59:34.947113  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:34.940359  1715 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:59:34.948926  4353 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:34.878815  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 116978us
I20260709 12:59:34.943073  4862 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:34.949406  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 58024.3us
I20260709 12:59:34.950277  1612 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:34.894565  4723 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:34.949026  4851 consensus_meta.cc:287] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.596s	user 0.013s	sys 0.003s
I20260709 12:59:34.962200  4353 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:34.964612  4353 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.948206  4716 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:59:34.954339  4813 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:34.958391  4837 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:34.989602  4837 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:34.990607  4826 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:34.991065  4826 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:34.983775  4723 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:34.984686  4880 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:34.991906  4880 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.992005  4826 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:34.985086  4794 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:34.969223  4613 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:34.986166  4716 consensus_queue.cc:1059] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:34.995448  4796 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:34.996061  4880 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:34.996963  4788 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:34.998327  4837 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:34.998919  4837 raft_consensus.cc:3055] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:34.999279  4837 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:35.000175  4837 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.002339  4881 consensus_queue.cc:1059] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:35.003654  4881 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:34.951567  4687 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:34.977274  4353 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:34.987548  4757 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:35.012359  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 62179.7us
I20260709 12:59:35.028380  4695 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:59:35.030706  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 61031.1us
I20260709 12:59:35.024847  4082 raft_consensus.cc:3055] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:35.028717  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:35.031723  4082 raft_consensus.cc:740] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:35.032442  4851 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:35.032933  4082 consensus_queue.cc:260] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.034276  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:35.034927  4082 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:35.035079  4851 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:35.036521  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:35.037305  4851 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:35.029122  4886 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:59:35.039187  4883 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:35.038717  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:34.972736  4786 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:34.997908  4607 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.014598  4878 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:35.004868  4800 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:35.053529  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:35.057109  1612 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:35.014686  4796 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:35.028178  4788 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:35.024231  4828 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:35.060101  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 119158us
I20260709 12:59:34.959944  4862 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.045895  4826 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:35.060984  4607 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:35.071642  4607 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:35.073726  4687 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.074298  4803 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.062248  4802 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:35.047500  4651 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:59:35.055720  4883 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.075671  4791 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.045676  4613 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 12:59:35.078322  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 46872.4us
I20260709 12:59:35.050882  4882 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:59:35.083942  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:35.084213  4799 consensus_queue.cc:1059] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:35.085242  2438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 505) took 1008 ms. Trace:
I20260709 12:59:35.085423  4799 raft_consensus.cc:3055] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:35.042255  4727 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:59:35.064109  4788 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.089540  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:35.092576  1572 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:35.090436  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:35.085702  2438 rpcz_store.cc:276] 0709 12:59:34.078013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.078216 (+   203us) service_pool.cc:224] Handling call
0709 12:59:34.093828 (+ 15612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.772321 (+678493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.084967 (+312646us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54007102d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:35.085174 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558927744}
I20260709 12:59:34.975431  4876 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:59:35.024139  4778 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.055090  4851 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:35.105501  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.107801  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:35.077852  4791 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.108822  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.110509  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:35.109546  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:35.116014  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:35.085914  4799 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:35.119467   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:35.120959  1572 raft_consensus.cc:2393] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:35.077852  4883 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.122336  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:35.129037  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:35.129637  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.134083  1570 raft_consensus.cc:2368] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8.
I20260709 12:59:35.138767  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:35.141167  4788 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:35.119130  4690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.016s	sys 0.005s
W20260709 12:59:35.143784  4690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.016s	sys 0.005s
I20260709 12:59:35.134750  4851 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:35.146708  4851 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.151043  2440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 502) took 1115 ms. Trace:
I20260709 12:59:35.151593  2440 rpcz_store.cc:276] 0709 12:59:34.035604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.035785 (+   181us) service_pool.cc:224] Handling call
0709 12:59:34.036245 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.860163 (+823918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.150703 (+290540us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54005d02d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:35.150936 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1887219584}
I20260709 12:59:35.153110  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:35.062428  4796 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.168147  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:35.176805  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 115141us
I20260709 12:59:35.178843  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:35.182870  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 178516us
I20260709 12:59:35.200155  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.201927  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.136888  4814 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:35.213953  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:35.215159  1714 raft_consensus.cc:2393] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 8: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:35.216984  1685 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:35.224267  1720 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:35.227454  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.231586  1685 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:35.233067  4502 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:35.233659  4502 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:35.234169  4502 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:35.247093  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.249145  1716 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:35.250481  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.198556  4876 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:59:35.229388  4727 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:35.283630  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.291108  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:35.305183  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:35.311355  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.285910  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.314350  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:35.329766  4082 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:35.331947  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.333078  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.264465  4778 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:35.334460  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.339717  1714 raft_consensus.cc:2393] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:35.274608  4851 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.339911  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:35.340198  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:35.341794  2444 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:35.345598  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:35.283010  4757 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:35.346311  2444 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:35.346809  1714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:35.347404  1714 raft_consensus.cc:606] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:35.347764  1714 raft_consensus.cc:614] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:35.349545  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 292479us
I20260709 12:59:35.350776  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.352500  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.350768  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:35.354789  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:35.355134  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:35.355436  1646 raft_consensus.cc:2376] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9. Re-sending same reply.
I20260709 12:59:35.355795  1643 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:35.277510  4338 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.360320  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:35.361158  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:35.360929  1643 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:35.362607  1714 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 10: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:35.363320  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:35.366775  2405 leader_election.cc:336] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.886s (SENT)
I20260709 12:59:35.367314  2405 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:35.367790  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:35.369649  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:35.370227  1643 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:35.371331  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:35.371680  4892 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.371907  1643 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:35.373502  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:35.374027  1646 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:35.376639  4813 raft_consensus.cc:3055] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:35.377079  4813 raft_consensus.cc:740] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:35.378810  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:35.379448  1647 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:35.365195  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.360239  4851 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:35.405545  2405 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:35.460762  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 55348.8us
I20260709 12:59:35.377990  4813 consensus_queue.cc:260] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.344201  4477 consensus_queue.cc:1059] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:59:35.419661  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.358129  4757 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.247584  4799 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.372208  4892 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.474681  1645 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:59:35.475164  1645 pending_rounds.cc:85] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 6
I20260709 12:59:35.475445  1645 pending_rounds.cc:107] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:59:35.463752  4883 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:35.475904  1645 raft_consensus.cc:2889] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:35.476084  4883 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.455591  4788 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:35.456552  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 51168.9us
I20260709 12:59:35.398707  4778 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:59:35.472033  4338 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:35.396699  4674 consensus_queue.cc:1059] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:59:35.494329  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:35.495223  1645 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:35.486326  1646 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:35.447576  4862 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.492156  2436 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 12:59:35.470506  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.463935  4886 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.481277  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:35.463604  4828 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:35.533259  4886 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.482753  4796 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.499986  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:35.500916  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.463912  4878 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:35.485945  2444 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:35.504891  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:35.475374  4892 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:35.511901  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:35.524425  1565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:59:35.549645  1565 raft_consensus.cc:606] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:35.550100  1565 raft_consensus.cc:614] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:35.547209  1537 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:35.553361  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.554239  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.538522  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:35.538697  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 57554us
I20260709 12:59:35.529788  1712 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:35.554852  1645 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:35.466655  1647 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:35.556213  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:35.556231  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:35.557085  1647 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:35.557539  4353 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:35.483243  4883 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.546599  1646 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:35.514263  4813 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:35.559592  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:35.536947  4338 raft_consensus.cc:3055] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:35.478698  4794 consensus_queue.cc:1059] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:59:35.564786  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:35.575246  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:35.541659  4778 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:35.575871  1646 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:35.577121  4353 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:35.582322  4353 consensus_queue.cc:1059] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:35.577014  1647 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:35.494619  4788 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.583803  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:35.549491  4852 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:35.565997  4796 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:35.565641  4338 raft_consensus.cc:740] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:35.568408  4723 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:35.640604  1646 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:35.602246  1645 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:35.644995  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:35.645809  1645 raft_consensus.cc:2393] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:59:35.628389  4897 log.cc:927] Time spent T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:59:35.632457  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:35.650293  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:35.651615  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:35.652236  1638 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:59:35.653057  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:35.653604  1638 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:35.632638  1647 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:35.610138  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:35.660434  1612 leader_election.cc:400] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8.
I20260709 12:59:35.660775  1612 leader_election.cc:403] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:35.579950  4886 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.665378  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:35.668846  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:35.607841  4744 raft_consensus.cc:3055] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:35.684118  4744 raft_consensus.cc:740] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:35.684590  1646 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:35.685211  4744 consensus_queue.cc:260] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.658509  4607 raft_consensus.cc:1064] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 12:59:35.642565  4796 raft_consensus.cc:697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:35.689000  4796 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.691231  4607 consensus_queue.cc:237] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.693846  1646 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:35.674433  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:35.674266  4886 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:35.549127  4878 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.693964  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:35.675395  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:35.696033  1646 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:59:35.705721  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:35.698246  1685 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:35.699214  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:35.714953  1685 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:35.719895  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.724227  4876 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:35.724174  1685 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:35.730032  1569 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:35.735780  1685 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:35.712869  4906 log.cc:927] Time spent T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:59:35.668520  4723 raft_consensus.cc:697] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:35.743185  1685 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:35.748382  1685 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:35.753588  4082 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:35.754407  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 176242us
I20260709 12:59:35.718109  4727 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:35.757212  1715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:35.757925  1715 raft_consensus.cc:606] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:35.722559  4885 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:35.725024  4876 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:35.773737  4723 consensus_queue.cc:237] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.725893  4866 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:35.792506  4886 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8.
I20260709 12:59:35.756433  4800 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:35.779613  4878 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.780412  4876 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.781729  4895 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:35.745034  4338 consensus_queue.cc:260] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.764447  4794 consensus_queue.cc:1059] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 12:59:35.783929  4907 log.cc:927] Time spent T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:59:35.786234  4757 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:35.749655  4606 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:35.759408  1536 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:35.744699  4882 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:35.725581  4883 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:59:35.774645  4502 consensus_meta.cc:287] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.007s
I20260709 12:59:35.795406  1644 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:35.763120  4885 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:35.807642  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:35.815608  1569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
W20260709 12:59:35.816531  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 57199.7us
I20260709 12:59:35.796975  4727 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:35.823751  1644 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:59:35.826357  1569 raft_consensus.cc:606] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:35.827353  1569 raft_consensus.cc:614] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:35.817456  4338 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:35.832703  4727 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.828760  4885 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:35.864326  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.865146  1566 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:59:35.837620  4780 raft_consensus.cc:3055] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:35.822175  4826 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:35.843320  4687 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:35.843920  2406 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:35.844139  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:35.881408  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.844748  1569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:59:35.882128  1569 raft_consensus.cc:606] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:35.882542  1569 raft_consensus.cc:614] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:35.845516  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.883472  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.884847  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.885615  1569 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:35.847492  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.851460  1638 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:35.867254  4913 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:35.888981   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:35.889091  4913 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.851938  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.820703  4778 raft_consensus.cc:3055] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:35.851796  1714 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:35.810629  4895 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.824162  4794 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:35.867962  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.871038  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.873142  1536 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:35.820940  4502 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.878957  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:35.893138  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.829166  4886 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:35.861327  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.899161  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.900161  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.893591  4082 consensus_queue.cc:1059] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:59:35.908782  4082 raft_consensus.cc:3055] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:35.909240  4082 raft_consensus.cc:740] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:35.819262  4883 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.887980  4687 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.906752  4886 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.896088  4778 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:35.899055  4796 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:35.914907  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:35.887449  4716 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:35.878778  4780 raft_consensus.cc:740] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:35.918448  1564 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 3.
I20260709 12:59:35.904034  4837 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:35.927977  1720 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:35.916515  4788 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.934568  1569 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:59:35.891233  4826 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:35.928120  4082 consensus_queue.cc:260] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:35.943493  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.965476  4851 consensus_meta.cc:287] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.544s	user 0.013s	sys 0.000s
I20260709 12:59:35.973068  4851 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:35.967280  4880 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:35.976370  4880 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:35.977207  4826 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.965581  4082 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:35.980059  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:35.990336  4687 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.991032  4502 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:35.987771  4923 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:35.993330  4920 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:59:35.996214  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:35.996760  4883 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:35.978437  4880 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.998925  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:35.996891  1640 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:35.992864  4780 consensus_queue.cc:260] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:36.013461  2436 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:59:36.010808  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 137719us
I20260709 12:59:36.016449  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:36.018272  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.018013  1536 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:36.121366  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 229914us
I20260709 12:59:36.010598  1568 raft_consensus.cc:2955] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 12:59:36.123795  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 105839us
I20260709 12:59:36.124917  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:35.932065  4796 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.132591  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:35.970842  4723 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:36.146540  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.148458  4353 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:36.150285  4353 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:36.150769  4353 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:36.156304  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:36.157426  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:36.157816  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:36.159032  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:36.158414  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:36.161801  1611 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:36.164398  4803 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:36.173720  4744 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:36.174741  4928 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:36.175251  4928 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:36.175683  4928 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:36.176371  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.158639  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:36.178220  1611 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:36.157960  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:36.193285  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:36.195070  4353 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:36.190491  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 270357us
I20260709 12:59:36.129047  4883 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:36.119601  4794 raft_consensus.cc:697] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:36.143965  4780 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:36.214830  1611 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:36.219221  4353 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:35.999724  4778 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.208325  4757 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:36.135429  4851 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:59:36.192261  4913 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:36.242326  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 109880us
I20260709 12:59:36.235430  1611 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:36.176384  4607 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:36.192134  4931 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:36.203001  4803 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:36.249760  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:36.240372  4932 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:36.150897  4723 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.253274  1536 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:36.253136  1611 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:36.254525  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.274408  4353 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:36.274940  4353 raft_consensus.cc:697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:36.284615  1611 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:36.276961  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:36.290343  4353 consensus_queue.cc:237] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.297343  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:36.216785  4883 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:36.297698  1713 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:36.261492  4931 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.244326  4930 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:36.255260  4607 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:36.251338  4892 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:36.294754  4932 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:36.304894  4918 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 12:59:36.312321  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:36.257165  4913 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:59:36.289213  4929 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:36.309595  4803 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:36.325714  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:36.322665  4929 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:36.312743  4895 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:36.313994  4757 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:36.346675  4934 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:36.327711  4803 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:36.331652  4929 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:36.361970  4723 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:36.368098  4607 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:36.369715  2443 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:36.369474  4929 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.374862  4883 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:36.376638  4917 log.cc:927] Time spent T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.376s	user 0.001s	sys 0.002s
I20260709 12:59:36.358812  4803 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:36.377234  4929 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:36.377988  4905 log.cc:927] Time spent T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.774s	user 0.010s	sys 0.003s
W20260709 12:59:36.379047  4885 consensus_meta.cc:287] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 12:59:36.379469  4885 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:36.382027  4886 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:36.383350  4931 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:36.383373  4885 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:36.332162  4932 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:59:36.314450  4794 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.386088  4803 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.388266  4803 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:36.390659  4928 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.394695  4796 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:36.396016  4928 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:36.401261  4799 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:36.448740   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:59:36.453894  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 176813us
W20260709 12:59:36.459556  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.463099  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:36.466745  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:36.471737  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 164053us
W20260709 12:59:36.473245  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 147519us
I20260709 12:59:36.478981  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2501) took 1102 ms. Trace:
I20260709 12:59:36.479665  1639 rpcz_store.cc:276] 0709 12:59:35.376388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.376691 (+   303us) service_pool.cc:224] Handling call
0709 12:59:35.377030 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.377368 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:35.377394 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:35.377779 (+   385us) log.cc:844] Serialized 26 byte log entry
0709 12:59:35.521470 (+143691us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:35.521529 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.521616 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.377453 (+855837us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:36.478002 (+100549us) raft_consensus.cc:1685] finished
0709 12:59:36.478074 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.478720 (+   646us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1133,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":60,"spinlock_wait_cycles":10654464,"thread_start_us":142310,"threads_started":1,"wal-append.queue_time_us":187595}
I20260709 12:59:36.483137  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2513) took 1070 ms. Trace:
W20260709 12:59:36.483884  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.487501  1563 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:36.487699  1572 raft_consensus.cc:1240] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:36.491711  1564 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:36.483741  1643 rpcz_store.cc:276] 0709 12:59:35.412697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.701933 (+289236us) service_pool.cc:224] Handling call
0709 12:59:35.702391 (+   458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:35.721043 (+ 18652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.721097 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:35.741580 (+ 20483us) log.cc:844] Serialized 52 byte log entry
0709 12:59:35.896288 (+154708us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:35.922447 (+ 26159us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.128476 (+206029us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.128725 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.128833 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.413095 (+284262us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b180014dbe0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1ab522 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd 000000000038f354 000000000038f199 00007f18ca18e83a
0709 12:59:36.482479 (+ 69384us) raft_consensus.cc:1685] finished
0709 12:59:36.482562 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.482924 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10904,"prepare.queue_time_us":307455,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":2334,"raft.queue_time_us":20843,"raft.run_cpu_time_us":512,"raft.run_wall_time_us":21126,"spinlock_wait_cycles":8254720,"thread_start_us":328154,"threads_started":2,"wal-append.queue_time_us":165438}
I20260709 12:59:36.517848  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:36.577214  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1881) took 1034 ms. Trace:
I20260709 12:59:36.578200  4791 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:36.579066  4791 raft_consensus.cc:697] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:36.580590  1642 raft_consensus.cc:1240] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:59:36.581228  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 2514) took 1168 ms. Trace:
I20260709 12:59:36.581387  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1882) took 1033 ms. Trace:
I20260709 12:59:36.580866  4791 consensus_queue.cc:237] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.581749  1638 rpcz_store.cc:276] 0709 12:59:35.412972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.668509 (+255537us) service_pool.cc:224] Handling call
0709 12:59:36.580752 (+912243us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540033b8d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:36.580978 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311614848}
W20260709 12:59:36.584472  2443 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42646 (request call id 537) took 1500 ms (client timeout 1517 ms). Trace:
I20260709 12:59:36.586009  4878 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:36.586652  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 120267us
W20260709 12:59:36.587239  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.587045  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:36.587778  4778 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:36.581833  1642 rpcz_store.cc:276] 0709 12:59:35.547922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.579289 (+1031367us) service_pool.cc:224] Handling call
0709 12:59:36.579947 (+   658us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.581084 (+  1137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.581309 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:36.551017  4794 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:36.577775  1645 rpcz_store.cc:276] 0709 12:59:35.542358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.508183 (+965825us) service_pool.cc:224] Handling call
0709 12:59:36.508803 (+   620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.509289 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:36.509846 (+   557us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.576686 (+ 66840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.576750 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:36.576803 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.576876 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.577022 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15350,"prepare.queue_time_us":31266,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":2782,"raft.queue_time_us":18483,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":208,"spinlock_wait_cycles":522624,"thread_start_us":49369,"threads_started":1,"wal-append.queue_time_us":63063}
I20260709 12:59:36.604943  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1877) took 1058 ms. Trace:
I20260709 12:59:36.608747  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 401) took 1139 ms. Trace:
I20260709 12:59:36.609189  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:36.609303  1720 rpcz_store.cc:276] 0709 12:59:35.468836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.502998 (+ 34162us) service_pool.cc:224] Handling call
0709 12:59:35.545846 (+ 42848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.932066 (+386220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.601983 (+669917us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400016b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:36.608492 (+  6509us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878293760}
W20260709 12:59:36.592182  2443 rpcz_store.cc:269] 0709 12:59:35.083546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.083668 (+   122us) service_pool.cc:224] Handling call
0709 12:59:36.583996 (+1500328us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003ec6d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:36.584237 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2930830208}
I20260709 12:59:36.605542  1641 rpcz_store.cc:276] 0709 12:59:35.533247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.481822 (+948575us) service_pool.cc:224] Handling call
0709 12:59:36.499299 (+ 17477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.500083 (+   784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.500116 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:36.500871 (+   755us) log.cc:844] Serialized 26 byte log entry
0709 12:59:36.568351 (+ 67480us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:36.573532 (+  5181us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.590239 (+ 16707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.590354 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.590411 (+    57us) raft_consensus.cc:1685] finished
0709 12:59:36.590429 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.591550 (+  1121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32113,"prepare.queue_time_us":243,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":84,"raft.queue_time_us":73297,"raft.run_cpu_time_us":436,"raft.run_wall_time_us":16567,"thread_start_us":66950,"threads_started":1,"wal-append.queue_time_us":67443}
I20260709 12:59:36.621172  4794 raft_consensus.cc:697] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:36.627183  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:36.627489  4794 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.628276  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:36.630631  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:36.632853  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:36.634392  4913 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:36.637253  4913 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:36.637825  4913 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:36.647101  4941 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:36.647733  4941 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:36.647904  4852 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:36.648201  4941 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:36.648921  4852 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:36.651054  2444 raft_consensus.cc:1240] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:36.652812  4950 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.078s	user 0.002s	sys 0.000s
W20260709 12:59:36.655056  1640 consensus_meta.cc:287] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.655s	user 0.005s	sys 0.014s
I20260709 12:59:36.655540  1640 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:36.657145  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:36.649909  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.680662  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1884) took 1125 ms. Trace:
I20260709 12:59:36.681154  1642 rpcz_store.cc:276] 0709 12:59:35.555689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.617685 (+1061996us) service_pool.cc:224] Handling call
0709 12:59:36.674523 (+ 56838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.680267 (+  5744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.680296 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.680372 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:36.680410 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.680481 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.680597 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:36.685616  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 271) took 1093 ms. Trace:
I20260709 12:59:36.689424  1642 rpcz_store.cc:276] 0709 12:59:35.592577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.682184 (+1089607us) service_pool.cc:224] Handling call
0709 12:59:36.682692 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.683043 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.683068 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.683125 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:36.683160 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.685407 (+  2247us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.685565 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:36.696416  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:36.706300  4799 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:36.706686  4928 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:36.707394  4799 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.707654  4928 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.710541  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:36.714157  1570 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
W20260709 12:59:36.714869  1466 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 110) took 20030 ms (client timeout 15000 ms). Trace:
I20260709 12:59:36.725082  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1872) took 1195 ms. Trace:
I20260709 12:59:36.725639  1646 rpcz_store.cc:276] 0709 12:59:35.521062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.904552 (+383490us) service_pool.cc:224] Handling call
0709 12:59:35.904919 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.905393 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.905463 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:35.922085 (+ 16622us) log.cc:844] Serialized 26 byte log entry
0709 12:59:36.129482 (+207397us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:36.156133 (+ 26651us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.585292 (+429159us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b18003ea580. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca18de07 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1a8455 00007f18cd290060 00007f18cd2a2716 00007f18cd2b3287 00007f18cd2b3208
0709 12:59:36.691391 (+106099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.698726 (+  7335us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.701438 (+  2712us) raft_consensus.cc:1685] finished
0709 12:59:36.705877 (+  4439us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.716336 (+ 10459us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14927,"prepare.queue_time_us":24501,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":43448,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":19524,"spinlock_wait_cycles":57619328,"thread_start_us":191041,"threads_started":2,"wal-append.queue_time_us":307060}
I20260709 12:59:36.729662  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 275) took 1087 ms. Trace:
I20260709 12:59:36.733342  1646 rpcz_store.cc:276] 0709 12:59:35.642417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.728362 (+1085945us) service_pool.cc:224] Handling call
0709 12:59:36.728847 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.729237 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.729267 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.729320 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:36.729379 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.729451 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.729583 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:36.735991  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 103397us
I20260709 12:59:36.730926  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:36.752259  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:36.753820  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 270) took 1165 ms. Trace:
I20260709 12:59:36.754247  1641 rpcz_store.cc:276] 0709 12:59:35.588064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.674650 (+1086586us) service_pool.cc:224] Handling call
0709 12:59:36.718182 (+ 43532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.753513 (+ 35331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.753548 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.753593 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:36.753626 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.753680 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.753768 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:36.756191  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1889) took 1055 ms. Trace:
I20260709 12:59:36.755574  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1888) took 1054 ms. Trace:
I20260709 12:59:36.756556  1641 rpcz_store.cc:276] 0709 12:59:35.700990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.755158 (+1054168us) service_pool.cc:224] Handling call
0709 12:59:36.755549 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.755895 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.755919 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.755988 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:36.756016 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.756065 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.756146 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:36.758213  4788 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:36.757229  1646 rpcz_store.cc:276] 0709 12:59:35.700723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.742504 (+1041781us) service_pool.cc:224] Handling call
0709 12:59:36.754747 (+ 12243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.755142 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.755186 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.755251 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:36.755292 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.755357 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.755499 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:36.758610  1720 raft_consensus.cc:2393] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:36.757184  1642 raft_consensus.cc:1240] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:36.762036  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:36.762542  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 274) took 1131 ms. Trace:
I20260709 12:59:36.763026  1640 rpcz_store.cc:276] 0709 12:59:35.631538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.693829 (+1062291us) service_pool.cc:224] Handling call
0709 12:59:36.738672 (+ 44843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.762080 (+ 23408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.762116 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.762197 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:36.762255 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.762331 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.762480 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:36.764170  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38394 (request call id 277) took 1284 ms. Trace:
I20260709 12:59:36.764626  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:36.766422  4940 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:36.767076  4940 raft_consensus.cc:697] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:36.764569  1570 rpcz_store.cc:276] 0709 12:59:35.480374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.480529 (+   155us) service_pool.cc:224] Handling call
0709 12:59:36.739168 (+1258639us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b540031bfd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:36.764062 (+ 24894us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2099896704}
I20260709 12:59:36.768955  1572 raft_consensus.cc:1240] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:36.768675  4940 consensus_queue.cc:237] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.760562  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 273) took 1141 ms. Trace:
I20260709 12:59:36.776504  1642 rpcz_store.cc:276] 0709 12:59:35.618845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.696451 (+1077606us) service_pool.cc:224] Handling call
0709 12:59:36.756915 (+ 60464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.760355 (+  3440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.760516 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:36.717626  4885 consensus_queue.cc:1059] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:59:36.731997  4852 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:36.802886  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 59796.5us
I20260709 12:59:36.804242  4799 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:36.811405  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1883) took 1263 ms. Trace:
I20260709 12:59:36.811810  1647 rpcz_store.cc:276] 0709 12:59:35.549713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.583727 (+1034014us) service_pool.cc:224] Handling call
0709 12:59:36.584287 (+   560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.584833 (+   546us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:36.585350 (+   517us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.715085 (+129735us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b1800402c40. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1ab3f3 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd 000000000038f354 000000000038f199 00007f18ca18e83a
0709 12:59:36.783251 (+ 68166us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.810964 (+ 27713us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.811012 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:36.811052 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.811112 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.811235 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119294,"prepare.queue_time_us":57524,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":17736,"raft.queue_time_us":74700,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":167,"spinlock_wait_cycles":5422720,"thread_start_us":102952,"threads_started":2,"wal-append.queue_time_us":93946}
W20260709 12:59:36.815634  4947 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 12:59:36.823773  4928 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:36.715263  1466 rpcz_store.cc:269] 0709 12:59:16.630190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.630483 (+   293us) service_pool.cc:224] Handling call
0709 12:59:36.660857 (+20030374us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:34.142484 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:34.143367 (+   883us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:34.143425 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:59:34.143454 (+    29us) tablet.cc:662] Decoding operations
0709 12:59:34.143932 (+   478us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:34.144010 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:34.144048 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:34.144271 (+   223us) tablet.cc:701] Row locks acquired
0709 12:59:34.144287 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:59:34.144475 (+   188us) write_op.cc:270] Start()
0709 12:59:34.144638 (+   163us) write_op.cc:276] Timestamp: P: 1783601974144417 usec, L: 0
0709 12:59:34.144666 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:59:34.145604 (+   938us) log.cc:844] Serialized 536 byte log entry
0709 12:59:35.144765 (+999161us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b18002c1f40. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1ab3f3 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd 000000000038f354 000000000038f199 00007f18ca18e83a
0709 12:59:35.495852 (+351087us) op_driver.cc:464] REPLICATION: finished
0709 12:59:35.645433 (+149581us) write_op.cc:301] APPLY: starting
0709 12:59:35.645552 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:35.645709 (+   157us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:35.645743 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:35.663927 (+ 18184us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:35.674806 (+ 10879us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:35.674865 (+    59us) write_op.cc:312] APPLY: finished
0709 12:59:35.675157 (+   292us) log.cc:844] Serialized 23 byte log entry
0709 12:59:35.675361 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:35.675450 (+    89us) write_op.cc:454] Released schema lock
0709 12:59:35.675496 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:35.675902 (+   406us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:35.675950 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":219831,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":149194,"apply.run_cpu_time_us":2136,"apply.run_wall_time_us":30455,"num_ops":1,"prepare.queue_time_us":315907,"prepare.run_cpu_time_us":24052,"prepare.run_wall_time_us":246866,"raft.queue_time_us":255362,"raft.run_cpu_time_us":7969,"raft.run_wall_time_us":90030,"replication_time_us":1346472,"spinlock_wait_cycles":35045760,"thread_start_us":585721,"threads_started":4,"wal-append.queue_time_us":234759,"wal-append.run_cpu_time_us":27773,"wal-append.run_wall_time_us":1531236}]]}
I20260709 12:59:36.826942  1611 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:36.828730  1611 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:36.829691  4951 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:36.830503  4951 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:36.832093  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.844424  4828 raft_consensus.cc:3055] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:36.845552  4828 raft_consensus.cc:740] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:36.852136  1567 raft_consensus.cc:1240] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:36.853729  1642 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:36.855556  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1879) took 1308 ms. Trace:
I20260709 12:59:36.856006  1639 rpcz_store.cc:276] 0709 12:59:35.533814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.482944 (+949130us) service_pool.cc:224] Handling call
0709 12:59:36.483469 (+   525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.483899 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.483926 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:36.484525 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:59:36.671655 (+187130us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:36.718550 (+ 46895us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.724003 (+  5453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.724101 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.842362 (+118261us) raft_consensus.cc:1685] finished
0709 12:59:36.842381 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.842494 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54230,"prepare.queue_time_us":50199,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":12846,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":16458,"spinlock_wait_cycles":1276288,"thread_start_us":177542,"threads_started":1,"wal-append.queue_time_us":202116}
I20260709 12:59:36.867637  1640 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:36.869330  4947 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.052s	user 0.003s	sys 0.000s
I20260709 12:59:36.905839  1563 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:59:36.906383  1563 pending_rounds.cc:85] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 4
I20260709 12:59:36.906663  1563 pending_rounds.cc:107] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:59:36.907011  1563 raft_consensus.cc:2889] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:36.853715  4941 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.885035  4828 consensus_queue.cc:260] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:36.912580  4941 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:36.913185  4828 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:36.914258  4943 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:36.914950  4943 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:36.915453  4949 log.cc:927] Time spent T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.238s	user 0.000s	sys 0.003s
I20260709 12:59:36.915133  1469 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 5 to 6, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195), no longer has a pending config: VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193), VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194), VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195), NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:36.917025  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1880) took 1383 ms. Trace:
I20260709 12:59:36.917382  4943 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:36.917436  1643 rpcz_store.cc:276] 0709 12:59:35.537720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.502118 (+964398us) service_pool.cc:224] Handling call
0709 12:59:36.502733 (+   615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.503499 (+   766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.503537 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:36.504180 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 12:59:36.619753 (+115573us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:36.686467 (+ 66714us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.700259 (+ 13792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.700346 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.875262 (+174916us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:36.916693 (+ 41431us) raft_consensus.cc:1685] finished
0709 12:59:36.916819 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.916958 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24169,"prepare.queue_time_us":69941,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":1945,"raft.queue_time_us":77134,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":11018,"spinlock_wait_cycles":19780480,"thread_start_us":115039,"threads_started":1,"wal-append.queue_time_us":171430}
I20260709 12:59:36.918769  1469 catalog_manager.cc:5697] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 4 to 5, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:36.924607  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1890) took 1223 ms. Trace:
I20260709 12:59:36.925161  1641 rpcz_store.cc:276] 0709 12:59:35.701309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.757575 (+1056266us) service_pool.cc:224] Handling call
0709 12:59:36.758040 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.900793 (+142753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.900839 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.924210 (+ 23371us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:36.924276 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.924389 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.924540 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:36.921906  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1891) took 1167 ms. Trace:
I20260709 12:59:36.926477  1646 rpcz_store.cc:276] 0709 12:59:35.754782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.805878 (+1051096us) service_pool.cc:224] Handling call
0709 12:59:36.904164 (+ 98286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.921489 (+ 17325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.921530 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.921601 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:36.921642 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.921706 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.921842 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:36.921026  1469 catalog_manager.cc:5697] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 4 to 5, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:36.929152  4943 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:36.900807  4951 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:36.887097  4788 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:36.934883  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:36.937575  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 50433.7us
W20260709 12:59:36.939800  4953 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:59:36.940419  1685 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:36.941432  4802 consensus_queue.cc:1059] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:36.943889  4802 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:36.944425  4802 raft_consensus.cc:697] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:36.948765  4802 consensus_queue.cc:237] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:36.950232  4878 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:36.950940  4788 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.951743  4878 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:36.955117  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 61424.3us
I20260709 12:59:36.953869  4788 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:36.965999  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:36.923476  4913 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.971058  4694 raft_consensus.cc:3055] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:36.954900  4878 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:36.971129  4837 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:36.978087  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1876) took 1429 ms. Trace:
I20260709 12:59:36.978534  1644 rpcz_store.cc:276] 0709 12:59:35.532963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.479482 (+946519us) service_pool.cc:224] Handling call
0709 12:59:36.480338 (+   856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.481243 (+   905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.481272 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:36.526591 (+ 45319us) log.cc:844] Serialized 26 byte log entry
0709 12:59:36.691160 (+164569us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:36.702587 (+ 11427us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.716729 (+ 14142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.716825 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.938866 (+222041us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:36.957798 (+ 18932us) raft_consensus.cc:1685] finished
0709 12:59:36.962539 (+  4741us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.962677 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1183,"prepare.queue_time_us":30982,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":15701,"raft.queue_time_us":74933,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":3546,"spinlock_wait_cycles":37857280,"thread_start_us":92286,"threads_started":1,"wal-append.queue_time_us":292720}
I20260709 12:59:36.980651  1569 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:36.982235  4913 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:36.992703  4956 log.cc:927] Time spent T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.119s	user 0.002s	sys 0.000s
I20260709 12:59:36.961200  4943 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:36.973011  4694 raft_consensus.cc:740] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:36.999797  4694 consensus_queue.cc:260] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:37.005334  4954 log.cc:927] Time spent T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260709 12:59:36.988832  1469 catalog_manager.cc:5697] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 7 to 8, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.007637  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.005579  4694 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:36.971974  4951 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:37.015694  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 91905.3us
I20260709 12:59:37.035669  4837 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.036580  4837 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.043743  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1885) took 1479 ms. Trace:
I20260709 12:59:37.044716  1645 rpcz_store.cc:276] 0709 12:59:35.564636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.603164 (+1038528us) service_pool.cc:224] Handling call
0709 12:59:36.603830 (+   666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.606975 (+  3145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.607004 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:36.660481 (+ 53477us) log.cc:844] Serialized 26 byte log entry
0709 12:59:36.696491 (+ 36010us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:36.729891 (+ 33400us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.795834 (+ 65943us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b1800268ba0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca125c0a 00007f18d3865219 00007f18ca1ada40 00007f18ca1a84e4 00007f18ca1a8455 00007f18cd290060 00007f18cd2a2716 00007f18cd2b3287 00007f18cd2b3208
0709 12:59:36.797757 (+  1923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.797862 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.822440 (+ 24578us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b1800268ba0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1ab522 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd 000000000038f354 000000000038f199 00007f18ca18e83a
0709 12:59:36.968260 (+145820us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:37.043498 (+ 75238us) raft_consensus.cc:1685] finished
0709 12:59:37.043519 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.043676 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49952,"prepare.queue_time_us":41185,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":68095,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":8128,"spinlock_wait_cycles":105211776,"thread_start_us":35425,"threads_started":1,"wal-append.queue_time_us":84585}
I20260709 12:59:37.025906  4788 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:37.068233  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1886) took 1491 ms. Trace:
I20260709 12:59:37.070040  1469 catalog_manager.cc:5697] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 6 to 7, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:37.068607  1638 rpcz_store.cc:276] 0709 12:59:35.576737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.610736 (+1033999us) service_pool.cc:224] Handling call
0709 12:59:36.611214 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:36.611852 (+   638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:36.611887 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:36.612414 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 12:59:36.699739 (+ 87325us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:36.730307 (+ 30568us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.797813 (+ 67506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.797884 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.975633 (+177749us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:37.064023 (+ 88390us) raft_consensus.cc:1685] finished
0709 12:59:37.067058 (+  3035us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.068183 (+  1125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123718,"prepare.queue_time_us":44840,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":74,"raft.queue_time_us":73356,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":16214,"spinlock_wait_cycles":31401856,"thread_start_us":86870,"threads_started":1,"wal-append.queue_time_us":104582}
I20260709 12:59:37.072868  4943 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.071228  4788 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:37.101428  4960 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:59:37.101953  4951 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.103055  4674 raft_consensus.cc:993] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 12:59:37.104460  4613 raft_consensus.cc:1081] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 12:59:37.098657  1469 catalog_manager.cc:5697] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
W20260709 12:59:37.114789  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 89843.8us
W20260709 12:59:37.119336  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 149452us
I20260709 12:59:37.121677  4814 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:37.123205  4814 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.125679  4814 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:37.130549  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:37.140372  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:37.133490  4940 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:37.144709  4940 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.145237  4837 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:37.146301  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:37.147017  4940 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:37.148116  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:37.143399  4778 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:37.149655  4778 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.150194  4613 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:37.162676  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:37.171532  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.176239  1645 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:37.176586  4788 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:37.176868  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:37.177659  2436 raft_consensus.cc:2393] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 6: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:37.171730  4837 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.157387  4943 raft_consensus.cc:2955] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:37.188879  1469 catalog_manager.cc:5697] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 6 to 7, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.195518  4778 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:37.195855  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:37.197074  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:37.197769  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:37.198464  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:37.202132  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 107188us
I20260709 12:59:37.222586  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:37.234376  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:37.234920  4802 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:37.235142  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:37.313213  4791 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.310643  1469 catalog_manager.cc:5697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 5 to 7, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:37.314533  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.313521  4865 consensus_queue.cc:1059] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:59:37.319167  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.305524  4778 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:37.310110  4613 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.347083  4613 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.349375  4613 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:37.314644  1639 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.331977  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.350940  1713 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:37.352218  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.352941  1717 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
I20260709 12:59:37.333227  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:37.333766  4474 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.355031  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.355195  1612 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.355437  4474 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.356102  1469 catalog_manager.cc:5697] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 6 to 7, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:37.357158  1714 raft_consensus.cc:2955] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:37.358935  4474 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:37.362607  4474 raft_consensus.cc:3055] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:37.363093  4474 raft_consensus.cc:740] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:37.364038  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:37.364351  4474 consensus_queue.cc:260] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.366034  4474 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.356056  1716 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:37.367466  4788 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:37.368201  4788 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.369380  1639 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:37.373669  4788 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:37.375128  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.376129  4931 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:37.376554  4931 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:37.376950  4931 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.377063  4788 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:37.319917  4828 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.343343  4802 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.380216  4828 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.381469  2436 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:37.381729  4802 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:37.345875  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.382697  1721 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:37.346119  4778 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.384734  4778 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:37.385569  4931 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.379165  1469 catalog_manager.cc:5697] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:37.387559  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:37.403028  2436 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 11: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:37.404103  1469 catalog_manager.cc:5697] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 4, term changed from 2 to 6, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to <none>, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:37.389853  1720 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:37.408892  1469 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:37.411643  1469 catalog_manager.cc:5697] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:37.390317  4778 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:37.392678  4828 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:37.376718  1612 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:37.394861  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.396334  4865 consensus_queue.cc:1059] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:37.397655  4802 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:37.389555  1536 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:37.390180  4791 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.435667  4794 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:37.435590  4931 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.432829  4943 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:37.438807  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 62194.6us
I20260709 12:59:37.443873  1612 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.445475  4966 raft_consensus.cc:3055] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:37.438174  4802 consensus_queue.cc:1059] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:59:37.445974  4966 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:37.438336  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 48862us
I20260709 12:59:37.445895  4943 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:37.446992  4928 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.447486  4802 raft_consensus.cc:3055] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:37.447093  4966 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.447899  4802 raft_consensus.cc:740] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:37.447616  4928 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.448298  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.448421  4941 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:37.449196  4941 raft_consensus.cc:3055] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:37.449522  4941 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:37.449587  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.439278  4865 raft_consensus.cc:3055] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:37.450431  4865 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:37.447021  4943 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:37.450371  4941 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.444571  4791 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.451671  4865 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.452324  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.452677  4928 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.453070  4865 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:37.453351  4943 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.454523  4941 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.455190  1564 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:37.455441  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.456305  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.456538  4837 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:37.457651  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.445678  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.459246  4878 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:37.468642   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:37.468981  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.469911  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.470583  1563 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 12:59:37.453941  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.473891  4966 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.477613  4802 consensus_queue.cc:260] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.480180  4802 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.481788  1569 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:37.485170  4865 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.485910  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.486682  4878 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:37.488240  1612 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.488940  4878 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:37.490221  1612 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.485783  4865 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.497184  4865 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:37.499838  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.501192  4878 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:37.502365  1611 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:37.502887  4878 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.503525  4878 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.505600  4878 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.506106  4878 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:37.506672  4878 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.508986  4878 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:37.511268  4778 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:37.518544  4778 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:37.520648  4778 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.521553  1611 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:37.523402  1611 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:37.529564  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:37.530222  1569 raft_consensus.cc:2376] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10. Re-sending same reply.
I20260709 12:59:37.531424  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.532027  1569 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:37.534475  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.535197  4943 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.538163  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:37.538731  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 48652.3us
I20260709 12:59:37.539144  4828 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:37.566617  4828 raft_consensus.cc:697] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:37.567610  4828 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.538003  4943 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.539304  4694 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:37.539707  2406 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:37.572644  4826 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:37.573136  4826 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.573559  4826 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.574517  1612 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.579011  4943 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:37.551548  1569 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:37.552829  1566 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:37.551033  4474 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:37.554282  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.554677  2440 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:37.583153  4788 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:37.557049  4951 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:37.583877  4474 raft_consensus.cc:3055] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:37.583984  4951 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:37.584318  4474 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:37.584375  4788 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:37.585031  4951 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.561118  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.562074  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.580803  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.580952  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:37.525301  4878 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:37.588011  2436 raft_consensus.cc:2376] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6. Re-sending same reply.
I20260709 12:59:37.588063  4878 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:37.588671  4878 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:37.591383  4474 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.593644  4474 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.594385  1566 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:37.585039  4788 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.597702  4943 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:37.559829  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.598150  4943 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.584561  4837 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.589449  4826 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.598927  4837 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.603551  4837 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.604734  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.605412  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.606007  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.610308  1572 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 12:59:37.603566  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:37.611356  1566 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.611011  4826 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:37.612953  2406 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.614457  4826 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:37.615163  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.615358  4826 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.615720  4826 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:37.577994  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:37.617931  1572 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:37.619251  4972 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:37.620609  1612 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.628018  4972 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:37.629112  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:37.627552  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.655507  1572 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 12:59:37.638193  1566 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 12:59:37.639801  4951 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.643803  4826 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.647195  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.647975  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.648838  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.637342  4788 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.649945  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.652009  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.602995  4878 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.652827  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.673333  2406 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:37.653761  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:37.677562  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 57058.6us
I20260709 12:59:37.681670  1715 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:37.659863  4972 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:37.682116  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:37.683035  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.686236  4943 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.693018  1719 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:37.696266  1716 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 12:59:37.674134  4474 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.704799  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.680131  4828 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:37.677227  4966 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:37.708165  1612 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.708837  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.712330  4951 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.713076  4966 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.715257  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:37.716827  4826 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.715449  4828 raft_consensus.cc:697] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:37.705993  4474 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.718045  4828 consensus_queue.cc:237] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.718880  4878 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.719362  4474 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:37.720669  4976 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:59:37.703318  4972 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.723232  4966 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:37.715936  4951 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:37.716601  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.728520  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.729247  1716 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.729336  1719 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:37.715137  4788 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.727389  4931 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:37.732412  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:37.732791  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.732950  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.732975  1566 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:37.734790  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.738304  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.739387  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.742971  1566 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 12:59:37.745646  4828 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.749080  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.756667  1721 raft_consensus.cc:2393] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 6: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:37.756415  4828 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.757586  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.713972  4943 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.759123  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.759722  1572 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 12:59:37.750561  1612 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.750834  1720 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:37.760900  2406 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:37.751312  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.754347  1712 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:37.755299  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.755576  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.763031  1719 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:37.763162  1717 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:37.763545  2406 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.758621  4828 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.764751  4943 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.765142  1717 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:37.765409  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.765604  1718 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:37.765334  4943 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.766897  4826 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:37.770362  4878 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:37.770653  4826 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.771098  4826 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:37.771236  4828 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:37.771626  4943 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:37.771906  4828 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:37.772944  4828 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.751801  4972 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.774250  4951 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:37.768200  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.777127  1612 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.780565  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.786763  1718 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:37.786864  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.779541  4972 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.785732  4878 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:37.789042  4878 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:37.789461  4878 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:37.785274  1716 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:59:37.793188  1611 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:37.795076  2443 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:37.781347  1721 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 12:59:37.804075  4972 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:37.804390  4913 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:37.804778  4943 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:37.805534  4943 raft_consensus.cc:697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:37.806043  1715 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:37.806600  4943 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.803638  4966 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.808805  4966 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.810513  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:37.813764  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.822278  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:37.823144  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.823710  1572 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 12:59:37.810729  4826 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:37.827193  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 50126.6us
I20260709 12:59:37.828045  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:37.830533  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:37.835613  2443 raft_consensus.cc:2368] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12.
I20260709 12:59:37.836010  4878 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.836714  4826 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.837137  4928 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:37.837648  4928 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:37.811257  4913 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:37.839581  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:37.841631  1572 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:37.841998  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:37.838263  4791 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:37.840457  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.846422  1721 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:59:37.850730  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:37.851501  1715 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:37.852897  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.850088  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:37.855089  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:37.839830  4972 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:37.856194  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:37.860428  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:37.862636  1641 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:37.852753  2443 raft_consensus.cc:2955] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:37.858381  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:37.882081  4794 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.882411  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:37.884730  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:37.886014  4474 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.861768  4972 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:37.887964  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:37.840768  4878 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:37.894793  1572 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 12:59:37.892371  4865 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:59:37.886709  4474 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.899021  4474 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:37.899690  4966 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:37.899816  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.893744  4972 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.894423  4794 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.838574  4928 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.900226  1721 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 12:59:37.852922  4951 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.905262  4951 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.907459  4951 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:37.908321  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.853184  4913 raft_consensus.cc:697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:37.943030  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:37.943068  2405 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:37.948014  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:37.948640  4826 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:37.958000  1715 raft_consensus.cc:2410] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:37.958853  4794 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:37.960196  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 72318.9us
I20260709 12:59:37.961398  4674 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:37.961933  4674 raft_consensus.cc:697] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:37.962960  4674 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:37.963923  4865 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:37.966780  4794 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:37.966924  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:37.969465  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:37.971414  4791 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:37.972121  4791 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:37.973466  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:37.974663  4791 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:37.974714  1643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 12:59:37.976828  4913 consensus_queue.cc:237] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:37.977259  1536 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:37.985405  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:37.987978  4791 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:37.989037  4794 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:37.991146  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:37.997663  1639 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.993160  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:38.003799  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:37.996102  4941 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:38.004019  1645 raft_consensus.cc:1240] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:37.987419  4826 raft_consensus.cc:697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:37.996227  4878 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:38.018529  4878 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.021692  4878 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:38.021915  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:38.023324  1643 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:38.023777  1643 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:38.003368  4931 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:38.030630  1640 raft_consensus.cc:1240] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:38.033154  1641 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 12:59:38.037076  1638 raft_consensus.cc:1240] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:38.041371  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:38.038255  4931 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:38.017589  4826 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:38.049026  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:38.049674  1715 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:38.051345  4931 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:38.052177  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:38.053462  1611 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:38.054698  4943 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:38.055107  4943 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:38.055481  4943 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:38.056136  4972 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.063601  4943 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:38.053481  1647 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:38.066779  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:38.067096  4943 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:38.068828  4972 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:38.073896  1715 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:38.074414  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:38.075189  1721 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:38.076058  1611 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:38.077510  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:38.078438  1638 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 8: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 12:59:38.085999  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.086810  1641 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:38.088336  1639 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 12:59:38.094254  4931 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:38.095105  4931 raft_consensus.cc:697] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:38.096194  4931 consensus_queue.cc:237] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:38.103138  1643 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.105623  1643 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:38.107777  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:38.108440  1721 raft_consensus.cc:3055] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:38.108759  1721 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:38.109587  1721 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.114818  1721 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:59:38.115195  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 127978us
I20260709 12:59:38.127035  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:38.129562  1639 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 9. Ops: []
I20260709 12:59:38.135587  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:38.141630  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:38.142350  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 180402us
I20260709 12:59:38.142482  1641 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:38.141099  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:38.144850  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:38.148492  1721 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 12:59:38.148828  1643 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:38.148923  1647 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:38.144088  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:38.150239  1611 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:38.150388  1686 leader_election.cc:400] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12.
I20260709 12:59:38.151094  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:38.148029  1641 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:38.151747  1639 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:38.152055  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:38.151213  1686 leader_election.cc:403] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:38.155766  1641 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:38.156098  1638 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:38.143505  4991 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:38.153558  4791 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:38.158079  1639 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:38.158764  4651 consensus_queue.cc:1059] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:38.144616  4913 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:38.175101  4651 raft_consensus.cc:3055] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:38.175227  4913 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.175527  4651 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:38.175685  4913 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:38.176476  4651 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.177650  4651 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:38.144225  4928 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:38.162870  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:38.179302  1638 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:38.164851  1647 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:38.159271  4837 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.165341  4674 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:38.165838  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:38.166008  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:38.167197  4794 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:38.168227  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:38.156038  4972 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:38.156214  4694 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12.
I20260709 12:59:38.154165  4941 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:38.200076  1646 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:38.200381  1641 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:59:38.203711  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 49665.3us
I20260709 12:59:38.205442  1646 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:38.225196  1466 catalog_manager.cc:5697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.203365  4972 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:38.199878  4865 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:38.239334  1536 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:38.226882  1466 catalog_manager.cc:5697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.203537  4941 raft_consensus.cc:697] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:38.193217  4837 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:38.240787  4865 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.254364  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:38.256124  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:38.259564  2443 raft_consensus.cc:2393] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:38.254186  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:38.258924  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:38.265506  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:38.266496  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:38.268756  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:38.269942  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:38.270690  1569 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:38.271690  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:38.269748  1685 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:38.273874  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:38.241117  4928 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.016s
W20260709 12:59:38.274477  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 68087.1us
I20260709 12:59:38.275101  2436 raft_consensus.cc:2393] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:38.277221  4837 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:38.277311  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:38.277539  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58252 (request call id 218) took 10503 ms. Trace:
I20260709 12:59:38.278192  1570 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:38.262395  4865 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:38.275378  1466 catalog_manager.cc:5697] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:38.251912  4996 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:38.288651  1466 catalog_manager.cc:5697] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 8, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.290364  1565 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:38.297165  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:38.291467  1466 catalog_manager.cc:5697] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:38.298489  1466 catalog_manager.cc:5697] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 8, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:38.265291  4778 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:59:38.303290  1566 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:38.306536  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.284915  1469 rpcz_store.cc:276] 0709 12:59:27.774615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.837499 (+ 62884us) service_pool.cc:224] Handling call
0709 12:59:38.277467 (+10439968us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:37.565389 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:37.566162 (+   773us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:37.566225 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:59:37.566246 (+    21us) tablet.cc:662] Decoding operations
0709 12:59:37.567616 (+  1370us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:37.567730 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:37.567758 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:59:37.569248 (+  1490us) tablet.cc:701] Row locks acquired
0709 12:59:37.569298 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:59:37.569457 (+   159us) write_op.cc:270] Start()
0709 12:59:37.569622 (+   165us) write_op.cc:276] Timestamp: P: 1783601977569394 usec, L: 0
0709 12:59:37.569648 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:59:37.571601 (+  1953us) log.cc:844] Serialized 5217 byte log entry
0709 12:59:37.853011 (+281410us) op_driver.cc:464] REPLICATION: finished
0709 12:59:38.049053 (+196042us) write_op.cc:301] APPLY: starting
0709 12:59:38.049169 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:38.049506 (+   337us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:38.049653 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:38.051396 (+  1743us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:38.051795 (+   399us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:59:38.051849 (+    54us) write_op.cc:312] APPLY: finished
0709 12:59:38.052255 (+   406us) log.cc:844] Serialized 95 byte log entry
0709 12:59:38.052459 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:38.052617 (+   158us) write_op.cc:454] Released schema lock
0709 12:59:38.052687 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:38.069658 (+ 16971us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:38.069688 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4780,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":168404,"apply.run_cpu_time_us":4051,"apply.run_wall_time_us":20595,"num_ops":13,"prepare.queue_time_us":38107,"prepare.run_cpu_time_us":11994,"prepare.run_wall_time_us":109870,"raft.queue_time_us":116704,"raft.run_cpu_time_us":58006,"raft.run_wall_time_us":163215,"replication_time_us":268986,"thread_start_us":283708,"threads_started":4,"wal-append.queue_time_us":7004}]]}
I20260709 12:59:38.308681  4999 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:38.309302  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.304180  1466 catalog_manager.cc:5697] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.311369  1466 catalog_manager.cc:5697] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 6 to 7, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
W20260709 12:59:38.300130  4994 log.cc:927] Time spent T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.124s	user 0.001s	sys 0.002s
I20260709 12:59:38.314700  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:38.313208  1466 catalog_manager.cc:5697] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 6, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:38.323742  1466 catalog_manager.cc:5697] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 8 to 9, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:38.332697  1466 catalog_manager.cc:5697] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 10 to 11, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:38.345008  2436 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:59:38.332736  1570 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 4.
W20260709 12:59:38.340030  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 77352.8us
I20260709 12:59:38.326576  1612 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:38.344168  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 43869.7us
W20260709 12:59:38.349012  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.348830  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:38.352898  2405 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:38.351365  1466 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 8, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.356942  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:38.345986  4828 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.348624  4943 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.359258  1466 catalog_manager.cc:5697] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:38.368067  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:38.368412  1466 catalog_manager.cc:5697] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 6, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:38.369923  1466 catalog_manager.cc:5697] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 6 to 7, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
W20260709 12:59:38.370963  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 44469.5us
I20260709 12:59:38.372306  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:38.372151  1466 catalog_manager.cc:5697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 8, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:38.373766  1612 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:38.377779  1715 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:38.378204  1715 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:38.375612  1466 catalog_manager.cc:5697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 6 to 7, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 7 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.379514  1466 catalog_manager.cc:5697] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:38.380739  1566 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:38.380925  1466 catalog_manager.cc:5697] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 4 to 7, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 7 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.383333  1644 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:38.387729  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:38.386215  1466 catalog_manager.cc:5697] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 8, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.316488  4972 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.378000  4931 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:38.371520  4794 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:38.376652  4928 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:38.385043  4951 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:38.368070  4828 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:38.379338  1565 raft_consensus.cc:2955] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:38.394610  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:38.338615  4941 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.389169  1466 catalog_manager.cc:5697] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.422871  1612 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:38.384765  1715 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:38.387061  4991 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:38.404529  1563 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:38.405949  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:38.415145  4694 consensus_queue.cc:1059] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:38.419860  4794 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.403798  4852 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:38.440400  4997 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:59:38.440834  4791 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:38.440596  4852 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:38.441550  5003 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:38.412119  1566 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:38.424486  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:38.426899  1612 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:38.384431  4996 raft_consensus.cc:697] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:38.442909  1567 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:38.445300  1612 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:38.445768  1466 catalog_manager.cc:5697] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 8, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:38.449882  1569 raft_consensus.cc:1240] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:38.453260  1466 catalog_manager.cc:5697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.455678  1466 catalog_manager.cc:5697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.456071  1612 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:38.457479  1466 catalog_manager.cc:5697] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 7, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:38.462749  1570 raft_consensus.cc:1240] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:38.440153  4878 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:38.475895  1466 catalog_manager.cc:5697] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 9 to 10, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:38.459524  4943 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:38.510218  1466 catalog_manager.cc:5697] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.513262  1466 catalog_manager.cc:5697] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: leader changed from <none> to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:38.404016  4928 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.442783  4966 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 12:59:38.506634  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 61403.3us
I20260709 12:59:38.444378  4791 consensus_queue.cc:1059] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:59:38.515457  1466 catalog_manager.cc:5697] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:38.458935  4989 consensus_queue.cc:1059] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 12:59:38.493923  4931 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:38.525730  1536 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:38.529389  1569 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:59:38.527423  1466 catalog_manager.cc:5697] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
W20260709 12:59:38.531323  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 144209us
I20260709 12:59:38.559121  1466 catalog_manager.cc:5697] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 8, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.493112  4913 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.564851  1466 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 6 to 7, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 7 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:38.507372  4694 consensus_queue.cc:1059] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:59:38.571190  1466 catalog_manager.cc:5697] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 4 to 5, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 5 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.575562  1686 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:38.584085  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 58452.9us
I20260709 12:59:38.584285  1720 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:59:38.585834  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:38.592094  2440 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:38.515641  5005 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:59:38.601508  1564 raft_consensus.cc:2368] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
W20260709 12:59:38.595397  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 90480.9us
I20260709 12:59:38.604969  1568 raft_consensus.cc:3055] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:38.605446  1568 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:38.618216  4966 consensus_queue.cc:1243] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Peer 6f381117554e49bb816791ab0a10f2b8 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:59:38.631397  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 45685us
I20260709 12:59:38.640098  5008 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:38.640581  5008 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.640887  5008 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:38.613541  4651 raft_consensus.cc:3055] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:38.642295  4651 raft_consensus.cc:740] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:38.607029  5002 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:38.649493  1563 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 12:59:38.613602  5011 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:38.607486  4996 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:38.653429  5006 log.cc:927] Time spent T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.170s	user 0.001s	sys 0.001s
I20260709 12:59:38.652307  4995 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.660643  4828 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:38.661305  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 47501.2us
W20260709 12:59:38.663141  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 60054.7us
I20260709 12:59:38.663748  1685 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:38.679523  4928 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:38.656867  5002 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:38.680531  5002 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:38.664080  4794 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:38.679409  4913 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:38.677645  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 221638us
I20260709 12:59:38.720130  1612 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:38.643221  4651 consensus_queue.cc:260] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:38.728214  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 64535.4us
I20260709 12:59:38.730088  5018 consensus_queue.cc:1059] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:38.730532  5019 consensus_queue.cc:1059] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:59:38.652369  5011 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.730108  4852 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:38.730017  5022 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:38.721858  5005 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:59:38.729918  5016 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.725054  4794 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:59:38.731851  5017 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:38.699558  4928 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:38.836045  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 115992us
I20260709 12:59:38.837817  4943 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:38.840142  5016 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:38.833154  1568 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.854429  5016 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:38.854547  4865 consensus_meta.cc:287] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.554s	user 0.005s	sys 0.009s
I20260709 12:59:38.666425  4995 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:38.857806   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:38.864014  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 230955us
I20260709 12:59:38.855320  4865 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:38.880199  1568 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.858220  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:38.887375  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:38.882438  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.894426  1565 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:38.895418  1612 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:38.897444  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 234203us
I20260709 12:59:38.840214  4931 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:38.850904  4989 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:38.913432  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:38.910694  1721 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:38.914297  1612 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:38.914335  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:38.915300  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.915340  1563 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:38.917259  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:38.917954  1565 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:59:38.896740  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 167764us
I20260709 12:59:38.896436  5016 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:38.920166  1612 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:38.896163  4943 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:38.923143  1563 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:38.925551  1567 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:38.916115  4989 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:38.937384  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:38.921257  4951 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:38.922381  4878 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:38.944585  5016 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:38.955714  4474 raft_consensus.cc:3055] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:38.956157  4474 raft_consensus.cc:740] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:38.957078  4474 consensus_queue.cc:260] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.953965  5016 raft_consensus.cc:697] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:38.959259  5016 consensus_queue.cc:237] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.962129  5023 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:38.967073  4865 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:38.919147  4931 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.964474  4941 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:59:38.968490  5002 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:39.235291  1715 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:39.099054  2406 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:39.102124  1714 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:59:39.109614  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.238281  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:38.994656  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:39.007884  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 85735.8us
I20260709 12:59:39.239290  1720 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:38.939697  4989 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:39.096580  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 49511.6us
W20260709 12:59:39.235421  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 315295us
I20260709 12:59:38.996714  1568 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:39.240054  1685 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:39.242792  1685 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:59:38.970741  5028 log.cc:927] Time spent T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:59:39.069856  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:39.562799  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:39.562917  4802 raft_consensus.cc:3055] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:39.563392  4802 raft_consensus.cc:740] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:39.263219  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:39.563774  2436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 559) took 1210 ms. Trace:
I20260709 12:59:39.090379  4995 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:39.108868  5002 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:39.440356  5010 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.565142  5010 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.566004  5034 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:39.566520  5034 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.567418  5010 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:38.975793  5011 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:39.092005  5008 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.564504  4802 consensus_queue.cc:260] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:39.595890  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 353188us
I20260709 12:59:39.605851  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:39.606668  1717 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:39.607525  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:39.597792  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 498809us
I20260709 12:59:39.609180  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:39.612270  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:39.615577  2443 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:39.616956  1719 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:39.112937  5033 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.139s
I20260709 12:59:39.097770  5048 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.153s
I20260709 12:59:39.550275  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:39.550768  1646 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:39.550992  4999 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.551430  5055 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:39.552021  1641 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.552222  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:39.553011  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:39.554693  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:39.551043  5054 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:39.033020  4996 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.268s
I20260709 12:59:39.022964  5017 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 12:59:39.558133  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 315391us
I20260709 12:59:39.558668  5022 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:39.159955  4941 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:39.257613  5047 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:39.150161  5007 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:39.560513  4613 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.560763  5014 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:38.969599  5030 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:39.560972  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:38.952103  5040 consensus_queue.cc:1059] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.397s
I20260709 12:59:39.570519  4991 raft_consensus.cc:3055] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:39.564193  2436 rpcz_store.cc:276] 0709 12:59:38.352912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.353026 (+   114us) service_pool.cc:224] Handling call
0709 12:59:38.353392 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:38.571161 (+217769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.571189 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:38.580633 (+  9444us) log.cc:844] Serialized 26 byte log entry
0709 12:59:38.628257 (+ 47624us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:38.628326 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.111494 (+483168us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54001586d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:39.111544 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:39.563404 (+451860us) raft_consensus.cc:1685] finished
0709 12:59:39.563431 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.563681 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10,"raft.queue_time_us":122062,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":4007,"spinlock_wait_cycles":255977728,"thread_start_us":101755,"threads_started":2,"wal-append.queue_time_us":125923}
I20260709 12:59:39.579428  4474 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.580083  5008 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:39.582609  5052 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:39.758078  5052 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:38.969372  4931 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:39.623883  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 430) took 1376 ms. Trace:
I20260709 12:59:39.653353  2406 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:39.683357  1644 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 5.
I20260709 12:59:39.602837  4778 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:39.612026  4995 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:39.568533  5034 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:39.711565  1715 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:59:39.815304  1715 pending_rounds.cc:85] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 8
I20260709 12:59:39.815649  1715 pending_rounds.cc:107] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:59:39.712543  1643 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:39.713500  1638 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:39.815943  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:39.725306  1685 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:59:39.817116  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 91902us
I20260709 12:59:39.610661  4852 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 12:59:39.694772  4802 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:39.823293  1685 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:39.712100  4794 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:39.831429  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:39.745229  1569 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:39.721297  4999 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.717564  5022 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.759575  1645 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
W20260709 12:59:39.777694  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.711710  4826 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:59:39.729315  5007 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:39.759274  1721 rpcz_store.cc:276] 0709 12:59:38.247299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.247484 (+   185us) service_pool.cc:224] Handling call
0709 12:59:38.247761 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.914508 (+666747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.623607 (+709099us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b540025b2d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:39.623814 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524116352}
I20260709 12:59:39.714984  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:39.854328  1646 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:39.815936  1715 raft_consensus.cc:2889] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:39.771550  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 118325us
I20260709 12:59:39.749441  4991 raft_consensus.cc:740] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:39.772679  4995 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.721077  5017 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:39.864018  4651 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:39.864203  5052 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:39.864506  4996 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:39.865022  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:39.842041  5034 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:39.853295  4794 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.857906  4814 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:39.723809  4941 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.853582  5022 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:39.870080  5002 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:39.849319  5008 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:59:39.743286  4613 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.854593  5040 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:39.824954  4778 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.875010  5033 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:39.822558  4837 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:39.872035  1713 raft_consensus.cc:606] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:39.888974  5047 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:39.840487  5024 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:39.824656  4931 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:39.888774  4814 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:39.882678  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:39.718115  5054 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.897047  5052 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:39.925608  1644 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:39.716892  5055 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.895555  5057 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:39.879069  4995 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:39.881994  4989 consensus_meta.cc:287] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.630s	user 0.018s	sys 0.017s
I20260709 12:59:39.749083  5014 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.871889  4674 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:39.940233  5062 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:39.940102  4674 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.940763  5062 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:39.941049  5014 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:39.906939  1713 raft_consensus.cc:614] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:39.862752  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 432) took 1490 ms. Trace:
I20260709 12:59:39.941998  5003 raft_consensus.cc:3055] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:39.942214  4674 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:39.942554  5003 raft_consensus.cc:740] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:39.941075  5055 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:39.943225  4613 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:39.909083  5040 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.945262  4941 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:39.909607  5017 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:39.951140  4794 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:39.919183  5024 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:39.951493  4778 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:39.908684  5012 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:39.952890  5007 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:39.941581  5062 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.936666  4972 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:39.959151  4999 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:39.959236  5057 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.896453  5002 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.925086  4814 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:39.884559  5000 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:59:39.894840  5034 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.941879  1715 rpcz_store.cc:276] 0709 12:59:38.372511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.374568 (+  2057us) service_pool.cc:224] Handling call
0709 12:59:38.374938 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.115262 (+740324us) spinlock_profiling.cc:243] Waited 88.7 ms on lock 0x7b58005db6d0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd1f40aa 00007f18cd276447 00007f18cd28efe7 00007f18cd2907de 00007f18cd29ab49 00007f18cd29b416 00007f18cd297d8f 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4
0709 12:59:39.862457 (+747195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.862687 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203952000}
I20260709 12:59:39.918998  4991 consensus_queue.cc:260] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.960179  5022 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.881186  1569 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 12:59:40.012002  5022 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:39.881778  4996 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.014640  4996 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:40.015491  1719 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:59:39.929725  1717 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 12:59:39.951880  5024 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:39.924476  4931 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.966392  5052 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:39.990981  5054 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:39.962124  4989 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.959152  4972 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:39.994544  4991 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:39.969725  5040 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:39.994812  5034 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:39.968804  5002 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:40.000698  5061 log.cc:927] Time spent T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:59:40.002354  5057 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:40.020256  1638 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 12:59:40.046495  1641 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:40.050470  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:40.053987  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 428363us
I20260709 12:59:40.047966  4941 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.047358  4474 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.061483  1644 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 12:59:40.090508  4941 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:40.090598  4474 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.093006  4474 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:40.045867  4794 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.064164  4802 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.099524  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:40.100023  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:40.101604  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 46634.4us
I20260709 12:59:40.103749  1568 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:40.104735  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:40.105050  4474 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 12:59:40.141815  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.142444  4794 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.142915  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:40.143471  1570 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:40.144716  4794 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:40.146086  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:40.146905  1564 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
W20260709 12:59:40.148375  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:40.098444  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 215311us
W20260709 12:59:40.150444  1640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.007s	sys 0.031s
W20260709 12:59:40.150830  1640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.007s	sys 0.031s
I20260709 12:59:40.151589  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:40.152140  1567 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:40.159461  1568 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:40.161111  1567 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:40.105589  5022 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 12:59:40.163861  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 318448us
W20260709 12:59:40.166821  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 291498us
I20260709 12:59:40.141049  4802 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:40.151970  5054 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:40.160768  5003 consensus_queue.cc:260] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.181161  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:40.188210  1713 raft_consensus.cc:1240] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:40.140987  4474 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.190917  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:40.166615  5008 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.185788  1715 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:40.166416  5035 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:40.203471  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.186439  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.168078  4999 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.189566  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.192162  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:40.185223  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:40.166944  5030 raft_consensus.cc:697] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:40.201246  1714 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:40.206943  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.207722  5016 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:40.208252  5074 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:40.208814  5067 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:40.210675  4972 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:40.198856  5054 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.211584  5052 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:40.278349  5072 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:40.278149  5030 consensus_queue.cc:237] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.279666  5054 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:40.280370  5067 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.213863  5058 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:40.218184  5035 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:40.218973  5008 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.204375  4794 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:59:40.222467  1638 raft_consensus.cc:1240] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:40.180850  4941 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:40.174249  5022 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.278802  5072 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:40.180670  5007 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:40.203099  5062 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:40.284493  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:40.205564  5064 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:40.241195  5025 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:40.206151  4791 consensus_queue.cc:1059] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:59:40.204344  5039 consensus_queue.cc:1059] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 12:59:40.241211  4999 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.295542  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:40.344192  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.312846  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:40.448923  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 124579us
W20260709 12:59:40.603042  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 419212us
I20260709 12:59:40.604419  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.316752  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:40.565544  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.790936  1568 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:40.652240  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:40.401793  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 114245us
W20260709 12:59:40.787719  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.732722  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.654752  1720 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:59:40.604413  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 400741us
I20260709 12:59:40.793342  1536 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:40.723120  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.311580  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:40.354538  1570 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:59:40.696228  1645 raft_consensus.cc:1240] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:40.632943  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:40.797304  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2559) took 1193 ms. Trace:
I20260709 12:59:40.799178  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:40.799481  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:40.803177  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.797686  1642 rpcz_store.cc:276] 0709 12:59:39.604438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.604574 (+   136us) service_pool.cc:224] Handling call
0709 12:59:39.621048 (+ 16474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.621233 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:40.152897 (+531664us) log.cc:844] Serialized 14 byte log entry
0709 12:59:40.759108 (+606211us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b1800334c00. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca125c0a 00007f18d3865219 00007f18ca1ada40 00007f18ca1a84e4 00007f18ca1a8455 00007f18cd290060 00007f18cd2a2716 00007f18cd2b3287 00007f18cd2b3208
0709 12:59:40.796935 (+ 37827us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:40.796979 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:40.797021 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.797150 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.797255 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48679,"prepare.queue_time_us":654289,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"spinlock_wait_cycles":37604736,"thread_start_us":573891,"threads_started":2}
W20260709 12:59:40.715536  4814 consensus_meta.cc:287] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.709s	user 0.007s	sys 0.005s
W20260709 12:59:40.666469  5079 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:59:40.663738  5077 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 12:59:40.427454  4931 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:40.827603  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:40.632967  5059 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.485s	user 0.003s	sys 0.000s
I20260709 12:59:40.393021  5068 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.839433  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:40.429028  4989 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:40.446278  5070 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:40.445967  5067 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:40.784083  5024 consensus_meta.cc:287] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.736s	user 0.010s	sys 0.001s
I20260709 12:59:40.604149  5003 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:40.853266  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 60035.8us
I20260709 12:59:40.864601  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:40.869592  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:40.270355  5016 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.853289  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.874486  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.875180  1718 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:40.876199  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.876842  1718 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 12:59:40.877571  5055 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:40.796953  5072 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:40.840654  5025 raft_consensus.cc:697] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:40.274608  5074 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.860323  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.861240  1638 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:40.852715  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2555) took 1300 ms. Trace:
I20260709 12:59:40.922075  1639 rpcz_store.cc:276] 0709 12:59:39.552433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.552546 (+   113us) service_pool.cc:224] Handling call
0709 12:59:39.553516 (+   970us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:39.894768 (+341252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.894796 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:39.895427 (+   631us) log.cc:844] Serialized 52 byte log entry
0709 12:59:40.102658 (+207231us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:40.612193 (+509535us) log.cc:844] Serialized 14 byte log entry
0709 12:59:40.852326 (+240133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.852414 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:40.852479 (+    65us) raft_consensus.cc:1685] finished
0709 12:59:40.852497 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.852650 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194338,"prepare.queue_time_us":330549,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":246117,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":7386,"spinlock_wait_cycles":1052800,"thread_start_us":1047930,"threads_started":4,"wal-append.queue_time_us":296346}
I20260709 12:59:40.924163  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:40.798832  5018 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:40.926381  5018 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.929141  5018 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:40.828612  5080 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.929955  5080 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.932662  5080 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:40.799391  5007 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:40.878033  5055 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:40.933400  5055 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:40.934913  5007 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:40.425495  4995 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:40.937386  4995 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:40.859880  4941 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:40.938277  2436 raft_consensus.cc:1240] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:59:40.615705  5035 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:40.886224  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.939657  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.940196  1713 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:40.941059  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.938016  4941 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:40.942902  4941 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:40.951622  1713 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:40.952966  1713 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:40.954578  1713 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:40.957434  4941 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.959874  4941 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:40.883266  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:40.896108  5054 raft_consensus.cc:3055] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:40.872758  4972 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:40.888399  5024 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.898517  5016 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:40.898918  5052 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:40.899366  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:40.332702  5058 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.902969  4474 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:40.868399  5068 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:40.856375  5030 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:40.906845  5089 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:40.907200  5081 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.041018  5014 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.907410  4996 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:41.046506  5081 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.046705  5014 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.046854  4996 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.908306  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:41.048693  4996 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.042347  5080 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.048991  1718 raft_consensus.cc:606] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:41.049501  1718 raft_consensus.cc:614] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:41.049389  5080 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.909313  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:40.392598  5002 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:41.051440  5080 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.051928  5080 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.052136  5002 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:40.853534  5039 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:41.052343  5080 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.052932  5039 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:41.046093  5024 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:41.046087  5058 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.055212  5039 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:41.055301  5058 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:41.056214  2443 raft_consensus.cc:1240] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:40.993651  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:41.056355  4941 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:40.980337  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:41.056892  4941 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:40.817441  5062 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.041354  1646 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:40.799144  5064 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.043274  1644 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:40.981351  5054 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:41.043072  5052 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:40.866467  4791 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.055925  5058 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:41.058188  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:40.847266  4814 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:40.913115  5072 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:40.888979  5070 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.045971  5057 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
W20260709 12:59:41.043766  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 183145us
W20260709 12:59:41.262317  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.112610  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:41.271347  2444 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:41.269964  2440 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:41.220402  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 296) took 1367 ms. Trace:
W20260709 12:59:41.176636  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.273345  1643 rpcz_store.cc:276] 0709 12:59:39.852706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.879119 (+ 26413us) service_pool.cc:224] Handling call
0709 12:59:39.890455 (+ 11336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:39.899638 (+  9183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.899685 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:39.923985 (+ 24300us) log.cc:844] Serialized 26 byte log entry
0709 12:59:40.241799 (+317814us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:40.241858 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.241952 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:41.220115 (+978163us) raft_consensus.cc:1685] finished
0709 12:59:41.220143 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.220337 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3804,"raft.queue_time_us":205674,"spinlock_wait_cycles":6562560,"thread_start_us":268356,"threads_started":1,"wal-append.queue_time_us":1017795}
I20260709 12:59:41.275547  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:41.112797  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2e78d031c384616a01064318cb24f28"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:41.278254  1718 raft_consensus.cc:606] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:41.278765  1718 raft_consensus.cc:614] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:41.280821  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:41.294090  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 467948us
I20260709 12:59:41.296975  2405 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:41.297827  5002 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:41.298375  5002 raft_consensus.cc:697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:41.299256  5002 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:41.303704  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.305416  4995 consensus_queue.cc:1059] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:41.306427  5007 raft_consensus.cc:3055] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:41.306833  5007 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 12:59:41.039990  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 168760us
I20260709 12:59:41.325524  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:41.041558  4802 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:41.336123  2436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 564) took 1246 ms. Trace:
I20260709 12:59:41.312698  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2573) took 1126 ms. Trace:
W20260709 12:59:41.331620  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 50890.4us
I20260709 12:59:41.336913  2436 rpcz_store.cc:276] 0709 12:59:40.089396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.089573 (+   177us) service_pool.cc:224] Handling call
0709 12:59:40.089937 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:40.938631 (+848694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.335877 (+397246us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54003ec6d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:41.336071 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1950456064}
I20260709 12:59:41.338024  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:41.339327  1686 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:41.340492  1720 rpcz_store.cc:276] 0709 12:59:40.185857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.185985 (+   128us) service_pool.cc:224] Handling call
0709 12:59:40.186285 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.794019 (+607734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.312414 (+518395us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b540025a8d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:41.312614 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076458240}
I20260709 12:59:41.330265  1537 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:41.345007  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:41.343710  1686 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:41.048714  5014 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.117810  5024 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.089166  4941 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:41.245139  5033 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:41.366271  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:41.128384  4474 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:41.090538  5022 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:41.048709  5081 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.127980  5062 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.091018  5068 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:41.361814  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:41.091487  4999 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:41.122591  4931 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:41.371532  5049 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:41.042032  4972 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.379040  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:41.330096  4791 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.125509  5064 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.089144  5074 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.365584  5039 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:41.385161  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 59789.8us
I20260709 12:59:41.393843  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:41.394428  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1944) took 1172 ms. Trace:
I20260709 12:59:41.541177  1641 rpcz_store.cc:276] 0709 12:59:40.230236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.231294 (+  1058us) service_pool.cc:224] Handling call
0709 12:59:40.231626 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.126781 (+895155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.126823 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:41.126878 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:41.126920 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.394172 (+267252us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b540008be54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:41.394215 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.394367 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2058086656}
W20260709 12:59:41.402616  1717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.003s	sys 0.013s
I20260709 12:59:41.361547  4802 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:41.243649  5055 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.392576  5034 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:41.431802  2443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 230) took 1273 ms. Trace:
I20260709 12:59:41.335583  4828 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:59:41.438083  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1952) took 1202 ms. Trace:
I20260709 12:59:41.046185  5089 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:41.381711  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 463783us
I20260709 12:59:41.328349  5007 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:41.069151  5030 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:41.538625  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 70468.8us
I20260709 12:59:41.577551  1643 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 12:59:41.547901  1717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.003s	sys 0.013s
I20260709 12:59:41.396431  4941 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:41.426347  1685 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.562s (SENT) [suppressed 4 similar messages]
I20260709 12:59:41.567014  2443 rpcz_store.cc:276] 0709 12:59:40.158455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.158590 (+   135us) service_pool.cc:224] Handling call
0709 12:59:40.158950 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.056630 (+897680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.431477 (+374847us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b5400156b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:41.431720 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2063089024}
I20260709 12:59:41.386406  4474 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:41.361236  5080 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.344393  5048 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:41.569764  1645 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:41.394595  5022 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 12:59:41.531183  5068 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:41.549955  5003 consensus_meta.cc:287] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.002s
I20260709 12:59:41.381193  5024 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:41.567167  1639 rpcz_store.cc:276] 0709 12:59:40.235958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.951828 (+715870us) service_pool.cc:224] Handling call
0709 12:59:40.952057 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.952306 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:40.973991 (+ 21685us) log.cc:844] Serialized 14 byte log entry
0709 12:59:41.437604 (+463613us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:41.437656 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:41.437697 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.437759 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.438006 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":479,"prepare.queue_time_us":203,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":108,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":463129,"threads_started":1}
I20260709 12:59:41.538620  5049 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:41.550218  4802 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.089440  5025 consensus_queue.cc:237] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.629979  1611 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:41.566896  5034 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:41.628194  5107 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:41.385730  5033 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:41.634130  5007 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:41.566588  5008 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:41.563663  5014 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:59:41.621639  4674 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:41.644594  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:41.624629  4941 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:41.647094  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1947) took 1414 ms (client timeout 1562 ms). Trace:
W20260709 12:59:41.678938  1646 rpcz_store.cc:269] 0709 12:59:40.234620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.632656 (+398036us) service_pool.cc:224] Handling call
0709 12:59:41.646915 (+1014259us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b5400219154. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:41.647031 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563618688}
I20260709 12:59:41.680334  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:41.564320  5039 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.631973  1643 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:41.650018  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:41.649156  1611 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:41.632997  5048 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 12:59:41.692622  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 43535.9us
I20260709 12:59:41.650390  5065 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:41.653375  1715 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:41.644945  4996 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.644991  4802 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:41.675920  5066 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:41.650708  5034 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:41.681165  4941 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:41.700348  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:41.692430  1718 raft_consensus.cc:606] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:41.652210  5062 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:41.641217  5068 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.494194  4931 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.777719  4931 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.778244  5110 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:41.778970  4474 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:41.778817  5110 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:41.780359  5084 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:59:41.781068  5110 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.772413  5101 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:41.695003  4674 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:41.782074  5101 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.784175  5101 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.697350  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:41.698127  5104 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:41.678747  5003 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:41.692297  5095 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.762859  1646 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 6: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:41.710532  4814 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:41.698303  5048 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:41.791429  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:41.701931  5058 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:41.711791  5066 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.712184  5065 raft_consensus.cc:697] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:41.710199  5012 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:41.775967  5068 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.710031  5074 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:59:41.771386  5052 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:41.657286  5107 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:41.793849  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:41.707891  5064 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:59:41.770574  1715 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:41.792615  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:41.801481  1645 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
W20260709 12:59:41.794291  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 443745us
I20260709 12:59:41.808879  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:41.710659  4996 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:41.805058  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 378709us
W20260709 12:59:41.808141  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.809557  1638 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:41.791620  5072 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:41.810899  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 268028us
I20260709 12:59:41.816701  1643 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:59:41.819875  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.788404  5104 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:41.798655  5066 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:41.794431  5056 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:41.820218  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:41.844455  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:41.846423  5093 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.942s	user 0.018s	sys 0.008s
I20260709 12:59:41.848899  5055 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.804517  4972 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.795039  5003 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.892872  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:41.893445  2438 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:41.894106  5003 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:41.850608  5094 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 12:59:41.851424  5115 log.cc:927] Time spent T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 12:59:41.895223  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.884150  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:41.885448  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:41.895968  5117 log.cc:927] Time spent T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:59:41.896199  1714 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:41.896389  1719 raft_consensus.cc:2393] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:41.885448  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:41.897014  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:41.897095  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:41.897673  1714 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:41.885627  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:41.897691  1719 raft_consensus.cc:606] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:41.898636  1713 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:41.889448  2443 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:41.891736  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:41.892050  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:41.897236  1567 raft_consensus.cc:2410] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:59:41.887517  1646 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:41.903941  5099 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:59:41.899741  5107 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:41.905447  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2575) took 1718 ms. Trace:
I20260709 12:59:41.906427  5023 raft_consensus.cc:3055] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:41.804052  5095 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.906803  5023 raft_consensus.cc:740] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:41.874905  5070 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.908440  5095 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:41.908912  5114 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.209s	user 0.003s	sys 0.004s
I20260709 12:59:41.910228  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 302) took 1625 ms. Trace:
I20260709 12:59:41.911043  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 446) took 1738 ms. Trace:
I20260709 12:59:41.910567  1565 rpcz_store.cc:276] 0709 12:59:40.284659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.284786 (+   127us) service_pool.cc:224] Handling call
0709 12:59:40.311729 (+ 26943us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:40.401379 (+ 89650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.401430 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:40.863519 (+462089us) log.cc:844] Serialized 26 byte log entry
0709 12:59:41.427366 (+563847us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:41.427406 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.427476 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:41.909961 (+482485us) raft_consensus.cc:1685] finished
0709 12:59:41.909980 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.910155 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68949,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":40475,"spinlock_wait_cycles":23168,"thread_start_us":446870,"threads_started":1,"wal-append.queue_time_us":741684}
I20260709 12:59:41.911515  1717 rpcz_store.cc:276] 0709 12:59:40.172265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.172384 (+   119us) service_pool.cc:224] Handling call
0709 12:59:40.172700 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:40.180623 (+  7923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.180650 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:40.760959 (+580309us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b2c00047778. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cbb91a11 00007f18cbba1372 00007f18cd2d3a01 00007f18cd29843a 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2
0709 12:59:40.784171 (+ 23212us) log.cc:844] Serialized 26 byte log entry
0709 12:59:41.620927 (+836756us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:41.620994 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.621078 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:41.910729 (+289651us) raft_consensus.cc:1685] finished
0709 12:59:41.910753 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.910979 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105999,"raft.queue_time_us":68207,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":37358,"spinlock_wait_cycles":3340032,"thread_start_us":764624,"threads_started":1,"wal-append.queue_time_us":992206}
I20260709 12:59:41.897768  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 1955) took 1093 ms. Trace:
I20260709 12:59:41.886660  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:41.913583  5052 raft_consensus.cc:476] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 12:59:41.964337  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:41.965202  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1964) took 1075 ms. Trace:
I20260709 12:59:41.965588  1645 rpcz_store.cc:276] 0709 12:59:40.889395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.909039 (+ 19644us) service_pool.cc:224] Handling call
0709 12:59:41.965009 (+1055970us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b5400430654. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:41.965112 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193764736}
I20260709 12:59:41.966535  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:41.967123  1565 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:41.967978  5109 consensus_queue.cc:1059] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:41.968874  5109 raft_consensus.cc:3055] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:41.969205  5109 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:41.969964  5109 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:41.970434  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:41.970909  4791 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:41.971189  5109 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:41.971545  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:41.971608  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:41.973003  1571 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:41.971777  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2574) took 1785 ms. Trace:
I20260709 12:59:41.974285  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:41.945694  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:41.957124  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:41.944483  1563 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:41.976523  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:41.791304  5049 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:41.919425  1646 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:59:41.948107  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:41.957484  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:41.977135  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:41.982179  1717 raft_consensus.cc:2410] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:59:41.913540  1642 rpcz_store.cc:276] 0709 12:59:40.804641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.057149 (+252508us) service_pool.cc:224] Handling call
0709 12:59:41.057452 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:41.057768 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.057792 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:41.058247 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:59:41.345417 (+287170us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:41.345535 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.345702 (+   167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:41.895830 (+550128us) raft_consensus.cc:1685] finished
0709 12:59:41.895852 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.897712 (+  1860us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9484,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":146374,"thread_start_us":286609,"threads_started":1,"wal-append.queue_time_us":586047}
W20260709 12:59:41.914229  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.973801  1716 rpcz_store.cc:276] 0709 12:59:40.186764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.187055 (+   291us) service_pool.cc:224] Handling call
0709 12:59:40.205371 (+ 18316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.827033 (+621662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.827066 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:40.827112 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:40.827147 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.971584 (+1144437us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b5400229a54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:41.971624 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.971727 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1429179776}
I20260709 12:59:41.958686  1719 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:42.022585  1644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 1961) took 1176 ms (client timeout 1552 ms). Trace:
I20260709 12:59:42.023972  1638 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:42.024060  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.024497  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.022650  1646 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:42.023895  1644 rpcz_store.cc:269] 0709 12:59:40.846030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.899129 (+ 53099us) service_pool.cc:224] Handling call
0709 12:59:42.022419 (+1123290us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b5400395154. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:42.022529 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10464000}
I20260709 12:59:41.905815  1712 rpcz_store.cc:276] 0709 12:59:40.187370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.187492 (+   122us) service_pool.cc:224] Handling call
0709 12:59:40.204644 (+ 17152us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:40.612559 (+407915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.612603 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:40.626037 (+ 13434us) log.cc:844] Serialized 26 byte log entry
0709 12:59:40.784146 (+158109us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:40.784182 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.784259 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:41.905231 (+1120972us) raft_consensus.cc:1685] finished
0709 12:59:41.905259 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.905397 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70107,"raft.queue_time_us":75171,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":10909,"thread_start_us":469115,"threads_started":2,"wal-append.queue_time_us":1064455}
I20260709 12:59:42.023190  1642 raft_consensus.cc:1240] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:42.022604  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:41.948012   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:42.025568  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.026891  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.026546  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:42.028115  1719 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:42.029203  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:42.029701  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:41.943778  4474 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:42.033352  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:42.033679  4474 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.035722  4474 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:42.036670  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:41.978725  5030 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:42.037057  4989 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:41.986410  4613 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.037786  4613 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.039721  4613 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:41.922777  5056 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.039553  5025 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.807576  5012 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:41.944176  4814 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.028537   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:41.852927  5104 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:42.066709  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:42.066974  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:42.067385  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:41.979346  5093 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:59:42.111620  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 44723.2us
I20260709 12:59:41.976379  5089 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:42.113075  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2549) took 2869 ms. Trace:
I20260709 12:59:42.113188  4613 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:42.113694  4613 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 12:59:42.070657  5116 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:59:42.114264  4613 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:42.071137  5037 consensus_queue.cc:1059] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:59:42.114943  4474 raft_consensus.cc:3055] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:42.115432  4474 raft_consensus.cc:740] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:42.113443  1647 rpcz_store.cc:276] 0709 12:59:39.243393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.549559 (+306166us) service_pool.cc:224] Handling call
0709 12:59:39.549994 (+   435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:39.897407 (+347413us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:40.193831 (+296424us) log.cc:844] Serialized 14 byte log entry
0709 12:59:40.806494 (+612663us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:40.865616 (+ 59122us) log.cc:844] Serialized 52 byte log entry
0709 12:59:40.865805 (+   189us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:40.865846 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.865927 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:41.846089 (+980162us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b240029b9e8. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0319c4 00007f18ca02facb 00007f18ca1eadc9 00007f18ca1eaa55 00007f18ca1ea09d 00007f18cce1c10e 00007f18cce3388c 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221
0709 12:59:42.112791 (+266702us) raft_consensus.cc:1685] finished
0709 12:59:42.112880 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.113001 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":153527,"prepare.queue_time_us":496171,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":5524,"raft.queue_time_us":225372,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":40979,"spinlock_wait_cycles":23509376,"thread_start_us":1005611,"threads_started":3,"wal-append.queue_time_us":674621}
I20260709 12:59:42.116330  4474 consensus_queue.cc:260] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.117765  4474 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:42.025336  5052 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.039664  5054 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.171737  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:42.172605  1565 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 12:59:42.177829  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:42.106961  5003 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:42.191993  1638 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:42.157768  5024 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:42.003453  5065 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.174708  5033 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:42.219045  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.107410  5025 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.153780  4814 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.224766  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:42.227680  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.170295  5052 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.233085  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:42.237654  1647 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.244180  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.207089  5039 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:42.246490  1721 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 4.
I20260709 12:59:42.267203  4814 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:42.189085  5037 consensus_queue.cc:1059] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 12:59:42.271957  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.273310  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.202553  5003 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.275082  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:42.200284  5048 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.284511  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.285348  1639 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:42.247260  4791 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:42.277000  5034 consensus_meta.cc:287] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 12:59:42.244077  5030 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:42.307435  1647 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:42.303059  5066 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:42.311213  5091 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:59:42.311408  1713 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 12:59:42.326298  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:42.345674  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:42.364357  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.413511  5066 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:42.414862  5127 log.cc:927] Time spent T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 12:59:42.414966  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.428558  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:42.415761  5126 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:59:42.420096  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.424856  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:42.427790  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 208252us
I20260709 12:59:42.429687  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.435741  1714 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:42.437909  1642 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:42.438295  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:42.438854  1646 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:42.441205  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:42.442376  1565 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:42.443281  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:42.445012  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.445963  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.426077  5030 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.426401  4791 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.451928  5030 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:42.429245  5012 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:42.452310  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.452873  4791 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:42.452978  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.453459  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:42.455397  5003 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:42.456895  4613 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.438813  5039 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:42.461457  5010 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:42.434252  5047 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:42.463995  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:42.467172  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2558) took 2913 ms. Trace:
I20260709 12:59:42.468957  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:42.469515  1565 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:42.470362  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:42.468559  1640 rpcz_store.cc:276] 0709 12:59:39.554209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.601981 (+ 47772us) service_pool.cc:224] Handling call
0709 12:59:39.602449 (+   468us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:40.154201 (+551752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.154250 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:40.169103 (+ 14853us) log.cc:844] Serialized 52 byte log entry
0709 12:59:40.424436 (+255333us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:40.652935 (+228499us) log.cc:844] Serialized 14 byte log entry
0709 12:59:40.851882 (+198947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.852059 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:42.463619 (+1611560us) raft_consensus.cc:1685] finished
0709 12:59:42.463638 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.467111 (+  3473us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":395888,"prepare.queue_time_us":228249,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":537997,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":69343,"thread_start_us":778124,"threads_started":3,"wal-append.queue_time_us":1737523}
W20260709 12:59:42.466918  5007 consensus_meta.cc:287] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.788s	user 0.008s	sys 0.002s
I20260709 12:59:42.442404  5107 consensus_queue.cc:1059] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:59:42.486974  4791 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:42.487622  5052 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:42.488049  5048 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:42.489492  5089 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:42.493605  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:42.420462  5034 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.501965  1568 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:42.502136  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.505242  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.505914  1640 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:42.506258  4613 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:42.490037  5104 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.508258  5104 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:42.508320  5034 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:42.491271  5047 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.508970  5034 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:42.510689  5047 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:42.511044  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:42.514269  1643 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:42.514662  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:42.515296  1568 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:42.491380  5010 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.518447  1612 leader_election.cc:400] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
I20260709 12:59:42.518771  1612 leader_election.cc:403] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:59:42.519675  5010 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:42.483891  5003 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:42.524855  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.525524  1645 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:42.522682  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:42.527168  1612 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:42.528084  1612 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:42.525815  5003 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:42.529028  5012 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:42.529233  5003 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.529778  5030 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:42.530229  5030 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:42.530567  5030 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:42.534199  5104 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:42.538817  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.539041  1646 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:42.539418  1720 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:42.539763  1719 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:42.540746  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.541499  1717 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:42.545605  1565 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:42.546571  1568 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:42.498279  4791 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:42.554315  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.555662  1717 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:42.501132  5025 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:42.558451  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:42.560402  5137 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:59:42.525954  5052 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
I20260709 12:59:42.562500  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:42.491740  5039 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.588321  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.547282  5057 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:42.590389  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:42.595012  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:42.589805  1717 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:42.596124  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.557492  4791 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:42.597133  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.601579  1717 raft_consensus.cc:2393] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:42.602849  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:42.604204  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:42.603614  1564 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:42.607429  1717 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:42.617020  4802 consensus_meta.cc:287] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.859s	user 0.005s	sys 0.004s
I20260709 12:59:42.617509  5066 raft_consensus.cc:993] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 12:59:42.619007  4474 raft_consensus.cc:993] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 12:59:42.618929  5136 raft_consensus.cc:1081] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 12:59:42.619499  4474 raft_consensus.cc:1081] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
W20260709 12:59:42.620749  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.624109  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:42.625422  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:42.622265  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:42.622265  1572 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:42.638402  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:42.639124  1568 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:42.639784  1572 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:42.641320  2444 raft_consensus.cc:2393] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 7: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:42.648195  1718 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 12:59:42.617486  4802 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.657707  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:42.664825  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:42.669335  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:42.667583  5074 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:42.673825  1718 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:42.678757  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2567) took 1114 ms. Trace:
I20260709 12:59:42.679121  1638 rpcz_store.cc:276] 0709 12:59:41.564229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.884729 (+320500us) service_pool.cc:224] Handling call
0709 12:59:42.023872 (+139143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.192433 (+168561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.678562 (+486129us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400395150. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:42.678702 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319370496}
I20260709 12:59:42.683568  1686 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:42.685289  4474 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:42.662482  5052 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:42.687608  1686 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:42.685820  4474 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.664901  5012 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:42.661934  5104 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:42.690989  1686 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:42.692018  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:42.696839  1721 raft_consensus.cc:1240] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:42.697238  1568 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:42.661360  5030 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.662953  5057 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:42.689180  4474 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:42.696334  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:42.685372  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 195616us
I20260709 12:59:42.704787  2436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 549) took 1331 ms. Trace:
W20260709 12:59:42.719646  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 200216us
I20260709 12:59:42.678620  5103 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:42.673399  5074 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.721438  2436 rpcz_store.cc:276] 0709 12:59:41.373088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.373263 (+   175us) service_pool.cc:224] Handling call
0709 12:59:41.373593 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.695380 (+321787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.695415 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:41.695459 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:41.695490 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.704499 (+1009009us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54005d3754. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:42.704560 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.704717 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739561344}
I20260709 12:59:42.723099  1686 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:42.725499  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:42.700949  5043 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:42.726365  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:42.730916  4474 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.698541  5019 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:42.699222  5010 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:42.722923  4941 consensus_meta.cc:287] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.935s	user 0.008s	sys 0.003s
I20260709 12:59:42.733901  5033 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:42.693152  5052 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.723984  5065 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:42.753557  5065 raft_consensus.cc:697] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:42.754570  5065 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.755923  5141 consensus_queue.cc:1059] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:42.758111  4613 consensus_queue.cc:1059] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:42.759248  5144 raft_consensus.cc:3055] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:42.759464  5052 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:42.759671  5144 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:42.740715  4941 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.760604  5144 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.738327  5043 raft_consensus.cc:697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:42.762042  1569 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:42.762178  4941 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:42.762527  5043 consensus_queue.cc:237] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.763010  1718 raft_consensus.cc:1240] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:59:42.763855  5056 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:42.693720  5012 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.730561  5103 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.766551  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:42.766997  5012 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:42.744751  5129 raft_consensus.cc:3055] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:42.746183  1715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54412 (request call id 453) took 1369 ms (client timeout 1756 ms). Trace:
W20260709 12:59:42.767731  1715 rpcz_store.cc:269] 0709 12:59:41.376709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.378743 (+  2034us) service_pool.cc:224] Handling call
0709 12:59:42.745973 (+1367230us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54000fee54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:42.746097 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492962176}
I20260709 12:59:42.733701  5048 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:42.747426  5033 raft_consensus.cc:697] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:42.747781  5074 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:42.747987  1712 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:59:42.736443  5066 consensus_queue.cc:1059] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:59:42.723533  5057 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.749018  5008 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.784907  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.785333  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.750212  4996 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:42.751259  5030 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:42.729171  5011 consensus_queue.cc:1059] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:59:42.699457  5104 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.740341  4474 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:42.733846  5107 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:42.736894  5019 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:42.767168  5103 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:42.769423  5048 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:42.769649  5129 raft_consensus.cc:740] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:42.795596  5003 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.795794  5129 consensus_queue.cc:260] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.797096  5129 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.787609  5008 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.799993  5008 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:42.800063  5048 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:42.801067  5033 consensus_queue.cc:237] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.799988  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:42.737038  5010 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.757758  4802 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:42.797770  5003 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:42.809140  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 80922.2us
I20260709 12:59:42.807078  1638 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:59:42.794163  5019 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:42.793900  4996 raft_consensus.cc:3055] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:42.830827  5048 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.833282  5048 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:42.840291  1644 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:42.840976  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.841291  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:42.842329  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.843513  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.844282  1644 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 4.
I20260709 12:59:42.845265  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.845958  1644 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:42.846954  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:42.847602  1644 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:42.848491  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.852689  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.853933  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.855243  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:42.857860  1642 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 9: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:42.808705  5010 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:42.859432  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:42.859881  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.865463  1644 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:42.865406  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.868274  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.822340  4996 raft_consensus.cc:740] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 12:59:42.888340  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 150981us
I20260709 12:59:42.858695  5069 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:42.889881  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:42.898942  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:42.902033  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.902395  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.895908  5033 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.916559  5033 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.918205  4996 consensus_queue.cc:260] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.918946  5033 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:42.921058  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.905027  5089 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:42.927842  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.929003  1644 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 12:59:42.938710  4674 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:42.903328  5056 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:42.938580  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.919654  4996 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:42.948205  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:42.942665  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.949930  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.944150  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.951709  1715 raft_consensus.cc:2393] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 6: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:42.905921  5069 raft_consensus.cc:697] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:42.947376  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:42.957337  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.958244  1643 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
W20260709 12:59:42.945467  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.958559  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:42.959506  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.960655  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:42.962895  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:42.970754  1715 raft_consensus.cc:1240] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:42.972998  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.973810  1643 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:42.974217  1718 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:42.982187  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:42.950577  4791 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:42.969162  5057 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:42.975914  5056 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.999536  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2562) took 2030 ms. Trace:
I20260709 12:59:43.000079  1641 rpcz_store.cc:276] 0709 12:59:40.969425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.564946 (+595521us) service_pool.cc:224] Handling call
0709 12:59:41.565293 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.635005 (+ 69712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.635035 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:41.635082 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:41.635111 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.999308 (+1364197us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b54001e0354. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:42.999359 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.999482 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159865088}
I20260709 12:59:43.000855  4814 raft_consensus.cc:3055] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:43.001317  4814 raft_consensus.cc:740] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:43.002259  4814 consensus_queue.cc:260] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.003695  4814 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:43.011188  5010 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.012794  5019 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.013875  5069 consensus_queue.cc:237] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:43.014966  5023 consensus_queue.cc:260] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:42.981210  5104 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:43.015933  1563 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:43.016927  4791 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:43.016736  5056 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:43.018424  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:43.020087  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:43.020502  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:43.021414  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:43.026721  5149 log.cc:927] Time spent T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.112s	user 0.003s	sys 0.000s
I20260709 12:59:43.026944  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:43.027505  1642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 12:59:43.028342  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:43.028388  1645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 12:59:43.029065  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:43.033195  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:43.055593  1641 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:43.125360  1712 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:43.066557  1639 raft_consensus.cc:2376] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6. Re-sending same reply.
I20260709 12:59:43.126111  5104 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:43.227429  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:43.227713  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:43.227492  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:43.219954  5156 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:43.168363   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:43.234464  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:43.236629  1642 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:43.279685  1642 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:43.035519  5057 consensus_queue.cc:1059] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.160s
I20260709 12:59:43.270658  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:43.289238  1643 raft_consensus.cc:3055] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:43.289664  1643 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:43.274662  5019 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:43.293983  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:43.294314  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:43.294699  1640 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
W20260709 12:59:43.256525  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.249661  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:43.295276  1647 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:43.295745  1639 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:43.271744  1641 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:43.280068  1611 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:43.301090  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:43.298059  1643 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.305693  1643 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:43.307070  5057 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:43.307621  5057 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.307847  5000 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:43.308122  5057 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.317286  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:43.300657  5129 consensus_meta.cc:287] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.503s	user 0.012s	sys 0.000s
I20260709 12:59:43.320443  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:43.296398  5104 raft_consensus.cc:3055] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:43.322996  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2591) took 1365 ms. Trace:
I20260709 12:59:43.325042  1716 rpcz_store.cc:276] 0709 12:59:41.957703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.027818 (+ 70115us) service_pool.cc:224] Handling call
0709 12:59:42.028042 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.040640 (+ 12598us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:42.201452 (+160812us) log.cc:844] Serialized 14 byte log entry
0709 12:59:42.437310 (+235858us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.437361 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:42.437400 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.322774 (+885374us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b5400065754. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:43.322818 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.322938 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9418,"prepare.queue_time_us":139145,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":10557,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3901,"spinlock_wait_cycles":28449536,"thread_start_us":230913,"threads_started":2,"wal-append.queue_time_us":339485}
I20260709 12:59:43.299234  5147 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:43.327345  1643 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:59:43.327664  1643 pending_rounds.cc:85] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 5
I20260709 12:59:43.327869  1643 pending_rounds.cc:107] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:59:43.328076  1643 raft_consensus.cc:2889] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:43.316565  1611 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:43.333930  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:43.334609  1639 raft_consensus.cc:2410] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:59:43.335803  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:43.336391  1646 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:43.338817  1611 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:43.335546  5146 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:43.343434  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:43.344739  1643 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:43.342792  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:43.345281  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:43.345765  1639 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:43.345892  1646 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:43.346721  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:43.347651  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:43.348349  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:43.324982  5104 raft_consensus.cc:740] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:43.347519  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:43.350296  5104 consensus_queue.cc:260] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:43.351174  1643 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 8: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:43.343601  5146 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.355846  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:43.361646  5057 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.364307  5144 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:43.370335  1641 raft_consensus.cc:2368] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7.
I20260709 12:59:43.371017  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:43.371624  1647 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:43.370600  5146 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:43.357350  5104 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.397524  2438 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:59:43.398102  2438 pending_rounds.cc:85] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 9
I20260709 12:59:43.398407  2438 pending_rounds.cc:107] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:59:43.398687  2438 raft_consensus.cc:2889] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:43.401227  5054 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:43.370339  5010 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:43.410153  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:43.410845  1564 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:43.415062  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:43.415879  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:43.416320  1567 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:43.420783  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:43.421036  5025 raft_consensus.cc:3055] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:43.421561  5025 raft_consensus.cc:740] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:43.415125  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:43.423837  1572 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.429291  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:43.434676  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:43.436882  1568 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:43.435896  2438 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
W20260709 12:59:43.444389  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.406271  5056 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:43.446188  1537 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:43.452188  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 483509us
I20260709 12:59:43.421970  5146 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.465557  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:43.458612  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:43.463004  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 161974us
W20260709 12:59:43.450968  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 113624us
I20260709 12:59:43.456207  5003 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:43.464371  4996 consensus_meta.cc:287] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.001s
I20260709 12:59:43.469560  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:43.470005  1572 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:43.494688  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:43.496222  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:43.498564  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:43.499264  1566 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:43.493708  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:43.473492  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.503002  5134 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:43.467828  5057 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:43.507537  1572 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:43.509480  1572 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:43.503657  5170 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:43.510672  1536 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:43.498328  5172 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:43.511364  5172 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.504379  1642 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.473955  5003 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:43.518173  5050 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:43.473392  5010 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:59:43.522475  1645 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:43.523365  1536 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:43.527086  1645 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:43.450480  5025 consensus_queue.cc:260] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.498726  5056 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:43.529695  1686 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:43.536681  1686 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:43.529569  1642 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:43.516933  4996 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:43.535967  5050 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:43.511693  5172 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:43.529179  5003 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:43.517464  5000 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:43.547847  1642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50864
I20260709 12:59:43.561108  1642 raft_consensus.cc:606] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Received request to transfer leadership
I20260709 12:59:43.550490  5090 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:43.551041  5146 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:43.515823  5089 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:59:43.558797  5166 log.cc:927] Time spent T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:59:43.558917  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 480008us
I20260709 12:59:43.567726  1638 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:43.568653  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:43.569706  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:43.542387  1645 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.576750  1566 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:43.577056  1645 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:43.578271  1686 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:43.540362  5057 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:43.543543  5134 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:43.541652  5025 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:43.545145  5019 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:43.527254  5170 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:59:43.589249  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:43.590457  1642 raft_consensus.cc:1240] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:43.606592  1564 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 12:59:43.540438  5048 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:59:43.565872  5034 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:43.562537  5056 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:43.606786  5146 consensus_queue.cc:1059] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:59:43.634379  1645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50864
W20260709 12:59:43.634548  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 111226us
I20260709 12:59:43.635023  1645 raft_consensus.cc:606] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Received request to transfer leadership
W20260709 12:59:43.615849  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 96932.6us
I20260709 12:59:43.615278  5129 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:43.658500  5129 raft_consensus.cc:697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:43.659691  5129 consensus_queue.cc:237] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.611115  5134 raft_consensus.cc:697] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:43.605829  5057 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.662732  5171 raft_consensus.cc:3055] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:43.621932  5019 raft_consensus.cc:697] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:43.663329  5171 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:43.664354  5019 consensus_queue.cc:237] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.664454  5171 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:43.541854  4941 consensus_queue.cc:1175] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a4be9cc90aca4dd4ad7db103062a7208" responder_term: 6 status { last_received { term: 5 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:59:43.662766  5134 consensus_queue.cc:237] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.670318  1638 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:43.621448  5056 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:43.674422  5050 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:43.675410  5175 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.676102  5175 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.686628  5056 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:43.686929  1717 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:43.689481  1568 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:43.692781  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 308) took 1593 ms. Trace:
I20260709 12:59:43.697621  1716 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:59:43.698025  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:43.699054  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:43.700687  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:43.693193  5003 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:43.694440  5172 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.712157  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:43.705003  1567 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:43.711418  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:43.697386  1563 rpcz_store.cc:276] 0709 12:59:42.099695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.521301 (+421606us) service_pool.cc:224] Handling call
0709 12:59:42.543966 (+ 22665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.036029 (+492063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.692592 (+656563us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b5400014d54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:43.692728 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085004032}
I20260709 12:59:43.718851  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:43.702186  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:43.714071  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:43.716233  1685 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:43.723654  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 86206us
I20260709 12:59:43.724640  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:43.726547  2436 raft_consensus.cc:2393] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 7: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:43.727070  1685 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:43.727138  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:43.728230  5048 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:43.728245  5104 consensus_queue.cc:1059] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:43.728801  5048 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:59:43.728510  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.735404  1646 raft_consensus.cc:2368] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10.
W20260709 12:59:43.737393  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.721194  5171 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:43.740926  1685 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:43.729195  5048 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:43.743050  1685 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:43.748247  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 170065us
I20260709 12:59:43.741036  5018 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:43.729933  5146 consensus_queue.cc:1059] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:59:43.752339  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:43.723271  5118 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:59:43.743808  4814 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:43.753100  1685 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:59:43.754626  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 118786us
I20260709 12:59:43.757608  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:43.758419  1455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 101370us
I20260709 12:59:43.758769  5177 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:43.759268  5177 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:43.759613  5177 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.761600  5003 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:43.758522  5018 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:43.762547  5018 raft_consensus.cc:697] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:43.763351  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:43.764062  2443 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:43.763420  5018 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.768362  5039 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:43.769364  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:43.771050  5172 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:43.771664  5172 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:43.754149  5175 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:43.777058  5023 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:43.784211  5164 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.422s	user 0.002s	sys 0.000s
W20260709 12:59:43.786077  5167 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.273s	user 0.000s	sys 0.000s
I20260709 12:59:43.787966  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:43.790154  4802 raft_consensus.cc:3055] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:43.790598  4802 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:43.793977  1536 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:43.796202  5039 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:43.796685  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.790889  1685 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:43.796694  5039 raft_consensus.cc:697] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:43.798992  5039 consensus_queue.cc:237] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.800344  5087 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:43.801785  1565 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:43.802315  5011 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.802866  5011 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:43.792752  2443 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 12:59:43.805684  1537 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:43.806638  5025 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:43.806114  1685 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:43.809342  1536 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:43.810779  1685 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:43.823441  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:43.824615  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:43.827746  1685 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:43.832271  1685 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:43.834086  1536 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:43.828709  5003 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:43.835592  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:43.840354  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:43.755765  5129 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:43.842535  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:43.808050  5025 raft_consensus.cc:697] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:43.829824  4814 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:43.837836  5089 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:43.836467  5087 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:43.846902  1685 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:43.807664  5177 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.842969  5144 raft_consensus.cc:2764] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:59:43.869570  1536 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:43.846473  4651 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:43.846122  5039 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:43.876832  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:43.844775  5056 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:43.852728  4814 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:43.844491  5176 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:43.843148  5153 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:43.851823  5180 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:43.878909  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:43.883598  5025 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:43.871883  5087 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:43.878088  5054 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:43.890028  5187 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:43.890878  1639 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:43.893095  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 46304.2us
I20260709 12:59:43.900987  4814 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:43.896214  4651 raft_consensus.cc:697] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:43.922786  4651 consensus_queue.cc:237] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.925031  5011 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:43.927281  5057 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:43.896673  5019 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:43.898587  2443 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:59:43.871495  5089 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.939083  5089 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:43.851945  5141 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:43.888976  5177 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:43.912834  5054 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:43.945250  5054 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.917768  5187 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.951037  5187 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:43.953528  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.913861  5181 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:43.954336  5181 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:43.954731  5181 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:43.956843  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 309) took 1856 ms. Trace:
I20260709 12:59:43.957235  1565 rpcz_store.cc:276] 0709 12:59:42.099917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.554126 (+454209us) service_pool.cc:224] Handling call
0709 12:59:42.554368 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.802181 (+1247813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.956618 (+154437us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54004204d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:43.956785 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2867991936}
I20260709 12:59:43.907414  1640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50864
I20260709 12:59:43.907150  5087 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:43.958341  1640 raft_consensus.cc:606] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Received request to transfer leadership
I20260709 12:59:43.880451  5056 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:43.959034  5056 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:43.891501  5048 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:43.963567  5048 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:43.878635  5188 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:43.914099  1685 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:43.963881  5054 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.964299  5188 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:43.964677  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 50655.2us
I20260709 12:59:43.965833  5054 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:43.920590  4802 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:43.966470  5188 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:43.933876  4791 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:43.966831  4802 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:43.934188  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 12:59:43.967070  5186 log.cc:927] Time spent T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:59:43.966997  5180 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:43.968526  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 2205) took 2147 ms. Trace:
I20260709 12:59:43.968920  1569 rpcz_store.cc:276] 0709 12:59:41.820849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.888859 (+ 68010us) service_pool.cc:224] Handling call
0709 12:59:41.889134 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.762433 (+873299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.968331 (+1205898us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b54002b5554. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:43.968475 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2007107968}
I20260709 12:59:43.912354  5095 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.970818  5095 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.971468  5087 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.966374  1685 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:43.973191  5175 raft_consensus.cc:3055] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:43.973430  5087 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:43.973620  5175 raft_consensus.cc:740] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:43.974087  5087 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:43.974686  5087 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.976186  5087 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:43.967163  4791 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.978778  4791 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:43.900807  5176 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:43.982245  5176 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:43.989002  5173 raft_consensus.cc:3055] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:43.989501  5173 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:43.990483  5173 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:43.991776  5173 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:44.003338  1565 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:44.003715  5087 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.004812  1566 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:44.006409  1564 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:44.008525  1686 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:44.009946  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:44.015136  5181 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:44.016800  5087 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:44.023919  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 48874.1us
I20260709 12:59:44.024606  5087 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:44.025066  5022 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:44.026203  5087 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:44.027324  1685 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:44.028334  5180 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:44.017441  5181 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:44.018473  5095 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:44.019788  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:44.031209  5180 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:44.030191  5087 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.035372  5056 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:44.038682  1470 catalog_manager.cc:5697] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:44.039644  1639 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:44.040459  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:44.040927  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:43.914204  5039 raft_consensus.cc:697] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:44.042213  5057 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.042732  5057 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:44.045228  5057 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:43.974658  5175 consensus_queue.cc:260] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:44.048179  1470 catalog_manager.cc:5697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:44.049333  5089 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.009809  4814 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.058166  1686 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:43.918620  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:59:44.063757  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 145190us
W20260709 12:59:44.066013  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 161386us
I20260709 12:59:44.042732  5039 consensus_queue.cc:237] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.049702  1470 catalog_manager.cc:5697] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 8 to 9, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:44.064905  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:44.078647  1536 leader_election.cc:400] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7.
I20260709 12:59:44.079061  1536 leader_election.cc:403] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:59:44.081108  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:44.081462  1714 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:44.075912  5035 consensus_queue.cc:1059] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:59:44.073767  5018 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:59:44.075868  5181 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:44.084049  5181 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:44.084152  5176 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.084522  5181 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.086773  5176 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:44.093021  1685 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:44.095765  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.096529  1564 raft_consensus.cc:2368] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 12:59:44.097574  1572 raft_consensus.cc:1240] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:44.098564  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 365497us
I20260709 12:59:44.102123  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.057793  5056 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:44.106029  1572 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:44.106402  1685 leader_election.cc:400] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10.
W20260709 12:59:44.108263  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.109902  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.114415  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.115156  1712 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.115628  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.116387  1713 raft_consensus.cc:3055] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:44.118113  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:44.118894  1716 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 12:59:44.120698  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.122808  1563 raft_consensus.cc:1240] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:44.123629  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.125011  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.126286  1571 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:44.116770  1713 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:44.123229  4791 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.134125  1611 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:44.134837  5069 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:44.135785  4791 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:44.136224  5104 consensus_queue.cc:1059] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:44.137110  5104 raft_consensus.cc:3055] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:44.137426  5104 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:44.138315  5104 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.139504  5104 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:44.142320  1569 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:59:44.144680  1611 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:44.145489  5057 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:44.146121  5057 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:44.146307  1611 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:44.147058  5057 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:44.147105  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.147800  1714 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:44.095992  5054 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:44.095579  5010 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:44.127498  1713 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.157383  1566 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:59:44.101907  5107 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.163432  1720 raft_consensus.cc:1240] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:44.163578  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:44.164372  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:44.164774  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:44.161798  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.167001  1713 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:44.164456  1611 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:44.159376  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.172109  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.173090  1572 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:44.122486  5090 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:44.175994  1563 raft_consensus.cc:1240] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:44.177377  1717 raft_consensus.cc:1240] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:44.179934  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.187526  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.188679  1714 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 12:59:44.190653  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:44.192925  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.190380  1611 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:44.157644  5054 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.124437  5019 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:59:44.170305  5025 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.219254  1721 raft_consensus.cc:1240] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:44.219825  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 44006.3us
I20260709 12:59:44.176988  5057 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:44.171667  5010 raft_consensus.cc:697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:44.221215  5054 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:44.229038  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 177248us
I20260709 12:59:44.185392  5090 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:44.223839  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.234258  1715 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:44.234946  1643 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:44.235610  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.236486  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.237564  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.232311  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:44.238687  1643 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:44.239019  1642 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:44.240612  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:44.241112  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:44.174350  5043 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:59:44.213456  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.241612  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:44.244231  1638 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:44.184093  5007 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:59:44.242445  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.241696  1643 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:44.248158  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:44.229316  5057 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.252700  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.184243  5181 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.261759  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.232772  5187 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:44.253537  1566 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:44.241883  5191 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:44.258787  1646 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:59:44.266897  1646 pending_rounds.cc:85] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 6
I20260709 12:59:44.267160  1646 pending_rounds.cc:107] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:59:44.267396  1646 raft_consensus.cc:2889] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:44.259719  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.268250  1563 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 12:59:44.259948  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.261092  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.262725  1568 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:44.250267  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:44.235263  5090 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:44.263643  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.219285  5188 consensus_queue.cc:1059] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:59:44.265005  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.274540  1567 raft_consensus.cc:2410] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:59:44.223165  5087 consensus_queue.cc:1059] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:59:44.257369  5033 consensus_queue.cc:1059] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:44.271867  1638 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 12:59:44.279309  1564 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:44.228646  5025 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.252635  5171 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:44.284828  1643 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:44.263746  5057 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:44.288725  5089 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:44.277843  5022 consensus_queue.cc:1059] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:59:44.289124  5181 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:44.289852  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.290292  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.292925  1712 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:44.295322  5010 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.296759  5200 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:44.297571  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:44.320575  1567 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:44.298540  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:44.298825  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:44.287992  5191 raft_consensus.cc:697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:44.300213  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:44.300518  5050 raft_consensus.cc:3055] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:44.298558  5025 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:44.301504  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:44.301874  1644 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:44.302217  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:44.302631  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.303260  5090 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.304322  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:44.308646  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:44.314978  1612 leader_election.cc:400] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 12:59:44.319370  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.342711  1568 raft_consensus.cc:2368] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 12:59:44.331983  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.281575  5188 consensus_queue.cc:1243] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:59:44.344244  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.344591  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.344700  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:44.345310  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.345728  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:44.345818  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:44.334514  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.346431  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:44.347208  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.347430  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:44.347951  5196 log.cc:927] Time spent T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:59:44.346438  1563 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.349506  1718 raft_consensus.cc:2393] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:44.348249  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:44.350414  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.351454  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:44.345883  5146 consensus_queue.cc:1059] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:59:44.352241  1567 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:44.352411  5146 raft_consensus.cc:3055] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:44.352820  5146 raft_consensus.cc:740] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:44.352954  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:44.347970  1570 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:44.349715  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.353868  5146 consensus_queue.cc:260] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.337543  1646 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:44.354368  1572 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 12:59:44.355367  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:44.356479  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:44.356709  1612 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:44.273041  5187 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.357424  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:44.350338  1566 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:44.358367  1567 raft_consensus.cc:1240] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:44.358273  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:44.329435  5022 consensus_queue.cc:1243] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer 338d817f94ee4c1bad162e9a5860b68a log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:59:44.364959  1570 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:44.361819  1563 raft_consensus.cc:2410] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:59:44.366142  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:44.368090  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 93148us
I20260709 12:59:44.337886  5118 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:59:44.332758  4814 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:44.331638  5050 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:44.372123  1567 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:44.378832  1566 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 12:59:44.379200  1685 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:59:44.364503  5197 log.cc:927] Time spent T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:59:44.383656  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.389009  1568 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:44.362241  5188 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:44.383173  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:44.390491  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 124714us
I20260709 12:59:44.392859  1685 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:44.394212  1685 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:59:44.394256  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 62069.9us
I20260709 12:59:44.395072  1685 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:44.395320  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:44.371699  5146 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.397564  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:44.341141  5069 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:59:44.400710  1570 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:44.401224  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:44.346510  5174 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 12:59:44.420244  2406 leader_election.cc:336] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.654s (SENT)
W20260709 12:59:44.441756  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.449093  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:44.454321  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.457722  1719 raft_consensus.cc:3055] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:44.458125  1719 raft_consensus.cc:740] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:44.458904  1719 consensus_queue.cc:260] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.460103  1719 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:44.460492  5050 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.461648  5050 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.463034  1641 raft_consensus.cc:3055] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:44.463419  1641 raft_consensus.cc:740] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:44.465438  5018 raft_consensus.cc:3055] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:44.465857  5018 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:44.466734  5018 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.468039  5018 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:44.372092  5048 consensus_queue.cc:1059] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 12:59:44.472506  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.386216  5171 consensus_queue.cc:1059] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:59:44.474409  1713 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 12:59:44.385288  5180 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:59:44.414286  4802 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:44.495384  1719 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
W20260709 12:59:44.495751  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 173111us
I20260709 12:59:44.497602  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:44.447485  5205 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:44.501394  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:44.509143  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:44.501508  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 106505us
I20260709 12:59:44.484849  5104 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:44.513643  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:44.471288  5188 consensus_queue.cc:1059] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
W20260709 12:59:44.532364  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.515511  1685 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:44.521431  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:44.476449  5054 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.544121  5056 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:44.517549  5095 raft_consensus.cc:2764] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:59:44.511837  5025 raft_consensus.cc:2764] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:44.557632  1611 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:44.519022  5181 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:44.515838  4802 raft_consensus.cc:697] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:44.510672  5203 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:44.538705  5089 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:44.570549  1611 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:44.574405  1565 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 10: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:44.576570  5205 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:44.577287  5205 raft_consensus.cc:697] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:44.578215  5205 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:44.578735  5202 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:59:44.580703  1611 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:44.450287  5191 consensus_queue.cc:237] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.546296  5206 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:44.603690  5054 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:44.402474  5129 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:44.402499  4814 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.582422  5171 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:44.599352  1641 consensus_queue.cc:260] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.619525  1642 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:59:44.609375  5129 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.617261  5171 raft_consensus.cc:697] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:44.623528  5146 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:44.638399  5187 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:44.615260  4814 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:44.650043  5129 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:44.692472  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 135555us
I20260709 12:59:44.691785  1564 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 10. Ops: []
W20260709 12:59:44.698555  2406 leader_election.cc:336] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.765s (SENT)
I20260709 12:59:44.699132  2406 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:44.702203  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 158995us
W20260709 12:59:44.700593  5107 consensus_meta.cc:287] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 12:59:44.700294  5187 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:44.717959  2443 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:44.641463  4802 consensus_queue.cc:237] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.724326  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.725544  1712 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:44.726799  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.728950  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:44.729615  1714 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:44.729629  5206 consensus_queue.cc:1059] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:44.731554  5206 raft_consensus.cc:3055] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:44.731937  5206 raft_consensus.cc:740] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:44.732765  5206 consensus_queue.cc:260] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:44.733961  5206 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:44.737360  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.737612  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:44.739825  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.742465  1569 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:44.709334  5118 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:44.738147  1717 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:44.716202  5107 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7.
I20260709 12:59:44.749516  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:44.751037  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.751821  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.735080  5213 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:44.752671  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.753342  1717 raft_consensus.cc:1240] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:44.755492  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.759124  1720 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 9: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:44.758352  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:44.759893  1717 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:44.760637  1571 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:44.762590  1717 raft_consensus.cc:3055] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:44.762750  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.762971  1717 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:44.763644  1717 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:44.764493  1717 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:44.764494  1712 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:44.766986  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:44.767220  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:44.768584  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:44.738641  5187 raft_consensus.cc:697] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:44.776068  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:44.745082  5146 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:59:44.782706  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.735354  5095 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:59:44.773516  5213 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:44.791329  5208 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:59:44.793308  5213 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:44.786983  5025 consensus_queue.cc:1059] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:59:44.795120  5025 raft_consensus.cc:3055] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:44.795485  5025 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:44.796347  5025 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.797524  5025 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:44.788762  5089 raft_consensus.cc:2764] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:44.793131  5225 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:44.802855  5035 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:44.803287  5187 consensus_queue.cc:237] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.804874  5018 raft_consensus.cc:3055] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:44.790650  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:44.805460  5168 raft_consensus.cc:3055] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:44.809337  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:44.811492  1717 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:59:44.812108  1717 pending_rounds.cc:85] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 9
I20260709 12:59:44.812479  1717 pending_rounds.cc:107] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:59:44.776968  5107 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:44.759074  5118 consensus_queue.cc:1059] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 12:59:44.819372  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.749346  5171 consensus_queue.cc:237] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.821310  1717 raft_consensus.cc:2889] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:44.810186  5168 raft_consensus.cc:740] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:44.807188  5018 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:44.809834  5181 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:44.832155  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.814095  5222 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:44.831528  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 59976.3us
W20260709 12:59:44.829026  5057 consensus_meta.cc:287] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.001s
I20260709 12:59:44.838675  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:44.841112  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:44.843466  5054 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:44.840752  5057 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.852217  5057 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:44.858376  1638 raft_consensus.cc:2393] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 10: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:44.832298  5181 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.860203  5181 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:44.833510  5222 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.864395  5222 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:44.867307  4995 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:44.867731  4995 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:44.868577  4995 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:44.869731  4995 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:44.870492  5168 consensus_queue.cc:260] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:44.871702  5168 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:44.872946  4814 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:44.876124  5134 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:59:44.878321  5018 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.839031  4791 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:59:44.883138  5226 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.883664  5226 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.885790  5226 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:44.886569  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.886906  5146 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:44.898324  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.033s	sys 0.017s
W20260709 12:59:44.937183  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.034s	sys 0.017s
W20260709 12:59:44.937630  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 554775us
I20260709 12:59:44.939188  1612 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:44.899180  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.900019  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:44.902127  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.941251  1720 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:44.902750  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:44.905922  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:44.942500  2436 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:44.943444  5118 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:44.941596  5213 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:44.915266  1713 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:44.916550  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:44.917618  5175 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.928835  5181 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.929769  5054 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:44.950516  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:44.948575  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:44.981011  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:44.960127  5181 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:44.959510  5222 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.986111  1720 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 12:59:44.988224  1611 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:44.981509  5191 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:44.990871  5222 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:44.997224  5213 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:44.997810  5213 raft_consensus.cc:697] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:44.992746  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:44.998728  5213 consensus_queue.cc:237] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:44.999487  1720 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:45.004253  1641 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:45.006431  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.012745  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:45.013535  1721 raft_consensus.cc:2393] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 10: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:45.014719  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.015923  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:45.017913  1641 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:59:45.018378  1641 pending_rounds.cc:85] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 3
I20260709 12:59:45.018676  1641 pending_rounds.cc:107] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:59:45.018985  1641 raft_consensus.cc:2889] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:45.019098  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:45.018797  1720 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:45.027014  1612 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:44.987139  5010 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:45.018258  5171 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:45.036494  1612 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:45.028765  5173 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:59:45.017201  5104 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:45.043013  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.035066  5057 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:45.030073  5191 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:45.049642  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:45.034317  5010 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.053790  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:45.037310  5022 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:45.033948  5129 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.046840  5210 raft_consensus.cc:2764] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:59:45.069687  1721 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:45.091892  5090 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:45.040892  5233 raft_consensus.cc:2764] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:59:45.055686  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:45.100188  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 44611.9us
I20260709 12:59:45.101656  1612 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.103201  1612 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.048084  5230 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:45.104733  1612 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.106207  1719 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:45.053823  5171 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:45.054023  5010 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:45.104480  5191 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:45.112908  1715 raft_consensus.cc:1240] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:59:45.116899  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.055851  5229 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:45.131950  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.103062  5104 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:45.104912  5218 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:45.139602  1612 leader_election.cc:400] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 12:59:45.140794  1612 leader_election.cc:403] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:59:45.061373  5022 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:45.152014  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.152201  1568 raft_consensus.cc:1217] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Deduplicated request from leader. Original: 9.9->[11.10-11.10]   Dedup: 11.10->[]
I20260709 12:59:45.152777  1568 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:59:45.135957  5229 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:45.154292  1569 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:45.161103  1563 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:45.159951  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:45.161827  1570 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:45.161991  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.162750  1566 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:45.164251  1565 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:45.164386  1612 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.135067  5129 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:45.160377  5104 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 12:59:45.166106  1567 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:45.140833  5230 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:45.166810  1569 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:59:45.136976  5010 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:45.168993  1612 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.155284  5090 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:59:45.177452  1569 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:45.179179  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:45.180107  5010 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:45.182916  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.172967  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.168155  5218 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:45.185139  1564 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:45.173410  5229 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:45.188333  5230 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:45.173095  5175 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:45.192153  1612 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:45.202585  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.204277  1612 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.205726  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.206343  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 473) took 1062 ms. Trace:
I20260709 12:59:45.207182  1716 rpcz_store.cc:276] 0709 12:59:44.143856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.147284 (+  3428us) service_pool.cc:224] Handling call
0709 12:59:44.147731 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.229590 (+ 81859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.229616 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.036212 (+806596us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b2c00047778. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cbb91a11 00007f18cbba1372 00007f18cd2d3a01 00007f18cd29843a 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2
0709 12:59:45.036577 (+   365us) log.cc:844] Serialized 26 byte log entry
0709 12:59:45.154751 (+118174us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:45.154781 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.154950 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.194861 (+ 39911us) raft_consensus.cc:1685] finished
0709 12:59:45.194879 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.206255 (+ 11376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27587,"raft.queue_time_us":71698,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4070,"spinlock_wait_cycles":10435840,"thread_start_us":139763,"threads_started":2,"wal-append.queue_time_us":122318}
I20260709 12:59:45.207417  5221 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:59:45.203591  5090 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:59:45.207731  5175 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:45.205886  5226 consensus_queue.cc:1059] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:59:45.202234  5134 consensus_queue.cc:1059] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:59:45.206964  5065 consensus_queue.cc:1059] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:59:45.214001  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.224018  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:45.225286  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:45.228761  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:45.232807  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:45.244752  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:45.213843  5218 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:45.246771  1536 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:45.213464  5213 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:45.248960  5227 raft_consensus.cc:3055] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:45.263062  5227 raft_consensus.cc:740] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:45.264572  5227 consensus_queue.cc:260] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:45.265777  5227 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:45.229789  5104 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.250039  5039 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:45.266299  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38580 (request call id 9) took 1143 ms. Trace:
I20260709 12:59:45.266402  5104 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:45.266911  1639 rpcz_store.cc:276] 0709 12:59:44.130226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.131186 (+   960us) service_pool.cc:224] Handling call
0709 12:59:45.266001 (+1134815us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b54002b93d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29e735 00007f18d225ed29 00007f18cb7dd1d4 00007f18cb7dd162 00007f18cb7dd091 00007f18cb7dd00c 00007f18cb7dc2c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:45.266210 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2262698240}
I20260709 12:59:45.229852  5025 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:45.243904  5056 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:45.256794  5229 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:45.244755  5176 consensus_queue.cc:1059] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:59:45.258858  5134 raft_consensus.cc:3055] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:45.229732  5230 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.229964  5175 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:45.215824  5219 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:59:45.269374  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:45.271919  1518 auto_rebalancer.cc:893] Removing replace marker failed: Replica a4be9cc90aca4dd4ad7db103062a7208 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 12:59:45.273332  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 66826us
I20260709 12:59:45.249714  5054 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:45.231745  5222 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:45.288230  1518 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 17d2c95439be4ced872760603b0ae02b already in progress
I20260709 12:59:45.289402  1536 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:45.292474  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:45.293103  1564 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:45.293387  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 66836.3us
I20260709 12:59:45.293540  1720 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:45.295331  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:45.297022  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:45.268522  5050 raft_consensus.cc:3055] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:45.272953  4791 raft_consensus.cc:2764] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:45.300844  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:45.288988  1518 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 17d2c95439be4ced872760603b0ae02b already in progress
W20260709 12:59:45.296581  5209 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.727s	user 0.004s	sys 0.001s
I20260709 12:59:45.280860  5175 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:45.311484  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:45.315575  2443 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:45.310683  1536 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:45.313308  1566 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:59:45.279783  5134 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:45.298437  5039 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:45.307914  5181 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:45.341238  1717 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:45.298962  5050 raft_consensus.cc:740] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:45.348534  1713 raft_consensus.cc:1275] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:45.348959  1564 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:45.315137  5176 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:45.312062  5260 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:59:45.286563  5230 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:45.354033  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 125534us
I20260709 12:59:45.317557  5104 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:45.317749  5175 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:45.315893  5226 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:59:45.349598  4791 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:45.383179  1639 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:45.380324  5007 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:45.386123  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:45.380846  5257 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.391707  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:45.395452  1641 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:45.395830  1644 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:45.351089  5222 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:59:45.396858  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2610) took 1093 ms. Trace:
W20260709 12:59:45.397509  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.398283  1644 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:59:45.398634  1644 pending_rounds.cc:85] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 4
I20260709 12:59:45.397236  1643 rpcz_store.cc:276] 0709 12:59:44.303884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.306346 (+  2462us) service_pool.cc:224] Handling call
0709 12:59:44.306720 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.307345 (+   625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.307390 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:44.317880 (+ 10490us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.480232 (+162352us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:44.480277 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.480352 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.261582 (+781230us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 12:59:45.396612 (+135030us) raft_consensus.cc:1685] finished
0709 12:59:45.396630 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.396802 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1170,"raft.queue_time_us":223,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4859,"spinlock_wait_cycles":3148672,"thread_start_us":117223,"threads_started":1,"wal-append.queue_time_us":213684}
I20260709 12:59:45.398862  1644 pending_rounds.cc:107] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:59:45.399111  1644 raft_consensus.cc:2889] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:45.400203  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.382028  5146 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:45.417064  1646 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:45.418152  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:45.419426  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:45.420234  1638 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:45.425344  2443 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:45.429612  5230 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:45.385447  5007 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:45.432322  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:45.389966  5206 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:45.433594  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 315) took 1137 ms. Trace:
I20260709 12:59:45.398454  5171 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:45.442296  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 95440.9us
I20260709 12:59:45.387655  5213 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:59:45.434687  1572 rpcz_store.cc:276] 0709 12:59:44.295709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.355361 (+ 59652us) service_pool.cc:224] Handling call
0709 12:59:44.355625 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:44.355835 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:59:44.472017 (+116182us) log.cc:844] Serialized 14 byte log entry
0709 12:59:45.422297 (+950280us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b18002a8500. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18cce404bc 00007f18ca18e48b 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1aac02 00007f18cce3220b 00007f18cce37d23 00007f18cce3823a
0709 12:59:45.433183 (+ 10886us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:45.433244 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:59:45.433311 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.433397 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.433530 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10624,"prepare.queue_time_us":160452,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":10742,"spinlock_wait_cycles":4261248,"thread_start_us":307188,"threads_started":2,"wal-append.queue_time_us":182666}
I20260709 12:59:45.454653  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:45.379737  5050 consensus_queue.cc:260] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.400743  5257 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:45.444540  5258 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:45.477309  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:45.397091  5134 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.432870  5146 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.436457  5260 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:59:45.481299  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:45.485105  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:45.491525  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:45.492304  1644 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 10: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:45.492399  1642 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:45.494539  5007 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:45.495553  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:45.495666  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:45.496308  1713 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 12:59:45.497123  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:45.497828  2405 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:45.498831  5007 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:45.499244  5007 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:45.499588  5007 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:45.500454  5146 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:45.500579  5129 raft_consensus.cc:3055] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:45.451175  5206 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:45.500957  5129 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:45.501760  5129 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.502942  5129 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:45.503381  5257 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:45.503671  5206 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:45.504705  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:45.505484  1718 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 7: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:45.480917  5050 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:45.481208  5258 raft_consensus.cc:697] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:45.514042  5237 raft_consensus.cc:3055] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:45.514613  5237 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:45.514421  5258 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:45.515432  5237 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.516305  5007 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:45.516419  5237 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:45.519443  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:45.523797  5188 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:45.524317  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.524291  5188 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.526733  5188 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:45.510802  5175 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.527352  1715 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 12:59:45.527931  1641 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:45.528566  2405 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:45.528847  5175 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:45.529460  5206 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:45.529951  5206 raft_consensus.cc:697] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:45.530349  5025 raft_consensus.cc:3055] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:45.530745  5025 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:45.530824  5206 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:45.531539  5025 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.532670  5025 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:45.534157  1641 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:45.537676  1647 raft_consensus.cc:1240] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:45.538455  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:45.518465  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1603) took 1359 ms. Trace:
I20260709 12:59:45.539288  1571 rpcz_store.cc:276] 0709 12:59:44.158764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.159040 (+   276us) service_pool.cc:224] Handling call
0709 12:59:45.518300 (+1359260us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b540031c9d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:45.518411 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359483136}
I20260709 12:59:45.558571  5007 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:45.560994  5090 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:45.563397  1685 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:45.564479  5090 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:45.575350  1685 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:45.581856  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:45.583511  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:45.543197  5171 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.585163  5188 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:45.568981  5213 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.592604  5212 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:45.593027  1685 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:45.593963  5212 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:45.594125  1685 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:45.590310  5171 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.597764  5171 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:45.598834  5221 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:45.590332  5237 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:45.552742  5261 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 12:59:45.626189  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.599591  5213 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:45.626881  5175 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.627359  5175 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.629483  5213 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:45.629675  5175 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:45.630223  4651 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:59:45.630780  1646 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:45.639468  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:45.640130  2443 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
W20260709 12:59:45.648034  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.603765  5010 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:59:45.656370  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 62328.8us
I20260709 12:59:45.658274  5035 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:45.658689  5035 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.659013  5035 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:45.661911  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:45.662302  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:45.662745  1716 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:45.663086  1719 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:45.663925  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:45.664723  1713 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:45.666383  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:45.666529  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:45.666958  1713 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:45.667414  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:45.668618  5022 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:45.669070  1720 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:59:45.670226  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 65161.9us
I20260709 12:59:45.670373  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:45.673713  1719 raft_consensus.cc:2368] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 12:59:45.675103  1564 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:45.681730  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:45.682391  1567 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:45.683346  1566 raft_consensus.cc:3055] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:45.683789  1566 raft_consensus.cc:740] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:45.686569  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:45.698547  1570 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:45.684558  1566 consensus_queue.cc:260] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.706135  1566 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:45.710080  1645 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:59:45.710556  1645 pending_rounds.cc:85] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 3
I20260709 12:59:45.710847  1645 pending_rounds.cc:107] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:59:45.711133  1645 raft_consensus.cc:2889] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:45.715476  1611 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:45.722756  1611 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:45.726150  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:45.726667  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:45.726845  1646 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:45.727919  5176 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:45.728542  5176 raft_consensus.cc:697] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:45.730307  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:45.734511  5176 consensus_queue.cc:237] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.755563  5054 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:45.756819  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:45.757582  5054 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:45.762655  5222 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:45.724645  5213 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:45.770516  5175 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:59:45.760412  5146 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:45.778966  5146 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.779349  5146 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:45.783007  5268 raft_consensus.cc:3055] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:45.783591  5268 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:45.784560  5268 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:45.762172  5187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.017s	sys 0.006s
I20260709 12:59:45.792251  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:45.792991  1570 raft_consensus.cc:2393] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 10: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:45.793366  1572 raft_consensus.cc:1275] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:45.724166  5173 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:59:45.818186  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:45.818209  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:45.819433  1570 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:45.821947  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:45.821343  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:45.826694  1611 leader_election.cc:400] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 12:59:45.827031  1611 leader_election.cc:403] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:59:45.730736  5171 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:59:45.775049  5230 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:45.787624  5057 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:45.788028  5213 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:45.766224  5054 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:45.831818  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:45.833488  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 45675.7us
I20260709 12:59:45.830034  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:45.793133  5187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.017s	sys 0.006s
I20260709 12:59:45.860311  1640 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:59:45.831785  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:45.840147  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:45.863173  1568 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:45.870584  1563 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:45.870478  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:45.865576  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:45.794736  5268 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:45.875640  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:45.876389  1568 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:45.852255  1570 raft_consensus.cc:2393] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:45.791582  5279 consensus_queue.cc:1059] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:59:45.895311  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:45.886813  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:45.894032  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:45.897764  1566 raft_consensus.cc:1275] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 12:59:45.898813  1566 pending_rounds.cc:85] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 4
I20260709 12:59:45.899111  1566 pending_rounds.cc:107] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:59:45.899729  1566 raft_consensus.cc:2889] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:45.900252  1570 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:45.850592  5191 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:45.901783  1566 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:45.901985  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:45.897717  1568 raft_consensus.cc:2393] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:59:45.904084  5089 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:59:45.906781  1572 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 7: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:45.835585  5213 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:45.911988  1685 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:45.896471  5025 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:45.834968  5230 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.837543  5035 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:45.835325  5057 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:45.871335  5173 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:59:45.915333  5056 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:45.936803  5146 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:45.937350  5230 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:45.937474  1717 raft_consensus.cc:2393] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:45.938252  5035 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:45.927632  5279 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:46.093297  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:46.122687  2443 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:59:46.025956  5172 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:46.124027  5293 log.cc:927] Time spent T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.185s	user 0.000s	sys 0.002s
W20260709 12:59:45.969864  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 53774.2us
I20260709 12:59:46.125330  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:45.969023  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 57140.7us
I20260709 12:59:45.921938  5211 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:59:46.107508  5146 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:46.115602  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:46.129175  2436 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:45.990597  5048 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:46.061563  5057 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:46.067574  5134 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:45.930150  5054 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.063158  5222 raft_consensus.cc:3055] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:46.121563  1712 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:46.151407  2436 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:46.127036  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:46.153519  5171 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:46.153892  5171 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:46.154279  5171 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.156214  5281 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:46.152557  5279 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:46.158866  5018 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:46.151383  5222 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:46.161353  5222 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.134774  5048 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:46.162382  5048 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:46.162528  5222 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:46.143157  4791 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.170819  4791 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.172876  4791 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:46.176224  5213 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:46.180389  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 285142us
I20260709 12:59:46.181075  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:46.181394  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:45.047004   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:46.190184  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:46.211875  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:46.214788  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 88388.9us
I20260709 12:59:46.180534  5279 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:46.201356  4791 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:46.193601  5181 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:46.225754  1611 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:46.227785  1646 raft_consensus.cc:1275] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:59:46.228449  1639 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:46.232064  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:46.232124  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:46.233050  1638 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:46.244725  5279 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:46.246454  2406 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:46.247532  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:46.248581  5118 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:46.246587  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 121375us
I20260709 12:59:46.250167  1612 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:46.250357  5172 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:46.251034  5172 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:46.251695  5213 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:46.255060  5172 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:46.255707  5025 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.256203  5025 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.257442  1612 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:46.258409  5025 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:46.259068  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:46.259904  1571 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 10: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:46.258431  5065 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:59:46.260286  5272 consensus_queue.cc:1048] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:46.259177  5107 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:46.261765  5172 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:46.265477  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:46.265764  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:46.266088  1567 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:46.266407  1564 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:46.267179  1612 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:46.267655  1569 raft_consensus.cc:2393] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:46.268342  1612 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:46.268352  1572 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:46.277362  1564 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:46.279987  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:46.284938  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:46.257148  5048 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.204916  5171 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:46.292012  1638 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:46.236364  5089 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:59:46.269905  5227 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.269657  4802 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.287773  5172 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:46.306489  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:46.307281  1712 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 12:59:46.308542  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:46.309640  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:46.310459  1716 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:46.311609  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:46.295992  5187 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:46.296229  5175 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:46.328608  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:46.329667  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:46.349541  1638 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:46.334185  4814 consensus_queue.cc:1048] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:46.335628  5266 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:46.338384  1685 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:46.340827  1570 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:46.318359  5226 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.353942  1716 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:46.288151  5213 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:59:46.289124  5057 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:59:46.349529  1639 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:46.292482  5118 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:59:46.395694  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 56612.5us
I20260709 12:59:46.395855  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:46.380947  1714 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:46.397770  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:46.398756  1714 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:46.399729  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:46.401043  1646 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:59:46.417675  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:46.418735  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:46.303954  5227 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:46.303638  4802 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:46.426517  5257 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:59:46.383572  5187 raft_consensus.cc:697] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:46.398535  5019 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:46.471536  1713 raft_consensus.cc:2393] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:46.430675  5297 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:46.435034  5181 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:46.395406  5226 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.479686  5297 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:46.470944  5191 consensus_meta.cc:287] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.562s	user 0.004s	sys 0.007s
I20260709 12:59:46.465611  5176 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.469838  5019 raft_consensus.cc:697] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:46.486132  5181 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.480353  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 333) took 1058 ms. Trace:
I20260709 12:59:46.507989  1714 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:46.507243  5176 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.515162  5226 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:46.515955  5176 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:46.516181  5290 log.cc:927] Time spent T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:59:46.500240  5146 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:46.495493  5180 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:46.499536  5191 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 12:59:46.519601  1569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:59:46.491058  5297 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:46.513294  1643 rpcz_store.cc:276] 0709 12:59:45.421847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.427363 (+  5516us) service_pool.cc:224] Handling call
0709 12:59:45.427682 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.430899 (+  3217us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:45.557815 (+126916us) log.cc:844] Serialized 14 byte log entry
0709 12:59:45.679438 (+121623us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.679964 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 12:59:45.680137 (+   173us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:46.068416 (+388279us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b4800220158. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d21c1aa1 00007f18d21b8b37 00007f18d21b89ca 00007f18d22b026f 00007f18d22aff37 00007f18d22c455c 00007f18d22c4508 00007f18d22c4488 00007f18d22c4443 00007f18d22c36ec 00007f18d11eda96
0709 12:59:46.069428 (+  1012us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b1800099400. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca18de07 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1a8455 00007f18d0c903c7 00007f18cd2a29a7 00007f18cd2b20bf 00007f18cd2b2038
0709 12:59:46.473273 (+403845us) log.cc:844] Serialized 14 byte log entry
0709 12:59:46.480069 (+  6796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.480141 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.480188 (+    47us) raft_consensus.cc:1685] finished
0709 12:59:46.480199 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.480306 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39113,"prepare.queue_time_us":373570,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":11698,"raft.run_cpu_time_us":8862,"raft.run_wall_time_us":391757,"spinlock_wait_cycles":62801536,"thread_start_us":651165,"threads_started":3,"wal-append.queue_time_us":200595}
I20260709 12:59:46.525704  1569 raft_consensus.cc:606] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:46.533614  1569 raft_consensus.cc:614] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:46.520447  5181 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:46.535259  5187 consensus_queue.cc:237] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:46.582316  5019 consensus_queue.cc:237] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.585351  1717 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:46.524434  5171 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:46.588871  5295 log.cc:927] Time spent T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:59:46.593740  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:46.594614  1567 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 12:59:46.597684  2406 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:46.524163  5007 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:46.601790  5299 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:59:46.604290  5281 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:46.606956  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:46.610330  1713 raft_consensus.cc:606] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:46.610891  1713 raft_consensus.cc:614] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:46.610126  5281 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.605993  5007 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:46.607604  5297 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:46.644990  5300 log.cc:927] Time spent T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:59:46.638509  5281 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:46.658593  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:46.651206  5226 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.670032  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:46.685103  2436 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 5.
I20260709 12:59:46.692159  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:46.695171  1643 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:46.697997  1641 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:46.700186  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:46.700992  1640 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:46.672490  5206 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.687289  5230 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:46.686334  5226 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.725800  1716 raft_consensus.cc:606] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:46.724990  5311 log.cc:927] Time spent T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:59:46.715723  5230 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.712764  5206 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:46.737898  5297 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:46.795065  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:46.797004  1570 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 12:59:46.817381  1685 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:46.797555  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:46.821614  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:46.822583  1640 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 12:59:46.841564  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:46.842435  1640 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:46.853796  2406 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:46.863092  5118 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:46.864261  5118 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:46.866549  5318 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.867198  5025 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:46.867847  5318 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.868607  5025 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.872409  5226 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:46.872815  5206 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:46.876118  1717 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:59:46.876850  5019 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:46.877445  5019 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.880998  5039 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:46.865823  4791 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:59:46.881697  5007 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:46.881886  5039 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.882807  5171 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:46.883541  5171 raft_consensus.cc:697] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:46.883533  5318 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:46.877951  5019 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:46.899197  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 45720.7us
I20260709 12:59:46.900343  5039 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:46.901559  5323 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:46.902174  5323 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.902390  5118 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:46.902770  5323 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:46.905287  5191 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:46.906332  5191 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.910274  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:46.911377  1570 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 12:59:46.911552  5191 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:46.885639  5171 consensus_queue.cc:237] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:46.914774  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:46.919030  2406 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:46.915405  4802 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:46.914700  5025 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:46.923276  1640 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 12:59:46.920815  5146 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:46.930848  5188 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:46.931885  5188 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:46.932643  5175 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:46.933394  5175 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:46.930932  5146 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:46.934931  5188 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:46.937676  5180 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:46.946329  5234 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:46.946768  5180 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:46.946923  5234 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.947486  5234 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:46.941761  5227 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:46.945192  5025 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:46.965582  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:46.999280  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:47.000639  1568 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:47.004390  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:47.004650  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:47.005252  1639 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:47.005453  1566 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 12:59:47.007653  5175 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:47.009021  5279 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.009794  5279 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.013221  5279 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.007822  5181 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.030809  5181 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:47.021180  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 678684us
I20260709 12:59:47.022226  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:47.036206  1715 raft_consensus.cc:2393] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:47.023331  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:47.024207  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:46.984577  5025 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.037962  5043 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:47.038578  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:47.039527  1640 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:47.039935  5025 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.040642  5334 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:47.041549  5334 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.040688  1713 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:47.042623  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:47.043501  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:47.044268  5334 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:47.044373  1720 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 12:59:47.041947  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:47.045318  1566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:59:47.046955  1566 raft_consensus.cc:606] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:47.047330  1566 raft_consensus.cc:614] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:47.048648  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:47.050215  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:47.050441  5025 consensus_queue.cc:1059] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:47.051930  5039 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:47.052446  5039 raft_consensus.cc:697] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:47.052376  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:47.054162  2443 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:47.055955  5089 raft_consensus.cc:3055] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:47.056239  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:47.056510  5089 raft_consensus.cc:740] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:47.062198  5272 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.063078  5272 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.067406  1612 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:47.018988  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:47.070842  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:47.071399  1570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:59:47.070990  5104 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:47.072113  5104 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.072538  5104 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:47.072428  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:47.071561  1647 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:47.072116  1570 raft_consensus.cc:606] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:47.074184  1639 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:47.075371  5297 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:47.075829  5297 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:47.076175  5297 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:47.074182  1570 raft_consensus.cc:614] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:47.078377  5176 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.079087  5176 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.079675  5048 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:47.087772  5222 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:47.088893  5281 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.090689  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:47.053925  5039 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.116951  5261 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.116642  5222 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.117625  5261 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.092939  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:47.094007   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:47.094121  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:47.096617  5272 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:47.097494  1714 raft_consensus.cc:2410] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:59:47.098193  5187 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:47.099680  5230 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.057837  5089 consensus_queue.cc:260] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.102936  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:47.105006  5213 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:47.102985  5146 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.106401  1611 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:47.111536  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:47.081813  5176 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.119277  5222 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.143576  1647 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:47.145763  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:47.148152  1568 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:47.169127  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:47.124815  5180 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.174062  2405 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:47.174844  1645 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:47.176393  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:47.176898  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 54172.4us
I20260709 12:59:47.131134  5213 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.129545  5187 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.190279  5168 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:47.193009  5230 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:47.193499  5230 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:47.193917  5230 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:47.194238  1646 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:59:47.198385  5089 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:47.198756  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:47.199607  2436 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:47.170420  5261 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:47.215050  1715 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:47.217986  5054 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:47.169116  1467 catalog_manager.cc:5697] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 5 to 6, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:47.218658  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:47.218868  5054 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.219434  5176 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:47.219543  1567 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:47.220148  5176 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.209877  5168 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:47.223802  5168 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.224265  5330 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:47.224452  5054 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:47.225334  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:47.233763  5168 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:47.234707  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:47.234920  5176 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.235467  5222 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:47.236312  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 130214us
I20260709 12:59:47.238176  1611 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:47.239146  5057 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:47.239800  5057 raft_consensus.cc:697] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:47.241045  5057 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.242491  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:47.244843  5213 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.245709  1717 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:47.245826  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:47.246958  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:47.247654  1716 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:47.250479  4651 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:47.251065  4651 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.251768  5180 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:47.259446  1611 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:47.253587  4651 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:47.265301  5260 raft_consensus.cc:993] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 12:59:47.265962  5191 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:47.266027  4651 raft_consensus.cc:1081] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 12:59:47.266757  5191 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:47.267244  5191 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:47.261713   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:47.269837  1715 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:47.269825  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:47.275331  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:47.209211  5234 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.282877  1611 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:47.285641  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:47.287034  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 118124us
I20260709 12:59:47.288286  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:47.224938  5330 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.289824  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:47.253659  5180 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.298959  5334 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:47.302279  1646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 12:59:47.302906  1646 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:47.303246  1646 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:47.305531  5146 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.306583  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:47.306668  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:47.300902  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:47.311380  2438 raft_consensus.cc:2368] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 12:59:47.311931  1716 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 12:59:47.228516  5297 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.308148  5187 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.313308  5176 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:47.327432  5279 consensus_queue.cc:1059] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:59:47.326514  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:47.321410  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:47.329770  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:47.348768  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:47.338627  1717 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:47.350895  2443 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:47.351369  2436 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 12:59:47.361181  1570 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:47.263866  5323 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.363682  1563 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 12:59:47.364668  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:47.366137  5187 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:47.366734  5187 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.366915  5203 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:59:47.309698  5180 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.377017  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:47.333946  5281 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:47.376045  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:47.349952  5279 raft_consensus.cc:3055] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:59:47.389509  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 70356.3us
I20260709 12:59:47.346994  5272 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:47.368875  5187 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.395404  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:47.394483  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:47.397101  1639 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:47.346284  5168 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:59:47.346520  5257 consensus_queue.cc:1059] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:59:47.400795  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:47.346251  5176 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.383459  5261 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:47.392383  5334 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:59:47.409251  5297 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.388677  5057 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:47.335767  5019 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.414268  5323 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.390699  5279 raft_consensus.cc:740] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:47.392431  5146 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:47.415722  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:47.372895  5230 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.377740  5025 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:59:47.430488  5203 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:47.435309  5057 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.403048  4791 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:47.441872  1714 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:59:47.443075  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:47.411903  5206 raft_consensus.cc:3055] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:47.458448  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:47.459816  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 82912.9us
I20260709 12:59:47.462086  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:47.459293  1715 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:47.464159  1686 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:47.472774  5230 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:47.474112  5346 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:59:47.475734  5330 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.478379  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:47.478962  1641 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:59:47.479512  5057 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.479838  5176 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.480216  1714 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 12:59:47.480063  5107 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:59:47.484504  1686 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:47.487334  5129 raft_consensus.cc:3055] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:47.487764  5129 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:47.485751  1686 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:47.494779  2405 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:47.494910  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:47.478029  5279 consensus_queue.cc:260] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.488677  5129 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.499415  1721 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:47.452684  5281 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:47.450816  1646 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.454946  5234 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:47.454942  5206 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:47.496953  5050 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:47.487381  5019 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:47.537339  1570 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:47.439371  5272 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.544090  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:47.515708  5323 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:47.546433  1537 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 12:59:47.547513  5347 log.cc:927] Time spent T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:59:47.546084  1639 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 12:59:47.554440  5266 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:47.555305  5179 consensus_queue.cc:1175] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "338d817f94ee4c1bad162e9a5860b68a" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
W20260709 12:59:47.556036  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 48052.3us
I20260709 12:59:47.556849  5054 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:47.557272  5054 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:47.557703  5054 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:47.454190  5104 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.560853  1641 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 12:59:47.564716  1612 leader_election.cc:400] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 12:59:47.564980  1612 leader_election.cc:403] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:47.540966  5050 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.564199  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:47.497854  5146 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.567083  1646 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.570375  5050 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:47.574333  5349 log.cc:927] Time spent T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:59:47.570170  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:47.575104  1571 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:47.573058  5129 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:47.578244  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:47.578441  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:47.579347  1719 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 11: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:47.580423  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:47.580993  1719 raft_consensus.cc:3055] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:47.581305  1719 raft_consensus.cc:740] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:47.582430  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:47.490131  5203 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.591725  5272 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:47.592410  1642 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:47.593348  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:47.594420  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 77806.5us
I20260709 12:59:47.599575  1611 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:47.600706  5334 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:47.601161  5334 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:47.601536  5334 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:47.602555  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:47.595997  1719 consensus_queue.cc:260] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.604748  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 12:59:47.573109  5342 log.cc:927] Time spent T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:59:47.597360  2405 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:47.610601  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:47.598651  1712 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 12:59:47.614499  1640 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:47.610981  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1660) took 1343 ms. Trace:
I20260709 12:59:47.626637  2438 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:47.623802  5180 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:47.627429  5206 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.628436  5146 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:47.626828  1712 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:47.609803  5188 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 12:59:47.630635  5104 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.631362  1714 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:47.631817  2405 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:47.632961  1719 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:47.583485  5323 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:47.595312  5191 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.637058  4995 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:47.643716  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:47.634307  5234 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:47.648386  4995 raft_consensus.cc:697] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:47.648582  5234 raft_consensus.cc:697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:47.649802  4995 consensus_queue.cc:237] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.651439  5171 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:47.649699  5234 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.655987  5050 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:47.657311  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 171643us
W20260709 12:59:47.658658  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.663002  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.657898  5257 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:47.666994  5257 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.667407  5257 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:47.688810  1720 raft_consensus.cc:2368] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8.
I20260709 12:59:47.683141  5334 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.703826  1686 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:47.691953  5050 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:47.712646  5334 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:47.719692  1611 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:47.725555  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:47.726142  1686 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:47.730444  5265 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:47.730978  4651 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:47.734141  5237 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:47.735520  5171 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:47.694619  5323 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.742390  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:47.743510  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:47.744222  1640 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:47.746583  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:47.747449  1712 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:47.709661  5261 consensus_queue.cc:1059] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:59:47.754317  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:47.734009  4651 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.732965  5334 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:47.764163  5261 raft_consensus.cc:3055] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:47.744794  5188 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:59:47.766717  4651 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:47.780282  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 54242.8us
I20260709 12:59:47.769330  5261 raft_consensus.cc:740] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:47.787793  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:47.772897  5334 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:47.792062  5334 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.796403  1719 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:47.800983  1712 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:47.801967  1611 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:47.804096  5258 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:47.807870  1611 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:47.808977  5188 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:47.809918  5188 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:47.810978  5188 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.813064  5054 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.828428  1640 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:47.815236  5054 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:47.835160  5356 log.cc:927] Time spent T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:59:47.835471  5348 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:59:47.802210  5257 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.835983  5175 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:47.880498  1715 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:47.828104  4651 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.817703  5171 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:47.884466  1712 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:47.886510  1718 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 11: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:47.886564  1719 raft_consensus.cc:1240] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:47.820585  5261 consensus_queue.cc:260] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:47.885622  5171 raft_consensus.cc:697] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:47.881132  5175 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:47.900166  5175 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:47.895345  5334 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:59:48.009891  5171 consensus_queue.cc:237] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:48.109479  5358 log.cc:927] Time spent T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
W20260709 12:59:48.264286  1570 consensus_meta.cc:287] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.701s	user 0.010s	sys 0.002s
I20260709 12:59:48.265062  1570 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 12:59:47.617079  1565 rpcz_store.cc:276] 0709 12:59:46.264867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.265178 (+   311us) service_pool.cc:224] Handling call
0709 12:59:47.102649 (+837471us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173eee 0000000000375939 00007f18d21e71e0 00007f18d22b00c4 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:59:47.102901 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.103431 (+   530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.103464 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:47.104007 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.165014 (+ 61007us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:47.165070 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.165157 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.608041 (+442884us) raft_consensus.cc:1685] finished
0709 12:59:47.608068 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.608345 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":181,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":7570304,"thread_start_us":59814,"threads_started":1,"wal-append.queue_time_us":193139}
I20260709 12:59:48.277917  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:48.278635  1567 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.278815  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.279493  1564 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 12:59:48.280184  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:48.280715  1571 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:48.281967  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:48.282747  1570 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 10: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:48.287915  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:48.290035  1571 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 12:59:48.291325  1567 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:48.300693  5367 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:48.301031  1536 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:48.301270  5367 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.303792  5367 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:48.304409  5367 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:48.305100  5367 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.307556  5054 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:48.308013  5054 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.308369  5054 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.313336  5367 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:48.315497  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:48.323760  5369 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:48.322166  5054 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.324761  1536 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:48.326452  5054 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:48.332767  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2669) took 1062 ms. Trace:
I20260709 12:59:48.333271  1721 rpcz_store.cc:276] 0709 12:59:47.270559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.270699 (+   140us) service_pool.cc:224] Handling call
0709 12:59:47.300154 (+ 29455us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:48.332525 (+1032371us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400228b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:48.332676 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378872576}
W20260709 12:59:48.342576  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.346349  5368 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.346936  5368 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.349165  5368 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:48.350662  5054 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:48.351601  5054 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.352203  5054 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:48.356462  1470 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 111) took 14948 ms (client timeout 15000 ms). Trace:
W20260709 12:59:48.356889  1470 rpcz_store.cc:269] 0709 12:59:33.452005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.465553 (+ 13548us) service_pool.cc:224] Handling call
0709 12:59:48.356217 (+14890664us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:45.102754 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:45.117419 (+ 14665us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:45.119204 (+  1785us) write_op.cc:435] Acquired schema lock
0709 12:59:45.121412 (+  2208us) tablet.cc:662] Decoding operations
0709 12:59:45.122301 (+   889us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:45.122413 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:45.122455 (+    42us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:59:45.122949 (+   494us) tablet.cc:701] Row locks acquired
0709 12:59:45.122975 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:59:45.123163 (+   188us) write_op.cc:270] Start()
0709 12:59:45.123311 (+   148us) write_op.cc:276] Timestamp: P: 1783601985123104 usec, L: 0
0709 12:59:45.123341 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:59:45.124226 (+   885us) log.cc:844] Serialized 1302 byte log entry
0709 12:59:45.379758 (+255532us) op_driver.cc:464] REPLICATION: finished
0709 12:59:45.557905 (+178147us) write_op.cc:301] APPLY: starting
0709 12:59:45.557982 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:45.558138 (+   156us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:45.558258 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:45.558633 (+   375us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:45.558805 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:59:45.558850 (+    45us) write_op.cc:312] APPLY: finished
0709 12:59:45.559032 (+   182us) log.cc:844] Serialized 35 byte log entry
0709 12:59:45.559936 (+   904us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:45.560022 (+    86us) write_op.cc:454] Released schema lock
0709 12:59:45.560060 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:45.585788 (+ 25728us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:45.587153 (+  1365us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1446385,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":176544,"apply.run_cpu_time_us":1754,"apply.run_wall_time_us":2491,"num_ops":3,"prepare.queue_time_us":71419,"prepare.run_cpu_time_us":34091,"prepare.run_wall_time_us":106106,"raft.queue_time_us":138179,"raft.run_cpu_time_us":18639,"raft.run_wall_time_us":277703,"replication_time_us":222321,"thread_start_us":338080,"threads_started":4,"wal-append.queue_time_us":50962,"wal-append.run_cpu_time_us":13204,"wal-append.run_wall_time_us":1414836}]]}
I20260709 12:59:48.367906  1536 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:48.369791  5369 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:48.371843  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:48.372109  5054 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:48.372474  1567 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.372984  5054 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:48.376804  5188 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:48.377640  5188 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.380434  5188 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:48.395437  5372 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:48.396200  5372 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.398977  1567 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 12:59:48.403482  5374 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:48.404357  5374 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:48.407438  5374 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:48.399097  5372 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:48.412300  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.418433  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:48.419064  1567 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:48.370957  5369 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.429975  5279 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:48.437494  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.438308  1568 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:48.439986  1567 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 12:59:48.444353  5171 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:48.445256  5171 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:48.449265  5171 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:48.450609  5203 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:48.451810  1566 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:48.495494  5179 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:48.496182  5179 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.496778  1567 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:48.501156  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:48.504658  5179 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:48.509583  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:48.517922  5374 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:48.518680  5374 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.521101  5374 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:48.521214  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:48.521643  5374 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:48.523680  5234 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:48.524276  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.526285  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:48.527613  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:48.531520  1568 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:48.532899  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.526321  5374 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.537663  4651 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:48.540282  5257 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:48.541656  1570 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:59:48.542222  1570 pending_rounds.cc:85] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 4
I20260709 12:59:48.542670  1570 pending_rounds.cc:107] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:59:48.543035  1570 raft_consensus.cc:2889] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:48.544492  5374 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:48.545212  5146 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:48.545655  1566 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:48.545694  5146 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.545692  1568 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:48.550272  5146 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:48.567795  5369 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.567869  5054 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.568539  5369 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.569224  1567 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:48.568918  5054 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:48.569978  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.570744  5369 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:48.571810  5234 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:48.574160  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.574542  5054 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:48.563349  5378 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:59:48.590377  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:48.592311  1569 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:48.588585  5201 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 12:59:48.600834  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.603948  5201 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:48.604777  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:48.604930  5381 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:48.598971  5361 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.605476  5381 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.606639  5201 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:48.606230  5361 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.607554  5201 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:48.608094  5381 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:48.608073  5201 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.608888  5361 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:48.600397  5257 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.612320  5345 log.cc:927] Time spent T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 1.001s	user 0.000s	sys 0.009s
I20260709 12:59:48.612001  5257 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.612154  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.613997  1718 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:48.614668  5257 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:48.615010  5201 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:48.616444  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:48.617142  5179 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:59:48.617626  1715 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 1722) took 1151 ms (client timeout 1514 ms). Trace:
W20260709 12:59:48.618027  1715 rpcz_store.cc:269] 0709 12:59:47.466803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.499866 (+ 33063us) service_pool.cc:224] Handling call
0709 12:59:48.617461 (+1117595us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400228654. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:48.617569 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516477184}
I20260709 12:59:48.618618  1686 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:48.620167  1686 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:48.621961  5179 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:48.623657  5179 consensus_queue.cc:1059] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:48.624541  5179 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:48.624965  5179 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:48.628093  5257 raft_consensus.cc:3055] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:48.628521  5257 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:48.621826  5204 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:48.629949  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.630489  1467 catalog_manager.cc:5697] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.632863  1467 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 6 to 7, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:48.621834  1466 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58250 (request call id 197) took 11120 ms. Trace:
I20260709 12:59:48.625761  5179 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.634654  5257 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:48.635161  5352 log.cc:927] Time spent T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 1.062s	user 0.000s	sys 0.010s
I20260709 12:59:48.638896  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.639197  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.644771  1564 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:48.645260  1718 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:48.645179  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:48.646472  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.647050  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.648020  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.648041  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:48.652282  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:48.648262  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.653196  1569 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:48.654423  1569 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:48.654387  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.649513  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:48.655309  1565 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 12:59:48.650310  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.651072  5146 raft_consensus.cc:476] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 12:59:48.657686  1567 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:48.651470  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 1724) took 1085 ms. Trace:
I20260709 12:59:48.659387  1720 rpcz_store.cc:276] 0709 12:59:47.565807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.565936 (+   129us) service_pool.cc:224] Handling call
0709 12:59:48.651263 (+1085327us) spinlock_profiling.cc:243] Waited 90.6 ms on lock 0x7b5400017a54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:48.651416 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208358656}
I20260709 12:59:48.652086  5175 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:48.660142  5257 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:48.660487  5175 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.652335  1612 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:48.661266  5234 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:48.662032  5146 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:48.662906  5175 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:48.657723  5191 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:48.665166  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.665643  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:48.668754  2443 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.009s	sys 0.021s
I20260709 12:59:48.665802  1564 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:48.680941  5374 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.722833  2443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.009s	sys 0.021s
W20260709 12:59:48.722947  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 57377us
I20260709 12:59:48.707619  5175 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:48.678591  1467 catalog_manager.cc:5697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:48.716427  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:48.634100  1466 rpcz_store.cc:276] 0709 12:59:37.501766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.503276 (+  1510us) service_pool.cc:224] Handling call
0709 12:59:48.621633 (+11118357us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:39.037801 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:39.038402 (+   601us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:39.066836 (+ 28434us) write_op.cc:435] Acquired schema lock
0709 12:59:39.066873 (+    37us) tablet.cc:662] Decoding operations
0709 12:59:39.088076 (+ 21203us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:39.088137 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:39.088167 (+    30us) tablet.cc:685] Acquiring locks for 33 operations
0709 12:59:39.093993 (+  5826us) tablet.cc:701] Row locks acquired
0709 12:59:39.094012 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:59:39.108388 (+ 14376us) write_op.cc:270] Start()
0709 12:59:39.150441 (+ 42053us) write_op.cc:276] Timestamp: P: 1783601979099880 usec, L: 0
0709 12:59:39.150470 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:59:39.254636 (+104166us) log.cc:844] Serialized 12972 byte log entry
0709 12:59:41.372302 (+2117666us) op_driver.cc:464] REPLICATION: finished
0709 12:59:41.956399 (+584097us) write_op.cc:301] APPLY: starting
0709 12:59:41.960550 (+  4151us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:41.961182 (+   632us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:41.961300 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:41.965715 (+  4415us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:41.987729 (+ 22014us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=33
0709 12:59:42.030551 (+ 42822us) write_op.cc:312] APPLY: finished
0709 12:59:42.034766 (+  4215us) log.cc:844] Serialized 218 byte log entry
0709 12:59:42.034938 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:42.035188 (+   250us) write_op.cc:454] Released schema lock
0709 12:59:42.035252 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:42.035643 (+   391us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:42.035682 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1296796,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":583828,"apply.run_cpu_time_us":6220,"apply.run_wall_time_us":79217,"num_ops":33,"prepare.queue_time_us":189793,"prepare.run_cpu_time_us":65121,"prepare.run_wall_time_us":868440,"raft.queue_time_us":457523,"raft.run_cpu_time_us":123379,"raft.run_wall_time_us":422701,"replication_time_us":2197127,"thread_start_us":1285049,"threads_started":4,"wal-append.queue_time_us":529165,"wal-append.run_cpu_time_us":33499,"wal-append.run_wall_time_us":2956133}]]}
I20260709 12:59:48.718438  1719 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:48.719182  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.719857  1720 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:59:48.724602  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:48.727005  5374 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.718238  5180 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.736279  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.724169  5191 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:48.740127  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.740772  1720 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:48.744233  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.744481  1715 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:48.745304  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.745743  1715 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:48.742421  5378 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:59:48.732970  5175 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.749554  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:48.753871  1467 catalog_manager.cc:5697] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 5 to 8, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:48.741209  5104 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:48.760143  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:48.756587  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.757359  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:48.747506  5180 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.761399  1720 raft_consensus.cc:2393] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 10: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:48.763723  1685 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:48.768813  1612 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:48.770623  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.771831  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.772580  5334 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:48.772910  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.772998  5334 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:48.773546  5334 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:48.778484  1642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 2090) took 1565 ms (client timeout 1974 ms). Trace:
W20260709 12:59:48.778873  1642 rpcz_store.cc:269] 0709 12:59:47.213074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.213205 (+   131us) service_pool.cc:224] Handling call
0709 12:59:48.778287 (+1565082us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b5400394c54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:48.778405 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801892224}
I20260709 12:59:48.771914  5180 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:48.787983  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:48.782816  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.789567  1714 raft_consensus.cc:2410] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:59:48.790863  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.791813  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:48.793643  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:48.796667  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:48.789045  5104 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:48.794687  5372 consensus_queue.cc:1059] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:59:48.809185   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:48.793964  5146 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:48.816259  1611 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:48.818801  1715 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:48.825891  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:48.826712  1640 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:48.789980  5191 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:59:48.798395  5171 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:48.843652  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:48.844281  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:48.844959  1639 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:48.846361  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:48.846858  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.847543  1715 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:48.823999  5104 raft_consensus.cc:697] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:48.823800  5146 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:48.798298  5188 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:59:48.852837  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:48.855571  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:48.857646  1640 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:48.858866  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.853742  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:48.860651  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:48.861012  1645 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:48.838377  5171 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:48.865568  5390 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:48.866936  5380 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:48.854771  5146 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:48.866106  5390 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.863071  5387 raft_consensus.cc:3055] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:48.881438  5387 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:48.881631  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:48.868137  5171 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.880721  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:48.867800  5372 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:48.890717  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:48.891363  1640 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:48.880301  5146 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:48.854127  5104 consensus_queue.cc:237] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.867520  5380 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:48.907615  1719 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:48.910359  1721 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 12:59:48.910801  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:48.918139  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:48.918467  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:48.920300  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.920480  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.927186  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.927911  1566 raft_consensus.cc:2410] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:59:48.930784  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.931775  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:48.902850  5368 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:48.900965  5389 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:59:48.934435  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.932402  1569 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:48.934134  1571 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 12:59:48.952502  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:48.953303  1647 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:48.957655  5389 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:48.931097  5279 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:48.969671  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:48.977403  5391 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:59:48.978679  5386 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:59:48.980222  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1736) took 1065 ms. Trace:
I20260709 12:59:48.980669  1712 rpcz_store.cc:276] 0709 12:59:47.914647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.915763 (+  1116us) service_pool.cc:224] Handling call
0709 12:59:47.916089 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.916742 (+   653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.916772 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:47.917250 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 12:59:48.794721 (+877471us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:48.794770 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.794839 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:48.979936 (+185097us) raft_consensus.cc:1685] finished
0709 12:59:48.979966 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.980129 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":36082,"threads_started":1,"wal-append.queue_time_us":106918}
I20260709 12:59:48.917603  5387 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:48.984318  5387 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.919981  5054 consensus_queue.cc:1059] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:59:49.020879  5372 raft_consensus.cc:697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:48.958611  5188 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:49.020375  5390 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:49.025005  5383 log.cc:927] Time spent T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:59:48.955845  5368 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.030544  5261 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:49.042431  5380 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:49.050786  5206 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:49.052605  5368 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.028520  5188 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.052673  5372 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.057051  5188 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.037753  5389 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:49.189953  5330 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 12:59:49.199445  1593 debug-util.cc:398] Leaking SignalData structure 0x7b080020ca60 after lost signal to thread 434
W20260709 12:59:49.210646  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08000ae420 after lost signal to thread 1504
W20260709 12:59:49.211652  1593 debug-util.cc:398] Leaking SignalData structure 0x7b080037fd60 after lost signal to thread 1596
I20260709 12:59:49.203781  5378 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 12:59:49.213675  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6a00 after lost signal to thread 1671
W20260709 12:59:49.213912  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6960 after lost signal to thread 1672
W20260709 12:59:49.214655  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6580 after lost signal to thread 1713
W20260709 12:59:49.215116  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6500 after lost signal to thread 1716
W20260709 12:59:49.215444  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6540 after lost signal to thread 1717
I20260709 12:59:49.207073  5175 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:49.216100  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003d61c0 after lost signal to thread 1745
I20260709 12:59:49.209378  5330 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:49.235423  5171 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.237519  5171 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.237833  5330 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.238188  2440 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 12:59:49.242434  5382 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.242923  5382 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:49.216573  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.244801  5171 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:49.245311  5171 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:49.245754  5389 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.246269  5389 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.247812  5188 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:49.248203  5389 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.248565  5387 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:49.248368  5188 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.249120  5387 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:49.250634  5188 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.251792  5387 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:49.247375  5171 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:49.218323  5374 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.224016  5378 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:49.255771  5378 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.212309  5334 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.232333  5146 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:49.234853  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5e80 after lost signal to thread 1746
I20260709 12:59:49.248744  5389 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:49.259105  1593 debug-util.cc:398] Leaking SignalData structure 0x7b0800331e60 after lost signal to thread 2477
I20260709 12:59:49.258790  5389 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.259754  5334 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:49.260010  1593 debug-util.cc:398] Leaking SignalData structure 0x7b0800367be0 after lost signal to thread 5266
W20260709 12:59:49.260573  1593 debug-util.cc:398] Leaking SignalData structure 0x7b080028af80 after lost signal to thread 5269
I20260709 12:59:49.260702  5146 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:49.260895  1593 debug-util.cc:398] Leaking SignalData structure 0x7b0800112b60 after lost signal to thread 5280
W20260709 12:59:49.261240  1593 debug-util.cc:398] Leaking SignalData structure 0x7b080033c7a0 after lost signal to thread 5297
W20260709 12:59:49.261612  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed600 after lost signal to thread 5314
W20260709 12:59:49.261871  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4820 after lost signal to thread 5318
W20260709 12:59:49.262216  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003c2480 after lost signal to thread 5335
W20260709 12:59:49.262470  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8da0 after lost signal to thread 5337
I20260709 12:59:49.260725  5389 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.230271  5372 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:49.279714  5372 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.282614  5372 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.335990  5374 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:49.336687  5374 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:49.338864  5374 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:49.347499  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 424505us
I20260709 12:59:49.348337  1536 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:49.349215  5371 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:49.349671  5371 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.350138  5371 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:49.353729  5378 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:49.354377  5378 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:49.354857  1536 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:49.357388  5378 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.364902  5368 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:49.372547  5371 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.380417  1718 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:49.387492  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:49.387912  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:49.398985  1566 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 12:59:49.388213  5371 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.415030  1647 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:49.416249  5398 raft_consensus.cc:3055] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:49.450487  5398 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:49.451884  5398 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.453491  5398 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:49.443773  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet 681214f01c5b4fc6a0aa493b2382c01f: Illegal state: Replica 338d817f94ee4c1bad162e9a5860b68a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:49.467182  5382 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.484437  1640 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
W20260709 12:59:49.495182  1567 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.002s	sys 0.020s
W20260709 12:59:49.495543  1567 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.002s	sys 0.021s
W20260709 12:59:49.577255  1570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.005s	sys 0.040s
W20260709 12:59:49.577683  1570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.005s	sys 0.040s
W20260709 12:59:49.585695  1467 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.006s	sys 0.009s
W20260709 12:59:49.586169  1467 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.008s	sys 0.009s
I20260709 12:59:49.597611  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:49.602967  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:49.603945  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:49.604346  1640 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:49.605434  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:49.599030  1642 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:49.609982  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:49.599421  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:49.615751  1639 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:49.622572  1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.001s	sys 0.010s
W20260709 12:59:49.623128  1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.001s	sys 0.010s
W20260709 12:59:49.623687  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 807473us
I20260709 12:59:49.599665  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:49.626158  5334 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:49.626989  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:49.628180  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:49.628778  1647 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:49.629693  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:49.600812  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:49.630980  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:49.631587  1641 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 12:59:49.606400  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:49.599978  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:49.633427  1638 raft_consensus.cc:2410] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:59:49.634016  1644 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:59:49.628702  1611 leader_election.cc:400] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8.
I20260709 12:59:49.637502  1611 leader_election.cc:403] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:49.635430  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:49.642386  5334 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8.
W20260709 12:59:49.643126  1645 consensus_meta.cc:287] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.780s	user 0.019s	sys 0.013s
I20260709 12:59:49.645119  1645 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:49.643913  5146 consensus_queue.cc:1059] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:59:49.647729  1641 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:49.650487  1642 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:49.642160  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:49.653033  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:49.645694  1611 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:49.654793  1639 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 12:59:49.658027  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:49.667841  1611 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:49.668686  5175 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:49.668838  1611 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:49.669094  5175 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:49.669539  5175 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:49.669693  5227 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:49.655087  5334 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:49.677124  5334 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:49.677572  5334 raft_consensus.cc:697] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:49.678445  5334 consensus_queue.cc:237] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.662695  5146 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:49.673629  5171 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:49.680399  5171 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:49.673506  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:49.674353  1570 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:49.683372  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:49.680805  5171 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:49.688731  5175 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.690421  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:49.690966  5175 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.691576  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:49.694428  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:49.695099  1568 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:49.696189  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:49.697269  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:49.700186  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:49.701721  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:49.697990  1568 raft_consensus.cc:2368] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
I20260709 12:59:49.703140  1459 maintenance_manager.cc:419] P b4fca1e1e7ea4cb985a4c9e3efed5179: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033385
I20260709 12:59:49.717859  1567 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:49.723719  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:49.735781  1571 raft_consensus.cc:1275] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:49.701665  5171 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.745219  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:49.745800  1566 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:49.748035  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:49.739521  5171 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.740222  5402 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.721637  5227 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:59:49.759687  1537 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:49.761397  5402 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:49.763157  5371 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:49.763638  5371 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:49.763847  5402 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:49.764087  5371 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:49.754045  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:49.772509  1568 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 12:59:49.775791  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:49.773079  5381 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:49.777850  5398 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:49.802386  5334 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:49.804060  5398 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:49.804708  5398 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:49.805220  1714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.001s	sys 0.008s
W20260709 12:59:49.805675  1714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.001s	sys 0.008s
I20260709 12:59:49.806574  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 531) took 1051 ms. Trace:
I20260709 12:59:49.807011  1714 rpcz_store.cc:276] 0709 12:59:48.755127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.805142 (+ 50015us) service_pool.cc:224] Handling call
0709 12:59:48.805396 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:48.820053 (+ 14657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:48.820097 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:48.848552 (+ 28455us) log.cc:844] Serialized 26 byte log entry
0709 12:59:49.806133 (+957581us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:59:49.806191 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.806275 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:49.806343 (+    68us) raft_consensus.cc:1685] finished
0709 12:59:49.806360 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.806510 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15008,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":19503,"thread_start_us":936370,"threads_started":1,"wal-append.queue_time_us":155304}
I20260709 12:59:49.810329  5389 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:49.811192  5389 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.813057  5380 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:49.813728  5389 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.813602  5380 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.814776  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:49.815919  5397 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:49.782332  5402 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:49.815828  5380 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:49.822444  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 75269.9us
I20260709 12:59:49.797036  5381 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:49.825565  1612 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:49.828243  5438 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:49.829042  5146 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:49.829669  5146 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:49.829121  5438 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.830191  5146 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:49.831933  5438 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.832082  5372 raft_consensus.cc:3055] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:49.823562  5402 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.836053  5402 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.841921  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:49.843245  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:49.844615  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:49.826304  5381 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:49.855711  1612 leader_election.cc:400] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
I20260709 12:59:49.856285  1612 leader_election.cc:403] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:59:49.862879  1566 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:49.857283  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:49.870733  5402 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:49.871459  5402 raft_consensus.cc:697] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:59:49.872332  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 83568.5us
I20260709 12:59:49.872742  5402 consensus_queue.cc:237] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.873281  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:49.874512  5442 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:49.866322  5437 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
I20260709 12:59:49.892220  5146 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:49.894510  1572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.018s	sys 0.007s
W20260709 12:59:49.894989  1572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.018s	sys 0.007s
I20260709 12:59:49.832506  5372 raft_consensus.cc:740] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:49.898281  5398 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:49.900694  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.901911  5188 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:49.899765  5372 consensus_queue.cc:260] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:49.907313  5372 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.909238  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:49.911033  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:49.913606  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:49.914692  1536 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:49.915385  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:49.926427  5436 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:49.936488  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:49.926427  5442 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:49.938205  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:49.938977  5146 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.945206  5381 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:49.952807  5398 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:49.953472  5398 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:49.954147  5398 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:49.954756  5398 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:49.955075  5398 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.955404  5398 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:49.965724  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:49.966564  2438 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:49.968995  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:49.972178  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:49.974426  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:49.953410  5370 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:49.967360  5371 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:49.982457  5380 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:49.990513  1643 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:49.987650  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 986387us
I20260709 12:59:49.983115  5370 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:50.005985  5374 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:59:50.021952  5371 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:49.998410  5380 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:50.014779  5370 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:50.042888  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 66672.5us
I20260709 12:59:50.028147  5442 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:50.028309  5380 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:50.034714  5371 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:50.050194  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:50.049177  5380 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:50.051759  5371 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.060515  5371 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:50.047523  5447 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:50.068230  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 80968.5us
I20260709 12:59:50.085400  5450 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:50.089094  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 104723us
I20260709 12:59:50.091182  1537 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:50.094031  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:50.077970  5371 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:50.052421  5442 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.078859  5449 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:59:50.083865  5381 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:50.082970  5447 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:50.097281  5397 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:50.103875  5368 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:50.114766  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 64712.1us
I20260709 12:59:50.116333  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:50.117173  1536 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:50.120221  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:50.104447  5450 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:50.132993  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 51609.6us
I20260709 12:59:50.117295  5368 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:50.105902  5371 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.137552  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:50.139223  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:50.142880  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1720) took 2738 ms. Trace:
I20260709 12:59:50.143373  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1723) took 2603 ms. Trace:
I20260709 12:59:50.146611  1572 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:59:50.146996  1572 pending_rounds.cc:85] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 6
I20260709 12:59:50.147230  1572 pending_rounds.cc:107] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:59:50.147450  1572 raft_consensus.cc:2889] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:50.148447  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:50.150694  1569 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 12:59:50.136756  5368 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:50.152948  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:50.143296  1717 rpcz_store.cc:276] 0709 12:59:47.402548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.402886 (+   338us) service_pool.cc:224] Handling call
0709 12:59:47.408102 (+  5216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.408575 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:47.408915 (+   340us) log.cc:844] Serialized 14 byte log entry
0709 12:59:49.445684 (+2036769us) log.cc:844] Serialized 14 byte log entry
0709 12:59:50.140503 (+694819us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.140570 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:50.140626 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.140709 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.140839 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2620440,"prepare.queue_time_us":1904957,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":724068,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":8363,"thread_start_us":109882,"threads_started":2,"wal-append.queue_time_us":23063}
I20260709 12:59:50.127552  5397 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.141237  5201 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:50.156970  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.157419  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1716) took 2808 ms. Trace:
I20260709 12:59:50.158452  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:50.158990  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:50.159204  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:50.159727  1564 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 12:59:50.142099  5203 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:50.158746  1716 rpcz_store.cc:276] 0709 12:59:47.349194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.359069 (+  9875us) service_pool.cc:224] Handling call
0709 12:59:47.359438 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.592847 (+233409us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:49.446078 (+1853231us) log.cc:844] Serialized 14 byte log entry
0709 12:59:50.140653 (+694575us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.140747 (+    94us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:50.140821 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.157156 (+ 16335us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400229054. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:50.157214 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.157353 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2427288,"prepare.queue_time_us":1761102,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":672893,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":8234,"spinlock_wait_cycles":514845056,"thread_start_us":119542,"threads_started":2,"wal-append.queue_time_us":16821}
I20260709 12:59:50.145499  5449 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:50.164992  5442 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:50.166004  5397 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:50.166600  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.167346  1716 raft_consensus.cc:2393] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 6: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:50.136128  5450 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.168258  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:50.167083  5361 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:50.169266  5451 log.cc:927] Time spent T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:59:50.170018  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.172014  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.182510  1719 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 12:59:50.183081  2405 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:50.187422  5453 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:50.188480  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:50.157023  5456 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:50.145787  1713 rpcz_store.cc:276] 0709 12:59:47.536673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.536900 (+   227us) service_pool.cc:224] Handling call
0709 12:59:47.547312 (+ 10412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.547674 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:49.446578 (+1898904us) log.cc:844] Serialized 14 byte log entry
0709 12:59:50.139402 (+692824us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.139462 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:50.139503 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.139572 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.139691 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2482051,"prepare.queue_time_us":1806107,"prepare.run_cpu_time_us":21,"prepare.run_wall_time_us":21,"raft.queue_time_us":682320,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":3118,"thread_start_us":108960,"threads_started":2,"wal-append.queue_time_us":10921}
I20260709 12:59:50.168442  5458 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:50.192620  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:50.192796  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2679) took 1472 ms. Trace:
I20260709 12:59:50.193248  1720 rpcz_store.cc:276] 0709 12:59:48.720454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.798950 (+ 78496us) service_pool.cc:224] Handling call
0709 12:59:48.799192 (+   242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:48.799520 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:49.445038 (+645518us) log.cc:844] Serialized 14 byte log entry
0709 12:59:50.141323 (+696285us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:50.154570 (+ 13247us) log.cc:844] Serialized 26 byte log entry
0709 12:59:50.154726 (+   156us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:50.154758 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.154824 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:50.192606 (+ 37782us) raft_consensus.cc:1685] finished
0709 12:59:50.192631 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.192746 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1232467,"prepare.queue_time_us":554817,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"raft.queue_time_us":685051,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":7253,"spinlock_wait_cycles":10803456,"thread_start_us":107037,"threads_started":2,"wal-append.queue_time_us":14234}
I20260709 12:59:50.195681  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:50.198179  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:50.206656  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:50.189003  5448 log.cc:927] Time spent T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:59:50.209371  5437 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:50.208276  1565 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:50.214843  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:50.215457  1569 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 12:59:50.204276  5257 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.186514  5449 raft_consensus.cc:697] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:50.190541  5334 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:50.191270  5180 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 12:59:50.238552  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.231580  2406 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:50.190289  5454 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.167956  5203 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.220952  5453 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.186749  5361 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:50.273703  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet 2d6b5add0ec94eccb0981a9bb10c79ef: Illegal state: Replica 66344ad7cd844754b2c81cc689a709b0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:50.226673  5455 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:50.279273  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 136790us
I20260709 12:59:50.236953  5456 raft_consensus.cc:697] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 12:59:50.269156  1685 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.974s (SENT) [suppressed 30 similar messages]
W20260709 12:59:50.285290  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 59600.8us
I20260709 12:59:50.233443  5237 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:50.286043  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:50.239331  5257 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.272517  5334 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:50.264313  5454 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:50.372258  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 161796us
W20260709 12:59:50.352121  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 66157.2us
I20260709 12:59:50.334172  1469 catalog_manager.cc:5697] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:50.374235  1612 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:50.264811  5180 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.239605  5436 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:59:50.287847  5455 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:50.353783  1467 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58260 (request call id 213) took 14942 ms (client timeout 15000 ms). Trace:
I20260709 12:59:50.354743  5456 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:50.410723  1742 debug-util.cc:398] Leaking SignalData structure 0x7b0800115da0 after lost signal to thread 434
I20260709 12:59:50.332783  5449 consensus_queue.cc:237] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.370152  2436 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
W20260709 12:59:50.358999  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 357166us
W20260709 12:59:50.418533  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 178453us
I20260709 12:59:50.359889  5188 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:50.379398  1467 rpcz_store.cc:269] 0709 12:59:35.411893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.412212 (+   319us) service_pool.cc:224] Handling call
0709 12:59:35.679544 (+267332us) spinlock_profiling.cc:243] Waited 75 ms on lock 0x7b54004254d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd202090 00007f18cd2a0f3a 00007f18d30571cc 00007f18d315537e 00007f18d16162a4 00007f18d1616232 00007f18d1616161 00007f18d16160dc 00007f18d1615392 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:49.586509 (+13906965us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:49.586547 (+    38us) write_op.cc:454] Released schema lock
0709 12:59:50.353721 (+767174us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:49.225669 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:49.233235 (+  7566us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:49.233277 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:59:49.233290 (+    13us) tablet.cc:662] Decoding operations
0709 12:59:49.233808 (+   518us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:49.233867 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:49.233887 (+    20us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:59:49.244694 (+ 10807us) tablet.cc:701] Row locks acquired
0709 12:59:49.244744 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:59:49.244903 (+   159us) write_op.cc:270] Start()
0709 12:59:49.245059 (+   156us) write_op.cc:276] Timestamp: P: 1783601989244842 usec, L: 0
0709 12:59:49.245084 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:59:49.249753 (+  4669us) log.cc:844] Serialized 2089 byte log entry
0709 12:59:49.284479 (+ 34726us) op_driver.cc:464] REPLICATION: finished
0709 12:59:49.296624 (+ 12145us) write_op.cc:301] APPLY: starting
0709 12:59:49.296728 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:49.296937 (+   209us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:49.297107 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:49.297929 (+   822us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:49.298281 (+   352us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:59:49.298319 (+    38us) write_op.cc:312] APPLY: finished
0709 12:59:49.298661 (+   342us) log.cc:844] Serialized 47 byte log entry
0709 12:59:49.298829 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:49.298932 (+   103us) write_op.cc:454] Released schema lock
0709 12:59:49.298985 (+    53us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":3035613,"reported_tablets":47,"spinlock_wait_cycles":172526336,"child_traces":[["op",{"apply.queue_time_us":11792,"apply.run_cpu_time_us":2717,"apply.run_wall_time_us":2718,"num_ops":5,"prepare.queue_time_us":329630,"prepare.run_cpu_time_us":6097,"prepare.run_wall_time_us":31592,"raft.queue_time_us":22446,"raft.run_cpu_time_us":7001,"raft.run_wall_time_us":14075,"replication_time_us":39280,"thread_start_us":746953,"threads_started":4,"wal-append.queue_time_us":5337,"wal-append.run_cpu_time_us":52892,"wal-append.run_wall_time_us":1112666}]]}
I20260709 12:59:50.356681  5450 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:50.376343  1612 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 12:59:50.432672  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 56433.5us
I20260709 12:59:50.433305  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:50.345837  5462 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:50.411737  1742 debug-util.cc:398] Leaking SignalData structure 0x7b080019ac60 after lost signal to thread 1504
I20260709 12:59:50.351949  5129 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:50.409128  5437 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:50.410405  5371 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:50.430883  1537 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:50.347157  5237 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.465561  5237 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:50.466765  5455 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:50.467829  5398 consensus_meta.cc:287] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.002s
I20260709 12:59:50.468252  5398 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.471035  5447 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:50.437894  1742 debug-util.cc:398] Leaking SignalData structure 0x7b080009bc80 after lost signal to thread 1596
I20260709 12:59:50.439811  5146 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:50.472494  5146 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:50.472798  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7ce0 after lost signal to thread 1671
W20260709 12:59:50.473229  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7ca0 after lost signal to thread 1672
I20260709 12:59:50.419092  1686 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:50.442857  5462 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:50.474478  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 55470.5us
I20260709 12:59:50.475873  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:50.476236  5462 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:50.476819  5462 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:50.477176  5462 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.477512  5462 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:50.432696  5381 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:50.478314  5470 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:50.478375  5381 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:50.480558  5381 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:50.480355  1469 catalog_manager.cc:5697] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 3 to 4, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:50.427524  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.444367  5129 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.447638  5463 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:50.445180  5438 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:50.445711  5437 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:50.488394  5398 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:50.462785  5361 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:50.482025  1469 catalog_manager.cc:5697] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 6 to 7, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:50.489114  5454 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:50.478890  5470 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.489622  5257 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:50.472842  5146 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:50.416894  5380 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.482777  5334 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.496455  5380 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:50.497126  5459 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:50.497799  5459 raft_consensus.cc:697] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:50.498190  1469 catalog_manager.cc:5697] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 7 to 9, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:50.498894  5459 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:50.457069  5467 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:50.489730  5470 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:50.501386  5467 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.501791  5467 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:50.503479  5462 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.485849  5129 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:50.483196  5180 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:50.457440  5457 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:50.507380  5457 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:50.509088  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08000e28c0 after lost signal to thread 1713
W20260709 12:59:50.509476  1742 debug-util.cc:398] Leaking SignalData structure 0x7b0800347e60 after lost signal to thread 1716
W20260709 12:59:50.509727  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08000ccc60 after lost signal to thread 1717
W20260709 12:59:50.510474  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1260 after lost signal to thread 1745
W20260709 12:59:50.510795  1742 debug-util.cc:398] Leaking SignalData structure 0x7b080005d4e0 after lost signal to thread 1746
W20260709 12:59:50.512132  1742 debug-util.cc:398] Leaking SignalData structure 0x7b080036a520 after lost signal to thread 2477
W20260709 12:59:50.514794  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 245667us
I20260709 12:59:50.519852  1570 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:50.537856  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:50.538830  1569 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:50.540443  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:50.542361  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:50.402267  2405 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:50.545070  1572 raft_consensus.cc:1240] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:50.546722  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 144548us
I20260709 12:59:50.551808  1469 catalog_manager.cc:5697] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 5 to 6, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:50.487876  5437 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:50.508843  5453 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:50.487726  5438 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:50.486792  5203 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:50.601291  1469 catalog_manager.cc:5697] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 5 to 6, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:50.605352  5257 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.599905  5454 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.605595  5438 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:50.612728  1469 catalog_manager.cc:5697] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 4 to 6, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:50.622452  1714 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:50.622638  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.624929  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.627697  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.628003  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.629017  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.626147  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:50.631210  1720 raft_consensus.cc:2393] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 7: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:50.632104  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:50.632331  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.634666  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:50.635144  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:50.636062  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:50.636237  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.636615  1721 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:50.636509  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.637468  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.637946  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.638391  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:50.638554  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.640169  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:50.640417  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.641271  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:50.641455  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:50.615366  5204 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:50.642140  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:50.615065  5461 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 12:59:50.644268  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 282192us
I20260709 12:59:50.645015  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:50.650182  1720 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:50.487586  5463 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:50.638895  1714 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:50.651197  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.633725  1469 catalog_manager.cc:5697] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:50.656638  1715 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 12:59:50.657056  1469 catalog_manager.cc:5697] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:50.659734  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:50.660512  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:50.655696  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.664458  1720 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:50.658638  1469 catalog_manager.cc:5697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 4 to 5, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:50.670621  1469 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 7 to 8, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:50.633411  5237 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:50.688694  5237 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.633008  5372 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:50.690433  5372 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.693060  5372 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:50.681869  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:50.695509  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:50.696612  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 53345.2us
I20260709 12:59:50.696779  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:50.622764  5257 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.699970  1638 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 12:59:50.703512  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:50.709054  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:50.712257  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:50.718318  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:50.719687  1639 raft_consensus.cc:1240] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:50.721264  5146 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.725494  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:50.654629  5129 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:50.633723  5454 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.683571  5201 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:50.739519  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:50.672227  5449 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:59:50.731828  5473 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:50.766398  5370 consensus_meta.cc:287] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.721s	user 0.007s	sys 0.005s
I20260709 12:59:50.766453  5470 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.767015  5370 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.753726  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:50.744197  5201 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:50.743764  5462 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:50.779419  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:50.759877  5368 consensus_meta.cc:287] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 12:59:50.739869  5475 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:50.760742  5266 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.762279  5467 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:50.790977  1569 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:59:50.786247  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 150426us
I20260709 12:59:50.660228  5461 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.778245  1563 raft_consensus.cc:2393] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:50.782668  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:50.784735  1713 raft_consensus.cc:2368] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12.
I20260709 12:59:50.791828  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:50.755016  5457 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:50.659119  5204 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:50.791667  5368 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:50.795601  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:50.795683  5266 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.795617  5470 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:50.797722  5437 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.806762  5475 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:50.811136  5389 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:50.843429  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 60861.9us
I20260709 12:59:50.763846  5463 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:50.852479  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:50.864271  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:50.824687  5462 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:50.866901  1685 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:50.786962  5447 consensus_queue.cc:1059] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:59:50.869038  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:50.872215  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.868628  5462 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.888118  1685 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:50.819425  5129 consensus_queue.cc:1059] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:59:50.854599  5380 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:50.841619  5203 consensus_queue.cc:1059] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:59:50.893746  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.903728  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:50.927453  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:50.929108  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:50.870627  5459 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:50.854389  5398 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:59:50.889513  5470 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:50.891296  5462 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:50.937678  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:50.939878  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.943125  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.954849  5261 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:50.956328  5481 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:59:50.959939  5489 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.960522  5489 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:50.962690  5442 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:50.963128  5442 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:50.963527  5442 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:50.964707  5437 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:50.939393  5381 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:50.933522  5371 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:50.863884  5389 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:50.969691  5389 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:50.971789  1721 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 12:59:50.972914  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.963351  5463 raft_consensus.cc:3055] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:51.018981  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:50.938660  5465 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:50.944648  5380 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:51.020020  1713 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 12:59:51.028105  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:51.042162  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:51.011672  5463 raft_consensus.cc:740] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:51.012346  5454 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:51.093906  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:51.094798  1642 raft_consensus.cc:2393] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 9: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:51.099046   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:51.103757  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 70666us
W20260709 12:59:51.107717  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 219689us
I20260709 12:59:51.108111  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:51.111204  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:51.112648  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 12:59:51.103012  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 263542us
I20260709 12:59:51.120301  1685 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:51.142670  1685 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:51.135484  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:51.143893  1685 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:51.037163  5370 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:51.162637  5470 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:51.165581  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:51.166607  1717 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 8: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 12:59:51.170894  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.142196  5454 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.153533  5467 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:51.179519  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:51.182332  1713 raft_consensus.cc:2376] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8. Re-sending same reply.
I20260709 12:59:51.183573  1713 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:51.185652  1713 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:59:51.119112  5175 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:59:51.166261  5129 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:51.156302  5266 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:51.159129  5436 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:51.192745  1713 raft_consensus.cc:1240] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:51.175864  5368 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:51.186645  5489 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:51.191809  5466 log.cc:927] Time spent T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:59:51.201013  1713 raft_consensus.cc:1275] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:59:51.201419  1713 pending_rounds.cc:85] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 5
I20260709 12:59:51.201700  1713 pending_rounds.cc:107] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:59:51.201990  1713 raft_consensus.cc:2889] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:51.203527  1713 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:51.190786  5439 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:51.192515  5461 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:51.263365  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 114962us
W20260709 12:59:51.263972  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 159448us
W20260709 12:59:51.199355  5438 consensus_meta.cc:287] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.564s	user 0.005s	sys 0.005s
I20260709 12:59:51.190908  5204 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:51.407842  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.189481  5463 consensus_queue.cc:260] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.197669  5436 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.431447  5475 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:51.399411  5438 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.393731  5439 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.480485  5511 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 12:59:51.481204  5507 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 12:59:51.440397  5175 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:51.489470  5511 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:51.505128  5387 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.505801  5387 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:51.535220  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 96691.1us
I20260709 12:59:51.541899  1685 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:51.504218  5511 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:51.485075  5475 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:51.492657  5478 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:51.508347  5387 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:51.593586  5257 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:51.598346  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:51.599181  2436 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 12:59:51.575106  5509 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:51.522258  5175 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.605496  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:51.605871  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:51.586858  5437 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:51.676467  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 57863.3us
I20260709 12:59:51.615180  5437 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:51.648727  5462 consensus_meta.cc:287] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.680s	user 0.012s	sys 0.000s
I20260709 12:59:51.597506  5475 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:51.589246  5478 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:51.699090  1685 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:51.701156  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:51.701798  1644 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 12:59:51.671547  5129 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:59:51.698097  5497 log.cc:927] Time spent T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.264s	user 0.002s	sys 0.000s
I20260709 12:59:51.713732  1685 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:51.709097  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1761) took 1027 ms. Trace:
I20260709 12:59:51.717911  1717 rpcz_store.cc:276] 0709 12:59:50.681751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.179196 (+497445us) service_pool.cc:224] Handling call
0709 12:59:51.181003 (+  1807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.181245 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:51.542493 (+361248us) log.cc:844] Serialized 14 byte log entry
0709 12:59:51.708679 (+166186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:51.708747 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:51.708805 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.708888 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.709030 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10698,"prepare.queue_time_us":301383,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2958,"raft.queue_time_us":21248,"thread_start_us":384016,"threads_started":2}
I20260709 12:59:51.705904  5462 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.690987  5204 consensus_queue.cc:1059] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:59:51.709035  5129 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.736723  1717 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:51.710909  5510 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.729063  5257 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:51.743000  1713 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:51.738183  5129 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:51.738023  5436 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:51.706725  5439 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:51.738824  5387 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:51.769673  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 66088.8us
I20260709 12:59:51.780540  5175 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:51.795789  5361 raft_consensus.cc:3055] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:51.796443  5361 raft_consensus.cc:740] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:51.798251  5505 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:51.742461  5438 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:51.799134  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:51.785374  5514 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:59:51.750638  5512 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:51.742611  5510 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.822511  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:51.824851  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:51.826439  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.774844  5387 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:51.831317  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:51.797601  5361 consensus_queue.cc:260] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.815728  5372 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:51.832711  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:51.831238  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:51.836562  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:51.839136  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 12:59:51.840585  5516 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:59:51.841228  5522 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:51.841822  5522 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:51.844547  5484 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.945s	user 0.010s	sys 0.015s
I20260709 12:59:51.845281  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 2721) took 1017 ms. Trace:
I20260709 12:59:51.827458  5450 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.845367  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:51.847146  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1760) took 1187 ms. Trace:
I20260709 12:59:51.846334  5450 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.847609  1720 rpcz_store.cc:276] 0709 12:59:50.659529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.665244 (+  5715us) service_pool.cc:224] Handling call
0709 12:59:50.968322 (+303078us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173eee 0000000000375939 00007f18d21e71e0 00007f18d22b00c4 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:59:50.968529 (+   207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:50.968986 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:50.969029 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:50.969598 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 12:59:51.395967 (+426369us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:51.396010 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.396083 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:51.846874 (+450791us) raft_consensus.cc:1685] finished
0709 12:59:51.846893 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.847079 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49189,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":2776,"spinlock_wait_cycles":31114496,"thread_start_us":425897,"threads_started":1,"wal-append.queue_time_us":477624}
I20260709 12:59:51.849305  5450 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:51.839507  1611 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:51.851065  5442 consensus_meta.cc:287] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.887s	user 0.012s	sys 0.000s
I20260709 12:59:51.851502  5442 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.851990  1611 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:51.853348  5439 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:51.853991  5439 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.824537  5436 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:51.840468  5508 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:51.855109  1611 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:51.867692  5508 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:51.869051  5438 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:51.854472  5439 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.821887  5512 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.870841  1568 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:51.872391  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 2389) took 1351 ms. Trace:
I20260709 12:59:51.872821  1568 rpcz_store.cc:276] 0709 12:59:50.521020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.521216 (+   196us) service_pool.cc:224] Handling call
0709 12:59:51.870682 (+1349466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.871284 (+   602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.872154 (+   870us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400198550. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:51.872322 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3102693248}
I20260709 12:59:51.855316  5372 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.878659  5462 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:51.869796  5436 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.880617  5475 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:51.881857  1644 raft_consensus.cc:2410] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:59:51.869431  5478 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:51.884529  5237 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:51.887840  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:51.888808  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2708) took 1263 ms. Trace:
I20260709 12:59:51.889201  1719 rpcz_store.cc:276] 0709 12:59:50.625340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.647747 (+ 22407us) service_pool.cc:224] Handling call
0709 12:59:51.887638 (+1239891us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:51.888742 (+  1104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15415040}
I20260709 12:59:51.890477  5524 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.891170  5524 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:51.894544  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:51.895501  1718 raft_consensus.cc:2393] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 10: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:51.895941  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 2706) took 1271 ms. Trace:
I20260709 12:59:51.896302  1718 rpcz_store.cc:276] 0709 12:59:50.624818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.646723 (+ 21905us) service_pool.cc:224] Handling call
0709 12:59:51.894368 (+1247645us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:51.895876 (+  1508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15651712}
I20260709 12:59:51.897639  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:51.902633  1718 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 12:59:51.863606  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:51.865386  5527 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.867093  5437 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:51.869129  1563 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 1723) took 1717 ms (client timeout 1547 ms). Trace:
W20260709 12:59:51.931859  1563 rpcz_store.cc:269] 0709 12:59:50.151601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.151714 (+   113us) service_pool.cc:224] Handling call
0709 12:59:51.868903 (+1717189us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b5400198554. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:51.869030 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399113600}
W20260709 12:59:51.932443  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 121113us
I20260709 12:59:51.898984  5525 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:51.900027  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:51.865851  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 2707) took 1185 ms. Trace:
I20260709 12:59:51.859419  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 2138) took 1214 ms. Trace:
I20260709 12:59:51.933830  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:51.934204  1638 rpcz_store.cc:276] 0709 12:59:50.644944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.659516 (+ 14572us) service_pool.cc:224] Handling call
0709 12:59:51.859187 (+1199671us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b540034dad4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:51.859344 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91049856}
I20260709 12:59:51.845991  1714 rpcz_store.cc:276] 0709 12:59:50.827552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.595369 (+767817us) service_pool.cc:224] Handling call
0709 12:59:51.595728 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:51.596099 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.596131 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:51.602861 (+  6730us) log.cc:844] Serialized 26 byte log entry
0709 12:59:51.703757 (+100896us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:51.703795 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.703854 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:51.844998 (+141144us) raft_consensus.cc:1685] finished
0709 12:59:51.845031 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.845209 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5240,"raft.queue_time_us":10889,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":6614,"thread_start_us":100496,"threads_started":1,"wal-append.queue_time_us":170376}
I20260709 12:59:51.901283  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:51.863132  5266 raft_consensus.cc:3055] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:51.935349  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:51.911877  1611 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:51.935696  5266 raft_consensus.cc:740] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:51.933918  1639 rpcz_store.cc:276] 0709 12:59:50.680109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.722027 (+ 41918us) service_pool.cc:224] Handling call
0709 12:59:51.863650 (+1141623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.863865 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.863901 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:51.863955 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:51.864004 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.864079 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.865614 (+  1535us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540034dad0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 12:59:51.865755 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2557726592}
I20260709 12:59:51.936756  5266 consensus_queue.cc:260] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.937116  1611 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:51.937718  5266 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:51.938185  5515 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:51.938948  5515 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:51.938957  1611 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:51.940366  5515 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:51.940721  5515 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:51.941105  5515 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:51.942600  1611 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:51.943495  5525 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:51.935463  1719 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:51.944926  5525 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:51.915508  1685 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:51.917850  5361 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:51.918099  5478 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:51.946483  5478 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:51.947345  1611 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:51.948750  5525 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:51.919448  5387 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:51.920845  5129 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:51.921281  5508 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:51.921305  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:51.922257  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:51.922816  5442 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:51.923506  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:51.923986  5524 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:51.952634  1611 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:51.934219  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:51.935158  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:51.948832  5478 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:51.955097  5475 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:51.917917  5523 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:51.951653  5129 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:51.952999  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:51.970361  2440 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:59:51.925274  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:51.953207  1718 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:51.956550  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:51.959559  1611 leader_election.cc:400] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12.
I20260709 12:59:51.974948  1638 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:51.976770  1611 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:51.977545  5525 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.977705  5515 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.960163  5524 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:51.979092  5523 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.954387  5527 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:51.951586  5510 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:51.955614  5475 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:51.978314  5525 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:51.978477  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:51.991158  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:51.959306  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:51.956197  5508 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:51.992950  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.993181  2440 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 12:59:51.994297  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:51.982867  5387 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:59:51.995380  5515 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:51.996176  5485 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:51.996691  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1774) took 1170 ms. Trace:
I20260709 12:59:51.996742  5485 raft_consensus.cc:697] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:51.997161  1713 rpcz_store.cc:276] 0709 12:59:50.826120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.271021 (+444901us) service_pool.cc:224] Handling call
0709 12:59:51.271382 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.744949 (+473567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.996449 (+251500us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b5400229f54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 12:59:51.996629 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084026112}
I20260709 12:59:51.997715  5485 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.000774  5527 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:51.990901  5475 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:52.003609  1611 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:52.005169  1611 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:51.992837  5510 consensus_queue.cc:1059] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:59:52.007057  5201 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:52.007642  5510 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:52.008040  5510 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.008450  5510 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:52.008613  5528 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:52.009181  5528 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.009514  5528 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:52.010389  5519 raft_consensus.cc:3055] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:59:52.003634  5480 log.cc:927] Time spent T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 1.145s	user 0.000s	sys 0.031s
I20260709 12:59:52.010824  5519 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:59:52.014031  5517 log.cc:927] Time spent T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.266s	user 0.003s	sys 0.000s
I20260709 12:59:52.014680  1566 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:52.014196  5519 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.015372  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 1728) took 1354 ms. Trace:
I20260709 12:59:52.015815  1566 rpcz_store.cc:276] 0709 12:59:50.660592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.660974 (+   382us) service_pool.cc:224] Handling call
0709 12:59:52.014328 (+1353354us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 12:59:52.014521 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.015095 (+   574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.015299 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2869504}
I20260709 12:59:52.017354  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.018119  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 1757) took 1372 ms. Trace:
I20260709 12:59:52.018411  1716 rpcz_store.cc:276] 0709 12:59:50.646000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.647682 (+  1682us) service_pool.cc:224] Handling call
0709 12:59:52.017204 (+1369522us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:52.018011 (+   807us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14565632}
I20260709 12:59:52.020182  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:52.022138  5519 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:51.989451  5524 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:59:52.027053  5436 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:52.028234  5523 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:52.028829  5495 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.882s	user 0.011s	sys 0.010s
I20260709 12:59:52.032850  5463 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.035251  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.036526  5442 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:52.036681  5371 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:52.037235  5371 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.038834  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:52.039434  1563 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:52.042874  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.045241  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.043982  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:52.048365  1719 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:52.048264  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:52.048552  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.049079  1570 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 12:59:52.041471  5527 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:52.055058  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.041935  5506 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:52.039292  5371 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:52.052031  5527 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.065531  1719 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 12:59:52.043591  5398 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:52.069819  5506 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.078980  5527 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:52.079663  1572 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:52.076671  5398 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.081694  1568 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:52.082967  5506 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:52.087273  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.045639  5528 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.089605  1563 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 12:59:52.089468  5398 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:52.098348  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:52.099112  1712 raft_consensus.cc:2368] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
I20260709 12:59:52.099466  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 1750) took 1475 ms. Trace:
I20260709 12:59:52.099778  1712 rpcz_store.cc:276] 0709 12:59:50.624439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.647021 (+ 22582us) service_pool.cc:224] Handling call
0709 12:59:52.098204 (+1451183us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 12:59:52.099409 (+  1205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16505216}
I20260709 12:59:52.102615  5397 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:52.103229  5439 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:52.103170  5397 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.104534  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.105803  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.109637  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.110452  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.114212  1568 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 12:59:52.111200  1571 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:52.151737  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:52.153653  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.156198  1571 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:52.157639  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:52.109594  5459 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:59:52.160686  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.162174  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.163401  1571 raft_consensus.cc:2393] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:52.164346  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.164502  5475 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.165431  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.166486  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.166957  5439 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:52.186751  5475 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:52.187883  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:52.188210  1686 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.188444  1567 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.126171  5397 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:52.188225  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.212262  1686 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.186679  5439 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.219446  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.220212  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.210790  1566 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:52.222925  1572 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 12:59:52.223210  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:52.226197  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:52.227555  5439 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:52.228547  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.229148  1568 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:52.230672  5506 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:52.231402  5519 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:52.231949  5519 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.221633  1571 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 12:59:52.188825  5261 raft_consensus.cc:3055] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:52.235481  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.235028  1686 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.237351  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.238015  5470 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:52.238550  1568 raft_consensus.cc:2393] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:52.240442  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:52.239425  1686 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.243152  1686 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.241433  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:52.213923  5475 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.214825  5129 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:52.250140  1568 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:52.250823  1612 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:52.310446  1567 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
W20260709 12:59:52.339339  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 88557.8us
W20260709 12:59:52.340327  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 97214.3us
I20260709 12:59:52.340564  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:52.341370  1686 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.339020  5475 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.349123  5475 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:52.351153  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.351547  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:52.352316  1566 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:52.353344  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.356351  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.358512  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:52.360517  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.236442  5261 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:52.363746  1569 raft_consensus.cc:2393] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:52.364084  5506 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:52.251260  4651 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:52.371248  1567 raft_consensus.cc:1240] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:52.364406  1568 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 12:59:52.337708  5436 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:59:52.366698  5129 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:52.208817  5459 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.362001  5188 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:52.385238  1566 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 12:59:52.386413  1566 raft_consensus.cc:1240] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:52.387791  1566 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:52.389261  1563 raft_consensus.cc:1240] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:52.241847  5519 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 12:59:52.369969  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.391644  5261 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.392786  5261 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:52.393041  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:52.394367  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:52.395578  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.395689  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.396818  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:52.389951  1566 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:52.397910  1717 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:52.399178  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.399574  1640 raft_consensus.cc:1275] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:52.401379  5188 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:52.402215  5188 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.396829  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.410115  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:52.397950  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.410813  1645 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:52.374415  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.413910  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:52.352694  5527 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:52.379433  1568 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:52.339072  5524 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:52.361805  5437 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:52.419404  5437 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:52.419817  5437 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.420064  5524 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.420993  5146 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:52.411365  5534 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:59:52.422096  5524 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:52.415650  2438 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:52.350785  5510 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.373525  1567 raft_consensus.cc:1240] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:52.413502  1713 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:52.415761  1721 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:52.418903  1564 raft_consensus.cc:1240] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:52.381400  5129 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:52.418601  5528 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:52.432204  1644 raft_consensus.cc:1240] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:52.434410  1645 raft_consensus.cc:1240] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:52.437655  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 61895.2us
I20260709 12:59:52.426930  5398 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:52.428737  5129 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:52.441974  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.442534  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:52.443780  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:52.447587  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.449239  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.450428  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.451174  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:52.452188  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:52.452863  1641 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 10: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:52.454105  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.429714  5456 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:59:52.455005  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:52.458598  2405 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:52.459616  1642 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:52.460568  2438 raft_consensus.cc:2393] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:52.440580  5512 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:52.462805  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:52.465560  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.465596  1536 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.467057  5475 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:52.467816  5475 raft_consensus.cc:697] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:52.468189  5469 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:52.468689  5475 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.469813  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:52.471201  5487 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:52.471700  5487 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.472152  5487 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.474454  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:52.477072  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:52.483445  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:52.483713  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.484560  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:52.487831  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.490208  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.495831  5463 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:52.497581  1536 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.500223  5463 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:52.490919  5368 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:52.476938  5370 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:52.443401  5398 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.489244  5397 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:52.486325  5456 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:52.503618  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.510264  1565 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:52.523172  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:52.523818  1641 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:52.525272  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:52.525825  1645 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:52.526513  1643 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:52.526881  1639 raft_consensus.cc:1240] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:52.527266  5465 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:52.527683  5528 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:52.528527  5528 consensus_queue.cc:1059] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:52.525847  1642 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:52.529281  5528 raft_consensus.cc:3055] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:52.529640  5528 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:52.529970  1536 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.530270  5524 raft_consensus.cc:3055] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:52.530793  5524 raft_consensus.cc:740] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:52.531874  5524 consensus_queue.cc:260] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.533464  5524 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:52.533603  5465 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:52.534227  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.536257  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:52.537425  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:52.538403  5463 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:52.541071  5528 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.541728  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:52.542697  5371 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:52.542907  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:52.541957  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:52.544894  5463 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:52.546962  1642 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11. Ops: []
W20260709 12:59:52.551218  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.550182  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.564770  1685 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.542325  5528 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:52.568740  5540 log.cc:927] Time spent T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:59:52.573130  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:52.570362  5506 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:52.568288  1685 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:52.576941  5494 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:52.577927  1721 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:52.578706  1721 raft_consensus.cc:606] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.579133  1721 raft_consensus.cc:614] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:52.582252  1715 raft_consensus.cc:1275] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:52.582746  1612 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:52.585049  1638 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:52.562359  5368 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:52.585443  1612 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:52.588580  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:52.588806  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:52.570920  5397 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:52.600204  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:52.600803  1721 raft_consensus.cc:2376] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10. Re-sending same reply.
I20260709 12:59:52.593991  1536 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:52.587427  5188 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:52.604949  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.592978  4651 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:52.593276  5389 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:52.595435  5494 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:52.590222  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:52.594185  5522 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:52.622818  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.601737  5397 raft_consensus.cc:697] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 12:59:52.637192  5539 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:59:52.597371  5456 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:59:52.639139  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.614277  5188 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:52.612907  5463 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:52.615061  5465 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:52.617024  4651 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:52.647308  5188 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:52.627378  5389 raft_consensus.cc:697] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:52.659266  5389 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.624871  5402 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:52.666939  5402 raft_consensus.cc:697] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:52.668295  5402 consensus_queue.cc:237] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.671067  4651 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:52.672849  1564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:59:52.648085  5463 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.688458  5459 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:52.688632  5463 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:52.690122  5372 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:52.692791  5398 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:52.699290  5397 consensus_queue.cc:237] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.627023  5146 consensus_queue.cc:1059] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:59:52.704089  5146 raft_consensus.cc:3055] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:52.704547  5146 raft_consensus.cc:740] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:59:52.706264  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 67233.7us
W20260709 12:59:52.705781  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 117927us
I20260709 12:59:52.710945  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:52.708211  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:52.712239  1536 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.712275  1685 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:52.728876  1685 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.645879  5370 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:52.733915  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 144255us
I20260709 12:59:52.736277  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:52.736490  2406 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.737528  5234 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:52.737751  2406 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.739239  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:52.708547  5398 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:52.749754  2406 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.751376  1685 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:52.752149  5551 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:52.748840  5478 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:52.748716  5261 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:52.754043  1564 raft_consensus.cc:606] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.724906  5459 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:52.754905  1537 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.757953  1564 raft_consensus.cc:614] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:52.746253  5462 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:52.755769  5550 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:52.795205  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.760071  5261 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:52.795445  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:52.796741  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.797930  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.798205  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.799290  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:52.799381  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.800875  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:52.801430  1572 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:52.802435  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.803877  1563 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:59:52.804551  5257 consensus_queue.cc:1059] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:52.806267  5361 raft_consensus.cc:3055] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:52.806622  5361 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:52.807303  5470 consensus_queue.cc:1059] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:52.807416  5361 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.808107  5470 consensus_queue.cc:1243] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer a4be9cc90aca4dd4ad7db103062a7208 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:52.808696  5361 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:52.808724  5527 raft_consensus.cc:3055] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:52.809401  5527 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:52.810384  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.810266  5527 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.754597  5458 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:59:52.812476  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.813774  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.814378  1720 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:52.814438  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:52.815886  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.817428  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.817934  1720 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:52.818591  1572 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 12:59:52.811512  5527 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:52.820648  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.822919  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:52.754127  5146 consensus_queue.cc:260] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.824757  5146 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.827224  5188 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.828266  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:52.794965  5550 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.836509  5550 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:52.837005  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:52.838096  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.839504  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:52.841202  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:52.842566  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.843053  5487 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.843873  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.845145  5487 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:52.845899  2437 raft_consensus.cc:2393] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:52.800300  5129 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.847649  1718 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:52.848922  5129 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:52.760792  5530 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:59:52.794489  5504 consensus_queue.cc:1059] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:59:52.851796  5504 raft_consensus.cc:3055] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:52.852205  5504 raft_consensus.cc:740] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:52.851902  4651 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.853034  5504 consensus_queue.cc:260] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.854581  4651 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:52.798193  5261 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:52.861456  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:52.862354  1713 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.870602  5188 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:52.871268  5368 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:52.875414  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.871342  5504 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.876520  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.877532  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:52.878283  1611 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:52.879832  1611 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:52.881074  5528 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:52.881412  5528 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:52.881752  5528 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.834649  5437 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.887874  5437 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:52.888383  5437 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:52.890938  5374 raft_consensus.cc:3055] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:52.891314  5374 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:52.892028  5374 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:52.893518  5374 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:52.895442  1713 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:52.895900  2438 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:59:52.897246  2440 raft_consensus.cc:1240] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:52.897102  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:52.900733  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:52.894778  1611 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:52.905776  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:52.908116  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.914584  1686 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.915807  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.916751  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:52.917979  1686 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.919502  1611 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:52.921977  1611 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:52.922886  1569 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:59:52.927448  1714 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 12:59:52.932518  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.937242  5129 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:52.937732  5129 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:52.938632  5129 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.918458  5469 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:52.917335  5527 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:52.919337  5455 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.931262  5188 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:52.943405  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:52.929345  5436 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:52.930294  5470 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:52.931890  5389 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:52.967197  5506 consensus_queue.cc:1059] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:52.968514  5530 consensus_queue.cc:1059] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:52.968989  5463 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.993518  5463 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:52.995139  1568 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:52.982594  1686 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:52.988596  5550 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:52.934597  5476 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:59:52.979028  5188 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.983774  5469 raft_consensus.cc:697] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 12:59:53.004237  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 249304us
I20260709 12:59:53.018543  1686 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:53.019968  1713 raft_consensus.cc:2393] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:52.984079  5455 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.020388  5188 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:53.091914  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 162107us
W20260709 12:59:53.080072  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 61631.9us
I20260709 12:59:53.091023  5530 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:53.066346  5454 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:53.073553  5361 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:53.079427  5527 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 12:59:53.117612  1537 consensus_peers.cc:597] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a2e78d031c384616a01064318cb24f28. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:53.123621  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 45576.9us
W20260709 12:59:53.253224  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.291617  5550 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:53.292303  5556 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 12:59:53.191499  5510 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:53.128176  5527 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:53.291635  5558 log.cc:927] Time spent T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 12:59:53.332753  5557 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
W20260709 12:59:53.349903  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 234973us
W20260709 12:59:53.368177  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.371122  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:53.371290  1612 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:53.371749  1638 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:53.372098  5402 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:53.374203  1612 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:53.375077  5554 raft_consensus.cc:3055] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:53.375180  5402 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:53.375514  5554 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:53.375340  1714 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:53.376725  5554 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.377992  1571 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:53.378401  1612 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:53.379118  5470 raft_consensus.cc:3055] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:53.379446  5402 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:53.379590  5470 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:53.381229  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:53.380821  5470 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:53.382028  5402 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:53.386695  1612 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:53.387678  5436 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:53.267392  5469 consensus_queue.cc:237] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:53.377959  5554 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:53.348402  5437 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:53.388792  5564 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
W20260709 12:59:53.395310  5261 consensus_meta.cc:287] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.003s
I20260709 12:59:53.388178  5436 raft_consensus.cc:697] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:53.404237  1638 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 12:59:53.415954  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:53.395781  5261 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.405675  5470 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:53.406932  5371 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.439550  1572 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:59:53.410957  5563 log.cc:927] Time spent T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 12:59:53.450295  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 61294.8us
I20260709 12:59:53.446365  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:53.444600  5575 consensus_queue.cc:1059] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:53.451092  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:53.453840  1719 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:53.437326  5402 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:53.440220  5455 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:53.446870  5566 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.462990  5402 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.458134  5437 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:53.472118  5402 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:53.481029  5389 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:53.451064  5371 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.463346  5476 raft_consensus.cc:3055] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:59:53.491780  5504 consensus_meta.cc:287] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.000s
I20260709 12:59:53.452553  5436 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.494364  1719 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
W20260709 12:59:53.496129  5374 consensus_meta.cc:287] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.004s
W20260709 12:59:53.466423  5559 log.cc:927] Time spent T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 12:59:53.496577  5527 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:53.498358  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 84848.8us
I20260709 12:59:53.467363  5566 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.507666  5476 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:53.508402  1564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:59:53.521457  1564 raft_consensus.cc:606] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:53.521852  1564 raft_consensus.cc:614] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:53.509337  5261 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:53.524503  5476 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.525509  5566 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:53.533095  1564 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:59:53.533510  1564 pending_rounds.cc:85] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 9
I20260709 12:59:53.533758  1564 pending_rounds.cc:107] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:59:53.533982  1564 raft_consensus.cc:2889] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:53.542546  5528 consensus_meta.cc:287] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.636s	user 0.000s	sys 0.011s
I20260709 12:59:53.543862  5371 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:53.544317  5528 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:53.546667  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 431638us
I20260709 12:59:53.551323  5462 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:59:53.551184  5488 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:59:53.576249  4651 consensus_queue.cc:1059] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:53.576504  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:53.577014  5577 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:53.580423  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:53.581121  1570 raft_consensus.cc:2368] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10.
I20260709 12:59:53.589929  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:53.590483  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:53.592299  1715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e93b49f668f7487dad07043590a5616f"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:53.592904  1715 raft_consensus.cc:606] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:53.593308  1715 raft_consensus.cc:614] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:53.560554  5188 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 12:59:53.611464  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.570510  5528 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:53.577550  5577 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.617602  5577 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:53.628988  5257 raft_consensus.cc:3055] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:53.629592  5257 raft_consensus.cc:740] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:53.630734  5257 consensus_queue.cc:260] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.632176  5257 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:53.649966  1466 catalog_manager.cc:5697] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 7 to 8, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:53.671736  5469 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:53.671949  5227 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:53.672508  5575 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:53.673058  5575 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.676934  5575 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:53.665750  5476 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:53.685303  1466 catalog_manager.cc:5697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:53.623683  5188 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:53.614593  5204 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:53.596882  5266 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:53.612596  5371 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 12:59:53.731242  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 153344us
I20260709 12:59:53.740192  1712 raft_consensus.cc:1240] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:53.733336  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 274328us
I20260709 12:59:53.743129  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:53.729693  5561 log.cc:927] Time spent T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.475s	user 0.000s	sys 0.006s
I20260709 12:59:53.746554  1611 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:53.732985  5260 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:53.744333  5504 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:53.748037  1713 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:59:53.748100  5504 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.749334  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:53.746280  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:53.742673  5361 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.750679  5361 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:53.735532  5569 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:59:53.747789  5260 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.756045  1611 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:53.756718  1719 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:53.762607  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:53.759444  1712 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 12:59:53.763840  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:53.765280  1638 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:53.766563  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:53.736125  5129 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:59:53.754318  5436 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:53.770913  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:53.771464  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:53.772045  1638 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:53.736547  5266 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.773741  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:53.784116  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:53.775578  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:53.760244  5510 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:53.759455  5522 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.738416  5371 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.785645  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:53.783717  1639 raft_consensus.cc:1240] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:53.777027  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:53.784708  1720 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:53.787578  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:53.790644  1685 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:53.791314  1714 raft_consensus.cc:2393] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 12:59:53.786451  1642 raft_consensus.cc:2393] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 7: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:53.792716  1569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff20dea159284907b41e95b640800f50"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:59:53.793574  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:53.804839  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:53.831411  5361 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:53.835973  5581 ts_tablet_manager.cc:933] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 12:59:53.836011  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:53.838877  5504 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:53.840059  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:53.840777  1572 raft_consensus.cc:2393] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 7: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:53.841904  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:53.842892  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:53.843182  5260 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:53.789871  5402 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:53.844781  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:53.846637  5371 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:53.847172  5371 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:53.785734  5582 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:59:53.850323  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:53.850663  5266 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:53.852953  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:53.854828  1642 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:53.855417  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:53.855957  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:53.856410  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:53.857246  1712 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:53.859127  1643 raft_consensus.cc:1240] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:53.861464  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 69041.5us
I20260709 12:59:53.861653  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:53.862767  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:53.863534  1714 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 8: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:53.864157  1569 raft_consensus.cc:606] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:53.864583  1714 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:53.864733  1721 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:53.868052  1536 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:53.862887  1640 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:53.873668  1571 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:53.876061  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:53.876243  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 85697.6us
I20260709 12:59:53.879110  1571 raft_consensus.cc:1240] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:53.880447  1566 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:59:53.881513  5586 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:59:53.882588  1572 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:53.879097  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:53.886420  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:53.887460  1644 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 9: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:53.794958  5522 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:53.909274  1641 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:53.909834  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:53.910275  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:53.882198  5361 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:53.962397  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 81469.2us
I20260709 12:59:53.948022  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:53.964567  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 208587us
I20260709 12:59:53.957182  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:53.966104  1611 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:53.966017  1570 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 12:59:53.968492  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:53.969189  1640 raft_consensus.cc:2393] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 7: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:53.973696  1536 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:53.979568  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 69222.7us
I20260709 12:59:53.912319  5398 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:53.871277  5397 consensus_queue.cc:1059] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:59:53.987768  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:53.882153  5562 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:53.963624  5554 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:54.037866  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.971436  5437 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.895736  5456 consensus_queue.cc:1059] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:59:53.969599  5566 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:54.057596  5398 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.063997  5581 tablet_copy_client.cc:323] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 12:59:54.063941  5566 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:54.065413  5398 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:54.067122  5566 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:54.065433  5565 raft_consensus.cc:3055] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:54.068501  5565 raft_consensus.cc:740] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:54.069295  5565 consensus_queue.cc:260] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:54.070538  5565 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:54.074836  5587 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:59:54.076516  5585 log.cc:927] Time spent T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:59:54.057480  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:54.057718  1719 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:54.056496  5146 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:59:53.981312  5455 consensus_queue.cc:1059] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:59:54.057364  5590 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:54.082587  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 91669.1us
I20260709 12:59:53.978551  5361 raft_consensus.cc:697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 12:59:54.090245  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 116634us
I20260709 12:59:54.097911  5361 consensus_queue.cc:237] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.058099  5562 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.100620  5562 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:54.087200  5554 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.103650  1639 raft_consensus.cc:1240] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:54.104892  5554 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:54.105618  5266 consensus_queue.cc:1059] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:54.106072  5456 raft_consensus.cc:3055] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:54.106536  5456 raft_consensus.cc:740] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:54.107366  5456 consensus_queue.cc:260] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.107692  5266 consensus_queue.cc:1059] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:54.108552  5456 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.108704  5485 raft_consensus.cc:3055] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:54.109171  5485 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:54.109947  5485 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.111006  5575 raft_consensus.cc:3055] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:54.111302  5485 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.111382  5575 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:54.110564  5397 raft_consensus.cc:3055] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:54.112370  5575 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:54.113080  5397 raft_consensus.cc:740] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:54.092722  5368 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:54.113752  5575 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.118620  5562 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.135000  1563 raft_consensus.cc:2368] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8.
I20260709 12:59:54.136332  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 1796) took 1314 ms. Trace:
I20260709 12:59:54.137301  5560 raft_consensus.cc:993] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 12:59:54.137782  5560 raft_consensus.cc:1081] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 12:59:54.123350  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.136730  1718 rpcz_store.cc:276] 0709 12:59:52.821776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.360166 (+538390us) service_pool.cc:224] Handling call
0709 12:59:53.360517 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.555806 (+195289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.555852 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:53.556410 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:59:53.707971 (+151561us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:53.745188 (+ 37217us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.745373 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.745446 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.136091 (+390645us) raft_consensus.cc:1685] finished
0709 12:59:54.136120 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.136272 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":223966,"prepare.queue_time_us":44307,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":2181,"raft.queue_time_us":197250,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":2523,"thread_start_us":151090,"threads_started":1,"wal-append.queue_time_us":229419}
W20260709 12:59:54.127314  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 49766.8us
W20260709 12:59:54.121382  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.130631  1466 catalog_manager.cc:5697] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 5 to 8, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 12:59:54.150677  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.152987  1686 leader_election.cc:400] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10.
I20260709 12:59:54.153419  1686 leader_election.cc:403] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:59:54.158717  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:54.160290  1536 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:54.159565  1567 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:54.170467  1686 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.132899  5530 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.177188  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.133674  5522 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:54.181171  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:54.154085  5476 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:54.087594  5437 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.175874  5550 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.168670  5554 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:54.193568  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.175714  4651 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10.
I20260709 12:59:54.195211  1611 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:54.188330  5260 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:54.202723  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:54.203745  1643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff20dea159284907b41e95b640800f50"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36692
I20260709 12:59:54.204212  1643 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:54.204558  1643 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:54.204874  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:54.199218  1686 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.183951  5462 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:54.184923  5566 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:54.187847  5530 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:54.303361  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 314572us
I20260709 12:59:54.254396  1581 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet a2e78d031c384616a01064318cb24f28 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 12:59:54.198117  5402 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:59:54.334542  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.190761  5204 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:59:54.188587  5512 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:59:54.188982  5476 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.205930  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:54.113902  5397 consensus_queue.cc:260] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.194696  5188 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:54.340443  1638 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:59:54.343637  1718 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:54.376492  1638 pending_rounds.cc:85] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 5
I20260709 12:59:54.377853  1638 pending_rounds.cc:107] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:59:54.378307  1638 raft_consensus.cc:2889] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:54.346593  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 147440us
W20260709 12:59:54.349435  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 144879us
I20260709 12:59:54.201354  5550 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.198287  5527 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 12:59:54.202319  5554 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:54.351414  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 156279us
I20260709 12:59:54.351925   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:54.350735  1643 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.320701  5463 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:54.394383  5463 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.395071  1611 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:54.396910  5463 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:54.374455  5459 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.338783  5488 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:54.397687  5488 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:54.398849  5488 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:54.351208  5146 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.351452  5504 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.376906  5476 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:54.382350  5567 consensus_queue.cc:1059] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:59:54.397691  5459 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.427176  5530 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:54.386540  5188 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:54.428699  5459 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:54.429572  5188 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:54.376113  1581 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet a2e78d031c384616a01064318cb24f28 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-a2e78d031c384616a01064318cb24f28
I20260709 12:59:54.431767  5550 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:54.386226  5436 consensus_meta.cc:287] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.601s	user 0.001s	sys 0.008s
I20260709 12:59:54.432811  5436 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:54.433504  1640 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:54.382036  5578 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:54.437810  5554 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:54.439101  1643 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:54.348397  5565 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:54.338850  5566 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:54.407516  5227 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:54.437610  5578 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.387315  1686 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:54.444301  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 75281.5us
I20260709 12:59:54.445124  5562 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:54.466337  5565 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:54.467442  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 72483.2us
I20260709 12:59:54.468147  1611 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:54.468690  5565 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:54.445592  5227 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:54.478562  5227 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:54.448637   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:54.449277  1466 catalog_manager.cc:5697] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:54.482031  5437 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:54.488801  5600 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:59:54.491622  5371 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:54.492226  5371 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.492730  5397 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:54.492828  5454 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:54.493600  5454 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.494282  5371 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:54.495105  5599 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:59:54.495893  5454 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:54.501160  5257 raft_consensus.cc:3055] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:54.501660  5257 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:54.503363  5257 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.375514  5402 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:54.453122  5129 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:54.507215  5129 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.507575  5129 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:54.508554  5402 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:54.509538  5257 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.454542  5476 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.459259  5146 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:54.460415  5578 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:54.461046  5566 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:54.466688  5590 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:54.475023  1611 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:54.513273  1466 catalog_manager.cc:5697] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:54.447573  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 63626.1us
I20260709 12:59:54.505033  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:54.515180  1611 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 12:59:54.506635  5602 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:59:54.518754  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:54.522487  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:54.515237  1466 catalog_manager.cc:5697] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 4 to 5, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:54.516639  1611 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:54.524621  1611 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:54.475134  5528 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:54.516812  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:54.520382  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.520673  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:54.528353  1712 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:54.528468  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:54.453716  5554 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.525812  1611 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:54.521066  1572 raft_consensus.cc:2393] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:54.531669  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:54.529412  1718 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:54.529623  1719 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:54.541538  1718 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:54.543177  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:54.548759  1718 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:54.549907  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:54.551239  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:54.539274  5589 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:54.552950  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:54.554003  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:54.554154  1581 tablet_copy_source_session.cc:215] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:54.555361  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:54.556784  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:54.534324  1466 catalog_manager.cc:5697] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:54.512859  5476 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:54.563608  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:54.564675  1714 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 12:59:54.567899  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:54.568593  1719 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:54.571491  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:54.572073  1565 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:54.572333  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:54.572254  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:54.572917  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:54.451603  5504 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:54.573279  1717 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 12:59:54.530571  5512 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:54.527580  5437 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:54.575027  2440 raft_consensus.cc:1240] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:54.575027  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 191244us
I20260709 12:59:54.530843  5522 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:54.586819  1686 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.596388  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:54.551868  1718 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:54.555055  5261 raft_consensus.cc:3055] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:54.606631  1686 leader_election.cc:400] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8.
I20260709 12:59:54.644294  1686 leader_election.cc:403] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:54.558272  5554 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:54.621297  5361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.022s	sys 0.031s
I20260709 12:59:54.611151  1466 catalog_manager.cc:5697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 10 to 12, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:54.612828  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:54.613525  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:54.530722  5188 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:59:54.566464  5591 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.540220  5573 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:59:54.579118  5592 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:54.647524  1571 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:59:54.609427  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.648590  2405 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:54.615613  5475 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.623889  5488 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:54.615316  5605 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:54.650839  1686 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:54.652899  5527 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8.
W20260709 12:59:54.660483  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 51179.1us
W20260709 12:59:54.651292  5361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.023s	sys 0.031s
I20260709 12:59:54.647907  5261 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:54.671766  1638 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:54.672576  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:54.674906  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:54.675205  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:54.675670  1638 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:54.675977  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:54.676435  1641 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:54.676704  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:54.676807  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:54.677345  1645 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 12:59:54.677852  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:54.678153  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:54.678458  1643 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:59:54.696301  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.696820  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:54.654402  5146 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:54.666355  5234 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:54.699909  5234 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:54.700281  5234 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.670150  5592 raft_consensus.cc:697] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:54.703346  5592 consensus_queue.cc:237] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:54.706678  5607 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:54.707747  5462 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:54.657572  5591 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.711436  5591 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:54.661058  5476 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:54.677611  5470 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:54.712606  5470 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.712988  5470 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.713196  5234 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:54.666798  5475 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:54.724668  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:54.725616  5475 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:54.726600  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:54.730894  5470 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.732649  1718 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 12:59:54.734293  1713 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 12:59:54.716035  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:54.718297  1638 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:54.746599  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:54.719863  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:54.699435  1536 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:54.714876  5146 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.747529  1645 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:54.722698  5234 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:54.723600  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:54.647276  5511 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:59:54.738122  5371 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.719036  5567 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:54.744629  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 12:59:54.722486  5601 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:59:54.747749  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 48393.4us
I20260709 12:59:54.758002  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.759598  1536 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:54.749334  5578 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:54.752413  1718 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 6.
I20260709 12:59:54.752941  5522 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.752005  5371 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.752214  5567 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.753803  5469 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:54.794253  5567 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.749948  5146 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.755167  5470 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:54.761906  1611 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 12:59:54.763625  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.798785  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:54.805976  1565 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:54.764065  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:54.807303  2405 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:54.767884  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:54.808287  1570 raft_consensus.cc:3055] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:54.808665  1570 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:54.768389  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:54.769104  5581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e78d031c384616a01064318cb24f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.765647  5578 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.763134  5455 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:54.817015  1466 catalog_manager.cc:5697] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:54.809525  1570 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.775051  5129 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.777673  5554 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 12:59:54.788357  1458 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.401s	user 0.001s	sys 0.006s
I20260709 12:59:54.799086  1643 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 12:59:54.802290  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 12:59:54.813452  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 52682.8us
I20260709 12:59:54.818123  1720 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:54.818287  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:54.827428  1572 raft_consensus.cc:2410] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:59:54.818400  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 149168us
I20260709 12:59:54.819469  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.771270  5476 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:54.771826  5368 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.819274  1685 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.824146  1570 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:54.824172  1466 catalog_manager.cc:5697] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 6 to 7, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:54.827478  1718 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 12:59:54.829073  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.833173  1685 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.762252  5573 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:59:54.831777  1466 catalog_manager.cc:5697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 8 to 9, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:54.835500  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:54.839617  1611 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:54.840186  1567 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.841015  1611 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:54.841856  5582 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:54.842710  5582 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:54.843158  5582 raft_consensus.cc:697] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:54.843899  5582 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.846782  1567 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:54.758908  5261 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.817827  5595 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:54.851322  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:54.822865  5578 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:54.853722  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.853847  1714 raft_consensus.cc:2393] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 11: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:54.821709  5457 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:54.821683  5402 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:54.859985  1570 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 12:59:54.887246  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58252 (request call id 219) took 10752 ms. Trace:
I20260709 12:59:54.823184  5455 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:54.797791  5522 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.865461  5595 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.831022  5576 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:54.830698  5512 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:54.884982  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 51872.9us
I20260709 12:59:54.848939  5508 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:54.826246  5530 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:59:54.839421  5554 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:54.888674  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.867019  5476 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:54.818492  5566 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.900712  1685 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.863564  5361 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:54.898743  5457 raft_consensus.cc:697] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:54.860803  5550 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:59:54.851794  5368 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:54.892100  5455 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.887660  1469 rpcz_store.cc:276] 0709 12:59:44.134497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.134667 (+   170us) service_pool.cc:224] Handling call
0709 12:59:54.887171 (+10752504us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:50.997183 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:51.192219 (+195036us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:51.193570 (+  1351us) write_op.cc:435] Acquired schema lock
0709 12:59:51.195908 (+  2338us) tablet.cc:662] Decoding operations
0709 12:59:51.518662 (+322754us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:51.518742 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:51.518782 (+    40us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:59:51.520022 (+  1240us) tablet.cc:701] Row locks acquired
0709 12:59:51.520048 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:59:51.520234 (+   186us) write_op.cc:270] Start()
0709 12:59:51.520360 (+   126us) write_op.cc:276] Timestamp: P: 1783601991520175 usec, L: 0
0709 12:59:51.520388 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:59:51.521207 (+   819us) log.cc:844] Serialized 4456 byte log entry
0709 12:59:51.921911 (+400704us) op_driver.cc:464] REPLICATION: finished
0709 12:59:52.022292 (+100381us) write_op.cc:301] APPLY: starting
0709 12:59:52.022373 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:52.023219 (+   846us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:52.023326 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:52.026977 (+  3651us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:52.027240 (+   263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 12:59:52.027291 (+    51us) write_op.cc:312] APPLY: finished
0709 12:59:52.027658 (+   367us) log.cc:844] Serialized 83 byte log entry
0709 12:59:52.027839 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.027988 (+   149us) write_op.cc:454] Released schema lock
0709 12:59:52.028046 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:52.028468 (+   422us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.028501 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":451592,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":100114,"apply.run_cpu_time_us":3809,"apply.run_wall_time_us":6163,"num_ops":11,"prepare.queue_time_us":199806,"prepare.run_cpu_time_us":56559,"prepare.run_wall_time_us":760755,"raft.queue_time_us":129722,"raft.run_cpu_time_us":21435,"raft.run_wall_time_us":93749,"replication_time_us":401354,"thread_start_us":348726,"threads_started":4,"wal-append.queue_time_us":193306,"wal-append.run_cpu_time_us":16034,"wal-append.run_wall_time_us":1346261}]]}
W20260709 12:59:54.923226  5610 log.cc:927] Time spent T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.171s	user 0.001s	sys 0.001s
I20260709 12:59:54.917465  5476 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:54.893402  5584 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:54.900920  5595 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:54.947805  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 59192.1us
I20260709 12:59:54.961714  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.952803  1611 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:54.921064  5204 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:54.966962  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:54.937999  5470 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:54.913343  5512 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.954907  5398 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:54.979285  1536 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:54.957659  5476 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:54.991384  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:54.997973  5368 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:54.999536  5266 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:55.000170  5266 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:54.935832  5361 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:54.969707  5528 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:54.973253  5459 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:55.017956  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:54.989018  5576 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:54.962972  5582 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:59:55.008024  5465 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:55.041750  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.043833  5371 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.045797  5361 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:55.048368  5623 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:59:54.974990  5204 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.050462  5129 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:55.050698  5522 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.050100  5457 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:55.016383  5528 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.053689  5146 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.054279  5528 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:55.057119  5465 raft_consensus.cc:697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:55.058336  1642 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 9: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:55.057971  5465 consensus_queue.cc:237] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.050506  5204 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:55.066246  5566 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.067711  5146 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.068413  5512 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.019294  5397 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:59:55.084415  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 199140us
I20260709 12:59:55.085201  1686 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:55.085776  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 94500us
I20260709 12:59:55.092599  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:55.093547  1567 raft_consensus.cc:2393] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:55.085690  5368 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 12:59:55.095291  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.096343  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:55.097255  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:55.098088  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:55.101833  1570 raft_consensus.cc:2393] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 7: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:55.094470  5456 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.103569  5456 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.085116  5577 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:55.090121  5397 raft_consensus.cc:697] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:55.098433  4651 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:55.093127  5494 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:55.128816  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:55.152902  1718 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 8: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:55.152416  5494 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:55.128230  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:55.154191  1720 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:55.155840  5494 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.135106  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:55.127120  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:55.159727  1716 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:55.107681  5368 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.110911  5456 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.164145  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:55.164722  1715 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 12:59:55.165879  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:55.166468  1563 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:55.168020  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:55.168236  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:55.168766  1570 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 12:59:55.171885  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:55.176142  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:55.173738  5397 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.177907  5567 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.113881  5578 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.115085  5577 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.167177  5575 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.199779  5575 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.201773  5575 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.185616  5581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42636 (request call id 622) took 1685 ms. Trace:
I20260709 12:59:55.186461  5476 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.190778  5567 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.190968  5368 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.167920  1458 maintenance_manager.cc:643] P b4fca1e1e7ea4cb985a4c9e3efed5179: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 5.222s	user 0.177s	sys 0.063s Metrics: {"bytes_written":30188,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":69765,"dirs.run_cpu_time_us":404,"dirs.run_wall_time_us":7289,"drs_written":1,"lbm_read_time_us":478,"lbm_reads_lt_1ms":4,"lbm_write_time_us":150387,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":5,"lbm_writes_lt_1ms":28,"peak_mem_usage":0,"raft.queue_time_us":56269,"reinsert_count":0,"rows_written":63,"spinlock_wait_cycles":6618496,"thread_start_us":127639,"threads_started":3,"update_count":11,"wal-append.queue_time_us":171524}
I20260709 12:59:55.196002  5577 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.196214  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:55.225526  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:55.227099  1459 maintenance_manager.cc:419] P b4fca1e1e7ea4cb985a4c9e3efed5179: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9430 bytes on disk
I20260709 12:59:55.171707  4651 raft_consensus.cc:697] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:55.230958  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:55.199200  1571 raft_consensus.cc:1240] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:59:55.231743  1716 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:55.232317  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:55.233614  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:55.234337  5368 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:55.234743  5368 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.234568  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:55.235209  5368 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.235543  1719 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:55.238294  5455 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.240536  5455 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.241101  5455 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:55.241431  5455 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.241755  5455 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.242717  1568 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:55.243608  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:55.244213  1718 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:55.202803  5578 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.204244  5261 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:55.184043  5371 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:55.229259  4651 consensus_queue.cc:237] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.255084  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:55.247846  1536 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:55.253882  1716 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:55.252347  5485 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:55.254985  5371 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.258241  1567 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:55.259279  1458 maintenance_manager.cc:643] P b4fca1e1e7ea4cb985a4c9e3efed5179: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.013s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":397,"lbm_reads_lt_1ms":4}
I20260709 12:59:55.257985  1536 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:55.261947  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:55.262830  5575 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:55.263298  5575 raft_consensus.cc:697] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:55.264007  5575 consensus_queue.cc:237] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.266526  5577 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:55.257375  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 98494.3us
I20260709 12:59:55.266933  5577 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:55.267342  5577 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.273211  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:55.275139  5476 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.276379  5371 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:55.276757  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:55.284283  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:55.261077  5578 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:55.277513  5485 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.290688  5578 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:55.295351  5485 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:55.295706  5578 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:55.287693  5452 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:55.302663  5266 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:55.305029  5595 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:55.301895  5455 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.287343  5368 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.307543  5455 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.308760  5368 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.309636  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:55.310596  1719 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:55.311551  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:55.311750  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:55.312158  1563 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 12:59:55.310240  1716 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 12:59:55.319763  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:55.320360  1717 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 12:59:55.322772  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:55.330108  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:55.330976  1716 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.333192  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.334966  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:55.337077  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.338768  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:55.340646  1716 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:55.341327  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.342298  1645 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 10: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:55.345189  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.351143  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:55.352561  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:55.353616  5562 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:55.354148  5562 raft_consensus.cc:697] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:55.337872  1642 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 12:59:55.355659  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.353965  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.357288  1641 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:55.355607  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.358199  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:55.362341  1717 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.359076  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:55.363449  1638 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:55.360330  1640 raft_consensus.cc:2393] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 11: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:55.367792  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.369261  1640 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 12:59:55.357182  5562 consensus_queue.cc:237] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.370867  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:55.382385  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.383201  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:55.383549  1645 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 7: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:55.383697  1643 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.216531  5581 rpcz_store.cc:276] 0709 12:59:53.513073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.519400 (+  6327us) service_pool.cc:224] Handling call
0709 12:59:53.836372 (+316972us) ts_tablet_manager.cc:934] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
0709 12:59:54.767779 (+931407us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:55.049180 (+281401us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:55.049319 (+   139us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:55.184073 (+134754us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:55.184535 (+   462us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:55.185443 (+   908us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:55.185504 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":7255,"tablet-copy.queue_time_us":239368,"thread_start_us":261848,"threads_started":2}
I20260709 12:59:55.372179  5577 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.374651  1646 raft_consensus.cc:2393] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 9: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:55.368590  1642 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 12:59:55.378345  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.285957  5528 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.355198  5550 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:55.370887  5630 log.cc:927] Time spent T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:59:55.387929  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:55.381815  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:55.398880  1611 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:55.406471  1638 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:55.414090  1639 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:55.414831  1643 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:55.408183  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:55.417018  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:55.400879  5550 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 12:59:55.424536  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.381937  5485 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:59:55.418148  5389 raft_consensus.cc:2764] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:55.422353  5504 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:55.439757  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:55.441289  1713 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.430420  5550 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:55.415236  5608 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 12:59:55.457350  5643 log.cc:927] Time spent T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:59:55.435422  5629 raft_consensus.cc:3055] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:55.458824  5371 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:55.407725  5592 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:59:55.462155  5504 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.463336  5595 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:55.465093  5577 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.512374  5550 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.430183  5581 tablet_copy_client.cc:806] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:55.466701  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:55.514554  5581 tablet_copy_client.cc:670] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:55.515424  5550 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:55.519423  5578 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.520692  1720 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:55.521116  1718 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:55.472625  1713 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:55.480386   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:55.485355  5402 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:55.477165  5629 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:55.526754  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:55.527632  5511 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:55.527545  5629 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.528854  5629 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:55.491015  5528 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.497129  1571 raft_consensus.cc:1240] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:55.498816  1717 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:55.521840  5578 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.538748  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:55.539453  1570 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
W20260709 12:59:55.503693  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 86843.1us
I20260709 12:59:55.543203  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:55.543550  1611 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:55.542852  1536 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:55.511162  5504 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:55.557109  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:55.538551  5511 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:55.561702  1718 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:55.563422  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:55.563977  1720 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:55.554085  5578 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:55.561396  5397 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:55.566766  5578 raft_consensus.cc:697] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:55.566897  5397 raft_consensus.cc:697] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:55.567796  5578 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.569877  5371 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:55.570590  5511 raft_consensus.cc:697] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:55.571363  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:55.572019  5511 consensus_queue.cc:237] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:55.572685  1716 raft_consensus.cc:1240] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:59:55.567904  5397 consensus_queue.cc:237] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.577651  1571 raft_consensus.cc:1240] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:55.579435  5640 consensus_queue.cc:1059] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:55.580364  5640 raft_consensus.cc:3055] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:55.580694  5640 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:55.581547  5640 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:55.554239  5528 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:55.582947  5528 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.583067  5640 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:55.583407  5528 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:55.564805  5465 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.589609  5465 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:55.592301  5465 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.598109  5581 tablet_copy_client.cc:538] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:55.581981  1570 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 12:59:55.617339  1686 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:55.637753  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:55.640487  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 225495us
I20260709 12:59:55.641047  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:55.642437  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:55.642583  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:55.647073  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:55.647308  1715 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:55.647863  5576 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:55.649123  5576 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:55.652866  1714 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:55.654471  1536 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:55.638939  5504 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:55.656366  4651 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:55.657228  5576 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:55.665462  5504 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:55.683199  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:55.659307  5653 consensus_queue.cc:1059] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:59:55.675669  5465 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.665723  5188 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:59:55.678675  4651 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:55.681272  5576 raft_consensus.cc:697] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:55.686688  5504 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:55.701921  1685 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:55.690964  5592 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:55.716125  1567 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:55.717118  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:55.717691  1563 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:55.722980  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.723664  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:55.724388  1643 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 10: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:55.724642  1536 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:55.726919  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:55.727497  1639 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.693555  5608 consensus_queue.cc:1059] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:59:55.708621  5146 consensus_queue.cc:1059] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:59:55.731678  4651 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.706807  5573 consensus_queue.cc:1059] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:59:55.708106  5260 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:55.740463  1644 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:55.692553  5465 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.742086  5456 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:55.742501  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:55.743258  5398 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:55.743675  5465 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.746517  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:55.747368  5577 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:55.747718  5577 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.747977  1720 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 12:59:55.748061  5577 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:59:55.750941  5654 log.cc:927] Time spent T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:59:55.753898  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:55.755861  1536 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:55.760069  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:55.761873  1638 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:55.762372  1639 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 12:59:55.762622  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.763300  1643 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 10: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:55.767259  1646 raft_consensus.cc:2393] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 9: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:55.759456  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:55.768822  1644 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 7: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:55.769996  5389 raft_consensus.cc:3055] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:55.770466  5389 raft_consensus.cc:740] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:59:55.774350  5651 log.cc:927] Time spent T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:59:55.775553  5576 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.778129  5575 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:55.709939  5562 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:55.778990  5562 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.781018  5562 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.722389  5629 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.723074  5371 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.781785  5629 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:55.782464  5371 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.783782  5629 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:55.742513  5456 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.784442  5371 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.784689  5456 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:55.786320  5647 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:59:55.788959  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:55.790812  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:55.791370  2437 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 12:59:55.794804  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:55.794966  1536 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:55.795845  5633 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:55.796213  5633 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.796522  5633 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:55.797243  5397 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:55.797735  5397 raft_consensus.cc:697] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:55.793313  1563 raft_consensus.cc:2410] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:59:55.798202  5455 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:55.798560  5397 consensus_queue.cc:237] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.799312  5455 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:55.796468  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:55.819131  5649 raft_consensus.cc:3055] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:55.819754  5649 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:55.820791  5649 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.825455  1563 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:55.813762  5581 tablet_bootstrap.cc:492] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 12:59:55.833256  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:55.831334  1720 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:59:55.834645  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:55.835979  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:55.836615  1717 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:55.807173  5146 consensus_queue.cc:1243] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 338d817f94ee4c1bad162e9a5860b68a log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:59:55.842139  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.842298  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 134374us
W20260709 12:59:55.840865  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 71347.1us
I20260709 12:59:55.843248  1685 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:55.844710  1685 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:55.847846  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:55.853667  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.854527  1685 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:55.849515  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.856437  1644 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:55.850457  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:55.851413  1643 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:59:55.773991  5528 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.801371  5504 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.833552  5398 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:55.836395  5188 raft_consensus.cc:3055] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:55.888695  1611 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:55.871479  5508 raft_consensus.cc:2764] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:55.871946  5476 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:55.892692  1640 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:55.897281  1643 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:59:55.897215  1536 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:55.897971  1643 pending_rounds.cc:85] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 5
I20260709 12:59:55.898342  1643 pending_rounds.cc:107] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:59:55.898583  1643 raft_consensus.cc:2889] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:55.874686  5629 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:55.879144  5129 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:55.842654  5565 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:59:55.879299  5188 raft_consensus.cc:740] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:55.873284  5146 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:59:55.871484  5575 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:59:55.899061  5476 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.920626  1717 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:59:55.903775  5592 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:55.927696  5476 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:55.933857  5368 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:55.960912  5260 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:55.962615  5389 consensus_queue.cc:260] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.963630  5661 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.964335  5661 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.940778  5592 raft_consensus.cc:697] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 12:59:55.985088  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 87964.8us
I20260709 12:59:55.986552  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:55.964046  5389 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.989254  5567 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:56.002815  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:56.002435  5592 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.009466  5577 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:55.991443  5562 consensus_queue.cc:1059] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:59:56.011175  5562 raft_consensus.cc:3055] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:56.011546  5562 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:56.011667  5577 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:56.012496  5562 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.013664  5562 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:56.016165  5649 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:56.015959  5456 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.020323  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:56.020776  1638 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:56.027302  1638 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 12:59:56.028293  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:56.029027  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:56.030539  5504 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:56.031348  5633 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:56.033345  5633 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:56.036177  1715 raft_consensus.cc:1275] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:56.036760  5528 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:55.993903  5455 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:59:55.958578  5188 consensus_queue.cc:260] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.049926  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:56.050559  2437 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:56.050783  5188 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:56.061524  2437 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 12:59:56.068190  5661 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:56.069010  5567 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:56.069535  5567 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:56.070418  5567 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:56.075567  5664 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:59:56.080230  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:56.087869  5368 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:56.088446  5368 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:56.091331  1713 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:56.093595  5595 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:56.114671  5456 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:56.115679  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:56.116405  1570 raft_consensus.cc:2368] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12.
I20260709 12:59:56.116825  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:56.118498  5629 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:56.118988  5629 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:56.119859  5629 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:56.140777  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:56.141633  1718 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:56.157183  1686 leader_election.cc:400] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12.
I20260709 12:59:56.157595  1686 leader_election.cc:403] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:59:56.162565  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 115530us
I20260709 12:59:56.173571  1466 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 112) took 6573 ms. Trace:
I20260709 12:59:56.180334  1718 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 12:59:56.185096  1646 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:56.186407  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:56.187091  1644 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:56.191465  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:56.192070  1563 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:59:56.200063  1611 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:56.203629  1467 catalog_manager.cc:5697] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 8 to 11, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.205042  1713 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:56.205281  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:56.206712  1715 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:59:56.174026  1466 rpcz_store.cc:276] 0709 12:59:49.581798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.632674 (+ 50876us) service_pool.cc:224] Handling call
0709 12:59:56.155181 (+6522507us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:55.044194 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:55.044749 (+   555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:55.044779 (+    30us) write_op.cc:435] Acquired schema lock
0709 12:59:55.044796 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:55.045818 (+  1022us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:55.045898 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:55.045926 (+    28us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:59:55.082334 (+ 36408us) tablet.cc:701] Row locks acquired
0709 12:59:55.082353 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:59:55.082701 (+   348us) write_op.cc:270] Start()
0709 12:59:55.089417 (+  6716us) write_op.cc:276] Timestamp: P: 1783601995082656 usec, L: 0
0709 12:59:55.091395 (+  1978us) op_driver.cc:348] REPLICATION: starting
0709 12:59:55.103356 (+ 11961us) log.cc:844] Serialized 4430 byte log entry
0709 12:59:55.162429 (+ 59073us) op_driver.cc:464] REPLICATION: finished
0709 12:59:55.224010 (+ 61581us) write_op.cc:301] APPLY: starting
0709 12:59:55.250790 (+ 26780us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:55.597849 (+347059us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:55.637849 (+ 40000us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:55.948242 (+310393us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:55.976446 (+ 28204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:59:55.976488 (+    42us) write_op.cc:312] APPLY: finished
0709 12:59:55.976844 (+   356us) log.cc:844] Serialized 105 byte log entry
0709 12:59:55.977021 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:55.977181 (+   160us) write_op.cc:454] Released schema lock
0709 12:59:55.977229 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:55.977627 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:55.977660 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2162558,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":61327,"apply.run_cpu_time_us":23522,"apply.run_wall_time_us":753593,"cfile_cache_hit":42,"cfile_cache_hit_bytes":43911,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":2,"lbm_read_time_us":48625,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":9,"num_ops":11,"prepare.queue_time_us":127398,"prepare.run_cpu_time_us":4639,"prepare.run_wall_time_us":59480,"replication_time_us":70875,"thread_start_us":185016,"threads_started":2}]]}
I20260709 12:59:56.211725  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:56.211979  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:56.212504  1639 raft_consensus.cc:2410] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:59:56.199452  5660 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:56.222492  1563 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 12:59:56.187214  5397 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:59:56.230768  5578 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:59:56.247500  5670 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:56.230597  5476 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.251017  5476 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:56.223424  5582 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:56.275734  5582 raft_consensus.cc:697] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:56.276269  1640 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:59:56.276747  1640 pending_rounds.cc:85] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 5
I20260709 12:59:56.277146  1640 pending_rounds.cc:107] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:59:56.276657  5582 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.277446  1640 raft_consensus.cc:2889] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:56.279095  5562 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:56.279765  5562 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.258858  1644 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 12:59:56.228672  5465 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:59:56.272279  5368 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:56.273949  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:56.289062  2440 raft_consensus.cc:2368] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16.
I20260709 12:59:56.291584  1537 leader_election.cc:400] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16.
I20260709 12:59:56.292030  1537 leader_election.cc:403] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:56.205525  1467 catalog_manager.cc:5697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.295369  1467 catalog_manager.cc:5697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.296952  1467 catalog_manager.cc:5697] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 8, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:56.298103  1467 catalog_manager.cc:5697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 9, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.299425  1467 catalog_manager.cc:5697] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.300815  1467 catalog_manager.cc:5697] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 8, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.301728  1467 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 6 to 8, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.303112  1467 catalog_manager.cc:5697] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 7, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.305439  1467 catalog_manager.cc:5697] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:56.287501  5562 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:56.286033  5660 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12.
W20260709 12:59:56.308813  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 86557.9us
I20260709 12:59:56.295275  5368 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16.
I20260709 12:59:56.318786  1536 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:56.320971  1644 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:56.314860  1467 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.316841  1638 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:56.324591  1467 catalog_manager.cc:5697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 4 to 5, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 5 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.326903  1467 catalog_manager.cc:5697] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.328570  1467 catalog_manager.cc:5697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.329527  1467 catalog_manager.cc:5697] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 9 to 10, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.331524  1685 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:56.331765  1467 catalog_manager.cc:5697] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.333099  1467 catalog_manager.cc:5697] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 8 to 10, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.340992  1716 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 12:59:56.346840  5508 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:56.348093  5508 raft_consensus.cc:3055] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:56.348512  5508 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:56.325322  5577 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:56.357029  1563 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:56.336731  1467 catalog_manager.cc:5697] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 8 to 11, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:56.353907  5266 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:56.364477  1467 catalog_manager.cc:5697] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 8 to 11, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.328249  5227 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:59:56.349519  5508 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.367012  5577 raft_consensus.cc:697] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:56.383656  5577 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.367270  5678 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.389122  5678 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.379971  5260 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:56.390753  5260 consensus_queue.cc:1243] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Peer 338d817f94ee4c1bad162e9a5860b68a log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:56.391635  5678 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:56.410944  5508 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:56.423007  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:56.423715  1720 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 12:59:56.436439  1611 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:56.443598  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:56.444415  1717 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:56.447968  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:56.449949  1714 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:56.450968  4651 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.451275  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:56.451470  4651 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.453493  4651 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:56.454005  5188 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:56.454437  5188 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.454773  5188 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:56.460706  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:56.461447  1564 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:56.463054  1686 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:56.463836  5261 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:56.464282  5261 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.464624  5261 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:56.474189  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:56.480296  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:56.480966  1643 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:56.489656  1717 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 12:59:56.503067  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:56.504709  1639 raft_consensus.cc:1275] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:56.507455  1646 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:56.509507  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:56.510342  1643 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:56.540601  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 12:59:56.521073  5581 log.cc:927] Time spent T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
I20260709 12:59:56.550762  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 12:59:56.558161  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 52104.7us
I20260709 12:59:56.563828  1564 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:59:56.564422  1564 pending_rounds.cc:85] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 5
I20260709 12:59:56.569737  1645 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:56.516170  5562 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:59:56.564716  1564 pending_rounds.cc:107] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.6
I20260709 12:59:56.581352  1564 raft_consensus.cc:2917] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Aborting config change with OpId 8.6: Aborted: Op aborted by new leader
I20260709 12:59:56.581933  1564 raft_consensus.cc:2889] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:56.560247  5398 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:56.576787  1643 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
W20260709 12:59:56.585415  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 150432us
I20260709 12:59:56.541442  5575 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:59:56.587378  1717 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:56.586578  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38386 (request call id 12) took 6304 ms. Trace:
I20260709 12:59:56.571734  5576 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:59:56.584324  5371 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:56.590157  1564 rpcz_store.cc:276] 0709 12:59:50.278497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.278814 (+   317us) service_pool.cc:224] Handling call
0709 12:59:50.639636 (+360822us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b2c00000658. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cbb91a11 00007f18cbba0a0a 00007f18cbba0693 00007f18cbba0631 00007f18cd2d3902 00007f18cd2d36dd 00007f18cd29ef3f 00007f18cd29e6b3 00007f18d225ed29 00007f18cb7dd1d4 00007f18cb7dd162
0709 12:59:52.509227 (+1869591us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5800602cd0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd1f40aa 00007f18cd276447 00007f18cd29370a 00007f18cd29476a 00007f18cd29391b 00007f18cd29f03c 00007f18cd29e6b3 00007f18d225ed29 00007f18cb7dd1d4 00007f18cb7dd162
0709 12:59:52.608904 (+ 99677us) log.cc:844] Serialized 506 byte log entry
0709 12:59:52.849085 (+240181us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b1800263bc0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca125c0a 00007f18d3865219 00007f18ca1ada40 00007f18ca1a84e4 00007f18ca1a8455 00007f18cd1f1b0b 00007f18cd276b63 00007f18cd29e752 00007f18d225ed29
0709 12:59:53.363960 (+514875us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b1800263bc0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1ab3f3 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd 000000000038f354 000000000038f199 00007f18ca18e83a
0709 12:59:53.540028 (+176068us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b1800263bc0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1ab522 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd 000000000038f354 000000000038f199 00007f18ca18e83a
0709 12:59:53.557728 (+ 17700us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b1800263bc0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1ab3f3 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd 000000000038f354 000000000038f199 00007f18ca18e83a
0709 12:59:56.582430 (+3024702us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33837,"raft.queue_time_us":109494,"raft.run_cpu_time_us":1461,"raft.run_wall_time_us":95356,"spinlock_wait_cycles":3365462912,"thread_start_us":117488,"threads_started":1,"wal-append.queue_time_us":212489,"wal-append.run_cpu_time_us":1759,"wal-append.run_wall_time_us":1019738}
I20260709 12:59:56.607792   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:56.613729  5261 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.616058  5261 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:56.618752  5609 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:59:56.608876  5581 tablet_bootstrap.cc:492] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:59:56.621026  1716 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:56.625263  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 12:59:56.647908  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet a2e78d031c384616a01064318cb24f28: Aborted: Op aborted by new leader
I20260709 12:59:56.640148  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:56.651986  1564 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:56.652736  1638 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:56.654857  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet c55d053b55024621933828292867f0e6: Illegal state: Replica 66344ad7cd844754b2c81cc689a709b0 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:56.662846  5581 tablet_bootstrap.cc:492] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
W20260709 12:59:56.663717  5672 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:56.617659  5188 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.668668  1641 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:59:56.671288  5649 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:56.663709  5581 ts_tablet_manager.cc:1403] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.850s	user 0.024s	sys 0.028s
W20260709 12:59:56.686679  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 83063.4us
I20260709 12:59:56.688007  2440 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:56.693122  1638 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
W20260709 12:59:56.702327  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 61631.5us
I20260709 12:59:56.704284  5188 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:56.694314  5465 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:59:56.707978  5371 raft_consensus.cc:697] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:56.696542  5260 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:59:56.701092  5456 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:59:56.721416  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:56.728267  1568 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:56.708886  5371 consensus_queue.cc:237] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.770679  1685 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:56.774848  1564 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
W20260709 12:59:56.771014  5695 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:59:56.759011  5266 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:59:56.790836  1714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:56.791666  1714 raft_consensus.cc:606] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:56.792093  1714 raft_consensus.cc:614] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:56.781980  5660 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:56.787252  5512 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:56.807207  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 118530us
I20260709 12:59:56.816053  1714 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:59:56.817369  1714 pending_rounds.cc:85] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 6
I20260709 12:59:56.818269  1714 pending_rounds.cc:107] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:59:56.819159  1714 raft_consensus.cc:2889] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:56.823988  5581 raft_consensus.cc:359] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 9 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.814548  5260 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:56.828307  5260 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.830492  5260 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:56.832156  1646 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:56.833346  5653 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:56.816551  5456 consensus_queue.cc:1059] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:59:56.836040  5456 raft_consensus.cc:3055] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:56.836369  5456 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:56.825910  5581 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 12:59:56.836967  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:56.837167  5456 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.837724  1564 raft_consensus.cc:2393] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:56.837317  5581 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:56.840322  5581 ts_tablet_manager.cc:1434] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.163s	user 0.006s	sys 0.002s
I20260709 12:59:56.807367  5660 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:56.841346  5660 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.842620  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:56.843358  1647 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:56.844657  1685 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:56.845069  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:56.845655  1718 raft_consensus.cc:606] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:56.845487  5266 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:56.812788  5512 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:56.854703  5456 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:56.864432  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:56.866154  1719 raft_consensus.cc:606] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:56.866556  1719 raft_consensus.cc:614] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:56.890693  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:56.891360  1719 raft_consensus.cc:606] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:56.852845  5266 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:56.891736  1719 raft_consensus.cc:614] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:56.922655  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 67704us
I20260709 12:59:56.872131  5696 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:59:56.928273  5398 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:56.864399  5512 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:56.911558  5266 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:56.930266  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 55077.9us
I20260709 12:59:56.933223  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:56.938990  1719 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:59:56.942606  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:56.944136  1566 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:59:56.944484  1566 pending_rounds.cc:85] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 5
I20260709 12:59:56.944684  1566 pending_rounds.cc:107] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:59:56.944983  1566 raft_consensus.cc:2889] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:56.945597  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:56.975502  1718 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:56.992249  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 12:59:56.993017  1717 raft_consensus.cc:606] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:56.968173  5608 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:59:56.980062  5398 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:59:57.031984  5371 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:59:57.042970  4651 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 12:59:57.065884  5704 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 12:59:57.076027  5719 log.cc:927] Time spent T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:59:57.081110  5706 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:59:57.114758   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:57.121719  1570 raft_consensus.cc:2410] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:59:57.011085  1581 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-a2e78d031c384616a01064318cb24f28 received from {username='slave'} at 127.0.0.1:38394
I20260709 12:59:57.128190  1581 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-a2e78d031c384616a01064318cb24f28 on tablet a2e78d031c384616a01064318cb24f28 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:57.170665  1641 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:57.073233  4651 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:57.172130  1612 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:57.175666  5146 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:57.176918  5146 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.197549  5550 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:57.198529  5550 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.199970  5146 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:57.201422  5550 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 12:59:57.203773  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 188702us
I20260709 12:59:57.218501  5528 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:57.221449  5725 log.cc:927] Time spent T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:59:57.230283  4651 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:57.244712  4651 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.245486  4651 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.248219  4651 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:57.217964  5510 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:59:57.268471  5638 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.269189  5638 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:57.269775  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:57.270860  1564 raft_consensus.cc:2393] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:57.277215  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:57.265162  5266 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.278353  1570 raft_consensus.cc:2393] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 10: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 12:59:57.281134  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 109389us
I20260709 12:59:57.285293  5266 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:57.293432  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:57.296487  1721 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 12:59:57.299669  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 12:59:57.300416  2436 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 12:59:57.295606   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:57.297590  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:57.308944  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:57.310096  1569 raft_consensus.cc:2393] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:57.315670  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:57.316673  1721 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 12:59:57.319932  5638 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:57.320634  1570 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 12:59:57.333952  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:57.338733  5670 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.339488  5670 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.341992  5670 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:57.344564  2405 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:57.324261  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:57.348719  5551 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:57.348841  1611 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:57.349181  5551 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.349633  5551 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:57.349866  5528 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:57.350382  5528 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 12:59:57.350797  5528 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:57.354607  5729 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:57.356133  5436 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:57.364651  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:57.368870  5726 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:57.375871  1569 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:57.375908  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:57.376911  1646 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:57.380141  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:57.380987  1564 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 13: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:57.369396  5726 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.381489  5726 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:57.365015  5729 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 12:59:57.386423  5729 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:57.395202  5726 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.398682  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:57.400766  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:57.401510  1564 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:57.408051  1643 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:57.389510  5551 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:57.410673  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:57.402438  5266 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:59:57.421469  5726 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:57.430399  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:57.431536  5551 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:57.436669  5729 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:57.416338  5528 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.445215  1647 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 12:59:57.451274  5397 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:57.453504  5528 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:57.454775  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:57.455582  1718 raft_consensus.cc:2368] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14.
I20260709 12:59:57.456329  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:57.456995  1570 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 12:59:57.457103  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:57.457698  1566 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:57.460546  1611 leader_election.cc:400] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14.
I20260709 12:59:57.460898  1611 leader_election.cc:403] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:59:57.461671  1716 raft_consensus.cc:1275] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:57.461767  1646 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 12:59:57.462127  5528 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:57.462074  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:57.470223  1719 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:57.471968  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:57.479499  1719 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 12:59:57.479842  1640 raft_consensus.cc:1275] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:57.481280  2405 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 12:59:57.482218  5551 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:57.483493  5729 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 12:59:57.483660  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 12:59:57.484304  5551 raft_consensus.cc:697] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 12:59:57.485852  5551 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 12:59:57.491724  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:57.501449  1564 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 12:59:57.506650  1566 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 12:59:57.509723  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:57.523772  5261 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:57.524289  5261 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:57.525241  5261 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.527837  1685 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:57.529414  5504 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:57.529872  5504 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 12:59:57.530215  5726 raft_consensus.cc:993] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 12:59:57.530290  5504 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:57.530856  5726 raft_consensus.cc:1081] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 12:59:57.538968  5565 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:57.539749  5260 raft_consensus.cc:993] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 12:59:57.540396  5669 raft_consensus.cc:1081] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 12:59:57.540974  1685 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 12:59:57.542872  5669 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:57.543318  5669 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:57.544276  5669 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.548834  5504 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.550393  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:57.551116  5504 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:57.552986  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:57.553789  1566 raft_consensus.cc:2393] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 12:59:57.579200  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:57.575495  5455 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.575356  1640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 12:59:57.589402  1640 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:57.589792  1640 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:57.568915  1647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 12:59:57.590649  1647 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:57.591120  1647 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:57.592458  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:57.603323  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:57.604074  1566 raft_consensus.cc:2368] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14.
I20260709 12:59:57.608512  5562 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:57.612462  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 12:59:57.617347  4651 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:59:57.614876  5528 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14.
I20260709 12:59:57.596020  5455 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.617102  5371 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:59:57.639266  5368 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:59:57.647473  5455 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:57.654633  1612 leader_election.cc:400] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14.
I20260709 12:59:57.664161  1647 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.667132  1642 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:57.680977  1638 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 12:59:57.681699  1641 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:57.678367  1640 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.687325  1647 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:57.688649  1640 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:57.687071  1685 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 12:59:57.705202  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 87409.9us
I20260709 12:59:57.713282  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:57.723979  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:57.710402  5729 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:57.726485  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:57.728777  1717 raft_consensus.cc:3055] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:57.729166  1717 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:57.730446  1569 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:57.731499  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:57.736614  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:57.742023  1572 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:57.740703  5729 raft_consensus.cc:697] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:57.751088  5729 consensus_queue.cc:237] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.750941  1569 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 12:59:57.753602  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:57.754292  1642 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:57.767379  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:57.768468  5436 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:57.768980  5436 raft_consensus.cc:697] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:57.772759  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:57.772681  1717 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.773696  5697 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:57.774078  5697 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.774447  5697 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:57.774101  1717 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:57.786995  5735 log.cc:927] Time spent T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.177s	user 0.004s	sys 0.000s
I20260709 12:59:57.790119  1717 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 12:59:57.790961  5697 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.796283  5697 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:57.769924  5436 consensus_queue.cc:237] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.806531  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:57.822444  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:57.823239  1641 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:57.833225  1641 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 12:59:57.847813  1572 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 12:59:57.849722  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:57.730217  5669 consensus_queue.cc:1059] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 12:59:57.867729  1716 raft_consensus.cc:3055] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:57.868132  1716 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:57.868981  1716 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.875223  1612 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:57.879649  1716 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:57.874476  1467 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58250 (request call id 198) took 3073 ms. Trace:
I20260709 12:59:57.872915  5697 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:57.884579  1467 rpcz_store.cc:276] 0709 12:59:54.769749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.770067 (+   318us) service_pool.cc:224] Handling call
0709 12:59:57.843011 (+3072944us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:56.496539 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:56.497298 (+   759us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:56.497343 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:59:56.497389 (+    46us) tablet.cc:662] Decoding operations
0709 12:59:56.499612 (+  2223us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:56.499721 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:56.499763 (+    42us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:59:56.527941 (+ 28178us) tablet.cc:701] Row locks acquired
0709 12:59:56.527958 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:56.528122 (+   164us) write_op.cc:270] Start()
0709 12:59:56.528253 (+   131us) write_op.cc:276] Timestamp: P: 1783601996528072 usec, L: 0
0709 12:59:56.528272 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:59:56.532386 (+  4114us) log.cc:844] Serialized 7517 byte log entry
0709 12:59:56.832952 (+300566us) op_driver.cc:464] REPLICATION: finished
0709 12:59:56.904361 (+ 71409us) write_op.cc:301] APPLY: starting
0709 12:59:56.904469 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:57.280059 (+375590us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:57.287644 (+  7585us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:57.436150 (+148506us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:57.436517 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 12:59:57.436594 (+    77us) write_op.cc:312] APPLY: finished
0709 12:59:57.437228 (+   634us) log.cc:844] Serialized 172 byte log entry
0709 12:59:57.469822 (+ 32594us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:57.491847 (+ 22025us) write_op.cc:454] Released schema lock
0709 12:59:57.491924 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:57.492503 (+   579us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:57.492537 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24316,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":71121,"apply.run_cpu_time_us":31568,"apply.run_wall_time_us":588057,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83585,"num_ops":19,"prepare.queue_time_us":86933,"prepare.run_cpu_time_us":6363,"prepare.run_wall_time_us":36160,"replication_time_us":279434,"thread_start_us":156294,"threads_started":2}]]}
I20260709 12:59:57.903264  1470 catalog_manager.cc:5697] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 6 to 7, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:57.905112  5188 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:57.905735  5188 raft_consensus.cc:697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 12:59:57.906759  5188 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.906937  1470 catalog_manager.cc:5697] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 8 to 9, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:57.911021  1470 catalog_manager.cc:5697] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:57.912709  1470 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 8 to 10, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:57.916114  5697 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:57.917411  5697 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:57.946480  1572 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:58.003278  5475 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:57.938397  1470 catalog_manager.cc:5697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 5 to 6, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.011121  1716 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 12:59:58.023314  1572 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:59:58.006253  5504 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:58.027515  4651 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:58.035808  5577 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:58.019258  5669 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:59:58.036588  5577 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:58.039354  1470 catalog_manager.cc:5697] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.042109  5455 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.051260  1470 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 7 to 10, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 10 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:58.062144  5455 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:58.071346  5577 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:58.071772  5455 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:58.048249  5504 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:58.075173  5504 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:58.108726  1721 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:58.104331  1470 catalog_manager.cc:5697] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 7 to 10, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:58.114382  5469 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:59:58.126380  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 12:59:58.178635  1564 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 12:59:58.137063  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:58.141851  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 12:59:58.155026  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:58.180701  1638 raft_consensus.cc:2410] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:59:58.156260  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:58.181522  1646 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 12:59:58.158645  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 12:59:58.160013  1639 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:58.163677  1647 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:59:58.171268  1566 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
W20260709 12:59:58.177161  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 65341.8us
I20260709 12:59:58.179780  1715 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 12:59:58.190807  1686 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:58.196491  5504 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:58.196969  5504 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 12:59:58.196635  5257 consensus_queue.cc:1059] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:58.197431  5504 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:58.197674  5257 consensus_queue.cc:1243] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer 338d817f94ee4c1bad162e9a5860b68a log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:58.198318  5257 raft_consensus.cc:3055] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:58.198752  5257 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 12:59:58.199790  5257 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:58.201180  5257 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:58.188849  5669 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:59:58.216197  1641 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 8: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 12:59:58.239394  1470 catalog_manager.cc:5697] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:58.241014  1470 catalog_manager.cc:5697] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 8 to 9, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:58.259526  1536 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 12:59:58.245771  5504 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:58.273931  5702 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:58.284372  5702 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.284736  5702 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.292789  1641 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:58.302019  5504 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:58.330837   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:58.347198  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:58.348011  1639 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 8: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 12:59:58.366255  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 95823us
I20260709 12:59:58.374104  1569 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:58.358271  5669 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:59:58.396343  1566 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:58.401786  1536 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 12:59:58.406090  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 12:59:58.399926  5749 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:59:58.414551  4651 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:58.415412  1717 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:58.418836  5757 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:58.403333  5702 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 12:59:58.421615  5702 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:58.426271  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 12:59:58.426868  1720 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.430636  1568 raft_consensus.cc:2368] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9.
I20260709 12:59:58.442837  5436 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:58.454516  1686 leader_election.cc:400] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9.
I20260709 12:59:58.454856  1686 leader_election.cc:403] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:59:58.457262  1720 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 12:59:58.460934  1646 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:58.469211  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 12:59:58.469861  1646 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.465917  5726 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9.
I20260709 12:59:58.497733  1536 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 12:59:58.557417  1646 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
W20260709 12:59:58.570552  5756 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 12:59:58.577682  5763 log.cc:927] Time spent T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.003s
W20260709 12:59:58.588521  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 90891.1us
I20260709 12:59:58.588696  5398 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:58.604959  5398 raft_consensus.cc:697] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 12:59:58.606019  5398 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 12:59:58.610981  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 72914.9us
I20260709 12:59:58.618559  1568 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:58.626941  1721 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:59:58.627418  1721 pending_rounds.cc:85] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 7
I20260709 12:59:58.627635  1721 pending_rounds.cc:107] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:59:58.635706  1721 raft_consensus.cc:2889] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:58.628260  5397 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:59:58.662596  1718 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:58.711766  5743 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:58.764015  5188 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:59:58.772521  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 67945.9us
I20260709 12:59:58.808354  5758 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 12:59:58.815593  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet 61b3acddedfe43b6b7d1a8f74c050925: Illegal state: Replica a4be9cc90aca4dd4ad7db103062a7208 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:58.822154  1641 consensus_queue.cc:237] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
W20260709 12:59:58.868693  5776 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:59:58.936690  1721 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:59:58.938139  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 48294.9us
I20260709 12:59:58.947755  1566 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:58.953804  5402 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 12:59:58.985018  1612 consensus_peers.cc:597] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95165be2dd8c456fb98e088711372ce3. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:58.996326  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 47836us
I20260709 12:59:59.006506  5751 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:59.032295  1466 catalog_manager.cc:5697] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 5 to 7, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.034104  1466 catalog_manager.cc:5697] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 5 to 7, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.041582  5188 raft_consensus.cc:2955] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:59.045099  1641 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:59:59.049340  5398 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:59.057204  1719 raft_consensus.cc:2955] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:59.087503  1466 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 113) took 2757 ms. Trace:
I20260709 12:59:59.087954  1466 rpcz_store.cc:276] 0709 12:59:56.330380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.336092 (+  5712us) service_pool.cc:224] Handling call
0709 12:59:59.087429 (+2751337us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:59.040296 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:59.040798 (+   502us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:59.040829 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:59:59.040844 (+    15us) tablet.cc:662] Decoding operations
0709 12:59:59.041267 (+   423us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:59.041325 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:59.041354 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:59.041699 (+   345us) tablet.cc:701] Row locks acquired
0709 12:59:59.041715 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:59:59.041875 (+   160us) write_op.cc:270] Start()
0709 12:59:59.041992 (+   117us) write_op.cc:276] Timestamp: P: 1783601999041818 usec, L: 0
0709 12:59:59.042011 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:59:59.043070 (+  1059us) log.cc:844] Serialized 915 byte log entry
0709 12:59:59.054235 (+ 11165us) op_driver.cc:464] REPLICATION: finished
0709 12:59:59.054726 (+   491us) write_op.cc:301] APPLY: starting
0709 12:59:59.054803 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:59.056055 (+  1252us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:59.056151 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:59.057317 (+  1166us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:59.057476 (+   159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:59:59.057524 (+    48us) write_op.cc:312] APPLY: finished
0709 12:59:59.057705 (+   181us) log.cc:844] Serialized 33 byte log entry
0709 12:59:59.057862 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:59.057946 (+    84us) write_op.cc:454] Released schema lock
0709 12:59:59.057984 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:59.060685 (+  2701us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:59.060715 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28017,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":279,"apply.run_cpu_time_us":3611,"apply.run_wall_time_us":5901,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":2678,"prepare.run_cpu_time_us":2731,"prepare.run_wall_time_us":3038,"replication_time_us":9035}]]}
I20260709 12:59:59.101049  1566 raft_consensus.cc:2955] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:59.103780  1717 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:59.119240  1716 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:59:59.121413  5398 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:59.149858  1641 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:59:59.151656  5770 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:59.159826  1467 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.161593  1467 catalog_manager.cc:5697] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 8 to 10, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:59.162993  1467 catalog_manager.cc:5697] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.164582  1467 catalog_manager.cc:5697] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 8, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.166846  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58260 (request call id 214) took 3234 ms. Trace:
I20260709 12:59:59.173251  1566 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:59:59.174952  1686 consensus_peers.cc:597] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6e5957876f24a868f3f2c49fcf5e759. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:59.175935  5770 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:59.184139  1467 catalog_manager.cc:5697] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:59.185986  1467 catalog_manager.cc:5697] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 14 to 16, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:59.187773  1467 catalog_manager.cc:5697] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 10 to 11, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:59.188961  1467 catalog_manager.cc:5697] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 6 to 9, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.190595  1467 catalog_manager.cc:5697] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 8 to 9, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.167240  1470 rpcz_store.cc:276] 0709 12:59:55.932236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.932396 (+   160us) service_pool.cc:224] Handling call
0709 12:59:59.166792 (+3234396us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:58.435900 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:58.436551 (+   651us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:58.436617 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:59:58.436635 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:58.437703 (+  1068us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:58.437788 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:58.437815 (+    27us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:59:58.520917 (+ 83102us) tablet.cc:701] Row locks acquired
0709 12:59:58.520965 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:59:58.521122 (+   157us) write_op.cc:270] Start()
0709 12:59:58.521281 (+   159us) write_op.cc:276] Timestamp: P: 1783601998521060 usec, L: 0
0709 12:59:58.521314 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:59:58.521987 (+   673us) log.cc:844] Serialized 4024 byte log entry
0709 12:59:58.869733 (+347746us) op_driver.cc:464] REPLICATION: finished
0709 12:59:58.962357 (+ 92624us) write_op.cc:301] APPLY: starting
0709 12:59:58.962455 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:58.975714 (+ 13259us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:58.975804 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:58.994895 (+ 19091us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:58.995100 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:59:58.995141 (+    41us) write_op.cc:312] APPLY: finished
0709 12:59:58.995388 (+   247us) log.cc:844] Serialized 97 byte log entry
0709 12:59:59.002921 (+  7533us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:59.003042 (+   121us) write_op.cc:454] Released schema lock
0709 12:59:59.003092 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:59.003426 (+   334us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:59.003456 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":104,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":92305,"apply.run_cpu_time_us":13634,"apply.run_wall_time_us":41052,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45947,"num_ops":10,"prepare.queue_time_us":130326,"prepare.run_cpu_time_us":51333,"prepare.run_wall_time_us":255476,"raft.queue_time_us":140227,"raft.run_cpu_time_us":15514,"raft.run_wall_time_us":103492,"replication_time_us":342677,"thread_start_us":388591,"threads_started":4,"wal-append.queue_time_us":192106}]]}
I20260709 12:59:59.192660  1467 catalog_manager.cc:5697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.198390  1467 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 8 to 10, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 10 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.201494  1467 catalog_manager.cc:5697] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 11, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 11 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.203548  1467 catalog_manager.cc:5697] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.205165  1467 catalog_manager.cc:5697] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 5 to 8, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.206652  1467 catalog_manager.cc:5697] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 9 to 12, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:59.210431  1467 catalog_manager.cc:5697] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 6 to 9, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.212496  1467 catalog_manager.cc:5697] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 9 to 10, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:59.213774  1467 catalog_manager.cc:5697] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:59.215005  1467 catalog_manager.cc:5697] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 12:59:59.216312  1467 catalog_manager.cc:5697] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 8, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:59.227288  5770 raft_consensus.cc:2955] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:59.239707  1572 raft_consensus.cc:2955] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:59.244300  1641 raft_consensus.cc:2955] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:59.274453  1644 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 12:59:59.320627  1717 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:59.326318  5751 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:59.335990  1572 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:59.345084  5751 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:59.349682  5510 raft_consensus.cc:2955] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 12:59:59.351208  1612 consensus_peers.cc:597] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71dad2e408414d2fa4f055c6eccf5b92. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:59.381196  1566 raft_consensus.cc:2955] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:59.385640  1717 raft_consensus.cc:2955] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:59.390693  1467 catalog_manager.cc:5697] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 5, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 7 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:59.393610  1467 catalog_manager.cc:5697] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 6, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 9 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:59.395879  1467 catalog_manager.cc:5697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 8 to 9, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 12:59:59.486867  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58252 (request call id 220) took 3699 ms. Trace:
I20260709 12:59:59.487522  1469 rpcz_store.cc:276] 0709 12:59:55.787642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.787793 (+   151us) service_pool.cc:224] Handling call
0709 12:59:59.486691 (+3698898us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20615,"reported_tablets":40}
I20260709 12:59:59.519097  1467 catalog_manager.cc:5697] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 12:59:59.670384  5796 ts_tablet_manager.cc:933] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:59.674482  5795 ts_tablet_manager.cc:933] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 12:59:59.697172  5796 tablet_copy_client.cc:323] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:45463
I20260709 12:59:59.713413  1657 tablet_copy_service.cc:140] P a4be9cc90aca4dd4ad7db103062a7208: Received BeginTabletCopySession request for tablet 95165be2dd8c456fb98e088711372ce3 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38584)
I20260709 12:59:59.714088  1657 tablet_copy_service.cc:161] P a4be9cc90aca4dd4ad7db103062a7208: Beginning new tablet copy session on tablet 95165be2dd8c456fb98e088711372ce3 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38584: session id = 6f381117554e49bb816791ab0a10f2b8-95165be2dd8c456fb98e088711372ce3
I20260709 12:59:59.723243  1657 tablet_copy_source_session.cc:215] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:59.737401  5796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95165be2dd8c456fb98e088711372ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.745182  5795 tablet_copy_client.cc:323] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 12:59:59.827000   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:59.839810  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet a6e5957876f24a868f3f2c49fcf5e759 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 12:59:59.840477  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet a6e5957876f24a868f3f2c49fcf5e759 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-a6e5957876f24a868f3f2c49fcf5e759
I20260709 12:59:59.856998  1730 tablet_copy_source_session.cc:215] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:59.880834  5803 ts_tablet_manager.cc:933] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 12:59:59.894236  5795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6e5957876f24a868f3f2c49fcf5e759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.904846  5803 tablet_copy_client.cc:323] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:45463
I20260709 12:59:59.910202  1657 tablet_copy_service.cc:140] P a4be9cc90aca4dd4ad7db103062a7208: Received BeginTabletCopySession request for tablet 71dad2e408414d2fa4f055c6eccf5b92 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38584)
I20260709 12:59:59.910789  1657 tablet_copy_service.cc:161] P a4be9cc90aca4dd4ad7db103062a7208: Beginning new tablet copy session on tablet 71dad2e408414d2fa4f055c6eccf5b92 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38584: session id = 6f381117554e49bb816791ab0a10f2b8-71dad2e408414d2fa4f055c6eccf5b92
I20260709 12:59:59.920210  1657 tablet_copy_source_session.cc:215] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:59.943154  5803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71dad2e408414d2fa4f055c6eccf5b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.969307  1566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 12:59:59.970024  1566 raft_consensus.cc:606] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 12:59:59.971042  5796 tablet_copy_client.cc:806] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:59.971668  5796 tablet_copy_client.cc:670] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:00.003018  5796 tablet_copy_client.cc:538] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:00.010283  5803 tablet_copy_client.cc:806] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:00.010913  5803 tablet_copy_client.cc:670] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:00.017565  5795 tablet_copy_client.cc:806] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:00.025988  5795 tablet_copy_client.cc:670] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:00.041659  5803 tablet_copy_client.cc:538] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:00.052239  5795 tablet_copy_client.cc:538] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:00.080783  5803 tablet_bootstrap.cc:492] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:00.082772  5796 tablet_bootstrap.cc:492] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:00.098326  1644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:44428
I20260709 13:00:00.098932  1644 raft_consensus.cc:606] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:00.096120  5795 tablet_bootstrap.cc:492] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:00.116564  1566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:00:00.117161  1566 raft_consensus.cc:606] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:00.127187  1644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:44428
I20260709 13:00:00.128003  1644 raft_consensus.cc:606] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:00.148454   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:00.150236   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:00.192481  5398 raft_consensus.cc:993] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:00.193070  5398 raft_consensus.cc:1081] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Signalling peer 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:00.199007  1718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:00.199589  1718 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:00.199945  1718 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:00.209022  1718 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:00.211719  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:00.212265  1567 raft_consensus.cc:3055] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:00.212558  1567 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:00.213213  1567 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:00.214075  1567 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:00.225344  1718 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:00.230441  1567 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:00.232596  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:00.234452  1638 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:00.241848  1638 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:00.254223  1686 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:00.256419  5808 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:00.256942  5808 raft_consensus.cc:697] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:00.257814  5808 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:00.316443  1467 catalog_manager.cc:5697] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 9 to 10, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:00.348992  5805 raft_consensus.cc:993] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: : Instructing follower 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:00.349763  5805 raft_consensus.cc:1081] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Signalling peer 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:00.355093  1717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:60088
I20260709 13:00:00.356671  1717 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:00.357087  1717 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:00.366528  1717 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:00.369374  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:00.369944  1567 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:00.384840  5796 tablet_bootstrap.cc:492] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:00.386128  1567 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:00.385913  5796 tablet_bootstrap.cc:492] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:00.387739  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:00.388638  5808 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:00.389120  5808 raft_consensus.cc:697] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:00.390571  5796 ts_tablet_manager.cc:1403] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.308s	user 0.019s	sys 0.032s
I20260709 13:00:00.390062  5808 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:00.422535  5796 raft_consensus.cc:359] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:00.423516  5796 raft_consensus.cc:740] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:00.424211  5796 consensus_queue.cc:260] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:00.421802  5795 tablet_bootstrap.cc:492] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:00.426172  5795 tablet_bootstrap.cc:492] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:00.426923  5795 ts_tablet_manager.cc:1403] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.331s	user 0.019s	sys 0.018s
I20260709 13:00:00.429190  1717 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:00.445393  5803 tablet_bootstrap.cc:492] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=2 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:00.446511  5803 tablet_bootstrap.cc:492] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:00.447239  5803 ts_tablet_manager.cc:1403] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.367s	user 0.030s	sys 0.047s
I20260709 13:00:00.461561  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:00.467586  5146 raft_consensus.cc:993] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: : Instructing follower 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:00.468106  5146 raft_consensus.cc:1081] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Signalling peer 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:00.469688  1719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:60088
I20260709 13:00:00.470194  1719 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:00.470571  1719 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:00.471570  5795 raft_consensus.cc:359] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:00.472422  5795 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:00.473091  5795 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:00.480589  1644 raft_consensus.cc:3055] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:00.481017  1644 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:00.482712  5796 ts_tablet_manager.cc:1434] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.000s
I20260709 13:00:00.488798  1644 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:00.490592  1644 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:00.495385  5803 raft_consensus.cc:359] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:00.496305  5803 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:00.500195  1657 tablet_copy_service.cc:342] P a4be9cc90aca4dd4ad7db103062a7208: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-95165be2dd8c456fb98e088711372ce3 received from {username='slave'} at 127.0.0.1:38584
I20260709 13:00:00.500746  1657 tablet_copy_service.cc:434] P a4be9cc90aca4dd4ad7db103062a7208: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-95165be2dd8c456fb98e088711372ce3 on tablet 95165be2dd8c456fb98e088711372ce3 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:00.503159  5795 ts_tablet_manager.cc:1434] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.001s
I20260709 13:00:00.506176  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-a6e5957876f24a868f3f2c49fcf5e759 received from {username='slave'} at 127.0.0.1:54412
I20260709 13:00:00.506664  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-a6e5957876f24a868f3f2c49fcf5e759 on tablet a6e5957876f24a868f3f2c49fcf5e759 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:00.514816  1719 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:00.510406  5803 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:00.533111  5803 ts_tablet_manager.cc:1434] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.003s
I20260709 13:00:00.534535  5758 raft_consensus.cc:993] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:00.535007  5758 raft_consensus.cc:1081] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Signalling peer 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:00.537328  1718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:00.537914  1718 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:00.538290  1718 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.557947  1657 tablet_copy_service.cc:342] P a4be9cc90aca4dd4ad7db103062a7208: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-71dad2e408414d2fa4f055c6eccf5b92 received from {username='slave'} at 127.0.0.1:38584
I20260709 13:00:00.558480  1657 tablet_copy_service.cc:434] P a4be9cc90aca4dd4ad7db103062a7208: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-71dad2e408414d2fa4f055c6eccf5b92 on tablet 71dad2e408414d2fa4f055c6eccf5b92 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:00.560690  1719 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:00.561692  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:00.562312  1572 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:00.564529  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:00.565011  1638 raft_consensus.cc:3055] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:00.565249  1638 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:00.566594  1718 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:00.568513  1718 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:00.569967  1638 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:00.571959  1638 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:00.573120  1644 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:00.574878  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:00.575511  1644 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.584159  1572 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:00.590721  1644 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:00:00.591557  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:00.592226  1567 raft_consensus.cc:3055] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:00.592550  1567 raft_consensus.cc:740] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:00.593353  1685 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:00.597195  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:00.598562  1567 consensus_queue.cc:260] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:00.602324  1638 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:00.603966  1567 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.605401  5770 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:00.624282  1567 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:00:00.600538  5266 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:00.628434  2436 raft_consensus.cc:1217] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 13:00:00.673722  5770 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:00.678093  5770 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:00.660379  5266 raft_consensus.cc:697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:00.683930  5266 consensus_queue.cc:237] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:00.723383  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 66286us
I20260709 13:00:00.726089  2436 raft_consensus.cc:1217] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 13:00:00.728643  1572 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:00.736361  5770 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:00.768854  1467 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 10 to 11, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:00.770546  1467 catalog_manager.cc:5697] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 10 to 11, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:00.798091  2440 raft_consensus.cc:1217] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 13:00:00.846338  1467 catalog_manager.cc:5697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 8 to 9, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:00.910216  1644 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:00.912362  5828 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:00.923751  1641 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:00.925151  5828 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:00.946201  1568 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:00.947692  5828 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:01.122995  5821 raft_consensus.cc:1064] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:01.125910  5821 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 4, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:01.151230   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:01.162165  5146 raft_consensus.cc:1064] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:01.164529  5146 consensus_queue.cc:237] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 3, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:01.198674  1566 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:01.204135  1568 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:01.207646  5770 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:01.202618  5820 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:00:01.255024  1641 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:01.257519  5266 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:01.299746  2440 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:01.307062  1568 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:01.307337  5844 raft_consensus.cc:1064] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:01.310236  5770 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:01.312040  5844 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:01.313391  5770 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:01.336005  1644 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:01.337023  1641 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:01.339560  5821 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:01.343547  5821 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:01.363821  1718 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:01.373437  2440 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:01.375439  1566 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:01.371618  5843 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:00:01.386233  5843 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:01.388397  5843 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:00:01.451318  1717 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:01.475234  2436 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:01.484102  1568 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:01.488020  5844 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:00:01.527629  5146 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 13:00:01.547173  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 57668.2us
W20260709 13:00:01.615264  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 67424.2us
W20260709 13:00:01.685959  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 157049us
W20260709 13:00:01.694442  5850 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:00:01.704430  5828 raft_consensus.cc:2955] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index 6 to 7, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:01.729130  1567 raft_consensus.cc:2955] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 6 to 7, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:01.769258  5844 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:01.772239  5844 raft_consensus.cc:2955] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:01.781179  2440 raft_consensus.cc:2955] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 6 to 7, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:01.798187  1641 raft_consensus.cc:2955] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 6 to 7, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:01.819118  1469 catalog_manager.cc:5697] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 6 to 7, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:01.832685  1566 raft_consensus.cc:2955] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:01.840957  2443 raft_consensus.cc:2955] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:01.865552  1720 raft_consensus.cc:2955] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:01.902585  1467 catalog_manager.cc:5697] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:01.915572  1569 raft_consensus.cc:2955] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:01.939694  2436 raft_consensus.cc:2955] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:01.913158  5866 raft_consensus.cc:2955] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:01.978369  1717 raft_consensus.cc:2955] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:02.123042  1466 catalog_manager.cc:5697] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 5 to 6, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:02.133786  1638 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:02.164243  1720 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:02.165140  2436 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:02.165860  5805 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:02.168905  5805 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:02.177335  5866 raft_consensus.cc:2955] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:02.179222  2436 raft_consensus.cc:2955] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:02.187013  1720 raft_consensus.cc:2955] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:02.224890  1466 catalog_manager.cc:5697] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 10 to 11, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:02.323136  1646 consensus_queue.cc:237] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:02.347601  2443 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:02.349124  5844 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:00:02.352739  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 71dad2e408414d2fa4f055c6eccf5b92 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:02.360886  1720 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:02.367367  1566 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:02.367460  5805 raft_consensus.cc:2955] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:02.368950  5855 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:02.369956  2443 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:02.370154  2436 raft_consensus.cc:2955] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:02.382336  5828 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:00:02.387650  1470 catalog_manager.cc:5697] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 6 to 7, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New cstate: current_term: 7 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:02.403752  1569 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:02.425177  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet 95165be2dd8c456fb98e088711372ce3 with delete_type TABLET_DATA_TOMBSTONED (TS 66344ad7cd844754b2c81cc689a709b0 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:47746
I20260709 13:00:02.423666  5828 raft_consensus.cc:2955] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:02.431382  2436 raft_consensus.cc:2955] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:02.437752  5844 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:02.439967  1572 raft_consensus.cc:2955] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:02.485138  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 95165be2dd8c456fb98e088711372ce3 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:02.512292  5882 tablet_replica.cc:333] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:00:02.513522  5882 raft_consensus.cc:2243] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:02.524734  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6e5957876f24a868f3f2c49fcf5e759 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:00:02.534198  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 70563.1us
I20260709 13:00:02.526584  5882 raft_consensus.cc:2272] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:02.553606  1470 catalog_manager.cc:5697] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 7 to 8, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 9 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:02.569701   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:02.553690  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 77026.3us
I20260709 13:00:02.579617  5882 ts_tablet_manager.cc:1916] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:00:02.627532  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 91939.1us
I20260709 13:00:02.652820  1569 raft_consensus.cc:2955] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:02.658152  1636 tablet_service.cc:1558] Processing DeleteTablet for tablet a6e5957876f24a868f3f2c49fcf5e759 with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:50864
I20260709 13:00:02.687173  5889 tablet_replica.cc:333] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:00:02.713685  1557 tablet_service.cc:1558] Processing DeleteTablet for tablet 71dad2e408414d2fa4f055c6eccf5b92 with delete_type TABLET_DATA_TOMBSTONED (TS 338d817f94ee4c1bad162e9a5860b68a not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:48208
I20260709 13:00:02.714988  5882 ts_tablet_manager.cc:1929] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:00:02.732010  5882 log.cc:1199] T 95165be2dd8c456fb98e088711372ce3 P 66344ad7cd844754b2c81cc689a709b0: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/wals/95165be2dd8c456fb98e088711372ce3
I20260709 13:00:02.733979  1455 catalog_manager.cc:5028] TS 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): tablet 95165be2dd8c456fb98e088711372ce3 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:02.747709  5890 tablet_replica.cc:333] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:00:02.749182  5890 raft_consensus.cc:2243] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:02.751084  5890 raft_consensus.cc:2272] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:02.758026  5889 raft_consensus.cc:2243] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:02.758961  5889 raft_consensus.cc:2272] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:02.762439  5889 ts_tablet_manager.cc:1916] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:02.765388  5890 ts_tablet_manager.cc:1916] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:02.788595  5890 ts_tablet_manager.cc:1929] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.10
I20260709 13:00:02.789063  5890 log.cc:1199] T 71dad2e408414d2fa4f055c6eccf5b92 P 338d817f94ee4c1bad162e9a5860b68a: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/wals/71dad2e408414d2fa4f055c6eccf5b92
I20260709 13:00:02.792357  1456 catalog_manager.cc:5028] TS 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): tablet 71dad2e408414d2fa4f055c6eccf5b92 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:02.800287  1720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b968f124f3854f20bff4af609192c41a"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:02.800877  1720 raft_consensus.cc:606] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:02.802129   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:00:02.803881   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:02.809490  5889 ts_tablet_manager.cc:1929] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.7
I20260709 13:00:02.809917  5889 log.cc:1199] T a6e5957876f24a868f3f2c49fcf5e759 P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/a6e5957876f24a868f3f2c49fcf5e759
I20260709 13:00:02.811826  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet a6e5957876f24a868f3f2c49fcf5e759 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:03.186748  5885 raft_consensus.cc:993] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 13:00:03.187304  5885 raft_consensus.cc:1081] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Signalling peer 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 13:00:03.196681  1572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b968f124f3854f20bff4af609192c41a"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:46640
I20260709 13:00:03.239137  1572 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:03.239583  1572 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:03.300743  1572 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:03.308274  1572 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:03.312024  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:03.334540  1720 raft_consensus.cc:3055] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:03.335032  1720 raft_consensus.cc:740] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:03.335891  1720 consensus_queue.cc:260] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:03.338853  1720 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:03.345304  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:03.355615  1641 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:03.379614  1641 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:03.382031  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:03.383176  5841 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:03.384809  5841 raft_consensus.cc:697] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 13:00:03.428630  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 45675.4us
I20260709 13:00:03.385772  5841 consensus_queue.cc:237] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:03.513953  1720 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:03.537166  1470 catalog_manager.cc:5697] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 11 to 12, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 12 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:03.804849   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:03.842386  1644 raft_consensus.cc:1275] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:00:03.844199  5883 consensus_queue.cc:1048] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:03.927853  1572 consensus_queue.cc:237] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:03.944185  1720 raft_consensus.cc:1275] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:00:03.946943  5841 consensus_queue.cc:1048] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:00:03.978684  1537 consensus_peers.cc:597] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e519a89ee28c45f98d4fe9c4bfea4baf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:03.990343  1717 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:03.995240  1644 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:03.997989  5900 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:03.999809  5901 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:04.090629  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 69232.7us
I20260709 13:00:04.153721  5900 raft_consensus.cc:2955] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:04.167802  1717 raft_consensus.cc:2955] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:04.179450  1718 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:04.189005  1470 catalog_manager.cc:5697] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.221207  1638 raft_consensus.cc:2955] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:04.245887  1641 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:04.248725  5770 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:04.255278  1569 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:00:04.258446  1686 consensus_peers.cc:597] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c79f18b2f4247348564b91d430d6124. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:04.259317  5855 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:04.267135  5770 raft_consensus.cc:2955] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:04.268694  1641 raft_consensus.cc:2955] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:04.281754  1572 raft_consensus.cc:2955] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:04.306371  1641 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:04.332573  1467 catalog_manager.cc:5697] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 10 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:04.336516  1718 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:04.338307  2443 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEARNER]: Advancing to term 12
I20260709 13:00:04.342566  5908 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:04.346205  2443 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:04.348153  1572 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:04.348364  5908 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:04.350690  5908 consensus_queue.cc:1243] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 6f381117554e49bb816791ab0a10f2b8 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:04.351295  5805 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:04.372709  2443 pending_rounds.cc:85] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 1
I20260709 13:00:04.373117  2443 pending_rounds.cc:107] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:00:04.373378  2443 raft_consensus.cc:2917] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:00:04.392323  2443 raft_consensus.cc:2889] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:04.393122  2443 pending_rounds.cc:107] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:00:04.393374  2443 raft_consensus.cc:2889] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 NON_PARTICIPANT]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:04.434404  5805 raft_consensus.cc:2955] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 13:00:04.615317  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 180153us
I20260709 13:00:04.618130  1718 raft_consensus.cc:2955] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:04.643854  1572 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:04.658517  5924 ts_tablet_manager.cc:933] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 13:00:04.659063  1467 catalog_manager.cc:5697] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:04.687052  1537 consensus_peers.cc:597] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac93f5a09723490eaf799683a1582480. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:04.698489  5924 tablet_copy_client.cc:323] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 13:00:04.708571  1581 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet e519a89ee28c45f98d4fe9c4bfea4baf from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 13:00:04.709158  1581 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet e519a89ee28c45f98d4fe9c4bfea4baf from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-e519a89ee28c45f98d4fe9c4bfea4baf
I20260709 13:00:04.715191  1720 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:04.718313  5922 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:04.742928  1581 tablet_copy_source_session.cc:215] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:04.747694  5924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e519a89ee28c45f98d4fe9c4bfea4baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:04.761693  1566 raft_consensus.cc:2955] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:04.771760  2440 raft_consensus.cc:2955] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEARNER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:04.776644  1641 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:04.782402  5928 ts_tablet_manager.cc:933] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:04.808292  5924 tablet_copy_client.cc:806] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:04.808956  5924 tablet_copy_client.cc:670] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:04.814433  5866 raft_consensus.cc:1064] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
W20260709 13:00:04.824124  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 48099.3us
I20260709 13:00:04.830526  5933 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:00:04.817028  5866 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 5, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:04.843250  5928 tablet_copy_client.cc:323] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 13:00:04.843752  1720 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:04.848091  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet 5c79f18b2f4247348564b91d430d6124 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 13:00:04.848645  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet 5c79f18b2f4247348564b91d430d6124 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-5c79f18b2f4247348564b91d430d6124
I20260709 13:00:04.851276  5805 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:04.857761  5924 tablet_copy_client.cc:538] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:04.857955  5900 raft_consensus.cc:2955] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:04.862740  2440 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:04.863620  1730 tablet_copy_source_session.cc:215] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:04.866232  5805 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:04.867918  1715 raft_consensus.cc:2955] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:04.885910  5928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c79f18b2f4247348564b91d430d6124. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:04.887763  5923 raft_consensus.cc:2955] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:04.892527  2440 raft_consensus.cc:2955] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:04.896670  5924 tablet_bootstrap.cc:492] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:04.915482  1467 catalog_manager.cc:5697] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:04.919463  1720 raft_consensus.cc:2955] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:04.937433  1466 catalog_manager.cc:5697] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:04.951534  1572 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:04.977015   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:04.979916  5805 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:04.984539  1646 raft_consensus.cc:2955] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:04.996714  1564 raft_consensus.cc:2955] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:05.068254  5928 tablet_copy_client.cc:806] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:05.069005  5928 tablet_copy_client.cc:670] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:05.074326  5928 tablet_copy_client.cc:538] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:05.104857  5928 tablet_bootstrap.cc:492] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:05.161109  1564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:00:05.161759  1564 raft_consensus.cc:606] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:05.163447   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:00:05.165074   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:05.207477  5937 ts_tablet_manager.cc:933] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 13:00:05.243268  5924 tablet_bootstrap.cc:492] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:05.244709  5924 tablet_bootstrap.cc:492] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:05.246840  5924 ts_tablet_manager.cc:1403] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.350s	user 0.042s	sys 0.008s
I20260709 13:00:05.312271  5924 raft_consensus.cc:359] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:05.313356  5924 raft_consensus.cc:740] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:05.333309  5937 tablet_copy_client.cc:323] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 13:00:05.323537  5924 consensus_queue.cc:260] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:05.336086  5924 ts_tablet_manager.cc:1434] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:00:05.340270  5928 tablet_bootstrap.cc:492] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:05.342033  5928 tablet_bootstrap.cc:492] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:05.342886  5928 ts_tablet_manager.cc:1403] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.238s	user 0.048s	sys 0.021s
I20260709 13:00:05.355072  5928 raft_consensus.cc:359] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:05.356096  5928 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:05.356942  5928 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:05.368770  5928 ts_tablet_manager.cc:1434] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
W20260709 13:00:06.162241  1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.014s	sys 0.009s
W20260709 13:00:06.162592  1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.014s	sys 0.009s
I20260709 13:00:06.208420  5943 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.210407  5943 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.220263  5943 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.270421  5953 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:06.271209  5953 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.273440  5953 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.321674  5911 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.323980  5911 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.326315  5911 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.341490  5911 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.346987  5911 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.349030  5911 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.354295  5953 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:06.368121  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-5c79f18b2f4247348564b91d430d6124 received from {username='slave'} at 127.0.0.1:54412
I20260709 13:00:06.380056  5911 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.384224  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-5c79f18b2f4247348564b91d430d6124 on tablet 5c79f18b2f4247348564b91d430d6124 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:06.384413  5911 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:06.341334  5948 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.380116  5954 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:06.387769  5948 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.394359  5948 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.391254  5954 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.397449  5954 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.398680  5911 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.382871  5953 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.401005  5953 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.401844  5946 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.402361  5946 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.404824  5946 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.386571  5945 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:06.410887  5945 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.413111  5945 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.416633  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.425031  5953 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:06.425664  5953 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.426390  2443 raft_consensus.cc:1217] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 13:00:06.427832  5953 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.428388  5953 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:06.429222  5953 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.433338  5941 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.434096  5941 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.436587  5941 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.447338  5941 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:06.447940  5941 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.450393  5941 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.451143  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.452071  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:06.453807  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.460210  5957 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.460808  5957 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.466691  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.469775  2436 raft_consensus.cc:1217] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 13:00:06.431466  5953 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:06.485980  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 102074us
I20260709 13:00:06.488258  5266 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.490022  5964 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:06.491968  5964 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.492857  5950 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.493474  5950 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.494187  5953 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:06.490407  5266 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.495483  5950 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.496330  5954 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.496658  5266 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.496833  5954 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.497596  5949 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.498165  5949 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.498919  5954 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.499583  1569 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:06.479631  5948 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:06.500779  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:06.501230  5948 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.503831  5266 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.504316  5266 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.467947  5945 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.506289  5964 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.518359  5949 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.517554  5266 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.513685  5866 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.519425  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:06.519748  5866 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.521373  5923 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:06.486260  5941 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.522529  5266 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.525131  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:06.518836  5948 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.531196  5967 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:06.531714  5967 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.494711  5953 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.535455  5266 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.521888  5866 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.539928  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.550645  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:06.513248  5954 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.556136  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:06.543057  5948 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.542379  5957 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.596872  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:06.528328  5945 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.535072  5941 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.521910  5923 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.551175  5943 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.620564  5266 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.624830  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.627139  5943 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.618204  5964 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:06.628144  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.628389  5964 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.629407  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.630378  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.631039  5953 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.631470  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.632045  1566 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:06.633343  5923 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.633685  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:06.630465  5964 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.620611  5940 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.636858  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.640923  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.641033  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.641927  1716 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:06.592671  5866 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:06.646853  5966 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.648209  5266 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.654253  5969 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.654829  5969 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:06.648241  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:06.592319  5949 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.650481  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.656656  1720 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 6.
I20260709 13:00:06.656534  5949 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.650843  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:06.597929  5954 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.651722  5266 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.629420  5943 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.669099  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:06.667234  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 74391.9us
I20260709 13:00:06.669776  1572 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
I20260709 13:00:06.634897  5948 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.677819  5955 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.678104  1582 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-e519a89ee28c45f98d4fe9c4bfea4baf received from {username='slave'} at 127.0.0.1:38394
I20260709 13:00:06.649438  5940 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.680102  5958 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.664789  5964 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:06.681290  5944 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.694948  5961 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.703496  5944 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.704008  5961 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.707021  5954 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.707319  5948 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.707635  5961 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.708083  5948 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.708724  5948 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.712119  5940 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.710165  5955 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.714708  5955 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.682003  5968 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.682909  5972 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.719933  5972 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.705909  5944 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.721633  5944 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.719287  5968 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:06.722118  5944 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.724095  5968 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.724649  5944 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.684216  5941 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.684393  5923 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.744056  5923 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.665453  5966 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.685211  5967 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.687055  5969 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.688360  5945 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.689035  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.669899  1581 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet ac93f5a09723490eaf799683a1582480 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 13:00:06.669405  5953 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:06.747659  5966 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.747756  5953 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.749944  5923 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.750044  5953 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.695407  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.698143  1582 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-e519a89ee28c45f98d4fe9c4bfea4baf on tablet e519a89ee28c45f98d4fe9c4bfea4baf with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:06.651865  5866 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.752074  1581 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet ac93f5a09723490eaf799683a1582480 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-ac93f5a09723490eaf799683a1582480
I20260709 13:00:06.753043  5866 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.700891  5266 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.702082  5958 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.702682  5964 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.725915  5972 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.683749  5949 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.756043  5964 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.757192  5958 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.754303  1686 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:06.758359  5966 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:06.758777  5966 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.759138  5966 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:06.761917  1581 tablet_copy_source_session.cc:215] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:06.765321  5948 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.773313  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:06.774284  5942 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:06.775228  5942 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.775712  5942 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.778515  5942 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:06.780344  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.780715  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.780848  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:06.781911  5967 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:06.782637  1686 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:06.782893  5967 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:06.785037  5967 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:06.786585  5940 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:06.787164  5942 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:06.787575  5942 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.787943  5942 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:06.788059  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.788378  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.789258  5945 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:06.789798  5945 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.791631  1686 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:06.792315  5940 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:06.793780  5940 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.794651  5940 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.792207  5945 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.796164  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:06.796584  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.796774  1638 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:00:06.805230  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:06.806362  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:06.805959  1638 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 13:00:06.808511  5967 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:06.808424  5945 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:06.809856  5967 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.812029  5967 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.810078  5945 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:06.816933  5945 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.808812  5968 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:06.818423  5968 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:06.820243  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 151578us
I20260709 13:00:06.820266  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.809262  5923 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:06.822495  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.824491  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.824785  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.825965  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:06.827243  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:06.828231  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.828745  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:06.828855  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.829267  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:07.017568   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:06.902105  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.953032  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:06.923848  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:07.012341  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 50065.3us
I20260709 13:00:06.828753  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.957454  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:06.958380  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:06.956095  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:07.005995  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 55266.8us
I20260709 13:00:06.989385  5953 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:06.953424  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.026121  1644 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:06.895246  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.903857  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.907334  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.918879  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.933702  2406 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:06.907815  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.902966  5959 raft_consensus.cc:1064] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:07.024559  5953 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:07.033254  5953 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:07.030112  5965 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:07.034747  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.035109  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:06.897444  5940 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.036466  1714 raft_consensus.cc:1240] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:06.990087  5942 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.037420  5972 raft_consensus.cc:1064] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:06.903903  5941 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:07.038157  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.038079  5941 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.039096  1718 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:06.770033  5966 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.039319  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.040038  1717 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:07.036088  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.040248  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:07.041574  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.041917  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.042007  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.041801  5976 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:07.042692  5976 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:07.040506  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.043179  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.043529  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:06.993969  5949 raft_consensus.cc:993] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:07.040664  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.955318  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.044955  5949 raft_consensus.cc:1081] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Signalling peer 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:07.045110  1645 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 13:00:07.045464  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.046253  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.046545  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.021967  1641 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:00:07.047551  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.048652  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.034508  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.036113  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:06.894107  5923 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:07.052807  5923 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.955591  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:07.053772  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 120117us
I20260709 13:00:07.044047  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.042647  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.044298  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.031080  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:06.921060  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:06.911666  1638 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:07.067210  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:07.069835  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:07.070011  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:07.073230  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.074023  5953 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:07.076120  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:07.078020  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:07.078931  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:07.079017  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:07.076721  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:07.081804  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:07.082106  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:07.083591  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:06.828871  5968 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:06.899870  5975 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:07.121356  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:07.121479  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:07.123766  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:07.127841  5942 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:07.128759  1537 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:07.077749  5964 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:07.131111  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:07.074234  5949 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:07.043310  5976 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:07.134760  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:07.052515  5972 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:07.052587  5959 consensus_queue.cc:237] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:07.158025  5952 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:07.136062  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 55187.1us
I20260709 13:00:07.138504  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:07.141503  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:07.141513  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.085603  5923 consensus_queue.cc:1059] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:00:07.143981  5949 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:07.167521  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.132308  5945 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:00:07.136024  5948 consensus_queue.cc:1059] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:00:07.169853  2405 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:07.173610  5945 raft_consensus.cc:3055] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:07.169435  5953 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:07.174007  5945 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:07.150566  5975 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.180090  5945 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.170164  5949 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:07.184192  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.186362  5975 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:07.181317  5945 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:07.187044  5962 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:07.187440  5977 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:07.174314  5948 raft_consensus.cc:3055] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:07.175022  5953 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:07.196321  5953 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.196877  5971 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:07.200136  5937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac93f5a09723490eaf799683a1582480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.202246  5977 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.203719  5941 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:07.204712  5977 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:07.197464  5971 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.215564  5971 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:07.217372  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 65738.4us
I20260709 13:00:07.219381  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.194397  5948 raft_consensus.cc:740] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:07.195799  5962 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:07.223188  1612 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 13:00:07.224169  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 140825us
I20260709 13:00:07.226964  5948 consensus_queue.cc:260] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.225657  1686 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:07.222898  5962 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.239269  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:07.238588  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:07.242972  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:07.243820  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:07.244472  1716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:07.238255  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:07.250041  1716 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:07.250432  5954 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:07.250478  1716 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:07.262482  5948 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:07.268275  1716 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.270303  1716 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:07.275677  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:07.276160  1569 raft_consensus.cc:3055] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:07.276420  1569 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:07.246170  5911 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:07.278450  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 55310.7us
I20260709 13:00:07.228006  5982 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:07.283794  2474 debug-util.cc:398] Leaking SignalData structure 0x7b080027b1e0 after lost signal to thread 434
W20260709 13:00:07.367002  2474 debug-util.cc:398] Leaking SignalData structure 0x7b08002911a0 after lost signal to thread 1504
W20260709 13:00:07.368254  2474 debug-util.cc:398] Leaking SignalData structure 0x7b08002d64e0 after lost signal to thread 1596
W20260709 13:00:07.369168  2474 debug-util.cc:398] Leaking SignalData structure 0x7b0800158c60 after lost signal to thread 1671
I20260709 13:00:07.233067  5976 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.371768  5976 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:07.286115  5953 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.288884  1612 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 13:00:07.373001  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 84245.2us
I20260709 13:00:07.294596  5940 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:07.373723  5953 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:07.369930  2474 debug-util.cc:398] Leaking SignalData structure 0x7b08001f6d00 after lost signal to thread 1745
I20260709 13:00:07.373737  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:07.375222  5945 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:07.375530  2474 debug-util.cc:398] Leaking SignalData structure 0x7b0800322c80 after lost signal to thread 2477
I20260709 13:00:07.375835  5945 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.376091  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.304947  5966 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:07.309548  5866 raft_consensus.cc:3055] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:07.376933  5866 raft_consensus.cc:740] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:07.377774  5866 consensus_queue.cc:260] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.378901  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.379267  5866 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:07.379671  5945 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:07.380686  1612 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.322902  5949 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.381511  5945 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.317502  2436 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:07.356669  5962 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:07.377702  5974 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:07.382652  5949 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:07.282264  5971 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.383612  2440 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:07.383644  5962 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:07.380788  5937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42636 (request call id 721) took 2191 ms. Trace:
I20260709 13:00:07.385404  5966 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:07.384892  5937 rpcz_store.cc:276] 0709 13:00:05.189249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.189392 (+   143us) service_pool.cc:224] Handling call
0709 13:00:05.207872 (+ 18480us) ts_tablet_manager.cc:934] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
0709 13:00:07.198790 (+1990918us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:07.217491 (+ 18701us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:07.219675 (+  2184us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:07.379280 (+159605us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:07.380242 (+   962us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:07.380586 (+   344us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:07.380651 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":34047,"tablet-copy.queue_time_us":17620,"thread_start_us":107046,"threads_started":2}
I20260709 13:00:07.387013  5937 tablet_copy_client.cc:806] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:07.387665  5937 tablet_copy_client.cc:670] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:07.382606  1612 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.281384  1569 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:07.465837  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 83688.3us
I20260709 13:00:07.467952  1612 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.468317  1569 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:07.468892  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:07.471263  1612 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.326897  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:07.301448  1572 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:07.495101  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.499293  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:07.500478  1714 raft_consensus.cc:2393] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 7: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:07.503684  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.503854  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:07.504920  1716 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 12: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:07.505980  1720 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:07.507613  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.499344  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:07.514485  5866 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:07.515483  5866 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.517792  2440 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:07.536141  5866 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.543660  5940 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:07.545742  5937 tablet_copy_client.cc:538] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:07.555552  5945 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:07.563871  5952 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:07.557688  5950 consensus_queue.cc:1059] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:00:07.574857  5958 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:07.497623  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.578104  1569 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:00:07.588534  5950 raft_consensus.cc:3055] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:07.607077  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.590603  5950 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:07.613799  5950 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:07.624044  5990 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:07.626623  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 129257us
I20260709 13:00:07.630594  1568 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:07.659700  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 74846.9us
I20260709 13:00:07.664125  1612 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.671350  5990 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:07.674077  5950 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:07.718600  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 66935.7us
I20260709 13:00:07.720021  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.721437  5942 consensus_queue.cc:1059] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:07.721863  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:07.722800  5942 raft_consensus.cc:3055] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:07.724009  5942 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:07.726357  5943 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:07.730280  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.730675  5943 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:07.731902  5943 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.728530  5986 raft_consensus.cc:2955] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:07.744906  5937 tablet_bootstrap.cc:492] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:07.754269  5990 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:07.756237  5988 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.759186  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.759982  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.760879  1639 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:00:07.762631  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.725346  5942 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.770659  5942 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.774492  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:07.776120  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.794100  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.802347  1569 raft_consensus.cc:2955] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:07.805148  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.806389  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.806613  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.807395  1643 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:07.807946  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.808643  1646 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 13:00:07.809651  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.810691  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.811081  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.813562  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.815516  2440 raft_consensus.cc:2955] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:07.815806  5949 raft_consensus.cc:2955] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:07.819644  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.821231  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.823278  1721 raft_consensus.cc:2955] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:07.851666  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.857623  2436 raft_consensus.cc:2955] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:07.859393  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.861958  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:07.874454  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:07.876070  1466 catalog_manager.cc:5697] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:07.878953  5948 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:07.879570  5948 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:07.882031  1643 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:07.882283  5866 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:07.882895  5866 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:07.883810  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.885357  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:07.885995  1642 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:07.886620  1647 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:07.888651  1638 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 13:00:07.889369  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:07.884954  5866 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:07.896647  5990 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:07.885399  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.898790  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.900327  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.900695  1647 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:00:07.897181  5990 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:07.903635  5990 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:07.881824  5948 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:07.905798  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:07.913897  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:07.916045  1642 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:00:07.914988  1467 catalog_manager.cc:5697] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 11 to 12, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.929270  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.930245  5949 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:07.930651  5949 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:07.930995  5949 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:07.933391  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:07.935230  5952 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.940995  5949 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.942970  1569 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:07.944001  5949 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:07.944738  5942 consensus_queue.cc:1059] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:07.945794  5942 raft_consensus.cc:3055] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:07.946203  5942 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:07.947196  5942 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:07.948459  5942 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:07.954309  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:07.959213  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:07.964633  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:07.965472  5952 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.966328  5952 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:07.968742  5957 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:07.969596  5957 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:07.974416  5957 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:07.976130  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:07.978570  5949 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:07.979588  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:07.984169  5957 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:07.984809  5957 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:07.987123  5949 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:07.988876  1536 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:07.995244  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:07.994560  5949 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:07.996349  5949 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:07.996716  5949 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.011309  2440 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:08.012025  5973 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:08.012964  5973 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:08.014524  5949 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:08.015926  5973 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:08.018106  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:08.027978  1685 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.029001  5983 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:08.031349  1685 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.032347  5983 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.033152  1685 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.034118  5983 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:08.044338  1685 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.045193  5983 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:08.048588  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 59837.8us
I20260709 13:00:08.048770  5947 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:08.049621  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.049486  5947 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:08.051100  5952 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:08.051219  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:08.051805  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:08.054427  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:08.055569  5947 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:08.055787  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:08.059222  5949 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:08.061764  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.062668  5952 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:08.063135  5952 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:08.063568  5952 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:08.063653  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:08.064714  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.066584  5950 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:07.989995  5957 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:08.067569  5949 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.081408  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:08.084949  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:08.087747  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:08.098306  1569 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:08.101893  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:08.115121  2405 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.116044  5947 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.153388  1685 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.154716  5986 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:08.160559  1717 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:08.162583  1685 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.166113  5983 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:08.170470  1685 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.171500  5952 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:08.171841  5983 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.173482  1685 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.173733  5952 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:08.174446  5983 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:08.175421  1685 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.190497  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:08.191690  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.191794  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:08.192332  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:08.193924  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:08.198401  5942 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:08.198681  1685 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.200124  5986 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.201182  1685 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.202775  5943 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:08.213542  5948 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.215165  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:08.215992  5990 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.217535  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:08.218417  5990 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:08.221465  5990 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:08.224416  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:08.227069  1685 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:08.234514  5990 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:08.236654  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:08.237161  5942 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:08.237823  5990 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:08.238613  5942 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:08.241209  5942 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:08.242683  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:08.243449  1572 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 13:00:08.245291  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:08.271831  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:08.271833  1685 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.277859  2406 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:08.278797  5957 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:08.278878  5986 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:08.279716  5986 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:08.282963  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:08.283998  1647 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 12: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:08.285048  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:08.286478  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:08.287423  1643 raft_consensus.cc:2393] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 7: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:08.288997  1638 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:08.289865  5952 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:08.290714  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:08.279033  1685 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.293485  5986 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:08.290482  5952 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:08.296809  5952 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:08.304402  1685 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:08.305739  5937 tablet_bootstrap.cc:492] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:08.306247  5986 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:08.306787  5986 raft_consensus.cc:697] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:08.307729  5986 consensus_queue.cc:237] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:08.311887  1685 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:08.313302  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:08.316202  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:08.317013  5942 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:08.317619  5942 raft_consensus.cc:697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:08.318851  5942 consensus_queue.cc:237] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:08.321264  5937 tablet_bootstrap.cc:492] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:08.323757  1685 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.326552  5943 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:08.326895  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:08.327809  5937 ts_tablet_manager.cc:1403] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.583s	user 0.048s	sys 0.030s
I20260709 13:00:08.330581  1467 catalog_manager.cc:5697] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:08.355147  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:08.371618  1572 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:08.353952  5952 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:08.369679  5948 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:08.430802  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 75742.2us
I20260709 13:00:08.431725  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:08.444856  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:08.446097  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:08.387640  5937 raft_consensus.cc:359] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:08.442569  5866 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:08.459074  5937 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:08.461155  5952 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:08.460902  5990 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:00:08.513156  5937 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:08.517326  5937 ts_tablet_manager.cc:1434] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.187s	user 0.009s	sys 0.002s
W20260709 13:00:08.518294  6002 log.cc:927] Time spent T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.124s	user 0.004s	sys 0.000s
I20260709 13:00:08.521771  1569 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:08.522811  5952 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:08.481489  6006 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:08.461380  5948 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:08.556059  6007 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:00:08.562408  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 76153.4us
I20260709 13:00:08.568815  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:08.569737  5948 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:08.571516  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:08.571789  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.573040  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:08.573532  6005 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:08.574960  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:08.576311  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:08.579980  6006 raft_consensus.cc:3055] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:08.580593  6006 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:08.581625  1569 raft_consensus.cc:1240] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:08.581619  6006 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:08.583007  6006 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:08.587558  2405 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.588645  6009 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:08.589998  6010 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:08.590659  6010 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:08.591809  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.592582  5949 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:08.592864  6010 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:08.593312  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.594241  6004 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.594280  6007 consensus_queue.cc:1059] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:08.594571  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.598134  1536 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.598889  5949 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:08.599429  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.600504  6008 raft_consensus.cc:3055] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:08.600884  6008 raft_consensus.cc:740] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:08.602506  6010 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:08.603225  6010 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:08.598899  5950 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:08.601756  6008 consensus_queue.cc:260] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:08.604647  2405 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.605048  6008 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.606004  6009 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:08.607167  2405 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.608170  6009 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:08.617622  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:08.631161  1641 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:08.636659  5948 raft_consensus.cc:2955] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:08.627161  1467 catalog_manager.cc:5697] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 11 to 12, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.653187  2440 raft_consensus.cc:2955] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:08.660167  1581 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-ac93f5a09723490eaf799683a1582480 received from {username='slave'} at 127.0.0.1:38394
I20260709 13:00:08.660681  1581 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-ac93f5a09723490eaf799683a1582480 on tablet ac93f5a09723490eaf799683a1582480 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:08.667435  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:08.668228  1638 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 11: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:08.670249  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:08.655896  1644 raft_consensus.cc:2955] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:08.678393  6007 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:08.679951  1470 catalog_manager.cc:5697] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:08.671087  1467 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 10 to 11, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.686015  1571 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:08.696273  1467 catalog_manager.cc:5697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 6 to 7, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.709165  1571 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:08.717969  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:08.712445  1638 raft_consensus.cc:2955] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:08.722452  5952 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.729598   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:08.734885  1567 raft_consensus.cc:1275] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:08.740363  6008 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:00:08.715225  6006 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:00:08.831694  5996 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:00:09.040894  1572 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:00:09.140107  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 433601us
I20260709 13:00:09.192312  6030 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.199648  5986 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:00:09.294261  5950 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.228499  6030 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:09.322624  5950 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:09.343497  5950 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:09.333503  6020 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:00:09.322726  5948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50864 (request call id 6) took 2431 ms. Trace:
I20260709 13:00:09.406708  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:09.407430  1571 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
W20260709 13:00:09.411811  6023 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:00:09.412014  6009 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:09.412570  6009 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:09.418414  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:09.451409  6026 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:09.456887  6026 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:09.458705  6024 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:09.459319  6024 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:09.462642  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:09.410205  6030 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:09.484906  2443 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:09.485807  5942 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:09.497401  6019 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:00:09.503975  5942 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.516782  1537 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:09.526636  6026 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:09.532366  6006 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:09.533051  6006 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:09.404318  5948 rpcz_store.cc:276] 0709 13:00:06.882016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.882552 (+   536us) service_pool.cc:224] Handling call
0709 13:00:07.127531 (+244979us) log.cc:844] Serialized 501 byte log entry
0709 13:00:07.206446 (+ 78915us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b1800181660. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1ab3f3 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd 000000000038f354 000000000038f199 00007f18ca18e83a
0709 13:00:09.298977 (+2092531us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":5648,"mutex_wait_us":3228,"raft.queue_time_us":9779,"raft.run_cpu_time_us":1247,"raft.run_wall_time_us":2305,"spinlock_wait_cycles":9313024,"thread_start_us":32899,"threads_started":1,"wal-append.queue_time_us":64281,"wal-append.run_cpu_time_us":2091,"wal-append.run_wall_time_us":1002016}
I20260709 13:00:09.539367  6009 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:09.540176  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:09.540424  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e93b49f668f7487dad07043590a5616f with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:09.541020  1721 raft_consensus.cc:2393] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 12: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:09.541070  6024 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:09.551899  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 52209.6us
I20260709 13:00:09.521932  5942 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:09.564831  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:09.566679  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:09.564019  6046 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.559451  6005 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:09.558745  6006 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:09.572157  6005 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.575712  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:09.592525  6005 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:09.579560  1536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.012s	sys 0.035s
W20260709 13:00:09.593214  1536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.013s	sys 0.035s
W20260709 13:00:09.593734  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 875790us
I20260709 13:00:09.594437  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:09.595323  6027 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:09.598484  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:09.599112  1641 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:00:09.601730  6046 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:09.603849  6046 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:09.606381  1643 raft_consensus.cc:1275] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:09.587939  1647 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:09.588912  1638 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:09.610970  1686 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:09.613386  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:09.631517  5942 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:09.633406  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 111178us
I20260709 13:00:09.633664  1721 raft_consensus.cc:2368] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11.
I20260709 13:00:09.641222  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:09.641433  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:09.655418  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet e93b49f668f7487dad07043590a5616f with delete_type TABLET_DATA_TOMBSTONED (TS 66344ad7cd844754b2c81cc689a709b0 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:47746
I20260709 13:00:09.658195  6057 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:09.659017  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:09.659085  6038 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:09.664685  6038 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:09.666792  6038 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:09.667568  6005 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:09.670404  6005 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:09.671938  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:09.672494  2440 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:09.685734  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:09.712572  1611 leader_election.cc:400] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11.
I20260709 13:00:09.713047  1611 leader_election.cc:403] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:09.714779  5942 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:09.727451  2440 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
W20260709 13:00:09.732864  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 60635.9us
I20260709 13:00:09.733637  1718 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:09.734539  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:09.737084  6038 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:09.737607  6038 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:09.734849  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 51076.9us
I20260709 13:00:09.740532  1572 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 10: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:09.739017  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:09.722260  6005 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:09.742794  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:09.752288  6008 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:09.755897  2443 raft_consensus.cc:1217] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 13:00:09.758677  6057 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:09.761624  6015 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.762169  6015 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:09.763867  6007 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:09.764178  6015 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:09.741156  6039 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:00:09.770581  1537 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:09.771873  6014 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:09.772380  6014 raft_consensus.cc:697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:09.773239  6014 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:09.776791  6038 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:09.779088  6005 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:09.780088  1469 catalog_manager.cc:5697] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 11 to 12, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 12 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:09.782364  6005 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:09.779156  1467 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58260 (request call id 246) took 1209 ms. Trace:
I20260709 13:00:09.785801  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:09.791818  6065 tablet_replica.cc:333] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:00:09.793179  6065 raft_consensus.cc:2243] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:09.795199  6015 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:09.795768  6015 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:09.796538  6046 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:09.797034  6046 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:09.797744  6015 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:09.798250  6015 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:09.799038  6046 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:09.801117  1612 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:09.804457  6034 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:09.809345  6030 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.810099  6030 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:09.798715  6015 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:09.812534  1612 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:09.813198  2405 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:09.813472  6015 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:09.814083  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 70979us
I20260709 13:00:09.814680  6015 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:09.816498  6025 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:09.821368  6065 raft_consensus.cc:2272] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:09.828836  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:09.829734  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:09.830416  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:09.830700  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:09.831152  1644 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 13:00:09.832692  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:09.833184  1640 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:00:09.834141  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:09.843446  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:09.852352  1640 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
W20260709 13:00:09.872200  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 120324us
I20260709 13:00:09.876765  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:09.877379  1566 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:09.879954  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:09.881469  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:09.885243  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:09.835753  6034 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:09.888662  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:09.809158  6039 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11.
I20260709 13:00:09.884693  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:09.893088  5948 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:09.896564  6065 ts_tablet_manager.cc:1916] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:09.894793  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:09.896679  5948 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:09.893288  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:09.898365  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:09.897982  1563 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:00:09.902778  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:09.812569  6030 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:09.907717  1564 raft_consensus.cc:2955] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:09.911044  1566 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:09.911424  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:09.911876  6032 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:09.926656  6032 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:09.927804  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:09.928834  5983 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:09.928942  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:09.929255  5983 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.929610  5983 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:09.929864  6011 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:09.930734  6011 raft_consensus.cc:697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:09.931854  6011 consensus_queue.cc:237] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:09.934904  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:09.938621  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 45740.8us
I20260709 13:00:09.939596  5983 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:09.917279  5948 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:09.920174  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:09.922569  1641 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:09.783299  1467 rpcz_store.cc:276] 0709 13:00:08.569481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.574557 (+  5076us) service_pool.cc:224] Handling call
0709 13:00:09.779073 (+1204516us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:08.753603 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:08.782632 (+ 29029us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:08.782668 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:00:08.782687 (+    19us) tablet.cc:662] Decoding operations
0709 13:00:08.783281 (+   594us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:08.783332 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:08.783363 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:00:08.783706 (+   343us) tablet.cc:701] Row locks acquired
0709 13:00:08.783724 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:00:08.783869 (+   145us) write_op.cc:270] Start()
0709 13:00:08.783988 (+   119us) write_op.cc:276] Timestamp: P: 1783602008783817 usec, L: 0
0709 13:00:08.784011 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:00:08.784686 (+   675us) log.cc:844] Serialized 1317 byte log entry
0709 13:00:09.449403 (+664717us) op_driver.cc:464] REPLICATION: finished
0709 13:00:09.516609 (+ 67206us) write_op.cc:301] APPLY: starting
0709 13:00:09.522614 (+  6005us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:09.733826 (+211212us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:09.741320 (+  7494us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:09.750093 (+  8773us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:09.750294 (+   201us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:00:09.750344 (+    50us) write_op.cc:312] APPLY: finished
0709 13:00:09.750560 (+   216us) log.cc:844] Serialized 41 byte log entry
0709 13:00:09.750739 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:09.750829 (+    90us) write_op.cc:454] Released schema lock
0709 13:00:09.750872 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:09.751240 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:09.751269 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"spinlock_wait_cycles":7936,"child_traces":[["op",{"apply.queue_time_us":44420,"apply.run_cpu_time_us":7165,"apply.run_wall_time_us":241898,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16673,"num_ops":3,"prepare.queue_time_us":23296,"prepare.run_cpu_time_us":2941,"prepare.run_wall_time_us":34301,"replication_time_us":656123,"thread_start_us":6660,"threads_started":1}]]}
I20260709 13:00:09.947234  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:09.963877  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:09.967494  1645 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:09.968056  1536 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:09.990556  6008 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.991127  6008 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:09.993057  6008 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:09.973006  6032 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:10.004433  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:10.001684  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:10.006722  1572 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:00:10.023188  5983 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:09.982126  6005 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:10.030398  1686 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:10.031752  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:10.032419  1564 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:10.052496  1564 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:00:10.053587  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:10.056228  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:10.060210  1612 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:10.041545  6010 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:00:10.062616  5986 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:10.066846  5943 raft_consensus.cc:476] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:10.072260  6036 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:10.092819  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:10.093987  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:10.080826  5986 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.097754  6013 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:10.099488  6034 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:10.117338  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:10.119629  6065 ts_tablet_manager.cc:1929] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.8
I20260709 13:00:10.106150  6036 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:10.120810  1714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:10.121471  1714 raft_consensus.cc:606] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:10.121188  6036 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:10.120290  6013 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:10.119719  6046 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:10.120306  6065 log.cc:1199] T e93b49f668f7487dad07043590a5616f P 66344ad7cd844754b2c81cc689a709b0: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/wals/e93b49f668f7487dad07043590a5616f
I20260709 13:00:10.106372  5986 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:10.135913  5990 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:10.137231  5990 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:10.139355  5990 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:10.140717  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:10.141911  6039 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:10.152227  1455 catalog_manager.cc:5028] TS 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): tablet e93b49f668f7487dad07043590a5616f (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:10.158721  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:10.160142  5943 raft_consensus.cc:993] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:10.160862  6030 raft_consensus.cc:1081] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:10.161378  5986 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:10.163431  6013 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:10.168049  6013 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:10.168946  6005 raft_consensus.cc:1064] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
W20260709 13:00:10.170406  6074 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:00:10.170706  6013 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:10.177739  5986 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:10.177947  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:10.172101  6005 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:10.173678  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:10.179589  1571 raft_consensus.cc:2368] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 15. Current term is 16.
I20260709 13:00:10.178670  1643 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:00:10.187539  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:10.188197  1571 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:10.201318  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:10.202275  1715 raft_consensus.cc:2368] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
I20260709 13:00:10.206228  1611 leader_election.cc:400] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
I20260709 13:00:10.206568  1611 leader_election.cc:403] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:10.207295  6013 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:00:10.223982  6013 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
I20260709 13:00:10.220839  6034 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:10.225200  6034 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:10.227118  1714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:10.227692  1714 raft_consensus.cc:606] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:10.229435  6034 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:10.234997  1571 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:10.236500  1643 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:00:10.236112  1686 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:10.244843  5986 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:10.245620  5986 raft_consensus.cc:697] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:10.246634  5986 consensus_queue.cc:237] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:10.257257  1612 leader_election.cc:400] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 15. Current term is 16.
I20260709 13:00:10.257628  1612 leader_election.cc:403] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:10.265511  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:10.266287  1571 raft_consensus.cc:2368] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
I20260709 13:00:10.262542  6034 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 15. Current term is 16.
I20260709 13:00:10.273190  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:10.273283  1714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c55d053b55024621933828292867f0e6"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:10.274015  1714 raft_consensus.cc:606] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:10.275813  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:10.273093  1643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 13:00:10.311579  1643 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:10.312065  1643 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:10.315433  6075 log.cc:927] Time spent T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:00:10.320014  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 46125.6us
I20260709 13:00:10.349653  1643 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:10.359053  1639 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:10.366586  1714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:10.367105  1714 raft_consensus.cc:606] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:10.372910  1639 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:10.376025  1643 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:10.377882  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 55340.8us
I20260709 13:00:10.384379  2443 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:10.386943   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:10.396813   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:10.377719  6036 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:00:10.402832  6036 raft_consensus.cc:3055] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:10.403275  6036 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:10.409715  6031 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:10.416985  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:10.421224  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:10.421748  1571 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:10.421903  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:10.404121  6036 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:10.429257  1571 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:10.435925  2440 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:10.440754  6031 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:10.449016  1717 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:10.468739  6036 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:10.473865  6010 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:00:10.501259  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 113329us
I20260709 13:00:10.544185  1641 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:10.546195  1641 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:10.547587  1644 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:10.545881  1612 leader_election.cc:400] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
I20260709 13:00:10.619881  1565 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:00:10.620169  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 74423.6us
I20260709 13:00:10.620991  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:10.630517  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:10.630437  6049 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:10.635361  6034 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:10.653369  6011 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:10.654621  6030 raft_consensus.cc:993] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:10.655097  6030 raft_consensus.cc:1081] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:10.658733  6034 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:10.659765  6034 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:10.662207  6010 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:10.673312  1568 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:00:10.677881  6087 raft_consensus.cc:2955] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:10.686792  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58250 (request call id 227) took 1058 ms. Trace:
I20260709 13:00:10.687189  1469 rpcz_store.cc:276] 0709 13:00:09.627908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.628136 (+   228us) service_pool.cc:224] Handling call
0709 13:00:10.686735 (+1058599us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:10.104752 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:10.105297 (+   545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:10.105328 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:00:10.105346 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:10.105667 (+   321us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:10.105750 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:10.107388 (+  1638us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:10.116313 (+  8925us) tablet.cc:701] Row locks acquired
0709 13:00:10.116342 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:00:10.116472 (+   130us) write_op.cc:270] Start()
0709 13:00:10.116590 (+   118us) write_op.cc:276] Timestamp: P: 1783602010116429 usec, L: 0
0709 13:00:10.116611 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:10.117278 (+   667us) log.cc:844] Serialized 541 byte log entry
0709 13:00:10.378605 (+261327us) op_driver.cc:464] REPLICATION: finished
0709 13:00:10.647585 (+268980us) write_op.cc:301] APPLY: starting
0709 13:00:10.647664 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:10.648755 (+  1091us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:10.648859 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:10.649660 (+   801us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:10.649830 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:00:10.649875 (+    45us) write_op.cc:312] APPLY: finished
0709 13:00:10.650116 (+   241us) log.cc:844] Serialized 25 byte log entry
0709 13:00:10.650279 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:10.650354 (+    75us) write_op.cc:454] Released schema lock
0709 13:00:10.650389 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:10.651212 (+   823us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:10.651261 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4693,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":265455,"apply.run_cpu_time_us":3099,"apply.run_wall_time_us":3531,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":298075,"prepare.run_cpu_time_us":2523,"prepare.run_wall_time_us":15543,"replication_time_us":255981,"thread_start_us":520652,"threads_started":2}]]}
I20260709 13:00:10.672277  6084 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:00:10.672444  6030 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:00:10.695950  1644 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:00:10.699208  1643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 13:00:10.699779  1643 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:10.700115  1643 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:10.703451  2440 raft_consensus.cc:2955] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:10.705353  1714 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:10.721174  1643 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:10.735960  1470 catalog_manager.cc:5697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:10.742369  1643 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:10.744971  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:10.745764  1714 raft_consensus.cc:3055] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:10.746178  1714 raft_consensus.cc:740] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 13:00:10.753774  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 77976.7us
I20260709 13:00:10.765384  6048 raft_consensus.cc:993] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:10.765992  6048 raft_consensus.cc:1081] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:10.738250  5943 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:00:10.760428  1714 consensus_queue.cc:260] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:10.790771  1714 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:10.803952  1714 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:10.806382  1611 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:10.807505  5948 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:10.808167  5948 raft_consensus.cc:697] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:10.820633  1469 catalog_manager.cc:5697] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:10.824756  1469 catalog_manager.cc:5697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:10.826161  1469 catalog_manager.cc:5697] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:10.816723  5948 consensus_queue.cc:237] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:10.869414  6011 raft_consensus.cc:993] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 13:00:10.870000  6067 raft_consensus.cc:1081] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Signalling peer 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 13:00:10.870503  1564 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:10.875149  1717 raft_consensus.cc:2955] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:00:10.892261  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 135590us
I20260709 13:00:10.875178  5943 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:00:10.923228  1563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:46640
I20260709 13:00:10.923772  1563 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:10.924099  1563 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.929674  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:10.930313  1569 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:10.930444  1644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c55d053b55024621933828292867f0e6"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 13:00:10.931015  1644 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:10.931347  1644 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:10.938927  1643 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:10.964792  1563 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:10.943084  6036 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:00:10.972186  1470 catalog_manager.cc:5697] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:10.976660  1644 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:10.980401  1563 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:11.008862  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:11.009548  1643 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.015307  1569 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:11.010288  1645 raft_consensus.cc:2955] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:00:11.025622  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 78687.4us
I20260709 13:00:11.059157  1644 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:11.060276  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:11.060889  1569 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:11.073634  1569 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
W20260709 13:00:11.064882  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 119779us
I20260709 13:00:11.082266  1643 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 13:00:11.083940  1717 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:11.095331  1568 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:11.063787  6067 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:00:11.154734  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 68887.2us
I20260709 13:00:11.159451  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:11.160074  1718 raft_consensus.cc:3055] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:11.160373  1718 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 13:00:11.195655  6103 log.cc:927] Time spent T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 13:00:11.198798  6102 log.cc:927] Time spent T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:00:11.219353  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:11.220043  1712 raft_consensus.cc:3055] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:11.221772  1712 raft_consensus.cc:740] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:11.230157  1570 raft_consensus.cc:1240] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:11.221904  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:11.238763  6105 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:11.252568  1718 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:11.235383  1712 consensus_queue.cc:260] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:11.257004  1712 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.253981  1718 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:11.294226  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 72395.5us
I20260709 13:00:11.294660  6039 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:11.295228  6039 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:11.296150  6039 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:11.298532  1467 catalog_manager.cc:5697] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 9 to 10, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.304688  1713 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:11.309823  1713 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:11.313098  6117 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:11.317166  6049 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:11.327569  1712 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 13:00:11.329288  2437 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:11.330120  1467 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 11 to 12, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.335750  1718 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:11.352735  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:11.353994  1564 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:11.355165  6083 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:11.355933  6083 raft_consensus.cc:697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:11.357811  6083 consensus_queue.cc:237] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:11.363934  1645 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:11.390829  1647 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:11.398022   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:11.408282  6107 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:11.428933  6114 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:11.489583  1569 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:11.497606  1563 consensus_queue.cc:237] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:11.520056  2443 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:11.554428  1568 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:11.538492  6046 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:00:11.539110  6087 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:00:11.618669  6004 raft_consensus.cc:2955] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:11.612811  6011 raft_consensus.cc:2955] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:11.636164  2437 raft_consensus.cc:2955] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:11.612320  1643 raft_consensus.cc:2955] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:11.633724  2443 raft_consensus.cc:2955] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:11.637528  1718 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:11.670749  6082 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:00:11.680621  6100 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:11.683130  1712 raft_consensus.cc:2955] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:11.700683  2440 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:11.706003  6110 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:11.717219  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5c79f18b2f4247348564b91d430d6124 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:11.720834  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ac93f5a09723490eaf799683a1582480 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:11.715842  1466 catalog_manager.cc:5697] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 10 to 11, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:11.783766  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 52668.2us
I20260709 13:00:11.787657  6136 raft_consensus.cc:2955] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:00:11.794516  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 63312.6us
W20260709 13:00:11.796152  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 53887.1us
I20260709 13:00:11.808725  2437 raft_consensus.cc:2955] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:11.813195  1470 catalog_manager.cc:5697] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 8 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:11.827831  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e519a89ee28c45f98d4fe9c4bfea4baf with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:00:11.846479  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 50489.9us
I20260709 13:00:11.847954  1643 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:11.846745  1469 catalog_manager.cc:5697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 6 to 7, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 7 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.857712  1636 tablet_service.cc:1558] Processing DeleteTablet for tablet ac93f5a09723490eaf799683a1582480 with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:50864
I20260709 13:00:11.872990  1470 catalog_manager.cc:5697] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 10 to 11, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New cstate: current_term: 10 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:11.874615  1470 catalog_manager.cc:5697] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:11.896727  6087 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:11.910718  1718 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:11.922257  6120 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:11.932565  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet e519a89ee28c45f98d4fe9c4bfea4baf with delete_type TABLET_DATA_TOMBSTONED (TS 66344ad7cd844754b2c81cc689a709b0 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:47746
I20260709 13:00:11.955684  6141 tablet_replica.cc:333] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:00:11.961602  6142 tablet_replica.cc:333] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:00:11.971652  1570 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:11.988472  1557 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c79f18b2f4247348564b91d430d6124 with delete_type TABLET_DATA_TOMBSTONED (TS 338d817f94ee4c1bad162e9a5860b68a not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:48208
I20260709 13:00:11.988927  1718 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:12.010911  1647 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:12.019847  6141 raft_consensus.cc:2243] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:12.020027  6142 raft_consensus.cc:2243] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:12.020887  6141 raft_consensus.cc:2272] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:12.020987  6142 raft_consensus.cc:2272] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:12.015316  6010 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:00:12.022802  6110 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:12.031802  1645 raft_consensus.cc:2955] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:12.018281  6117 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:00:12.053169  6141 ts_tablet_manager.cc:1916] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:12.066383  6142 ts_tablet_manager.cc:1916] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:12.036301  6145 tablet_replica.cc:333] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:00:12.091735  6145 raft_consensus.cc:2243] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:12.092609  6145 raft_consensus.cc:2272] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:12.101442  6145 ts_tablet_manager.cc:1916] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:00:12.204408  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 58500us
I20260709 13:00:12.215250  6142 ts_tablet_manager.cc:1929] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 13:00:12.215898  6142 log.cc:1199] T e519a89ee28c45f98d4fe9c4bfea4baf P 66344ad7cd844754b2c81cc689a709b0: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/wals/e519a89ee28c45f98d4fe9c4bfea4baf
I20260709 13:00:12.239494  1455 catalog_manager.cc:5028] TS 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): tablet e519a89ee28c45f98d4fe9c4bfea4baf (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:12.319270  6141 ts_tablet_manager.cc:1929] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 13:00:12.319795  6141 log.cc:1199] T ac93f5a09723490eaf799683a1582480 P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/ac93f5a09723490eaf799683a1582480
I20260709 13:00:12.321738  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet ac93f5a09723490eaf799683a1582480 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:12.333746  6145 ts_tablet_manager.cc:1929] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.10
I20260709 13:00:12.338326  6145 log.cc:1199] T 5c79f18b2f4247348564b91d430d6124 P 338d817f94ee4c1bad162e9a5860b68a: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/wals/5c79f18b2f4247348564b91d430d6124
I20260709 13:00:12.353266  1456 catalog_manager.cc:5028] TS 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): tablet 5c79f18b2f4247348564b91d430d6124 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:12.674100   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:12.745350  1568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:00:12.746016  1568 raft_consensus.cc:606] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:12.763841  1568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:00:12.764479  1568 raft_consensus.cc:606] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:12.766297   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:12.768102   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:12.953652  6154 raft_consensus.cc:993] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:12.954335  6110 raft_consensus.cc:1081] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Signalling peer 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:12.956986  1719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:12.957572  1719 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:12.957957  1719 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:12.968005  1719 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:12.974959  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:12.975618  1568 raft_consensus.cc:3055] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:12.975924  1568 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:12.976722  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:12.977339  2440 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:12.976773  1568 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:12.981789  1568 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:12.995682  2440 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:12.997008  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:12.997831  1719 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:12.997867  6109 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:12.998637  6109 raft_consensus.cc:697] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:12.999655  6109 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:13.017061  1568 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:13.021102  1466 catalog_manager.cc:5697] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 12 to 13, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.228016  6110 raft_consensus.cc:993] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:13.228507  6110 raft_consensus.cc:1081] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Signalling peer 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:13.233122  1645 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:13.233599  1712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:13.235813  1712 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:13.237207  1712 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:13.261188  1719 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:13.264545  6153 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:13.269745  1612 consensus_peers.cc:597] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a6fdab08a024ae6999ae0a520cd1cd0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:13.288944  1570 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:13.290449  6120 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:13.250531  1712 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:13.310379  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:13.311036  1564 raft_consensus.cc:3055] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:13.311283  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:13.312013  1645 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:13.311333  1564 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:13.319486  1564 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:13.320612  1564 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:13.320713  1712 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:13.325906  6120 raft_consensus.cc:2955] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:13.347481  1570 raft_consensus.cc:2955] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:13.359866  1718 raft_consensus.cc:2955] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:13.364889  1564 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:13.366825  1686 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:13.368567  6096 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:13.369827  6096 raft_consensus.cc:697] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:13.372557  6096 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:13.388501  1466 catalog_manager.cc:5697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 9 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:13.396191  1645 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:13.418119  1719 consensus_queue.cc:237] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:13.427335  2440 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:13.430003  6109 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:13.544075  1564 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:13.544281  1638 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:00:13.608456  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 62936.5us
W20260709 13:00:13.608520  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 61097.2us
I20260709 13:00:13.612440  1564 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:13.620678  6182 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:13.613266  6169 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:00:13.626899  6172 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:00:13.648859  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 100057us
W20260709 13:00:13.705248  1686 consensus_peers.cc:597] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 478c3696a6364c18a8ebef13ff075bfa. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:13.706676  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 132098us
I20260709 13:00:13.703814  1466 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 12 to 13, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.717976  6096 raft_consensus.cc:2955] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:13.752166  1719 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:13.765391  1638 raft_consensus.cc:2955] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:13.769016   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:13.798138  1466 catalog_manager.cc:5697] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 8, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 10 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:13.848547  1568 raft_consensus.cc:2955] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 13:00:13.856877  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 177109us
I20260709 13:00:13.915163  1645 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:13.916868  6183 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:13.926028  1563 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:13.928321  6171 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:13.944680  1564 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:13.947865  1645 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:13.965574  6171 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:13.967723  6183 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:00:13.963326  6199 ts_tablet_manager.cc:933] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:00:14.042421  1686 consensus_peers.cc:597] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f9c43e38d20461f85176d58e01fc7a1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:14.094857  6109 raft_consensus.cc:2955] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:14.102737  1638 raft_consensus.cc:2955] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:14.138979  6206 ts_tablet_manager.cc:933] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:14.132709  6204 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:00:14.150794  1569 raft_consensus.cc:2955] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:14.217000  1470 catalog_manager.cc:5697] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 12 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:14.233036  1638 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:14.259486  6199 tablet_copy_client.cc:323] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:45463
I20260709 13:00:14.260555  6206 tablet_copy_client.cc:323] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
W20260709 13:00:14.251597  6207 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.009s
I20260709 13:00:14.269194  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet 478c3696a6364c18a8ebef13ff075bfa from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 13:00:14.277542  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet 478c3696a6364c18a8ebef13ff075bfa from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-478c3696a6364c18a8ebef13ff075bfa
I20260709 13:00:14.280184  1717 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:14.285959  6184 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:00:14.285924  1730 tablet_copy_source_session.cc:215] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:14.295934  6206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 478c3696a6364c18a8ebef13ff075bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.310361  1569 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:14.326042  6206 tablet_copy_client.cc:806] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:14.326635  1657 tablet_copy_service.cc:140] P a4be9cc90aca4dd4ad7db103062a7208: Received BeginTabletCopySession request for tablet 4a6fdab08a024ae6999ae0a520cd1cd0 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38584)
I20260709 13:00:14.326778  6206 tablet_copy_client.cc:670] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:14.327323  1657 tablet_copy_service.cc:161] P a4be9cc90aca4dd4ad7db103062a7208: Beginning new tablet copy session on tablet 4a6fdab08a024ae6999ae0a520cd1cd0 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38584: session id = 6f381117554e49bb816791ab0a10f2b8-4a6fdab08a024ae6999ae0a520cd1cd0
W20260709 13:00:14.334088  1612 consensus_peers.cc:597] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25bf4151e41a48f3b21b94c95a02dcd4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:14.336757  6184 raft_consensus.cc:2955] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:14.342296  6153 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:14.342841  1657 tablet_copy_source_session.cc:215] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:14.338629  6206 tablet_copy_client.cc:538] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:14.347187  6199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6fdab08a024ae6999ae0a520cd1cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.358244  1717 raft_consensus.cc:2955] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:14.367058  6206 tablet_bootstrap.cc:492] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:14.431135  1569 raft_consensus.cc:2955] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:14.437222  1469 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index -1 to 10, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:14.498250  6199 tablet_copy_client.cc:806] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:14.499142  6199 tablet_copy_client.cc:670] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:14.524076  6199 tablet_copy_client.cc:538] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:14.621551  6217 ts_tablet_manager.cc:933] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:14.634770  6199 tablet_bootstrap.cc:492] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:14.637854  6217 tablet_copy_client.cc:323] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 13:00:14.639744  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet 1f9c43e38d20461f85176d58e01fc7a1 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 13:00:14.640283  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet 1f9c43e38d20461f85176d58e01fc7a1 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-1f9c43e38d20461f85176d58e01fc7a1
I20260709 13:00:14.648464  1730 tablet_copy_source_session.cc:215] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:14.654122  6217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9c43e38d20461f85176d58e01fc7a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.649271  6206 tablet_bootstrap.cc:492] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:14.668138  6206 tablet_bootstrap.cc:492] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:14.669409  6206 ts_tablet_manager.cc:1403] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.303s	user 0.037s	sys 0.011s
I20260709 13:00:14.680171  6206 raft_consensus.cc:359] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:14.685933  6206 raft_consensus.cc:740] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:14.689170  6206 consensus_queue.cc:260] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:14.707974  6206 ts_tablet_manager.cc:1434] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:00:14.715950  6217 tablet_copy_client.cc:806] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:14.718029  6217 tablet_copy_client.cc:670] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:14.718647  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-478c3696a6364c18a8ebef13ff075bfa received from {username='slave'} at 127.0.0.1:54412
I20260709 13:00:14.719177  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-478c3696a6364c18a8ebef13ff075bfa on tablet 478c3696a6364c18a8ebef13ff075bfa with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:14.733356  6217 tablet_copy_client.cc:538] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:14.762598  6217 tablet_bootstrap.cc:492] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:14.811991  2440 raft_consensus.cc:1217] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 13:00:14.882542  6199 tablet_bootstrap.cc:492] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:14.883674  6199 tablet_bootstrap.cc:492] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:14.885210  6199 ts_tablet_manager.cc:1403] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.251s	user 0.029s	sys 0.006s
I20260709 13:00:14.892881   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:14.906426  6206 ts_tablet_manager.cc:933] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:14.929104  6199 raft_consensus.cc:359] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:14.929984  6199 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:14.943454  6199 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:14.966082  6199 ts_tablet_manager.cc:1434] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.000s
I20260709 13:00:14.972756  1657 tablet_copy_service.cc:342] P a4be9cc90aca4dd4ad7db103062a7208: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-4a6fdab08a024ae6999ae0a520cd1cd0 received from {username='slave'} at 127.0.0.1:38584
I20260709 13:00:14.973264  1657 tablet_copy_service.cc:434] P a4be9cc90aca4dd4ad7db103062a7208: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-4a6fdab08a024ae6999ae0a520cd1cd0 on tablet 4a6fdab08a024ae6999ae0a520cd1cd0 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:14.997352  6206 tablet_copy_client.cc:323] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:45463
I20260709 13:00:15.000801  1657 tablet_copy_service.cc:140] P a4be9cc90aca4dd4ad7db103062a7208: Received BeginTabletCopySession request for tablet 25bf4151e41a48f3b21b94c95a02dcd4 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38584)
I20260709 13:00:15.001366  1657 tablet_copy_service.cc:161] P a4be9cc90aca4dd4ad7db103062a7208: Beginning new tablet copy session on tablet 25bf4151e41a48f3b21b94c95a02dcd4 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38584: session id = 6f381117554e49bb816791ab0a10f2b8-25bf4151e41a48f3b21b94c95a02dcd4
I20260709 13:00:15.024600  1657 tablet_copy_source_session.cc:215] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:15.036342  6206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bf4151e41a48f3b21b94c95a02dcd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:15.046141  1721 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:15.046808  1721 raft_consensus.cc:606] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:15.050211   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:00:15.051976   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:15.073066  6217 tablet_bootstrap.cc:492] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:15.088521  6217 tablet_bootstrap.cc:492] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:15.099973  6217 ts_tablet_manager.cc:1403] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.338s	user 0.044s	sys 0.023s
I20260709 13:00:15.103236  6217 raft_consensus.cc:359] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:15.124536  6217 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:15.125360  6217 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:15.128305  6217 ts_tablet_manager.cc:1434] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:00:15.135593  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-1f9c43e38d20461f85176d58e01fc7a1 received from {username='slave'} at 127.0.0.1:54412
I20260709 13:00:15.136055  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-1f9c43e38d20461f85176d58e01fc7a1 on tablet 1f9c43e38d20461f85176d58e01fc7a1 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:15.136166  6206 tablet_copy_client.cc:806] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:15.136723  6206 tablet_copy_client.cc:670] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:15.178325  6172 raft_consensus.cc:993] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 13:00:15.178884  6172 raft_consensus.cc:1081] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Signalling peer 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 13:00:15.180052  6206 tablet_copy_client.cc:538] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:15.181478  1563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:46640
I20260709 13:00:15.182996  1563 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:15.183450  1563 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:15.195498  6206 tablet_bootstrap.cc:492] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:15.232002  1563 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:15.245608  1563 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:15.327461  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:15.328135  2440 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:15.330204  2443 raft_consensus.cc:1217] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 13:00:15.414507  2440 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:00:15.424924  2437 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:15.437702  1537 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:15.442302  6154 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:15.442860  6154 raft_consensus.cc:697] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:15.443738  6154 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:15.459075  6224 raft_consensus.cc:1064] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:15.461522  6224 consensus_queue.cc:237] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:15.504976  6206 tablet_bootstrap.cc:492] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:00:15.511581  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 67458.6us
I20260709 13:00:15.486986  6172 consensus_queue.cc:1059] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:00:15.545176  1647 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:15.524988  6206 tablet_bootstrap.cc:492] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:15.546849  6206 ts_tablet_manager.cc:1403] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.352s	user 0.039s	sys 0.012s
I20260709 13:00:15.550678  6223 raft_consensus.cc:3055] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:15.551180  6223 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:15.552129  6223 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:15.553437  6223 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:15.555959  6206 raft_consensus.cc:359] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:15.548117  6172 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:00:15.578305  6206 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:15.603382  6206 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
W20260709 13:00:15.594691  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 110093us
I20260709 13:00:15.605985  1469 catalog_manager.cc:5697] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 13 to 14, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 14 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:15.590812  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 95984.6us
W20260709 13:00:15.617653  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 103355us
I20260709 13:00:15.622134  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:15.637136  1717 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:00:15.641498  2437 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:15.641597  2440 raft_consensus.cc:1217] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 13:00:15.652473  6236 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:15.656607  6206 ts_tablet_manager.cc:1434] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.109s	user 0.005s	sys 0.000s
I20260709 13:00:15.666265  1567 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:15.709723  1657 tablet_copy_service.cc:342] P a4be9cc90aca4dd4ad7db103062a7208: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-25bf4151e41a48f3b21b94c95a02dcd4 received from {username='slave'} at 127.0.0.1:38584
I20260709 13:00:15.719208  1657 tablet_copy_service.cc:434] P a4be9cc90aca4dd4ad7db103062a7208: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-25bf4151e41a48f3b21b94c95a02dcd4 on tablet 25bf4151e41a48f3b21b94c95a02dcd4 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:15.743114  6231 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:15.762233  2443 raft_consensus.cc:1217] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 13:00:15.787405  6178 raft_consensus.cc:1064] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:15.790320  6178 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:15.813915  6231 raft_consensus.cc:2955] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:15.821776  2437 raft_consensus.cc:2955] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:15.841840  1470 catalog_manager.cc:5697] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 8 to 9, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:15.845541  2437 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:00:15.848251  6226 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:15.864490  1712 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:15.885337  2437 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:15.891022  1571 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:15.892259  6178 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:00:15.909211  6184 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:00:15.941973  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 77772.7us
I20260709 13:00:15.980126  1647 raft_consensus.cc:2955] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:15.993484  6179 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:00:16.019412  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 63540.9us
I20260709 13:00:16.079842  1567 raft_consensus.cc:2955] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.091965  6245 raft_consensus.cc:2955] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:00:16.106777  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 43874.4us
I20260709 13:00:16.110074  1717 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:00:16.111008  1567 raft_consensus.cc:2955] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.119374  6226 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:16.131405   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:16.168012  2443 raft_consensus.cc:2955] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.286860  6253 raft_consensus.cc:1064] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:16.289724  6253 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:16.307535  6178 raft_consensus.cc:1064] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:16.312536  1721 consensus_queue.cc:237] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:16.305701  1469 catalog_manager.cc:5697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.332322  6178 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:16.335146  1645 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:16.340950  2437 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:16.350684  6170 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:16.357484  6224 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:16.367152  1717 raft_consensus.cc:2955] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.377789  6224 raft_consensus.cc:2955] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.384958  1638 raft_consensus.cc:2955] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.392827  1645 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:16.394840  6109 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:16.387030  2437 raft_consensus.cc:2955] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.389377  2443 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:16.390988  1567 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:16.399582  6109 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:16.414873  6255 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:00:16.440105  1721 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:16.443670  2440 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:16.444141  6259 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:16.446909  6178 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:16.447824  1570 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:16.452464  6259 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:16.473501  1647 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:16.487864  6245 raft_consensus.cc:2955] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.495436  2436 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:16.502924  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 478c3696a6364c18a8ebef13ff075bfa with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:16.503795  1570 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:16.508829  6178 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:16.511920  1570 raft_consensus.cc:2955] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.519101  6179 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:16.528462  1470 catalog_manager.cc:5697] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 9 to 10, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New cstate: current_term: 10 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.575336  6184 raft_consensus.cc:2955] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.589643  1570 raft_consensus.cc:2955] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:00:16.624266  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 59462.7us
I20260709 13:00:16.632683  1721 raft_consensus.cc:2955] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.638696  2443 raft_consensus.cc:2955] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.642547  2437 raft_consensus.cc:2955] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.642760  2440 raft_consensus.cc:2955] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.608795  6224 raft_consensus.cc:2955] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.663552  1467 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 10 to 11, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.680249  1557 tablet_service.cc:1558] Processing DeleteTablet for tablet 478c3696a6364c18a8ebef13ff075bfa with delete_type TABLET_DATA_TOMBSTONED (TS 338d817f94ee4c1bad162e9a5860b68a not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:48208
I20260709 13:00:16.700271  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4a6fdab08a024ae6999ae0a520cd1cd0 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:00:16.700791  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 48992us
I20260709 13:00:16.703209  1638 raft_consensus.cc:2955] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.711673  1571 raft_consensus.cc:2955] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.747391  1470 catalog_manager.cc:5697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New cstate: current_term: 9 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:16.760131  1467 catalog_manager.cc:5697] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.768586  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a6fdab08a024ae6999ae0a520cd1cd0 with delete_type TABLET_DATA_TOMBSTONED (TS 66344ad7cd844754b2c81cc689a709b0 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:47746
I20260709 13:00:16.771570  1647 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:16.806442  1721 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:16.823601  6274 tablet_replica.cc:333] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:00:16.823611  1567 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:16.824235  2437 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:16.833593  6224 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:16.834679  6236 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:16.842639  6275 tablet_replica.cc:333] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:00:16.842881  2443 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:16.845403  6236 raft_consensus.cc:2955] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.830600  6274 raft_consensus.cc:2243] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:16.858853  1567 raft_consensus.cc:2955] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.866461  6274 raft_consensus.cc:2272] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:16.870674  6274 ts_tablet_manager.cc:1916] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:16.876942  6184 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:16.883366  2443 raft_consensus.cc:2955] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.906781  1467 catalog_manager.cc:5697] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 10 to 11, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 12 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.940591  6275 raft_consensus.cc:2243] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:16.950498  6275 raft_consensus.cc:2272] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:16.965771  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 50257.9us
I20260709 13:00:16.970258  6272 raft_consensus.cc:2955] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.975047  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f9c43e38d20461f85176d58e01fc7a1 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:16.982810  1636 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f9c43e38d20461f85176d58e01fc7a1 with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:50864
I20260709 13:00:16.992403  2440 raft_consensus.cc:2955] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:16.999992  6274 ts_tablet_manager.cc:1929] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.9
I20260709 13:00:17.000496  6274 log.cc:1199] T 478c3696a6364c18a8ebef13ff075bfa P 338d817f94ee4c1bad162e9a5860b68a: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/wals/478c3696a6364c18a8ebef13ff075bfa
I20260709 13:00:17.007364  1570 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:17.017196  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 25bf4151e41a48f3b21b94c95a02dcd4 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:17.018639  6276 tablet_replica.cc:333] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:00:17.019762  6276 raft_consensus.cc:2243] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:17.020663  6276 raft_consensus.cc:2272] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:17.026405  1456 catalog_manager.cc:5028] TS 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): tablet 478c3696a6364c18a8ebef13ff075bfa (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:17.016333  6275 ts_tablet_manager.cc:1916] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:17.032537  6184 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:00:17.030344  1469 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 11 to 12, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:17.046599  6276 ts_tablet_manager.cc:1916] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:17.068524  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet 25bf4151e41a48f3b21b94c95a02dcd4 with delete_type TABLET_DATA_TOMBSTONED (TS 66344ad7cd844754b2c81cc689a709b0 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:47746
I20260709 13:00:17.099282  1567 raft_consensus.cc:2955] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:17.116750  6275 ts_tablet_manager.cc:1929] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 13:00:17.117336  6275 log.cc:1199] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 66344ad7cd844754b2c81cc689a709b0: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/wals/4a6fdab08a024ae6999ae0a520cd1cd0
I20260709 13:00:17.135267  1455 catalog_manager.cc:5028] TS 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): tablet 4a6fdab08a024ae6999ae0a520cd1cd0 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:17.135336  6275 tablet_replica.cc:333] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:00:17.141494  6275 raft_consensus.cc:2243] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:17.150887  6275 raft_consensus.cc:2272] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:17.159958  6275 ts_tablet_manager.cc:1916] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:17.191587  6276 ts_tablet_manager.cc:1929] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 13:00:17.192086  6276 log.cc:1199] T 1f9c43e38d20461f85176d58e01fc7a1 P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/1f9c43e38d20461f85176d58e01fc7a1
I20260709 13:00:17.193919  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet 1f9c43e38d20461f85176d58e01fc7a1 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:17.248413  6275 ts_tablet_manager.cc:1929] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.11
I20260709 13:00:17.270308  6275 log.cc:1199] T 25bf4151e41a48f3b21b94c95a02dcd4 P 66344ad7cd844754b2c81cc689a709b0: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/wals/25bf4151e41a48f3b21b94c95a02dcd4
I20260709 13:00:17.272039  1455 catalog_manager.cc:5028] TS 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): tablet 25bf4151e41a48f3b21b94c95a02dcd4 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:17.581414   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:17.872021  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 86053.5us
W20260709 13:00:17.889138  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 95442.9us
I20260709 13:00:18.041101  1570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:00:18.042222  1570 raft_consensus.cc:606] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:18.044621   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:00:18.049914   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:18.295528  6269 raft_consensus.cc:993] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:18.296123  6269 raft_consensus.cc:1081] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:18.315949  1645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36692
I20260709 13:00:18.316634  1645 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:18.317098  1645 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:18.348102  1647 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:18.372287  1717 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:18.374157  6215 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:00:18.380146  1612 consensus_peers.cc:597] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c55d053b55024621933828292867f0e6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.385056  1570 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:18.388460  6286 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:18.393968  1645 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:18.427048  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:18.427923  1719 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:18.426260  1645 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:18.431077  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:18.431730  1567 raft_consensus.cc:3055] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:18.432024  1567 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:18.432870  1567 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:18.433991  1567 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:18.468624  6215 raft_consensus.cc:2955] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:18.439177  1719 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:00:18.479496  1611 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:18.480719  6178 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:18.481266  6178 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:18.482221  6178 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:18.491997  1567 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:00:18.483170  1717 raft_consensus.cc:2955] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:18.508513  1467 catalog_manager.cc:5697] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 12 to 13, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.524684  1567 raft_consensus.cc:2955] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:18.537475  1568 consensus_queue.cc:237] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
W20260709 13:00:18.557210  1537 consensus_peers.cc:597] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d6b5add0ec94eccb0981a9bb10c79ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.561854  1641 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:18.564131  6284 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:18.564432  1469 catalog_manager.cc:5697] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index -1 to 8, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 11 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:18.588519  6283 raft_consensus.cc:2955] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:18.590515  1717 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:18.596470  6280 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:18.600040  1641 raft_consensus.cc:2955] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:18.613296  1718 raft_consensus.cc:2955] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:18.639438  1717 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:18.676050  1645 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:00:18.676322  1686 consensus_peers.cc:597] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: daf4ad4ac54a4a228481863e56e53d54. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.678961  1568 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:18.679104  6236 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:18.680733  6289 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:18.719803  6289 raft_consensus.cc:2955] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:18.725968  1568 raft_consensus.cc:2955] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:18.743512  1645 raft_consensus.cc:2955] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 13:00:18.807170  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 67035.4us
I20260709 13:00:18.863426  1717 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:18.919149  1571 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:18.917663  6307 ts_tablet_manager.cc:933] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:18.927506  6285 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:00:18.924528  1467 catalog_manager.cc:5697] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 7 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:18.933662  1467 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 10, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 13 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:18.944687  6307 tablet_copy_client.cc:323] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:45463
I20260709 13:00:18.948081  1657 tablet_copy_service.cc:140] P a4be9cc90aca4dd4ad7db103062a7208: Received BeginTabletCopySession request for tablet c55d053b55024621933828292867f0e6 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38584)
I20260709 13:00:18.948717  1657 tablet_copy_service.cc:161] P a4be9cc90aca4dd4ad7db103062a7208: Beginning new tablet copy session on tablet c55d053b55024621933828292867f0e6 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38584: session id = 6f381117554e49bb816791ab0a10f2b8-c55d053b55024621933828292867f0e6
I20260709 13:00:18.963621  1657 tablet_copy_source_session.cc:215] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:00:18.967185  1686 consensus_peers.cc:597] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a186179c799f4e53a8adf725dfd98a58. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.973774  1568 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:18.975267  1645 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:18.976603  6303 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:18.979802  6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c55d053b55024621933828292867f0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:18.978404  6305 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:00:19.035149  6231 raft_consensus.cc:2955] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:19.051884   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:19.052532  1567 raft_consensus.cc:2955] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:19.092381  1718 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:19.094401  6215 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:19.102195  1467 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:19.112073  6316 ts_tablet_manager.cc:933] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 13:00:19.141201  6307 tablet_copy_client.cc:806] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:19.142330  1641 raft_consensus.cc:2955] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:19.175725  6316 tablet_copy_client.cc:323] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 13:00:19.177960  1581 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet 2d6b5add0ec94eccb0981a9bb10c79ef from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 13:00:19.178546  1581 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet 2d6b5add0ec94eccb0981a9bb10c79ef from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-2d6b5add0ec94eccb0981a9bb10c79ef
I20260709 13:00:19.186503  1581 tablet_copy_source_session.cc:215] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:19.196259  6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6b5add0ec94eccb0981a9bb10c79ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:19.212294  6307 tablet_copy_client.cc:670] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:19.238711  6307 tablet_copy_client.cc:538] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:19.301343  6307 tablet_bootstrap.cc:492] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:19.342084  6316 tablet_copy_client.cc:806] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:19.345990  6316 tablet_copy_client.cc:670] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:19.349128  6319 ts_tablet_manager.cc:933] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:19.355737  6316 tablet_copy_client.cc:538] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:19.371588  6319 tablet_copy_client.cc:323] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 13:00:19.373749  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet daf4ad4ac54a4a228481863e56e53d54 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 13:00:19.375077  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet daf4ad4ac54a4a228481863e56e53d54 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-daf4ad4ac54a4a228481863e56e53d54
I20260709 13:00:19.387132  1730 tablet_copy_source_session.cc:215] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:19.390538  6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf4ad4ac54a4a228481863e56e53d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:19.404556  6316 tablet_bootstrap.cc:492] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:19.453564  6323 ts_tablet_manager.cc:933] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:19.465502  6323 tablet_copy_client.cc:323] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 13:00:19.467294  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet a186179c799f4e53a8adf725dfd98a58 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 13:00:19.467878  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet a186179c799f4e53a8adf725dfd98a58 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-a186179c799f4e53a8adf725dfd98a58
I20260709 13:00:19.478592  1730 tablet_copy_source_session.cc:215] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:19.503680  6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a186179c799f4e53a8adf725dfd98a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:19.505961  6307 tablet_bootstrap.cc:492] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.506968  6307 tablet_bootstrap.cc:492] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:19.530251  6307 ts_tablet_manager.cc:1403] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.229s	user 0.042s	sys 0.004s
I20260709 13:00:19.533879  6307 raft_consensus.cc:359] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:19.534785  6307 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:19.539881  6307 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:19.553629  6307 ts_tablet_manager.cc:1434] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:00:19.564357  1657 tablet_copy_service.cc:342] P a4be9cc90aca4dd4ad7db103062a7208: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-c55d053b55024621933828292867f0e6 received from {username='slave'} at 127.0.0.1:38584
I20260709 13:00:19.564853  1657 tablet_copy_service.cc:434] P a4be9cc90aca4dd4ad7db103062a7208: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-c55d053b55024621933828292867f0e6 on tablet c55d053b55024621933828292867f0e6 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:19.588807  6316 tablet_bootstrap.cc:492] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.588838  6319 tablet_copy_client.cc:806] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:19.591898  6319 tablet_copy_client.cc:670] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:19.589923  6316 tablet_bootstrap.cc:492] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:19.594229  6316 ts_tablet_manager.cc:1403] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.190s	user 0.044s	sys 0.004s
I20260709 13:00:19.597549  6316 raft_consensus.cc:359] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:19.601974  6316 raft_consensus.cc:740] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:19.602732  6316 consensus_queue.cc:260] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:19.608078  6316 ts_tablet_manager.cc:1434] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:00:19.602197  6319 tablet_copy_client.cc:538] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:19.610260  1581 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-2d6b5add0ec94eccb0981a9bb10c79ef received from {username='slave'} at 127.0.0.1:38394
I20260709 13:00:19.610723  1581 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-2d6b5add0ec94eccb0981a9bb10c79ef on tablet 2d6b5add0ec94eccb0981a9bb10c79ef with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:19.622859  2443 raft_consensus.cc:1217] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 13:00:19.642894  6319 tablet_bootstrap.cc:492] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:19.715879  6319 tablet_bootstrap.cc:492] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.718922  6323 tablet_copy_client.cc:806] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:19.722265  6323 tablet_copy_client.cc:670] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:19.731359  6323 tablet_copy_client.cc:538] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:19.717555  6319 tablet_bootstrap.cc:492] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:19.736006  6319 ts_tablet_manager.cc:1403] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.093s	user 0.035s	sys 0.006s
I20260709 13:00:19.740744  6319 raft_consensus.cc:359] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:19.741756  6319 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:19.742573  6319 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:19.746490  6319 ts_tablet_manager.cc:1434] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:00:19.748931  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-daf4ad4ac54a4a228481863e56e53d54 received from {username='slave'} at 127.0.0.1:54412
I20260709 13:00:19.749353  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-daf4ad4ac54a4a228481863e56e53d54 on tablet daf4ad4ac54a4a228481863e56e53d54 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:19.753144  6323 tablet_bootstrap.cc:492] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:19.834959  6323 tablet_bootstrap.cc:492] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.835944  6323 tablet_bootstrap.cc:492] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:19.836681  6323 ts_tablet_manager.cc:1403] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.084s	user 0.029s	sys 0.019s
I20260709 13:00:19.842374  6323 raft_consensus.cc:359] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:19.843267  6323 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:19.843990  6323 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:19.846586  6323 ts_tablet_manager.cc:1434] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:00:19.848886  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-a186179c799f4e53a8adf725dfd98a58 received from {username='slave'} at 127.0.0.1:54412
I20260709 13:00:19.849437  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-a186179c799f4e53a8adf725dfd98a58 on tablet a186179c799f4e53a8adf725dfd98a58 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:19.915175  2443 raft_consensus.cc:1217] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 13:00:19.993330  2443 raft_consensus.cc:1217] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 13:00:20.332804  6215 raft_consensus.cc:1064] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:20.338243  2443 raft_consensus.cc:1217] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:00:20.339869  6215 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:20.364038   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:20.377553  1718 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:20.379658  6286 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:20.389451  6269 raft_consensus.cc:1064] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:20.392179  6269 consensus_queue.cc:237] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:20.489002  2443 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:20.557786  1568 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:20.575105  2443 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:20.582620  6332 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:00:20.606271  6305 raft_consensus.cc:1064] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:20.608884  6305 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:20.624133  1718 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:20.665481  2437 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:20.667333  6170 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:20.672061  6284 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:20.678943  1568 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:20.682070  1646 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:20.704748  6305 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:20.716084  1644 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:20.751368  6231 raft_consensus.cc:2955] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:20.822369  1470 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:20.825076  2440 raft_consensus.cc:2955] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:20.832787  6269 raft_consensus.cc:2955] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:20.842284  1717 raft_consensus.cc:2955] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:20.851977  2443 raft_consensus.cc:2955] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:20.855515  6334 raft_consensus.cc:1064] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:20.852008  6215 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:00:20.878544  1571 raft_consensus.cc:2955] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:00:20.897547  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 51040.6us
I20260709 13:00:20.899760  1469 catalog_manager.cc:5697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:20.914780  6334 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:20.932081  6215 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:20.948479  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 65621.2us
I20260709 13:00:20.970400  1647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:44428
I20260709 13:00:20.971246  1647 raft_consensus.cc:606] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
W20260709 13:00:21.012491  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 64512.1us
I20260709 13:00:21.023542   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:00:21.025336   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:21.028658  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 73466.6us
I20260709 13:00:21.053573  2443 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:21.059276  6170 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:21.042321  6343 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:00:21.073804  6332 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 13:00:21.128262  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 97842.6us
I20260709 13:00:21.143498  6286 raft_consensus.cc:2955] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.154296  1718 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:21.162695  2440 raft_consensus.cc:2955] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.167028  2437 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:21.168292  6328 raft_consensus.cc:993] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: : Instructing follower 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 13:00:21.169562  6328 raft_consensus.cc:1081] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Signalling peer 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 13:00:21.169502  6334 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:21.193143  1568 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:21.198659  6359 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:21.241582  1569 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:21.249529  6343 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:21.258522  1569 raft_consensus.cc:2955] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.263880  2440 raft_consensus.cc:2955] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.275311  1470 catalog_manager.cc:5697] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 8 to 9, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.275875  1568 consensus_queue.cc:237] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:21.280580  6359 raft_consensus.cc:2955] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:00:21.286836  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 124227us
W20260709 13:00:21.287460  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 86707us
I20260709 13:00:21.291183  1717 raft_consensus.cc:2955] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.335913  1644 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:21.343786  2440 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:21.352471  6353 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:21.359738  1569 raft_consensus.cc:2955] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.366948  1721 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:21.368887  6358 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:21.395514  1569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:46634
I20260709 13:00:21.396112  1569 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:21.396512  1569 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:21.396239  6305 raft_consensus.cc:2955] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.402149  6284 raft_consensus.cc:2955] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.404495  1571 raft_consensus.cc:2955] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.413743  1470 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 10 to 11, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.418730  1638 raft_consensus.cc:2955] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.423225  1569 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:21.433568  1636 tablet_service.cc:1558] Processing DeleteTablet for tablet a186179c799f4e53a8adf725dfd98a58 with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:50864
I20260709 13:00:21.438810  6357 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:21.447786  1721 raft_consensus.cc:2955] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.461086  2440 raft_consensus.cc:2955] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.470175  1568 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:21.427503  1647 raft_consensus.cc:2955] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.486493  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:21.487123  1646 raft_consensus.cc:3055] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:21.487407  1646 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:21.488101  1646 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:21.489257  1646 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:21.489137  1643 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:21.498046  1569 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:21.505283  1470 catalog_manager.cc:5697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index 8 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 7 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.515407  1466 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 10 to 11, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.518261  1646 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
W20260709 13:00:21.523116  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 57563.1us
I20260709 13:00:21.525180  1721 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:21.531014  2440 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:21.541154  1629 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d6b5add0ec94eccb0981a9bb10c79ef with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:50864
I20260709 13:00:21.544135  6215 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:21.545997  6328 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:21.547806  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:21.548385  2443 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:21.589231  2443 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:21.594789  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:21.597886  1643 raft_consensus.cc:2955] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.604971  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a186179c799f4e53a8adf725dfd98a58 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:21.602105  6369 tablet_replica.cc:333] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:00:21.602139  6358 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:21.610679  6358 raft_consensus.cc:697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:21.610312  2440 raft_consensus.cc:2955] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.611661  6358 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:21.616533  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 89334us
I20260709 13:00:21.624868  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d6b5add0ec94eccb0981a9bb10c79ef with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:21.644871  1466 catalog_manager.cc:5697] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 9 to 10, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New cstate: current_term: 11 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.649979  6369 raft_consensus.cc:2243] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:21.650775  6369 raft_consensus.cc:2272] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:21.659538  6363 raft_consensus.cc:2955] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.671178  2437 raft_consensus.cc:2955] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.673429  6369 ts_tablet_manager.cc:1916] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:21.676461  1721 raft_consensus.cc:2955] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:21.727270  1557 tablet_service.cc:1558] Processing DeleteTablet for tablet c55d053b55024621933828292867f0e6 with delete_type TABLET_DATA_TOMBSTONED (TS 338d817f94ee4c1bad162e9a5860b68a not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:48208
I20260709 13:00:21.733479  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c55d053b55024621933828292867f0e6 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:21.742693  6369 ts_tablet_manager.cc:1929] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 13:00:21.743335  6369 log.cc:1199] T a186179c799f4e53a8adf725dfd98a58 P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/a186179c799f4e53a8adf725dfd98a58
I20260709 13:00:21.745225  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet a186179c799f4e53a8adf725dfd98a58 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:21.746438  6369 tablet_replica.cc:333] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:00:21.763430  6369 raft_consensus.cc:2243] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:21.764595  6369 raft_consensus.cc:2272] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:21.772493  6369 ts_tablet_manager.cc:1916] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:21.784281  1466 catalog_manager.cc:5697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 9 to 10, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 10 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:21.811331  6377 tablet_replica.cc:333] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:00:21.819013  6377 raft_consensus.cc:2243] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:21.820050  6377 raft_consensus.cc:2272] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:21.830302  6377 ts_tablet_manager.cc:1916] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:21.837455  6369 ts_tablet_manager.cc:1929] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.8
I20260709 13:00:21.839010  6369 log.cc:1199] T 2d6b5add0ec94eccb0981a9bb10c79ef P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/2d6b5add0ec94eccb0981a9bb10c79ef
I20260709 13:00:21.840477  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet 2d6b5add0ec94eccb0981a9bb10c79ef (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:21.969484  6377 ts_tablet_manager.cc:1929] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 13:00:21.970088  6377 log.cc:1199] T c55d053b55024621933828292867f0e6 P 338d817f94ee4c1bad162e9a5860b68a: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/wals/c55d053b55024621933828292867f0e6
I20260709 13:00:21.974710  1456 catalog_manager.cc:5028] TS 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): tablet c55d053b55024621933828292867f0e6 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:22.026290   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:22.067678  1721 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:22.084440  1643 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:22.085819  2437 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:22.087270  6357 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:22.089571  6305 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:22.106701  6343 raft_consensus.cc:2955] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:22.116745  2437 raft_consensus.cc:2955] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:22.121394  1643 raft_consensus.cc:2955] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:22.133991  1466 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 11 to 12, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New cstate: current_term: 13 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:22.170583  2437 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:22.172243  6374 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:22.178494  1557 tablet_service.cc:1558] Processing DeleteTablet for tablet daf4ad4ac54a4a228481863e56e53d54 with delete_type TABLET_DATA_TOMBSTONED (TS 338d817f94ee4c1bad162e9a5860b68a not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:48208
I20260709 13:00:22.179477  6377 tablet_replica.cc:333] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:00:22.180398  6377 raft_consensus.cc:2243] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:22.182924  6377 raft_consensus.cc:2272] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:22.191079  6377 ts_tablet_manager.cc:1916] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:22.205786  1643 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:22.208253  6376 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:22.233213  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet daf4ad4ac54a4a228481863e56e53d54 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:22.358278  6377 ts_tablet_manager.cc:1929] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:00:22.358834  6377 log.cc:1199] T daf4ad4ac54a4a228481863e56e53d54 P 338d817f94ee4c1bad162e9a5860b68a: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/wals/daf4ad4ac54a4a228481863e56e53d54
I20260709 13:00:22.360550  1456 catalog_manager.cc:5028] TS 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): tablet daf4ad4ac54a4a228481863e56e53d54 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:23.199592   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:23.217393  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 46694.1us
W20260709 13:00:23.218961  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 48753.6us
I20260709 13:00:23.305042  1569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:00:23.305677  1569 raft_consensus.cc:606] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:23.332114   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
W20260709 13:00:23.334506  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 47209.1us
I20260709 13:00:23.334688   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:23.358987  1569 consensus_queue.cc:237] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
W20260709 13:00:23.363011  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 76774.2us
W20260709 13:00:23.387804  1537 consensus_peers.cc:597] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8c2c21bc6aa4835b68933c89735091f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:23.389117  1717 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:23.390857  6385 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:23.417270  1643 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:23.418987  6386 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:23.435518  6385 raft_consensus.cc:2955] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:23.451814  1718 raft_consensus.cc:2955] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:23.504052  1638 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:23.505678  1466 catalog_manager.cc:5697] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:23.524899  1718 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:00:23.532812  1612 consensus_peers.cc:597] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff20dea159284907b41e95b640800f50. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:23.533470  6393 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:23.547005  1569 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:23.625581  6390 raft_consensus.cc:2955] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:23.630831  1718 raft_consensus.cc:2955] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 13:00:23.642036  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 82679.2us
I20260709 13:00:23.646248  6391 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:23.647212  1643 raft_consensus.cc:2955] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:23.686784  1718 consensus_queue.cc:237] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:23.702571  6401 raft_consensus.cc:993] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:23.703143  6401 raft_consensus.cc:1081] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Signalling peer 66344ad7cd844754b2c81cc689a709b0 to start an election
I20260709 13:00:23.706082  1717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:23.706614  1717 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:23.706984  1717 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:23.719533  1717 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:23.726191  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:23.726890  1570 raft_consensus.cc:3055] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:23.727308  1570 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:23.728579  1570 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:23.729076  1717 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:23.729383  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:23.729796  1570 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:23.729992  2436 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:23.699064  1568 raft_consensus.cc:2955] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:23.759686  2436 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:00:23.762677  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:23.764182  6334 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:23.764706  6334 raft_consensus.cc:697] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:23.766403  1645 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:23.767930  6357 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:00:23.769749  1686 consensus_peers.cc:597] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8ca192f35fd14bb58ebd0766d7a202f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:23.770334  1569 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:23.771046  6334 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:23.778488  6357 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:23.802384  1570 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:00:23.820669  1469 catalog_manager.cc:5697] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 11 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:23.865221  6305 raft_consensus.cc:2955] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:23.867283  1466 catalog_manager.cc:5697] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 14 to 15, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.883780  1569 raft_consensus.cc:2955] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:23.904500  1645 raft_consensus.cc:2955] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:23.916576  6411 ts_tablet_manager.cc:933] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 13:00:23.919450  1643 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:23.926836  1469 catalog_manager.cc:5697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.927065  6412 ts_tablet_manager.cc:933] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:23.985301  1718 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:23.986825  6411 tablet_copy_client.cc:323] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 13:00:23.987758  2440 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Advancing to term 10
I20260709 13:00:23.990468  1569 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:23.988174  6393 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:23.998667  6390 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:24.012223  6412 tablet_copy_client.cc:323] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:45463
I20260709 13:00:24.014593  1657 tablet_copy_service.cc:140] P a4be9cc90aca4dd4ad7db103062a7208: Received BeginTabletCopySession request for tablet ff20dea159284907b41e95b640800f50 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38584)
I20260709 13:00:24.015197  1657 tablet_copy_service.cc:161] P a4be9cc90aca4dd4ad7db103062a7208: Beginning new tablet copy session on tablet ff20dea159284907b41e95b640800f50 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38584: session id = 6f381117554e49bb816791ab0a10f2b8-ff20dea159284907b41e95b640800f50
I20260709 13:00:24.019155  1718 raft_consensus.cc:2955] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:24.023722  1657 tablet_copy_source_session.cc:215] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:24.020224  6390 raft_consensus.cc:2955] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:24.027011  2440 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:24.027686  1581 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet b8c2c21bc6aa4835b68933c89735091f from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 13:00:24.028262  1581 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet b8c2c21bc6aa4835b68933c89735091f from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-b8c2c21bc6aa4835b68933c89735091f
I20260709 13:00:24.032037  6391 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:24.033005  6391 consensus_queue.cc:1243] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 6f381117554e49bb816791ab0a10f2b8 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:24.033420  6412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff20dea159284907b41e95b640800f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:24.036936  2440 pending_rounds.cc:85] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 5
I20260709 13:00:24.037283  2440 pending_rounds.cc:107] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.6
I20260709 13:00:24.042375  1581 tablet_copy_source_session.cc:215] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:24.043983  1568 raft_consensus.cc:2955] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:24.042004  2440 raft_consensus.cc:2917] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Aborting config change with OpId 8.6: Aborted: Op aborted by new leader
I20260709 13:00:24.050539  2440 raft_consensus.cc:2889] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 10 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:24.078308  1469 catalog_manager.cc:5697] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:24.086637  6411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c2c21bc6aa4835b68933c89735091f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:24.123703  6412 tablet_copy_client.cc:806] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:24.153616  2440 raft_consensus.cc:2955] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:24.162920  1568 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:00:24.164047  6411 tablet_copy_client.cc:806] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:24.169472  6305 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:24.153874  6412 tablet_copy_client.cc:670] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:24.164645  6411 tablet_copy_client.cc:670] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:24.190485  6412 tablet_copy_client.cc:538] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:24.204690  6411 tablet_copy_client.cc:538] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:24.217825  6412 tablet_bootstrap.cc:492] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:24.233819  6411 tablet_bootstrap.cc:492] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:24.314142  2436 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:00:24.315668  6334 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:24.354130   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:24.377521  6425 ts_tablet_manager.cc:933] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:24.448567  6425 tablet_copy_client.cc:323] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
I20260709 13:00:24.450282  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet 8ca192f35fd14bb58ebd0766d7a202f8 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 13:00:24.450812  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet 8ca192f35fd14bb58ebd0766d7a202f8 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-8ca192f35fd14bb58ebd0766d7a202f8
I20260709 13:00:24.465319  1730 tablet_copy_source_session.cc:215] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:24.465603  6412 tablet_bootstrap.cc:492] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:24.469290  6425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca192f35fd14bb58ebd0766d7a202f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:24.478022  6412 tablet_bootstrap.cc:492] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:24.479104  6412 ts_tablet_manager.cc:1403] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.275s	user 0.032s	sys 0.018s
I20260709 13:00:24.482659  6412 raft_consensus.cc:359] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:24.486467  6412 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:24.487756  6412 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:24.491106  6412 ts_tablet_manager.cc:1434] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:00:24.527240  6425 tablet_copy_client.cc:806] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:24.527920  6425 tablet_copy_client.cc:670] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:24.599632  1657 tablet_copy_service.cc:342] P a4be9cc90aca4dd4ad7db103062a7208: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-ff20dea159284907b41e95b640800f50 received from {username='slave'} at 127.0.0.1:38584
I20260709 13:00:24.601197  1657 tablet_copy_service.cc:434] P a4be9cc90aca4dd4ad7db103062a7208: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-ff20dea159284907b41e95b640800f50 on tablet ff20dea159284907b41e95b640800f50 with peer 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:24.644925  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 50757.3us
W20260709 13:00:24.649262  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 57962.4us
W20260709 13:00:24.742656  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 59122us
W20260709 13:00:24.753465  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 71438.4us
I20260709 13:00:24.754442  2440 raft_consensus.cc:1217] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 13:00:24.812080  6425 tablet_copy_client.cc:538] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:00:24.855571  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 88822.7us
I20260709 13:00:24.875589  6365 raft_consensus.cc:1064] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
W20260709 13:00:24.907795  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 64767.4us
I20260709 13:00:24.912135  6411 tablet_bootstrap.cc:492] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:24.913159  6411 tablet_bootstrap.cc:492] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:24.912756  6365 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:24.925184  6425 tablet_bootstrap.cc:492] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:24.926369  6411 ts_tablet_manager.cc:1403] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.685s	user 0.045s	sys 0.039s
I20260709 13:00:24.954768  6411 raft_consensus.cc:359] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:24.955698  6411 raft_consensus.cc:740] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:24.956403  6411 consensus_queue.cc:260] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:25.029637  2443 raft_consensus.cc:1217] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 13:00:25.030550  1719 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:25.034426  6433 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:25.056121  6411 ts_tablet_manager.cc:1434] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.000s
I20260709 13:00:25.059687  1581 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-b8c2c21bc6aa4835b68933c89735091f received from {username='slave'} at 127.0.0.1:38394
I20260709 13:00:25.060168  1581 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-b8c2c21bc6aa4835b68933c89735091f on tablet b8c2c21bc6aa4835b68933c89735091f with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:25.062202  2443 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:25.144344  6433 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:25.158953  6391 raft_consensus.cc:1064] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:25.162287  6391 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:25.169268  1570 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:25.202574  6433 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:25.284861  1713 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:25.287729  6391 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:25.298667  2436 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:25.305716  6425 tablet_bootstrap.cc:492] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:25.311764  1565 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:25.316978  6365 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:25.331337  6451 raft_consensus.cc:2955] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.342235  2443 raft_consensus.cc:2955] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.355952  6365 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:25.362498  1719 raft_consensus.cc:2955] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.342290  1570 raft_consensus.cc:2955] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.373152  1467 catalog_manager.cc:5697] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:25.410120  6425 tablet_bootstrap.cc:492] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:25.410989  6425 ts_tablet_manager.cc:1403] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 0.486s	user 0.036s	sys 0.009s
I20260709 13:00:25.427466  6451 raft_consensus.cc:2955] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.430401  2436 raft_consensus.cc:2955] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.434535  1570 raft_consensus.cc:2955] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.436045  6425 raft_consensus.cc:359] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:25.451709  6425 raft_consensus.cc:740] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:25.452430  6425 consensus_queue.cc:260] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:25.454923  6425 ts_tablet_manager.cc:1434] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 13:00:25.456938  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-8ca192f35fd14bb58ebd0766d7a202f8 received from {username='slave'} at 127.0.0.1:54412
I20260709 13:00:25.457350  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-8ca192f35fd14bb58ebd0766d7a202f8 on tablet 8ca192f35fd14bb58ebd0766d7a202f8 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:25.460780  1718 raft_consensus.cc:2955] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.503630  6453 raft_consensus.cc:1064] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:25.508358  6453 consensus_queue.cc:237] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:25.522035  1644 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:25.537855  2443 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:25.541910  6451 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:25.543984  1570 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:25.543841  1466 catalog_manager.cc:5697] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:00:25.545976  1668 debug-util.cc:398] Leaking SignalData structure 0x7b0800377bc0 after lost signal to thread 434
W20260709 13:00:25.547063  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08003685e0 after lost signal to thread 1504
I20260709 13:00:25.547894  6451 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:00:25.548303  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08003712a0 after lost signal to thread 1596
W20260709 13:00:25.549427  1668 debug-util.cc:398] Leaking SignalData structure 0x7b0800165520 after lost signal to thread 1671
W20260709 13:00:25.550601  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1e20 after lost signal to thread 1745
W20260709 13:00:25.551765  1668 debug-util.cc:398] Leaking SignalData structure 0x7b0800386b20 after lost signal to thread 2477
I20260709 13:00:25.551684  6454 raft_consensus.cc:2955] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.562827  2436 raft_consensus.cc:2955] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.580199  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a2e78d031c384616a01064318cb24f28 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:25.580631  1568 raft_consensus.cc:2955] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.591056  1644 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:25.605252  2436 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:25.605834  1466 catalog_manager.cc:5697] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.606448  6435 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:25.614286  6365 raft_consensus.cc:2955] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.616009  2436 raft_consensus.cc:2955] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.625058  1718 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:25.627866  6391 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:25.635273  1713 raft_consensus.cc:2955] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.643708  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet a2e78d031c384616a01064318cb24f28 with delete_type TABLET_DATA_TOMBSTONED (TS 66344ad7cd844754b2c81cc689a709b0 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:47746
I20260709 13:00:25.656970  6469 tablet_replica.cc:333] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:00:25.679272  2443 raft_consensus.cc:1217] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 13:00:25.680145  2436 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:25.681734  6402 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:25.686277  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff20dea159284907b41e95b640800f50 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:25.686681  1713 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:25.690517  6402 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:25.723515  1644 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:25.729660  6453 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:00:25.690137  1466 catalog_manager.cc:5697] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 10 to 11, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New cstate: current_term: 11 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.746883  6469 raft_consensus.cc:2243] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.748387  6469 raft_consensus.cc:2272] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.756559  1557 tablet_service.cc:1558] Processing DeleteTablet for tablet ff20dea159284907b41e95b640800f50 with delete_type TABLET_DATA_TOMBSTONED (TS 338d817f94ee4c1bad162e9a5860b68a not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:48208
I20260709 13:00:25.765175  6469 ts_tablet_manager.cc:1916] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:25.787838  6474 tablet_replica.cc:333] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:00:25.788995  6474 raft_consensus.cc:2243] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.789747  6474 raft_consensus.cc:2272] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.802579  6474 ts_tablet_manager.cc:1916] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:25.803256  6468 raft_consensus.cc:2955] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.811465  2443 raft_consensus.cc:2955] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.815090   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:25.841017  1713 raft_consensus.cc:2955] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.854480  1466 catalog_manager.cc:5697] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:25.874759  1646 raft_consensus.cc:2955] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:25.890488  6469 ts_tablet_manager.cc:1929] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.8
I20260709 13:00:25.910315  6469 log.cc:1199] T a2e78d031c384616a01064318cb24f28 P 66344ad7cd844754b2c81cc689a709b0: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/wals/a2e78d031c384616a01064318cb24f28
I20260709 13:00:25.916527  1455 catalog_manager.cc:5028] TS 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): tablet a2e78d031c384616a01064318cb24f28 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:25.918301  6474 ts_tablet_manager.cc:1929] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 13:00:25.918850  6474 log.cc:1199] T ff20dea159284907b41e95b640800f50 P 338d817f94ee4c1bad162e9a5860b68a: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/wals/ff20dea159284907b41e95b640800f50
I20260709 13:00:25.920363  1456 catalog_manager.cc:5028] TS 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): tablet ff20dea159284907b41e95b640800f50 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:25.941311  1568 consensus_queue.cc:237] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:25.961696  6402 consensus_queue.cc:1175] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "66344ad7cd844754b2c81cc689a709b0" responder_term: 9 status { last_received { term: 9 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 9 index: 8 } }
I20260709 13:00:26.026247  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:26.026989  1719 raft_consensus.cc:606] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:26.028615   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:00:26.030380   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:26.032143  1644 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:26.035329  6453 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:26.022787  2443 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:26.134855  6402 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:26.157464  6468 raft_consensus.cc:2955] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:26.179080  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b8c2c21bc6aa4835b68933c89735091f with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:26.196195  2440 raft_consensus.cc:2955] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:26.199393  1466 catalog_manager.cc:5697] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.223124  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet b8c2c21bc6aa4835b68933c89735091f with delete_type TABLET_DATA_TOMBSTONED (TS 66344ad7cd844754b2c81cc689a709b0 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:47746
I20260709 13:00:26.224323  6469 tablet_replica.cc:333] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:00:26.225348  6469 raft_consensus.cc:2243] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:26.226276  6469 raft_consensus.cc:2272] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:26.225955  1644 raft_consensus.cc:2955] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:26.229665  6469 ts_tablet_manager.cc:1916] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:26.293553  6469 ts_tablet_manager.cc:1929] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 13:00:26.293979  6469 log.cc:1199] T b8c2c21bc6aa4835b68933c89735091f P 66344ad7cd844754b2c81cc689a709b0: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/wals/b8c2c21bc6aa4835b68933c89735091f
I20260709 13:00:26.295890  1455 catalog_manager.cc:5028] TS 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): tablet b8c2c21bc6aa4835b68933c89735091f (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:26.312106  6452 raft_consensus.cc:1064] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:26.314901  6452 consensus_queue.cc:237] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:26.350440  1645 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:26.359445  2440 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:26.361745  6476 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:26.374038  1570 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:26.379184  6444 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:26.424521  6447 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:00:26.529203  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 101022us
I20260709 13:00:26.604322  6480 raft_consensus.cc:2955] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:26.624213  1570 raft_consensus.cc:2955] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:00:26.685271  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 145025us
W20260709 13:00:26.716040  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 211413us
W20260709 13:00:26.755565  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 45113.8us
W20260709 13:00:26.804899  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 115100us
I20260709 13:00:26.871960  1466 catalog_manager.cc:5697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:26.883838  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 44435.3us
W20260709 13:00:26.972756  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 169093us
I20260709 13:00:27.073446   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:26.987689  2437 raft_consensus.cc:2955] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:00:27.147917  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 61671.4us
I20260709 13:00:27.152478  6445 raft_consensus.cc:993] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:27.181391  6445 raft_consensus.cc:1081] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
W20260709 13:00:27.238381  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 95704us
W20260709 13:00:27.265991  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 62231.2us
I20260709 13:00:27.271225  1645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 13:00:27.271718  1645 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:27.272048  1645 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:27.273417  1644 raft_consensus.cc:2955] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:27.282116  1645 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:27.283988  1645 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:27.309702  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:27.310364  2436 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:27.311761  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:27.312381  1721 raft_consensus.cc:3055] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:27.312703  1721 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:27.313516  1721 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:27.329385  2436 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:27.335790  1721 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:27.355581  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:27.361291  6486 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:27.361806  6486 raft_consensus.cc:697] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:27.362643  6486 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:27.382169  1721 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:27.403128  1466 catalog_manager.cc:5697] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 10 to 11, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.415910  1718 consensus_queue.cc:237] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:27.421473  2436 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:27.422106  1569 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:27.423484  6444 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:27.427314  6444 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:27.435648  6445 raft_consensus.cc:2955] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:27.443708  1568 raft_consensus.cc:2955] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:27.453591  2436 raft_consensus.cc:2955] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:27.476774  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8ca192f35fd14bb58ebd0766d7a202f8 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:27.482002  1469 catalog_manager.cc:5697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 8 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:27.555365  1636 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ca192f35fd14bb58ebd0766d7a202f8 with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:50864
I20260709 13:00:27.595304  6509 tablet_replica.cc:333] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:00:27.598227  6509 raft_consensus.cc:2243] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.599210  6509 raft_consensus.cc:2272] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.604439  6509 ts_tablet_manager.cc:1916] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:27.648227  6509 ts_tablet_manager.cc:1929] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.8
I20260709 13:00:27.648753  6509 log.cc:1199] T 8ca192f35fd14bb58ebd0766d7a202f8 P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/8ca192f35fd14bb58ebd0766d7a202f8
I20260709 13:00:27.650666  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet 8ca192f35fd14bb58ebd0766d7a202f8 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:27.973071  1721 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:00:28.184764  6519 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
W20260709 13:00:28.204208  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 425699us
W20260709 13:00:28.271742  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 105743us
I20260709 13:00:28.307003  2436 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:00:28.559170   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:28.589461  6525 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:00:29.688141  2436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.005s	sys 0.010s
W20260709 13:00:29.694453  2474 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7040 after lost signal to thread 434
I20260709 13:00:29.714236  6538 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:29.714929  6538 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:29.718644  6522 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:29.719334  6522 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:29.720512  2405 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.097s	user 0.011s	sys 0.015s
I20260709 13:00:29.721792  6522 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:29.723619  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:29.724388  1717 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:29.748132  6468 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:29.748726  6468 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:29.750833  6468 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:29.763803  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:29.750502  6538 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:29.770133  6443 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:29.770656  6443 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:29.771085  6443 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:29.773433  2474 debug-util.cc:398] Leaking SignalData structure 0x7b0800372360 after lost signal to thread 1504
W20260709 13:00:29.774696  2474 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8e40 after lost signal to thread 1596
W20260709 13:00:29.775754  2474 debug-util.cc:398] Leaking SignalData structure 0x7b0800321480 after lost signal to thread 1671
I20260709 13:00:29.776273  6534 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:29.776840  6534 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:29.776832  2474 debug-util.cc:398] Leaking SignalData structure 0x7b0800395960 after lost signal to thread 1745
I20260709 13:00:29.778781  6516 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:00:29.778854  2474 debug-util.cc:398] Leaking SignalData structure 0x7b0800064220 after lost signal to thread 2477
I20260709 13:00:29.779552  6516 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:29.779958  6534 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:29.780884  2436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.007s	sys 0.011s
I20260709 13:00:29.781960  6516 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:29.782594  6542 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:29.783131  6542 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:29.785168  6542 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:29.785851  2405 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.011s	sys 0.015s
W20260709 13:00:29.786196  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 1.16275e+06us
I20260709 13:00:29.794951  6545 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:29.795754  6545 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:29.798365  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:29.802806  6545 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:29.805852  6545 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:29.807421  6545 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:29.813215  6515 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:29.814464  6515 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:29.816366  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 166553us
I20260709 13:00:29.816673  6515 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:29.819130  6513 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:29.831300  6513 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:29.832804  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:29.833448  6513 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:29.833504  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:29.821966  6536 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:29.826516  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:29.834403  6536 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:29.836589  6536 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:29.830168  6545 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:29.840766  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:29.846879  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:29.846625  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:29.849164  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:29.849834  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:29.852013  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:29.853525  1537 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:29.855177  6520 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:29.858834  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:29.859102  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:29.858884  6497 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:29.860481  6497 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:29.863590  6497 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:29.865458  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:29.868132  6443 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:29.878194  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:29.882458  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:29.878072  6538 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:29.882494  6541 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:29.886144  6538 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:29.886520  6541 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:29.888417  6538 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:29.889254  6541 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:29.889477  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:29.889921  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:29.889982  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:29.890875  6497 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:29.894344  2436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 608) took 1269 ms. Trace:
I20260709 13:00:29.894836  2436 rpcz_store.cc:276] 0709 13:00:28.623744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.630836 (+  7092us) service_pool.cc:224] Handling call
0709 13:00:28.631520 (+   684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.632166 (+   646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.632216 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.632779 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:00:29.781297 (+1148518us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:29.861151 (+ 79854us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.892487 (+ 31336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.892570 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.892611 (+    41us) raft_consensus.cc:1685] finished
0709 13:00:29.892625 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.892738 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":100376,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":5112,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":240,"thread_start_us":1252951,"threads_started":3,"wal-append.queue_time_us":26278,"wal-append.run_cpu_time_us":2577,"wal-append.run_wall_time_us":1004208}
I20260709 13:00:29.899278  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:29.906311  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:29.906739  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:29.879458  6443 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:29.914851  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:29.917613  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:29.927943  1685 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:29.928882  6538 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:29.930594  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:29.931013  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:29.935034  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:29.937017  1567 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:29.938920  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:29.939888  1685 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:29.940737  6538 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:29.942215  1685 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:29.943228  6538 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:29.948879  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:29.949396  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:29.971396  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:29.977322  6544 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:29.986788  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:29.991961  2406 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:29.993479  2406 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:29.993754  6536 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:29.994621  6536 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:29.995134  2406 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:29.997231  6513 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:29.998914  1645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:44428
I20260709 13:00:29.999737  1645 raft_consensus.cc:606] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:30.000061  6536 consensus_queue.cc:1059] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:30.001107  6536 raft_consensus.cc:3055] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:30.001412  6536 raft_consensus.cc:740] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:30.002352  6536 consensus_queue.cc:260] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:30.003594  6536 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:30.004016   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:00:30.005853   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:30.013505  2406 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:30.014797  6516 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:30.017439  2406 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:30.018668  6516 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:30.020373  2406 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:30.021510  6516 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:30.039788  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:30.046159  6544 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:30.050127  6486 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:30.050796  6486 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:30.051450  6454 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:30.052068  6454 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:30.052934  6486 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:30.056447  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:30.055574  6454 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:30.059263  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:30.065836  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:30.066088  6544 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:30.068388  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:30.138882  6514 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:30.139571  6514 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:30.140272  6518 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:30.140789  6518 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:30.141780  6514 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:30.143989  6518 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:30.148592  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:30.152222  6486 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:30.152781  6486 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:30.154827  6486 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:30.160331  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:30.162968  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:30.188964  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:30.192203  1567 consensus_queue.cc:237] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:30.197832  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:30.214321  6486 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:30.216066  6486 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:30.238515  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:30.251425  1537 consensus_peers.cc:597] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bfbaf6c33e5b45ea9c75342b1011f209. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:30.253386  6486 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:30.301465  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 87378.7us
I20260709 13:00:30.308573  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:30.309580  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:30.310034  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:30.309592  6454 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:30.311029  6454 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:30.314967  1717 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:30.309919  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:30.311568  1612 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:30.318297  6486 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:30.319216  6544 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:30.325605  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:30.355890  1638 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:30.358021  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:30.360185  6514 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:30.363724  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:30.365787  6518 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:30.374940  6451 raft_consensus.cc:993] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208: : Instructing follower 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 13:00:30.375547  6451 raft_consensus.cc:1081] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Signalling peer 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 13:00:30.391343  6520 raft_consensus.cc:2955] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:30.402158  1717 raft_consensus.cc:2955] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:30.423595  6545 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:30.424853  1570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:46634
I20260709 13:00:30.425470  1570 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:30.425817  1570 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:30.437655  1570 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:30.440035  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:30.440865  6514 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:30.445530  1570 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:30.446722  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:30.447847  1643 raft_consensus.cc:3055] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:30.447060  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:30.448181  1643 raft_consensus.cc:740] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:30.448575  1717 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:30.449080  1643 consensus_queue.cc:260] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:30.450246  1643 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:30.459100  1717 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:30.460602  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:30.461421  6520 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:30.461953  6520 raft_consensus.cc:697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:30.462944  6520 consensus_queue.cc:237] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:30.466703  1644 raft_consensus.cc:2955] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:30.471974  1643 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:30.473824  1470 catalog_manager.cc:5697] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index -1 to 7, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:30.491395  1570 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:30.536334  1717 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:30.537545  2443 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEARNER]: Advancing to term 10
I20260709 13:00:30.540650  1644 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:30.542244  6520 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:30.551359  6522 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:30.561637  2443 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:30.564738  6522 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:00:30.582751  6522 consensus_queue.cc:1243] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer 6f381117554e49bb816791ab0a10f2b8 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:30.593191  2443 pending_rounds.cc:85] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 4
I20260709 13:00:30.593535  2443 pending_rounds.cc:107] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:00:30.593808  2443 raft_consensus.cc:2917] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:00:30.595050  2443 raft_consensus.cc:2889] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:30.653671  6522 raft_consensus.cc:2955] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:30.659330  1717 raft_consensus.cc:2955] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:30.665597  1644 raft_consensus.cc:2955] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:30.697063  2443 raft_consensus.cc:2955] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:30.713476  1644 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:30.725315  1717 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:00:30.728911  1612 consensus_peers.cc:597] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc8f7aca67ac4df5b6f0b4f41d538dfd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:30.731770  6563 ts_tablet_manager.cc:933] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751)
I20260709 13:00:30.733559  6537 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:30.735277  1469 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index -1 to 9, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 10 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:30.737486  6468 raft_consensus.cc:1064] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:30.740037  6468 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:30.754376  1718 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:30.761243  2436 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:00:30.762136  6556 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.055s	user 0.007s	sys 0.003s
I20260709 13:00:30.763896  6522 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:30.800429  1638 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:00:30.806710  6564 log.cc:927] Time spent T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.088s	user 0.000s	sys 0.003s
I20260709 13:00:30.797437  6520 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:00:30.842103  6563 tablet_copy_client.cc:323] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:45751
I20260709 13:00:30.883224  1569 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:30.865406  6524 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:00:30.958881  1638 raft_consensus.cc:1275] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:30.929306  6451 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:00:30.961836  1581 tablet_copy_service.cc:140] P 338d817f94ee4c1bad162e9a5860b68a: Received BeginTabletCopySession request for tablet bfbaf6c33e5b45ea9c75342b1011f209 from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38394)
I20260709 13:00:30.985762  1581 tablet_copy_service.cc:161] P 338d817f94ee4c1bad162e9a5860b68a: Beginning new tablet copy session on tablet bfbaf6c33e5b45ea9c75342b1011f209 from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38394: session id = 6f381117554e49bb816791ab0a10f2b8-bfbaf6c33e5b45ea9c75342b1011f209
I20260709 13:00:31.001909  1467 catalog_manager.cc:5697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 9 to 10, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 10 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:31.006999   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:31.043298  6544 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:00:31.053743  1581 tablet_copy_source_session.cc:215] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:31.054822  6451 raft_consensus.cc:2955] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:31.058915  1717 raft_consensus.cc:2955] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:31.074867  6579 raft_consensus.cc:2955] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:31.105455  1713 raft_consensus.cc:1275] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:31.090673  1644 raft_consensus.cc:2955] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:31.142838  1571 raft_consensus.cc:2955] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:31.156833  6563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfbaf6c33e5b45ea9c75342b1011f209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:31.176476  1713 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:31.183331  1467 catalog_manager.cc:5697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index -1 to 6, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 7 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:31.184114  1466 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:31.184303  2438 raft_consensus.cc:2955] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:31.252024  1644 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:31.253657  6578 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:31.263592  6571 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:31.285188  1565 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:31.286708  1713 raft_consensus.cc:2955] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:31.310158  6574 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:00:31.318487  1686 consensus_peers.cc:597] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbe76ebe20be4546bed4f95e2ee090bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:31.370426  6589 ts_tablet_manager.cc:933] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:00:32.378034  1501 debug-util.cc:398] Leaking SignalData structure 0x7b0800038e00 after lost signal to thread 434
W20260709 13:00:32.678678   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000f440 after lost signal to thread 1717
W20260709 13:00:32.679384   436 kernel_stack_watchdog.cc:198] Thread 1717 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 382ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:00:32.749492  6593 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:32.750151  6593 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:32.752651  6593 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:32.757432  6593 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:32.759330  6593 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:32.761909  6593 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:32.766878  6595 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.767467  6594 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:32.767818  6595 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:32.768164  6594 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:32.770659  6594 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:32.770908  6595 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:32.771297  6594 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:32.771811  6595 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:32.771960  6594 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:32.772555  6595 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:32.774374  6594 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:32.775291  6595 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:32.779172  6595 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:32.779814  6596 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:32.779747  6595 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:32.780493  6596 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:32.781912  6595 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:32.782486  6595 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:32.782989  6596 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:32.782919  6595 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:32.783612  6596 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:32.784165  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58252 (request call id 328) took 1445 ms. Trace:
I20260709 13:00:32.784132  6596 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:32.786226  1470 rpcz_store.cc:276] 0709 13:00:31.338461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.338604 (+   143us) service_pool.cc:224] Handling call
0709 13:00:32.784095 (+1445491us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2}
I20260709 13:00:32.784992  6595 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:32.785414  6550 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:32.292165   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:32.788188  6594 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:32.788727  6544 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:32.788656  6594 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:32.789332  6544 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:32.790725  6594 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:32.791441  6544 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:32.794211  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08001ddf00 after lost signal to thread 1504
I20260709 13:00:32.794936  6550 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:32.799245  6596 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:32.802305  6550 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:32.808079  6596 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:32.808797  6596 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:32.811451  6596 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:32.979461  6550 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:32.980473  6550 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:32.983250  6550 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.248416  6596 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:33.249459  6596 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.252646  6596 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.517184  6516 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.517858  6516 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.520447  6516 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.513849  6573 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:33.525745  6541 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.530272  6573 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.531162  6541 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.532853  6541 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.533095  6573 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.533934  6541 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.533892  6597 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.534744  6541 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.534883  6597 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.536723  6541 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.536932  6597 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.537212  6541 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.537460  6597 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.537750  6541 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.537969  6597 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.539755  6541 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.539994  6597 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.540226  6541 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.540544  6597 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.540714  6541 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.541013  6597 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.546859  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:33.547562  1569 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:33.549458  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:33.550938  6541 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.551573  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:33.552901  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:33.553617  6576 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:33.553817  1571 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:33.554194  6576 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.556416  6576 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.556958  6576 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.557551  1686 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:33.557412  6576 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.560161  6576 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.560396  6597 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.560954  6576 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.561465  6576 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.563374  6550 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.564008  6569 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:33.563917  6550 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.564433  6569 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.564841  6569 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.566032  6550 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.567396  6550 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.567886  6550 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:33.572592  1501 debug-util.cc:398] Leaking SignalData structure 0x7b0800311ec0 after lost signal to thread 1518
I20260709 13:00:33.573199  6596 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:33.573696  6550 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.574846  6572 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.575001  6597 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.575505  6597 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.573719  6596 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.578251  6597 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.569082  1686 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:33.578819  6597 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.583354  6596 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.583645  6597 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.589114  6597 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.589718  6597 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.590543  6597 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.592579  6597 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.593014  6597 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.593452  6597 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.599522  6569 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.589661  6598 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.601115  6598 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.563572  6576 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.603338  6598 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.595564  6541 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:33.604035  6541 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.604462  6541 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.601769  6569 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.575407  6572 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.629482  6468 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.633948  6468 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.639761  6540 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 13:00:33.640772  1717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.345s	user 0.024s	sys 0.006s
W20260709 13:00:33.644037  1717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.349s	user 0.025s	sys 0.006s
I20260709 13:00:33.629809  6522 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.647580  6598 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.648175  6598 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.648936  6443 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:33.649369  6581 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:33.649451  6443 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.650182  6581 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.651669  6443 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.652338  6536 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:33.652719  6581 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.652871  6536 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.653402  6581 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:33.646878  6540 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.654563  6516 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.655074  6516 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.656065  6540 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.653986  6581 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.658691  6581 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.657110  6551 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.645344  6579 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.662245  6579 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.664201  6579 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.659829  6573 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.664975  6573 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.667240  6573 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.639773  6468 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.657893  6522 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.674460  6522 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.675299  6468 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.675800  6468 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.678828  6516 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.680560  6572 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.681535  6598 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.682112  6598 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.682587  6598 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.684619  6598 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.645929  6596 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.686007  6596 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:33.688174  6596 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.688763  6551 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.690979  6551 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.694164  6468 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.699118  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:33.705547  6536 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.646471  6597 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.712778  6597 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.713557  6577 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.713383  6597 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:33.714116  6577 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.714399  6569 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.715186  6569 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.716078  6577 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.716645  6577 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.717092  6577 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.718315  6584 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.718528  6572 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.718897  6584 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.719256  6572 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.730536  6584 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.730955  6572 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.731297  6568 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.731961  6568 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.717890  6597 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.717875  6569 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.734993  1569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a057e47a0fca4295957540c192996970"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:00:33.735774  1569 raft_consensus.cc:606] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:33.736294  6589 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 2.364s	user 0.006s	sys 0.018s
W20260709 13:00:33.737353  6589 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 2.365s	user 0.006s	sys 0.018s
I20260709 13:00:33.737920  6589 tablet_copy_client.cc:323] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:45463
I20260709 13:00:33.740365  6577 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.741120  6568 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:31.369319  6563 tablet_copy_client.cc:806] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:33.744796  6563 tablet_copy_client.cc:670] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:33.746433  1466 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58250 (request call id 288) took 2479 ms. Trace:
I20260709 13:00:33.747344   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:00:33.746824  1466 rpcz_store.cc:276] 0709 13:00:31.266554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.266806 (+   252us) service_pool.cc:224] Handling call
0709 13:00:33.746373 (+2479567us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28607,"reported_tablets":1}
I20260709 13:00:33.749667   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:33.759363  6600 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:00:33.760293  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 191255us
I20260709 13:00:33.760229  6600 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.762202  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:33.764160  6600 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.764662  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:33.765722  6497 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.766275  6497 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.767047  1569 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:33.767096  6601 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.767805  6601 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.768301  6497 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.765484  6600 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.769209  6600 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.770028  6601 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.770925  6497 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.771382  6497 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.773196  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:33.773474  6601 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.773856  6568 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.773348  6497 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.774080  1569 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:33.774123  6601 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:33.774431  6568 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.776551  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:33.776551  6568 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:33.777379  6568 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.777849  6568 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.785324  6568 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.785969  6581 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.786698  6602 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.787235  6583 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.787310  6602 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.787879  6583 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.786500  6581 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.752676  6513 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.790433  6513 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.791594  6581 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.792091  6581 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.792402  6513 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.792511  6581 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.792966  6513 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.793428  6513 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.789768  6602 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.795137  6602 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.795571  6602 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.796139  6513 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.794324  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:33.796830  2440 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:33.797434  6602 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.801412  6567 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.801944  6567 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.803807  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:33.753008  6551 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:33.753520  6516 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.780404  6573 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.780303  6536 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:33.792740  6454 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.780808  6601 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.794552  6581 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:33.815131  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:33.996742  6567 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.789952  6583 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:33.998534  6516 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.805806  6602 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:34.001371  6602 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.807042  6513 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:34.019445  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.006413  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 3600) took 2681 ms. Trace:
I20260709 13:00:34.020583  1714 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:34.020367  1717 rpcz_store.cc:276] 0709 13:00:31.279230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.279575 (+   345us) service_pool.cc:224] Handling call
0709 13:00:31.279956 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.294617 (+ 14661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.294644 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.295098 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.644668 (+2349570us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:33.781502 (+136834us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.960624 (+179122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.960740 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.960790 (+    50us) raft_consensus.cc:1685] finished
0709 13:00:33.960806 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.960952 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1085,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":17106,"thread_start_us":2649624,"threads_started":3,"wal-append.queue_time_us":102458,"wal-append.run_cpu_time_us":2328,"wal-append.run_wall_time_us":1002340}
I20260709 13:00:34.007512  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:33.949704  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.024127  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.033463  2440 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:34.023766  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.033712  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:34.034480  1571 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.031968  1565 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 13: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:34.033604  2437 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:34.034392  1715 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:00:33.960963  6577 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:33.911455  6578 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.907547  6600 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.032248  6513 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.067389  6577 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:33.923382  6497 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.089956  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.090592  1717 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:34.038952  6540 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:34.060221  1569 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.032861  6599 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:33.960067  6541 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.083514  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.035521  6537 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:34.019625  6573 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:33.840649  6551 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.092206  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.092713  6603 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:34.094853  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.099440  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.031780  6454 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.088048  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.113897  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.103740  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.112968  2437 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:34.101181  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.106217  1571 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:34.110437  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.087081  6583 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.024542  6536 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.114729  2436 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 13:00:34.114799  1567 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:34.116693  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.108527  6537 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.117900  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.120728  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.117823  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.082213  6578 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.105058  6540 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.121003  1720 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:34.194581  6611 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.195209  6541 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:34.196219  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.196736  6573 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:34.197554  6516 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.198338  6513 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.103993  6497 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.173528  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.196878  6551 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.150874  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.122272  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.167357  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.208554  1570 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:00:34.206791  1719 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:34.122601  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.203540  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.204272  1716 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:34.105031  6599 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.147691  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.212177  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.212550  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.212783  1568 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:00:34.147435  6603 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:34.172359  6606 log.cc:927] Time spent T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:34.211272  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.210578  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.171761  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.195251  6611 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.214653  6537 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.215224  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.221328  6611 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:34.221956  6599 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.222707  6578 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.226228  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.226502  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.226940  2442 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:34.227409  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.227556  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.227766  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.228349  2442 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:00:34.228443  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.229040  2438 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:34.229180  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:34.215891  1501 debug-util.cc:398] Leaking SignalData structure 0x7b0800263760 after lost signal to thread 1596
I20260709 13:00:34.229573  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.207906  6514 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.230234  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.230804  2440 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 13:00:34.231029  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.231603  2444 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:34.121356  1721 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:00:34.220404  6454 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.232475  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.214607  6536 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:34.220606  6540 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:34.226604  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.234519  6497 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.230237  6514 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.235407  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.118803  6567 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.236413  6514 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.236241  6567 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.216899  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.233594  6603 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.208729  2448 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:34.217299  2446 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:00:34.237697  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.239650  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.239732  2438 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:34.237697  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.237675  2437 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 13:00:34.243432  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.243625  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.238454  1563 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:00:34.238370  2447 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:34.116568  6451 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.247337  1570 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:00:34.249171  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.257223  1571 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:34.253896  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.255030  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.256204  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.256353  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.259848  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.260195  1537 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.264598  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.246436  6609 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:34.123384  6583 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.275163  6613 ts_tablet_manager.cc:933] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.249927  6607 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.265141  6610 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.260588  6537 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.292356  6537 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.293179  6525 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.293704  6525 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.294576  6537 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.295694  6525 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.296360  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.288607  6609 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.296742  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.297696  6540 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:34.298379  6609 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.299093  6609 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:34.299259  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.291374  6610 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.298933  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.295614  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.288957  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.304668  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.298266  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.298529  6599 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:34.280062  6545 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:34.305258  1568 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
W20260709 13:00:34.304090  1501 debug-util.cc:398] Leaking SignalData structure 0x7b0800038ea0 after lost signal to thread 1671
I20260709 13:00:34.276528  6602 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.298424  6454 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:34.295105  6537 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.312481  6612 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:34.288477  6514 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.296245  6525 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:00:34.314091  1501 debug-util.cc:398] Leaking SignalData structure 0x7b0800038d20 after lost signal to thread 1672
I20260709 13:00:34.316181  6567 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:34.318135  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.315828  6610 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:34.328688  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 220381us
I20260709 13:00:34.317569  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.299635  6609 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.267283  6451 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.335736  2405 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:34.313045  6545 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.298300  6540 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.338893  2405 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.333914  2406 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.336440  6537 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.344691  6451 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.345009  6537 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.345594  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.346341  1715 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 13:00:34.346432  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.347049  1717 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:34.347738  6611 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:34.347908  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.348229  6611 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.348747  6611 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.328918  6454 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.350162  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.351583  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.351925  6454 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.340004  6582 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:34.352690  6583 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:34.352782  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.353389  1713 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:34.329012  6612 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.354032  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.354782  2405 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.355263  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.355553  6612 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.355680  2405 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.304427  6607 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:34.356870  2405 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.332531  6525 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.337453  6610 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.358466  6610 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.359450  6609 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:34.360127  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08002a60e0 after lost signal to thread 1745
I20260709 13:00:34.360386  6610 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.357764  6607 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:34.361578  1501 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5720 after lost signal to thread 2477
I20260709 13:00:34.361801  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.362118  6451 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.362429  1716 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:34.362671  6451 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.363466  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.364071  1714 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
I20260709 13:00:34.364811  6451 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.365586  6537 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.365710  6615 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.331281  6514 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.366330  6537 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.366406  6615 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.368018  6514 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.319868  6599 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.365423  1686 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:00:34.371083  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 110938us
I20260709 13:00:34.368732  6615 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.359681  6525 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.375545  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.339412  6567 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:34.387431  1721 raft_consensus.cc:1240] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:34.375860  1537 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.372331  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.339814  6545 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.390426  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.368783  6537 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.391948  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.392372  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.395565  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.396169  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.409459  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.396693  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.397651  1686 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.399418  6497 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:34.415594  6497 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:34.416116  6497 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:34.417467  6541 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:34.418033  6541 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.399571  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.418463  1686 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.419157  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.419365  1686 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.419528  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.419746  6569 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:34.420159  6569 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.420354  1686 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.420603  6569 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.421037  1720 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:34.421240  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.384604  6602 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:34.386628  6608 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:34.422252  6600 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:34.422366  6608 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.422734  6600 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.422874  6608 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.423130  6600 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.423385  6599 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.424551  6584 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:34.424963  6584 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.425376  6584 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.382328  6603 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:34.384764  6582 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:34.426234  6601 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:34.426503  6582 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.422254  6602 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.418465  6541 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.426688  6601 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.428109  6601 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.401345  6540 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.426229  6603 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.402900  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.403613  6613 tablet_copy_client.cc:323] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:43271
W20260709 13:00:34.413488  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.365433  6451 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.414928  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.442914  6451 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.443089  6600 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.444502  6617 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:34.426929  6582 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:34.444932  6617 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:34.444978  6451 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.445405  6617 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:34.446758  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.436352  6603 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.387166  6567 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:34.449599  6567 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.449971  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:34.427419  6602 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.385121  6578 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:34.457649  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.431672  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.438455  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.442323  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.449088  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.458510  1566 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:34.452035  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.459307  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:34.459830  1566 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.453413  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.460367  1565 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 13:00:34.455363  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.455453  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:34.456286  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.469693  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.470607  6619 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:34.471055  6619 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.471414  6619 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:34.474252  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.474960  1715 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:34.477217  6582 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.457531  6578 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.483321  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.491219  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.486538  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.444965  6600 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.490984  6578 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.490020  6577 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:34.500180  6545 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.494583  1564 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 13:00:34.417837  6611 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.501986  6582 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.505729  6611 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.505316  6602 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.510210  6602 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.514583  6567 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:34.518610  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 161539us
I20260709 13:00:34.519817  6567 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.491251  6608 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.517242  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.491304  6603 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.522817  1730 tablet_copy_service.cc:140] P 66344ad7cd844754b2c81cc689a709b0: Received BeginTabletCopySession request for tablet cbe76ebe20be4546bed4f95e2ee090bd from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:54412)
I20260709 13:00:34.523437  1730 tablet_copy_service.cc:161] P 66344ad7cd844754b2c81cc689a709b0: Beginning new tablet copy session on tablet cbe76ebe20be4546bed4f95e2ee090bd from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:54412: session id = 6f381117554e49bb816791ab0a10f2b8-cbe76ebe20be4546bed4f95e2ee090bd
I20260709 13:00:34.524413  6603 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.524930  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:34.525051  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:34.525784  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:34.519928  2406 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:34.516476  6545 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.527343  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:34.527734  2406 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.527346  6608 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.528446  6608 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:34.528551  2406 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.528769  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:34.529193  6608 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:34.529625  2406 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:00:34.529867  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 154079us
I20260709 13:00:34.531132  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:34.532370  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.533607  2405 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:34.535751  6611 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:34.536150  6611 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.536494  6611 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.533275  2406 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:34.538335  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.539336  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.539618  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.539893  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.538992  1638 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 13:00:34.543197  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.543931  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.544484  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.543563  6581 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:34.546829  6581 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.547135  6567 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:34.543267  6584 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.547290  6581 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:34.550384  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.556857  6611 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.557139  6601 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.558773  6578 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.559381  6541 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.559757  6619 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.585481  6578 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.561307  6497 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.587001  6619 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.587142  1715 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:34.587824  1657 tablet_copy_service.cc:140] P a4be9cc90aca4dd4ad7db103062a7208: Received BeginTabletCopySession request for tablet cc8f7aca67ac4df5b6f0b4f41d538dfd from peer 6f381117554e49bb816791ab0a10f2b8 ({username='slave'} at 127.0.0.1:38584)
I20260709 13:00:34.588450  1657 tablet_copy_service.cc:161] P a4be9cc90aca4dd4ad7db103062a7208: Beginning new tablet copy session on tablet cc8f7aca67ac4df5b6f0b4f41d538dfd from peer 6f381117554e49bb816791ab0a10f2b8 at {username='slave'} at 127.0.0.1:38584: session id = 6f381117554e49bb816791ab0a10f2b8-cc8f7aca67ac4df5b6f0b4f41d538dfd
I20260709 13:00:34.588774  6584 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.542549  1537 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.564029  2406 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 13:00:34.566648  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 115840us
I20260709 13:00:34.590579  6582 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:34.590900  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:34.590984  2406 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:34.591815  6582 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:34.591966  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:34.592226  2406 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:34.567303  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.592797  6620 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:34.593114  2406 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.593560  6582 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:34.593739  6623 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:34.568274  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.572654  6617 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.594223  6623 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.571338  1686 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:34.575938  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.594661  6623 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.595249  6497 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.572751  6602 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:34.581312  1717 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:34.583097  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.529664  6608 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.599148  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.584276  1716 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:34.584781  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:34.563882  1566 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
W20260709 13:00:34.591104  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 47918.3us
I20260709 13:00:34.600593  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:34.591637  6624 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:34.595712  6603 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:34.595769  6617 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.577541  1730 tablet_copy_source_session.cc:215] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:34.580287  6569 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.575227  6611 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:34.596777  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:34.604964  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.605429  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.601984  6603 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.608790  1686 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:34.610069  6613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe76ebe20be4546bed4f95e2ee090bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:34.630239  6603 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.630630  1657 tablet_copy_source_session.cc:215] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:34.602957  6608 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:34.634871  6619 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:34.636888  6601 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.610584  6617 raft_consensus.cc:993] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower 6f381117554e49bb816791ab0a10f2b8 to start an election
I20260709 13:00:34.601261  6541 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.587230  6581 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.643097  6620 raft_consensus.cc:1081] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Signalling peer 6f381117554e49bb816791ab0a10f2b8 to start an election
I20260709 13:00:34.643573  6601 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:34.644989  6601 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.612165  6600 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:34.647682  6608 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.648293  6600 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:34.648712  6600 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.612563  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.654385  1644 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:00:34.654737  6569 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.612882  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.614519  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.656049  1639 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:34.615593  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.657123  1641 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:34.615900  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.616927  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.602566  1537 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.658658  1642 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:00:34.658936  6620 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:34.659516  6620 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.659891  6620 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.661629  6600 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.662912  1719 raft_consensus.cc:1240] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:34.664978  6611 consensus_queue.cc:1059] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:34.666096  6611 raft_consensus.cc:3055] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:34.666445  6611 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:34.666477  6600 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.667062  6620 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.667474  6611 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.668434  6601 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.602221  6624 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:34.638399  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:34.639925  6622 consensus_queue.cc:1059] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:34.641070  1686 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:34.611384  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.641414  6603 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:34.672767  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:34.672961  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.673575  1639 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:34.673925  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.674198  6603 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:34.674438  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:34.674553  1644 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:34.675040  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.644340  6550 consensus_queue.cc:1059] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:34.645088  6581 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:34.675922  6624 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.676235  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:34.677950  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.680471  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:34.611672  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.681015  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.681605  1638 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 13:00:34.682003  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.682449  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.676113  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.682901  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:34.658854  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 56333.1us
I20260709 13:00:34.684475  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.675431  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.685148  1537 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.622449  6584 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:34.686160  6584 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.668956  6611 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.686362  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.675549  6617 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:34.689440  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.690142  1640 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 13:00:34.687963  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.694199  6584 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.647068  6623 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.687101  6619 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:34.696203  6619 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.696615  6619 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:34.685230  6624 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:34.686260  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 45262us
I20260709 13:00:34.683058  1639 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:34.623549  1715 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:34.705260  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:34.707789  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.698638  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:34.712929  6545 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:34.713313  6550 raft_consensus.cc:3055] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:34.713933  6545 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.649915  6608 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:34.711246  1686 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:34.686720  6497 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:34.715936  6545 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.720510  6497 raft_consensus.cc:697] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:34.721596  6624 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.721428  6497 consensus_queue.cc:237] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.714416  6550 raft_consensus.cc:740] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:34.719973  6574 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:34.719489  6622 raft_consensus.cc:3055] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:34.670809  6620 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:34.726949  2405 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.724647  1686 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:34.728368  6611 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:34.728824  6578 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:34.728924  6611 raft_consensus.cc:697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:34.729470  6578 raft_consensus.cc:697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:34.734169  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:34.736249  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.732982  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:34.738372  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:34.730417  6578 consensus_queue.cc:237] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.716233  6541 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:34.750627   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:34.753304  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:34.754225  2443 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.750741  1566 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:34.758242  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:34.758989  2444 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:34.759881  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:34.760771  1566 raft_consensus.cc:2368] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14.
I20260709 13:00:34.759842  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:34.731832  6545 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.768465  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:00:34.770360  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 85267.4us
I20260709 13:00:34.771075  1537 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.725826  6574 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.725744  6622 raft_consensus.cc:740] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:34.762820  6550 consensus_queue.cc:260] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.771484  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.920058  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.796494  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 13:00:34.787247  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.919544  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:34.816313  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 108526us
I20260709 13:00:34.916138  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.856565  1537 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:34.924182  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.793195  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:34.930563  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.925720  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:34.931655  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:34.924193  2440 raft_consensus.cc:2393] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:34.952054  6620 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:34.952461  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.958438  6620 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.958860  6620 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.952378  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.953363  6550 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.953476  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.959175  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.911648  6545 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:34.923693  6574 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.763298  6623 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:34.932247  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 75785.6us
I20260709 13:00:34.923985  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.885404  1611 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:34.959259  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:34.966929  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 216170us
I20260709 13:00:34.965399  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.965489  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:34.968437  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:34.969694  6537 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:34.878412  2443 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:34.964676  1466 catalog_manager.cc:5697] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 10 to 11, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:34.938625  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:34.974483  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:34.975253  2447 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 11: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:34.974546  2438 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:34.763154  6541 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:34.970502  6624 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:34.970235  6537 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:34.983795  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:34.977572  2446 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:34.979188  2438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a057e47a0fca4295957540c192996970"
dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:42636
I20260709 13:00:34.979465  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:34.980096  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.976580  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:34.789541  6617 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:34.911953  6601 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.985711  1686 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:34.986480  6545 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:34.986418  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 13:00:34.986739  6627 log.cc:927] Time spent T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.101s	user 0.002s	sys 0.004s
I20260709 13:00:34.987433  6600 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:34.983278  6622 consensus_queue.cc:260] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.989100  2438 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:35.016991  2438 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.989508  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:35.018441  2440 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 8: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:35.015040  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.978837  6541 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:34.985374  6537 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.995980  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.996351  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.997110  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.998250  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.998346  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:35.020493  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:34.979375  6584 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:34.997110  6619 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.024503  6619 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:35.026363  2436 raft_consensus.cc:1240] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:35.006299  6617 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:35.027200  6622 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.027585  6617 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:35.030371  1569 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:35.030931  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.032073  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:35.031833  6620 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.033201  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:34.981761  6623 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:35.011610  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:35.014335  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:35.016255  6568 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.020823  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.998548  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:34.730022  6611 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.034180  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.038586  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:35.038897  2446 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:35.039710  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:35.046856  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:35.047041  6540 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:35.048028  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.048130  6540 raft_consensus.cc:3055] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:35.049192  6540 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:35.050987  2436 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:35.053141  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:35.054781  1566 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 11: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:35.054709  1686 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.054708  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.058960  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.034577  6620 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:35.072356  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 103955us
I20260709 13:00:35.060236  1719 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:35.066233  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.066339  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.066685  6601 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:35.067166  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:35.059689  6451 consensus_queue.cc:1059] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:00:35.069370  2448 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:35.059741  6568 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.070786  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.071544  1715 raft_consensus.cc:1240] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:35.082129  2438 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.073179  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:35.074231  2443 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:35.083544  1564 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:35.083981  2446 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:35.084102  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:35.078078  2436 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:35.037791  6623 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:35.078758  2447 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:35.080734  1686 leader_election.cc:400] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14.
I20260709 13:00:35.085501  1686 leader_election.cc:403] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:00:35.088115  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.050032  6540 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.088972  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.093392  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.094655  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.095096  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.095727  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.096763  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.097066  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.091399  6623 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:35.098318  6545 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:35.100653  2440 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:35.091550  6620 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:35.119300  6620 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:35.119035  6617 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.119760  6620 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:35.121431  6617 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:35.081173  6613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42646 (request call id 1142) took 1012 ms. Trace:
I20260709 13:00:35.122633  6613 rpcz_store.cc:276] 0709 13:00:34.068723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.082047 (+ 13324us) service_pool.cc:224] Handling call
0709 13:00:34.288300 (+206253us) ts_tablet_manager.cc:934] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
0709 13:00:34.608739 (+320439us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:34.653799 (+ 45060us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:34.653923 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:34.918385 (+264462us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:34.918762 (+   377us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:35.049995 (+131233us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b5800122a98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca1741a2 00007f18d30b5bb9 00007f18d21e6d88 00007f18d22ad973 00007f18d22a970f 00007f18d22ab2d3 00007f18d22dcf4e 00007f18d22c1fdd 00007f18d22c1f89
0709 13:00:35.058566 (+  8571us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:35.078820 (+ 20254us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":26689,"spinlock_wait_cycles":18124032,"tablet-copy.queue_time_us":159662,"thread_start_us":126279,"threads_started":2}
I20260709 13:00:35.124454  6613 tablet_copy_client.cc:806] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:35.101342  1645 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:35.099435  6601 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14.
I20260709 13:00:35.098742  6545 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:35.081408  6578 consensus_queue.cc:1059] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:00:35.125334  6581 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:35.176971  2444 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:00:35.099989  6537 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:35.151646  6613 tablet_copy_client.cc:670] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:35.189208  1640 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:35.193140  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.165100  6545 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.192185  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.193675  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.200266  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.200980  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.203243  6537 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:35.203318  6600 raft_consensus.cc:2955] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:35.206524  6578 raft_consensus.cc:3055] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:35.206943  6578 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:35.207894  6578 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.210350  6563 tablet_copy_client.cc:538] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:35.212072  6568 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:35.185976  6623 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.194590  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.191234  6584 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:35.191671  2406 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.219764  6603 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:35.191108  6540 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:35.196969  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.198278  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:35.213227  6572 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:00:35.213696  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 66974.4us
I20260709 13:00:35.224819  6572 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:35.228976  6574 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:35.229087  6572 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.223690  6620 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:35.194502  2438 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:35.248211  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:35.249150  2437 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 13: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:35.254431  6574 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:35.255190  6623 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:35.257413  6620 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:35.224773  6578 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:35.262208  6545 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:35.264326  6545 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:35.264703  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.265992  1572 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:35.242578  6541 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:35.266403  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.266614  1569 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:35.267566  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.268173  6541 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:35.266036  1571 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:35.269452  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.269562  1564 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:35.270828  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.272717  1570 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:35.274730  1564 raft_consensus.cc:1240] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:35.275543  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.276919  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.277101  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.277876  1570 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:35.277923  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.280129  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.281639  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.282553  1569 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:35.257926  6572 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:35.282956  1571 raft_consensus.cc:1240] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:35.284113  1566 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:35.286690  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.287119  6622 raft_consensus.cc:3055] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:35.287525  6622 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:35.287940  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.288434  6622 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.289719  6622 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.296382  2437 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:35.289639  1566 raft_consensus.cc:2955] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:35.297034  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.302927  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:35.309613  1645 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:35.312551  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.312907  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.314441  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.313730  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.315409  1571 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:35.315933  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:35.323774  1646 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.325579  1563 raft_consensus.cc:2393] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:35.326012  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.327214  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:35.328181  1715 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 14: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:35.328442  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:35.328941  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:35.330490  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.331243  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:35.330755  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.330706  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:35.333235  2448 raft_consensus.cc:2393] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 13: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:35.331377  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:35.333820  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.334870  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.334827  1686 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:35.336207  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:35.345903  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.352762  1720 raft_consensus.cc:1240] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:35.360054  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.363175  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:35.364197  1569 raft_consensus.cc:2393] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 14: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:35.338017  6451 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.368453  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.354151  6601 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:35.315037  6617 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 13:00:35.365895  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 176304us
W20260709 13:00:35.372653  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.331818  6540 consensus_queue.cc:1059] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:00:35.337312  6635 consensus_queue.cc:1059] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:00:35.379544  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:35.381170  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.382460  2446 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:35.383853  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.361945  6550 consensus_queue.cc:1059] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:00:35.373629  6638 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.396399  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.371325  6625 consensus_queue.cc:1059] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:00:35.396983  6563 tablet_bootstrap.cc:492] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
W20260709 13:00:35.411890  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.420576  1714 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:35.417853  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.419431  1715 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:35.419862  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:35.432708  1716 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.417412  1712 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:35.434001  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.437770  1720 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:35.438899  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.406935  6633 consensus_queue.cc:1059] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:00:35.447754  1716 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:35.397178  6537 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:00:35.450783  6537 raft_consensus.cc:3055] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:35.451134  6537 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:35.407449  6451 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.455452  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.451952  6537 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.457222  6537 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:35.457376  6540 raft_consensus.cc:3055] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:35.457849  6540 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:35.458657  6540 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.459757  6540 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:35.463198  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 79428.7us
I20260709 13:00:35.433032  6601 raft_consensus.cc:697] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:35.455392  1685 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:35.464972  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 83863.5us
I20260709 13:00:35.467087  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.469453  1685 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.471756  1685 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.403707  6630 consensus_queue.cc:1059] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:00:35.474558  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.476296  1685 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.478725  1685 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.474433  2405 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:35.482595  1563 raft_consensus.cc:1240] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:35.483678  1685 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.479681  6569 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.488519  6601 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.492421  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.492576  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.492707  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:35.493316  1566 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:35.493287  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:35.494010  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:35.497471  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:35.480782  6645 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.501292  6639 raft_consensus.cc:3055] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:35.503793  6617 raft_consensus.cc:3055] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:35.504179  6617 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:35.504630  1646 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:35.505031  6617 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.480365  6572 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.506238  6617 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.506392  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:35.475137  6568 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.508070  6581 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:35.508366  1570 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:35.508460  6581 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:35.508955  6581 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.509436  6636 raft_consensus.cc:3055] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:35.509837  6636 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:35.510852  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:35.511582  1572 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 14: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:35.513854  6631 raft_consensus.cc:3055] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:35.514292  6631 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:35.506624  6569 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.479415  6600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:54408 (request call id 21) took 4305 ms. Trace:
I20260709 13:00:35.472998  6640 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:35.501761  6639 raft_consensus.cc:740] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 13:00:35.523924  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 187763us
I20260709 13:00:35.524953  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.520490  1685 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.521667  1719 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 17.
I20260709 13:00:35.519287  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:35.525671  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:35.526744  1572 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 13: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:35.526988  1685 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.494453  6651 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.529531  1717 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:35.529990  6640 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:35.534974  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 60487.7us
I20260709 13:00:35.536132  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.527438  6650 raft_consensus.cc:2764] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:35.529039  6569 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.531210  6578 consensus_queue.cc:1059] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:00:35.538200  6633 consensus_queue.cc:1059] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:35.538337  6622 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.515161  6631 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.539312  6622 raft_consensus.cc:3055] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:35.539242  6633 consensus_queue.cc:1059] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:35.539871  6589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8f7aca67ac4df5b6f0b4f41d538dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:35.539762  6631 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.540359  6633 raft_consensus.cc:3055] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:35.540709  6633 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:35.510650  6636 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.542136  6636 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:35.539820  6622 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:35.544966  6622 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.546691  6622 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.551947  6639 consensus_queue.cc:260] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.553419  6639 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.516636  6600 rpcz_store.cc:276] 0709 13:00:31.174377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.174491 (+   114us) service_pool.cc:224] Handling call
0709 13:00:31.182202 (+  7711us) log.cc:844] Serialized 506 byte log entry
0709 13:00:31.331536 (+149334us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b5400081720. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd20ddbe 00007f18cd218930 00007f18cd2188d8 00007f18cd218858 00007f18cd218813 00007f18cd217a9c 00007f18d3103626 00007f18d30fddd8 00007f18cd2547cb 00007f18cd2572c0
0709 13:00:35.479299 (+4147763us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12307,"raft.queue_time_us":13463,"raft.run_cpu_time_us":1620,"raft.run_wall_time_us":1620,"spinlock_wait_cycles":58709760,"thread_start_us":54634,"threads_started":1,"wal-append.queue_time_us":63646,"wal-append.run_cpu_time_us":4282,"wal-append.run_wall_time_us":1086106}
I20260709 13:00:35.556428  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:35.557209  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:35.557978  1570 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:35.556468  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:35.558663  6578 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:35.558928  1566 raft_consensus.cc:2393] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 13: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:35.559190  6578 raft_consensus.cc:697] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:35.560165  6578 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.541478  6633 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.562628  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:35.537890  1612 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.554605  1572 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:35.565120  1612 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.566527  6646 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.569047  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.573279  2405 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:35.566092  1685 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.582157  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.582736  1685 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.585534  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.585690  2405 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:35.562690  6633 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:35.559324  6569 raft_consensus.cc:3055] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:35.590381  6650 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:35.590499  6569 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:35.590922  6650 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:35.591336  6650 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.591500  6569 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.590394  6550 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.593402  6581 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.594743  6611 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:35.595144  6611 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:35.595506  6611 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:35.596215  6581 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:35.599599  6646 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.601107  6646 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:35.603322  6569 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.586758  1572 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:35.586527  6540 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:35.590116  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.573890  6651 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.613252  6650 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.587565  2405 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.574538  6537 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.617303  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.618067  6550 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.618196  6642 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:35.618662  6652 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:35.621685  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:35.623090  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:35.624056  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:35.624811  2436 raft_consensus.cc:1240] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:35.626132  6620 consensus_queue.cc:1059] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:35.626693  1712 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:35.627214  6620 raft_consensus.cc:3055] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:35.627611  6620 raft_consensus.cc:740] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:35.628522  6620 consensus_queue.cc:260] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.631520  1712 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:35.615481  1685 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.617595  2405 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:35.639178  6652 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.587060  6600 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:35.641242  2405 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.642448  6642 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:35.643671  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 13:00:35.639190  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 51154.9us
I20260709 13:00:35.629861  6620 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.645922  1685 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:35.646925  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.648067  2405 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.650700  1685 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.605757  6611 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.653899  6608 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:00:35.654704  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.655349  6611 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:35.652105  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.653211  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.653503  1685 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.656198  6646 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.656813  6648 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:00:35.657501  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.657979  1685 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.652055  6601 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.650115  6581 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.659058  6601 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.661554  6650 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:35.662724  1685 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.666849  6601 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.646993  6642 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:35.668015  1685 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.668408  6642 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.668789  6601 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:35.672600  1685 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.678887  1712 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:35.677990  6601 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.652571  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.691957  1611 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:35.691687  1536 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.558s (SENT) [suppressed 6 similar messages]
I20260709 13:00:35.696738  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.698230  6540 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:35.694424  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 45464us
I20260709 13:00:35.699420  2406 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.700193  6608 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.693666  6451 consensus_queue.cc:1059] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:00:35.693909  6639 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.701107  6540 raft_consensus.cc:3055] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:35.691531  6550 consensus_queue.cc:1059] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:00:35.701526  6540 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:35.701499  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.701884  6550 raft_consensus.cc:3055] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:35.694814  6636 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:35.702412  6550 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:35.702654  6636 raft_consensus.cc:697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:35.703140  6540 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:35.703472  6636 consensus_queue.cc:237] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:35.703301  6550 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:35.704294  6540 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.704982  6550 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.712529  6608 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.696372  6651 consensus_queue.cc:1059] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:00:35.713969  2406 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.714236  6651 raft_consensus.cc:3055] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:35.716815  6651 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:35.717706  6651 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:35.690744  6537 consensus_queue.cc:1059] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:00:35.719229  6608 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.720333  6537 raft_consensus.cc:3055] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:35.720734  6537 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:35.721741  6537 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:35.722882  6537 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:35.724347  6550 consensus_queue.cc:1059] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:35.725860  6651 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:35.730152  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.733518  6639 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.737583  1612 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.738540  6639 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:35.743288  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.749390  1466 catalog_manager.cc:5697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 10 to 11, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:35.751886  1612 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.762367  6550 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.759681  6639 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.764019  6642 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.769810  1564 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:35.758381  1466 catalog_manager.cc:5697] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index -1 to 8, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New cstate: current_term: 8 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:35.759393  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.785806  1466 catalog_manager.cc:5697] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 10 to 11, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:35.787712  1466 catalog_manager.cc:5697] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 11 to 12, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:35.798005  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 93477.2us
I20260709 13:00:35.801141  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.807646  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.808630  6451 consensus_queue.cc:1059] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:35.809712  6451 raft_consensus.cc:3055] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:35.810075  6451 raft_consensus.cc:740] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:35.797384  6550 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.814864  1612 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 13:00:35.815824  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 167817us
I20260709 13:00:35.816659  2405 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.813243  6540 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.818697  1612 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.820670  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.822355  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.823523  2448 raft_consensus.cc:2955] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:35.821774  6608 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:35.826808  6589 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45120 (request call id 644) took 4607 ms. Trace:
I20260709 13:00:35.827284  6589 rpcz_store.cc:276] 0709 13:00:31.219709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.220854 (+  1145us) service_pool.cc:224] Handling call
0709 13:00:31.370804 (+149950us) ts_tablet_manager.cc:934] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Initiating tablet copy from peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
0709 13:00:35.513318 (+4142514us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:35.665209 (+151891us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:35.665345 (+   136us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:35.818598 (+153253us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:35.826322 (+  7724us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:35.826666 (+   344us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:35.826726 (+    60us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":235,"tablet-copy.queue_time_us":97781,"thread_start_us":2456503,"threads_started":2}
I20260709 13:00:35.828529  6589 tablet_copy_client.cc:806] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:35.826910  6642 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:35.829033  6589 tablet_copy_client.cc:670] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:35.810781  6451 consensus_queue.cc:260] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.833403  6642 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.818619  6638 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.840996  2405 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.841811  1612 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.846465  6540 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.770273  6631 raft_consensus.cc:2955] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:35.817919  6622 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.850455  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.856698  1470 catalog_manager.cc:5697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 10 to 11, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:35.866645  6638 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:35.867476  6451 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.875249  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.876332  6657 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:35.878672  6638 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.875342  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:35.895074  1612 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.895090  6657 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:35.896178  6657 raft_consensus.cc:697] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:35.897125  6657 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:35.898216  6638 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:35.898955  6638 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.896203  1612 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.900804  1612 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.901764  6537 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.902455  6537 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.901988  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:35.915031  6638 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:35.915623  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.916705  1712 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:35.917546  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.921861  6613 tablet_copy_client.cc:538] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:35.926458  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.927944  1638 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:35.928745  6638 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.829828  6636 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.894593  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.930492  6626 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:35.932852  6613 tablet_bootstrap.cc:492] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:35.932953  6626 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:35.933538  6626 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.933853  1640 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:00:35.937418  1685 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.938148  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.938541  1685 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.939620  1685 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.941182  6572 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:35.941363  6652 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.942296  6572 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:35.932437  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.945740  6630 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.948655  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.949801  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 13:00:35.952757  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.955686  1572 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:35.957564  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.957710  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.959481  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.961687  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:35.962635  6625 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.959290  6630 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:35.968915  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:35.971282  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:35.972234  1572 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:35.967415  6630 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:35.968859  1640 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 13:00:36.004647  6630 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:36.095645  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 124458us
W20260709 13:00:36.097308  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 122991us
I20260709 13:00:36.100086  1644 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:36.097301  1643 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:36.097947  1647 raft_consensus.cc:2955] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:36.101590  6626 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:36.107776   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:36.093055  6563 log.cc:927] Time spent T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:00:36.118351  1467 catalog_manager.cc:5697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:36.096563  6625 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.972826  6617 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:36.147783  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:36.163823  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:36.168550  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:36.170814  6626 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:36.178267  1536 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:36.181945  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:36.173130  1564 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:36.185950  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:36.190307  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 58066.1us
I20260709 13:00:36.191062  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:36.194134  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:36.132755  6600 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:00:36.216408  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:36.230652  1645 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:36.232084  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 80529.1us
I20260709 13:00:36.172631  6545 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:36.167655  6617 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:36.185623  6620 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:36.179472  6669 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:36.187451  6626 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:36.246981  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 13:00:36.230839  6637 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:00:36.195704  6625 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:36.150604  6650 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
W20260709 13:00:36.262444  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 71338us
I20260709 13:00:36.263437  2406 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:36.268766  6608 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:36.269335  6608 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:36.167433  6671 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:00:36.274747  2448 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:00:36.247045  6617 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:36.248210  6670 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:36.280035  2406 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:36.288820  1639 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:00:36.287258  6646 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:00:36.291474  6670 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:36.294391  6631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:48208 (request call id 10) took 2472 ms. Trace:
W20260709 13:00:36.294788  6668 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:00:36.295924  6600 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:00:36.294914  6631 rpcz_store.cc:276] 0709 13:00:33.812879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.812994 (+   115us) service_pool.cc:224] Handling call
0709 13:00:34.118260 (+305266us) log.cc:844] Serialized 501 byte log entry
0709 13:00:36.284990 (+2166730us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":237605,"raft.run_cpu_time_us":1115,"raft.run_wall_time_us":1114,"spinlock_wait_cycles":1988864,"thread_start_us":276776,"threads_started":2,"wal-append.queue_time_us":220341,"wal-append.run_cpu_time_us":1777,"wal-append.run_wall_time_us":1011729}
I20260709 13:00:36.270893  6676 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:36.307636  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 66971.5us
I20260709 13:00:36.277911  6625 raft_consensus.cc:697] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:36.310199  2436 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:36.313272  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.311311  6677 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:36.314673  1712 raft_consensus.cc:1275] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:36.314819  6589 tablet_copy_client.cc:538] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:36.316342  6625 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:36.316979  6670 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:36.321518  6451 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:36.327762  1564 raft_consensus.cc:3055] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:36.327936  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:36.328171  1564 raft_consensus.cc:740] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:36.328438  1570 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:36.328893  1564 consensus_queue.cc:260] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:36.329873  1564 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:36.330899  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:36.329788  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:36.335631  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:36.336148  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:36.352486  1564 raft_consensus.cc:1275] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:36.341782  1572 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
W20260709 13:00:36.376132  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 61918.6us
I20260709 13:00:36.282929  6672 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:00:36.323689  6676 raft_consensus.cc:697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 13:00:36.390558  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 54496.2us
W20260709 13:00:36.394845  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 48712.1us
I20260709 13:00:36.326884  6678 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:36.411414  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:36.377786  6603 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:00:36.392933  6682 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:36.449153  6563 tablet_bootstrap.cc:492] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:36.485330  6620 consensus_queue.cc:1059] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:36.486248  6691 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:36.448053  6603 raft_consensus.cc:3055] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:36.424243  6636 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.506819  2436 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:36.503927  6603 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:00:36.514951  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 130327us
I20260709 13:00:36.530776  1647 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:36.494562  6676 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:36.509544  6636 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:36.537639  6636 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:36.538604  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:36.539324  1716 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:36.539752  6608 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:36.539351  6630 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:36.541035  1611 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:36.541934  6603 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:36.542872  6630 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:36.543195  6603 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:36.548954  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 152891us
I20260709 13:00:36.551899  2444 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:36.562677  6563 tablet_bootstrap.cc:492] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:36.512341  6617 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:36.565994  6563 ts_tablet_manager.cc:1403] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 1.186s	user 0.030s	sys 0.015s
I20260709 13:00:36.565667  6636 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:36.576236  6681 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 13:00:36.596408  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.597479  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 186321us
I20260709 13:00:36.599828  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:36.586789  6636 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.606791  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:36.609025  6545 consensus_queue.cc:1059] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:36.621960  1565 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:36.625857  6680 raft_consensus.cc:3055] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:36.663148  6680 raft_consensus.cc:740] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:36.663985  6680 consensus_queue.cc:260] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:36.664943  6680 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.666153  6572 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:36.628317  2444 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:36.642877  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:36.580178  6625 consensus_queue.cc:1059] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:00:36.659659  6617 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:36.660298  6589 tablet_bootstrap.cc:492] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Bootstrap starting.
I20260709 13:00:36.662276  1565 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:36.667639  2436 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
W20260709 13:00:36.668706  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 62033.2us
I20260709 13:00:36.678622  1536 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:36.671370  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 121923us
I20260709 13:00:36.581769  6626 consensus_queue.cc:1059] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:00:36.674259  6685 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:36.682719  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:36.684048  2437 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:36.627492  6630 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:36.647449  6636 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:36.685313  1716 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 17: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 13:00:36.680959  6686 log.cc:927] Time spent T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:00:36.598482  6681 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:36.732108  6696 raft_consensus.cc:3055] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:36.722191  6572 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:00:36.732658  6696 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:36.733053  6572 raft_consensus.cc:3055] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:36.733457  6572 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:36.702253  6652 consensus_queue.cc:1059] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:00:36.719970  6617 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:36.720134  6694 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:00:36.750277  6646 consensus_queue.cc:1059] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:36.751087  6617 raft_consensus.cc:697] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:36.752218  6681 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:36.752076  6617 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:36.754707  6572 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:36.756049  6572 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:36.733608  6696 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:36.757165  6600 consensus_queue.cc:1175] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a4be9cc90aca4dd4ad7db103062a7208" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 8 } }
I20260709 13:00:36.758143  6696 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:36.758415  6563 raft_consensus.cc:359] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:36.759449  6563 raft_consensus.cc:740] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:36.759891  6691 raft_consensus.cc:3055] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:36.760305  6691 raft_consensus.cc:740] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:36.760187  6563 consensus_queue.cc:260] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:36.761288  6691 consensus_queue.cc:260] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:36.762163  6648 raft_consensus.cc:3055] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:36.762638  6648 raft_consensus.cc:740] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:36.763478  6648 consensus_queue.cc:260] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:36.764621  6648 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:36.767506  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 59642.3us
I20260709 13:00:36.769517  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:36.776042  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:36.780385  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.784328  6685 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:36.797590  2406 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:36.812167  2406 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:36.825234  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:36.826558  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:36.830188  2437 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:36.791051  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36627e4c13c74e8a9fd501f26c7aff53 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:36.834476  2406 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:36.836273  2406 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:36.788909  6669 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:36.785411  6685 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:36.789702  6626 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:36.834625  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:36.794972  6677 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:00:36.846351  6663 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:36.838461  6689 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:36.832996  6603 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:36.833285  6676 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.833935  6642 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:36.869904  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:36.876121  6684 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.876680  6563 ts_tablet_manager.cc:1434] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.287s	user 0.007s	sys 0.002s
I20260709 13:00:36.865324  6626 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:36.880110  6626 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:36.880141  6676 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:36.882741  6676 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:36.864128  6680 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:36.869474  6663 raft_consensus.cc:697] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:36.888340  6663 consensus_queue.cc:237] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:36.876739  6684 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:36.893421  6684 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:36.897034  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:36.897709  1565 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:36.897958  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:36.906490  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:36.907373  1570 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:00:36.916682  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:36.927346  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:36.821517  6675 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:00:36.929721  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:36.965531  6451 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:36.985682  1712 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:36.987221  1536 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:36.995270  6679 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:36.915007  6680 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:37.012470  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 176265us
I20260709 13:00:37.017335  6578 raft_consensus.cc:3055] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:36.995816  6679 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.927244  6636 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.034988  2406 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:37.033455  6679 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:37.004892  6670 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:37.074188  6670 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.074748  6670 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:37.017856  6578 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:37.076606  6578 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:37.078552  6578 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.011885  6650 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.057730  1581 tablet_copy_service.cc:342] P 338d817f94ee4c1bad162e9a5860b68a: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-bfbaf6c33e5b45ea9c75342b1011f209 received from {username='slave'} at 127.0.0.1:38394
I20260709 13:00:37.082908  1581 tablet_copy_service.cc:434] P 338d817f94ee4c1bad162e9a5860b68a: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-bfbaf6c33e5b45ea9c75342b1011f209 on tablet bfbaf6c33e5b45ea9c75342b1011f209 with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:37.083066  6711 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.083827  6711 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:37.086217  6693 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:37.089294  6715 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:37.089924  6715 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.093227  6715 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.069199  6694 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:37.098337  6710 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.093861  6719 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.098909  6710 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:37.099223  6719 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:37.098965  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.048360  1717 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
W20260709 13:00:37.102802  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 303259us
I20260709 13:00:37.105641  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.106252  1570 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
W20260709 13:00:37.106695  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 53254.3us
I20260709 13:00:37.107462  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:37.072459  6603 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:00:37.128679  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.085935  6650 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.147666  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:37.161732  1716 raft_consensus.cc:606] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:37.126514  6648 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.124107  6581 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:37.143180  6636 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.136878  6684 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:37.146804  6711 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:37.101374  6693 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:37.186828  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 80321.3us
I20260709 13:00:37.193737  6684 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:37.194275  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:37.194837  1716 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.196192  6684 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:37.170275  6719 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:37.198601  6714 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:00:37.182597  6648 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.200852  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:37.211293  6684 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:37.212951  1712 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:37.220860  1611 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:37.223243  1716 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:00:37.226533  6693 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:37.230764  6640 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.231340  6640 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.197486  6711 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.230819  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:37.237203  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:37.250280  1717 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 12: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:37.254330  1717 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:37.252512  1611 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:37.211982  6636 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.257249  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:37.266445  6636 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:37.268635  6713 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.401s	user 0.002s	sys 0.000s
I20260709 13:00:37.268808  6636 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.270236  6603 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.233522  6684 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:37.270853  6603 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.271941  6710 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:37.272400  6684 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:37.273074  6603 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:37.275019  6640 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.275365  6728 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.275986  6728 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.251013  6711 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.279453  6451 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:37.279826  6451 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.255555  6719 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.280586  6711 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.281231  6711 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:37.282910  6650 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:37.281636  6711 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:37.284621  6711 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.280674  6696 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:00:37.280611  6719 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.257460  6676 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:37.294651  6697 raft_consensus.cc:3055] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:37.288718  6670 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.290046  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.297521  6648 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.328841  6676 raft_consensus.cc:697] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:37.298382  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:37.329610  1712 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:37.329934  6676 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:37.300590  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:37.332753  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.301182  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:37.280126  6451 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.334216  1716 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
W20260709 13:00:37.305220  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 197799us
I20260709 13:00:37.305466  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.335027  2448 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:37.308166  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.337657  1611 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:37.338670  1611 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:37.311473  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:37.317065  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.281242  6679 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.323175  6719 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.325608  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:37.326911  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.300206  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:37.349517  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.350476  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.347493  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.350917  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.359707  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.391618  2437 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:00:37.360455  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.331619  6728 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.414378  1717 raft_consensus.cc:606] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:37.397271  2446 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:37.390794  1718 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:37.409498  2436 raft_consensus.cc:2393] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 10: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:37.392405  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.418291  1611 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:37.404958  2406 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:37.420707  2406 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:37.333722  6697 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:37.416455  1717 raft_consensus.cc:614] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:37.353255  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.389699  6733 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:37.412863  6451 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:37.413926  6693 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.420002  6652 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.421520  6719 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:37.393558  1563 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:00:37.389886  6729 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:37.428622  1719 raft_consensus.cc:2368] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11.
I20260709 13:00:37.423863  1686 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:37.456866  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:37.458412  6451 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:37.422737  6681 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.459362  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:37.459947  1718 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.459908  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:37.460764  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:37.461774  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:37.461061  1647 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:37.474865  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:37.475235  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:37.431687  6733 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.481135  1644 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:37.482384  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:37.457775  6719 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.463228  6729 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.474436  6688 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.491952  6688 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.488546  1646 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:37.495038  6688 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:37.484942  6733 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.462648  6611 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:37.483083  6675 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:37.499445  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:37.465975  6650 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:37.481732  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.507819  1721 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:00:37.505676  6729 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.511703  6694 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:37.514385  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.514706  6650 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.515065  1565 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 13:00:37.515115  6650 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:37.515937  1686 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:37.517809  6670 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.519380  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.519994  1570 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:37.521394  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:37.521970  2437 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.478811  6728 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:37.522796  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.530144  2448 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 13:00:37.521854  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.531201  2438 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:00:37.523556  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.532866  1570 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:37.525143  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.532892  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.530418  2405 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:37.534718  1563 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:37.533946  2443 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:37.528360  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:37.536531  1713 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:37.525779  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.538429  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.532614  6731 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:37.539110  2442 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:37.539521  6731 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.543681  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:37.544288  1565 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.501291  6719 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.538929  6736 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:37.547957  2438 raft_consensus.cc:1217] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 13:00:37.547559  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:37.457326  6693 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.533020  6672 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:37.533133  6617 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:00:37.552601  6679 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.545553  6728 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.506461  6608 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:37.555540  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:37.462875  6652 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.522887  6675 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.558120  1640 raft_consensus.cc:2955] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:37.558924  6451 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.566776  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:37.580530  6451 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.583055  6451 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.568040  1718 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:37.569808  1713 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:37.570982  1644 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:37.583873  6608 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.591827  1565 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:37.594738  1721 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:37.595500  6608 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:37.579720  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:37.598949  2442 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:37.599458  1644 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:37.572086  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:37.544310  6657 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.578495  2447 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:37.572765  2437 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:00:37.599870  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:37.602335  6657 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.603246  1718 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 13:00:37.523428  6697 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.604569  6657 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:37.605479  6697 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.601897  1612 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:37.608153  6731 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.609499  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:37.604593  6728 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.610776  6728 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:37.611109  6728 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.611438  6728 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:37.612632  6740 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:37.613088  6740 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.613421  6740 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:37.570461  6696 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:37.553750  6736 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.616313  6736 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.616518  6693 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:37.627794  6741 log.cc:927] Time spent T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260709 13:00:37.583602  6675 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.647251  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.647991  2436 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 13:00:37.649384  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:37.654534  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.655547  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.657253  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:37.657886  1638 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:00:37.658974  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:37.659524  1565 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:00:37.660439  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.669848  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:37.673246  1537 consensus_peers.cc:597] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:37.674638  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:37.657517  1470 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 10 to 11, VOTER 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) evicted. New cstate: current_term: 10 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:37.677330  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:37.669848  6613 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:00:37.682196  1470 catalog_manager.cc:5697] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 9 to 10, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.684881  1572 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:37.687316  2442 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:37.688231  6672 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:37.690483  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:37.684108  6636 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:37.692767  6636 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.692417  6736 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.693205  6636 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.692781  6652 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.698961  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:37.699347  1537 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:37.700436  6451 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.700992  6451 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:37.644243  6733 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:37.723053  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 165601us
I20260709 13:00:37.724982  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:37.731630  2405 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:37.732580  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 151984us
I20260709 13:00:37.733924  6451 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:37.730496  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:37.735162  1685 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:37.719086  6697 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:37.720346  6681 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:37.721203  6710 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:37.744208  1565 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:37.745590  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:37.750167  6600 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:37.736464  6730 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:37.752509  6674 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:37.753088  6674 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:37.753562  6674 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:37.754485  6600 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:37.755043  6600 raft_consensus.cc:697] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:37.755939  6600 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.756871  6736 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:37.760260  6733 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:37.741737  6678 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:00:37.762791  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:37.763366  1721 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.763276  6710 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:37.765431  6710 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:37.700489  6650 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.772938  2443 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:37.774778  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.774963  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:37.775591  1572 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.778296  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.720820  6729 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.783509  1570 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:37.784422  2440 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:37.787367  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.788621  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.789387  1563 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:37.797340  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:37.805380  2448 raft_consensus.cc:2393] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 11: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:37.805825  6451 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:37.807040  1570 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:37.768584  6697 raft_consensus.cc:697] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:37.808074  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:37.806341  6451 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.726266  6675 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.831162  1572 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:00:37.781890  6652 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.832340  1536 leader_election.cc:400] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11.
I20260709 13:00:37.833426  1645 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 13: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:37.833659  1536 leader_election.cc:403] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:37.839164  6451 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.842834  1721 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:00:37.891497  1716 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 13: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:37.893100  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:37.892493  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:37.907833  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.844358  2405 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:37.912237  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:37.827380  6733 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:37.826814  6748 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:37.839916  6721 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:37.916699  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:37.919939  1719 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:37.917739  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 73504.1us
I20260709 13:00:37.842586  6669 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11.
I20260709 13:00:37.829664  6569 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.909839  6742 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:00:37.922254  6677 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:37.935387  6677 raft_consensus.cc:697] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:37.935645  6650 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:37.835763  6682 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 13:00:37.936583  6677 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:37.941329  6746 log.cc:927] Time spent T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:00:37.894013  6696 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:00:37.843796  6652 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.931358  1611 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:37.921617  6646 raft_consensus.cc:993] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:37.829355  6710 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:37.942446  1719 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:00:37.833967  6740 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.966897  1611 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:37.967646  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 124449us
I20260709 13:00:37.930534  6721 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:37.975773  6626 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.987747  6626 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.988575  2406 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:37.988925  6688 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:37.990257  6650 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:37.990688  6650 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.991034  6650 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.991525  6626 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:37.971637  6710 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:37.997047  6710 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:37.998870  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:37.999522  1719 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:37.986297  6728 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.001411  1611 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:38.002334  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:37.921593  6733 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.004106  1571 raft_consensus.cc:2393] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:37.978070  6646 raft_consensus.cc:1081] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:37.977494  6711 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:37.971563  6730 raft_consensus.cc:697] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:37.941998  6719 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:37.972183  6625 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:00:37.964609  6569 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:38.023324  6636 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.024763  6569 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:38.025476  1721 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 13:00:38.027408  1646 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 12: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:38.033432  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:38.034071  1718 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 13:00:38.014195  6725 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:38.014353  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:37.977813  6682 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:00:37.944940  6697 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.035778  1611 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:38.036340  1721 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:38.037467  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:38.039635  6451 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:38.039999  6451 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.038121  1720 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:38.040299  6451 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.005600  6710 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:38.038106  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:38.045960  1639 raft_consensus.cc:2393] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 13: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:38.033694  6711 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:38.043130  6710 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:38.059866  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:38.064589  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:38.064751  1720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:38.065352  1720 raft_consensus.cc:606] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:38.063041  6451 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:38.069427  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:38.051728  6652 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.070036  2440 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:38.070812  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:38.069798  6748 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:38.063124  6710 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:38.081595  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:38.086354  1712 raft_consensus.cc:2393] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 13: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:38.086404  1720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:38.087080  1720 raft_consensus.cc:606] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:38.087406  1720 raft_consensus.cc:614] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:38.071303  6756 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:00:38.055488  6636 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:38.071897  6750 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:00:38.098428   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:38.072310  6740 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.100271   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:38.077173  6728 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.101871  1712 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:38.077831  6589 tablet_bootstrap.cc:492] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:38.069657  6675 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.080161  6733 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.067996  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:38.059527  6729 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.094434  2440 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:38.096613  6711 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:38.074324  6719 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.103566  6451 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:38.104620  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:38.113840  1686 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:38.114030  1712 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.111455  6758 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:00:38.068784  6730 consensus_queue.cc:237] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:38.095687  6721 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:38.134527  6589 tablet_bootstrap.cc:492] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:38.140048  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:38.156574  1645 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:00:38.156906  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:38.157876  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:38.136852  6682 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:38.137312  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:38.158702  1645 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
W20260709 13:00:38.161818  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 48062.8us
I20260709 13:00:38.162077  1641 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 13: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:38.142191  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:38.163285  1647 raft_consensus.cc:2393] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 9: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:38.164882  1612 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:38.172231  6763 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:38.174346  1720 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:38.181883  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:38.183947  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:38.184175  1570 raft_consensus.cc:2393] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 10: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:38.184708  1567 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:38.185709  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:38.186299  1572 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.187009  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:38.186884  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:38.187629  1563 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.189167  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:38.167655  6721 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:38.183410  1685 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:38.198544  1685 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:38.169458  6569 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:38.206437  6569 raft_consensus.cc:697] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:38.207718  6569 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.210788  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:38.211650  1566 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:38.173616  6691 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.180927  6589 ts_tablet_manager.cc:1403] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 1.540s	user 0.036s	sys 0.019s
I20260709 13:00:38.201443  6672 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:38.191335  6674 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.224059  6672 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:38.226045  6672 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.227221  2442 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 13:00:38.227785  6674 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:38.204836  6710 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:38.232280  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:38.234517  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:38.221988  6589 raft_consensus.cc:359] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:38.224675  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:38.246840  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:38.247460  1712 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 13:00:38.250164  1569 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:38.252967  1647 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:00:38.258520  1572 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:38.180791  6676 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.175810  6650 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.263778  6657 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.264369  6657 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.225314  6572 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:38.254766  6578 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:38.254228  6589 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:38.285195  6572 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.287050  6672 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.293555  2438 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:38.289249  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:38.295054  2440 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 10: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:38.296082  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:38.296967  2440 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:38.290099  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:38.299279  2448 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:38.273754  6657 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:38.290905  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:38.300400  2436 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 13: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:38.291721  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:38.300992  2446 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.304868  6650 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:38.306383  6710 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:38.307473  6572 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.307355  6589 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:38.267486  6676 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.292438  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:38.311118  6676 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.289390  6763 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.314245  6763 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.320827  1715 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:38.297763  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:38.322146  2440 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:38.329383  2446 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 13:00:38.336078  2440 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
W20260709 13:00:38.338086  6752 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.595s	user 0.003s	sys 0.001s
I20260709 13:00:38.361538  6672 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.414762  1564 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
W20260709 13:00:38.419390  1537 consensus_peers.cc:597] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a -> Peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297): Couldn't send request to peer 6f381117554e49bb816791ab0a10f2b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:38.425653  1563 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 13:00:38.432840  1569 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:38.432899  1612 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:38.447311  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 158567us
I20260709 13:00:38.449182  6451 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:38.451632  6711 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:38.451961  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:38.452085  6710 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:38.462879  6711 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:38.454169  6736 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.454162  6569 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.458707  6589 ts_tablet_manager.cc:1434] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.240s	user 0.004s	sys 0.006s
I20260709 13:00:38.474951  6736 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.479969  6710 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:38.480792  6710 raft_consensus.cc:697] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:38.482044  6569 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:38.484284  6710 consensus_queue.cc:237] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:38.490463  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 57917us
I20260709 13:00:38.486918  6780 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:38.477763  6736 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:38.499748  6711 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:38.492377  6780 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.502193  2405 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:38.503185  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:38.504534  1712 raft_consensus.cc:2393] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:38.504987  6780 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.506469  2437 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEARNER]: Advancing to term 8
I20260709 13:00:38.510031  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:38.510869  2440 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:38.511034  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:38.515497  6736 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:38.485193  6569 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:38.530679  1720 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:38.540768  1611 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:38.544098  1569 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:38.547394  6760 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:38.555792  1537 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:00:38.561239  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 56626.7us
I20260709 13:00:38.566871  1611 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:38.565671  2405 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:38.575176  6670 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:38.575984  6670 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.576756  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:38.576972  2444 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:38.577701  2440 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:00:38.581460  6694 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.582906  6762 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:38.583300  1537 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:38.605662  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:38.597657  6762 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.602113  6711 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:38.612015  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:38.605902  1720 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:38.608593  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:38.634851  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:38.639541  2436 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 9: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:38.640161  6670 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.640828  6784 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:00:38.642743  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 78950us
I20260709 13:00:38.646250  1611 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:38.636845  6760 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:00:38.647727  6721 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:38.648252  6721 raft_consensus.cc:697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 13:00:38.651559  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 68517us
I20260709 13:00:38.633548  6762 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.660259  1565 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 9: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 13:00:38.664528  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 99122.4us
I20260709 13:00:38.671594  6763 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.672839  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 3587) took 1376 ms. Trace:
I20260709 13:00:38.673309  1564 rpcz_store.cc:276] 0709 13:00:37.296751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.297166 (+   415us) service_pool.cc:224] Handling call
0709 13:00:37.349356 (+ 52190us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 13:00:38.672601 (+1323245us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003b3b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:38.672737 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2377848064}
I20260709 13:00:38.675196  6787 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.675843  6787 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.677263  1641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 13:00:38.677947  1641 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:38.678376  1641 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.678584  6787 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:38.679313  6711 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:38.680083  6711 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:38.663944  6670 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:38.682215  6613 tablet_bootstrap.cc:492] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:00:38.684064  6685 raft_consensus.cc:1064] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:38.687247  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:38.688112  1568 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:00:38.690969  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:38.691998  1645 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 9: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:38.694882  6601 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:38.696884  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:38.698012  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:38.683645  6613 tablet_bootstrap.cc:492] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: Bootstrap complete.
I20260709 13:00:38.649536  6721 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:38.699249  6780 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:00:38.719660  6767 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.473s	user 0.003s	sys 0.000s
W20260709 13:00:38.703758  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.653656  6694 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.665113  1611 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:38.726701  1569 raft_consensus.cc:2393] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:38.681412  6711 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.710830  6685 consensus_queue.cc:237] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:38.738669  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 82081us
I20260709 13:00:38.746165  6451 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:38.746801  6451 raft_consensus.cc:697] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:38.747812  6451 consensus_queue.cc:237] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:38.749974  1719 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:00:38.750627  1720 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:38.751638  6715 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:38.752909  1466 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58260 (request call id 328) took 1406 ms. Trace:
I20260709 13:00:38.753396  6715 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:38.753285  1466 rpcz_store.cc:276] 0709 13:00:37.346429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.346553 (+   124us) service_pool.cc:224] Handling call
0709 13:00:38.752655 (+1406102us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":4}
I20260709 13:00:38.754006  6719 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:38.760514  6613 ts_tablet_manager.cc:1403] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: Time spent bootstrapping tablet: real 2.828s	user 0.042s	sys 0.020s
I20260709 13:00:38.764773  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:38.762825  6760 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:00:38.753976  6715 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.767791  2405 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:00:38.772871  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.762400  6670 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.775424  6670 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:38.781754  1720 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:38.777436  6736 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:38.799600  6791 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:00:38.794034  6736 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.806015  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:38.811105  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:38.813493  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:38.812314  1641 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.809036  6736 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:38.839067  1640 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:38.837109  6645 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:00:38.848377  6694 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:38.851264  2440 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:00:38.852077  1641 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.846758  6581 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:00:38.865157  1685 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:38.868587  6578 raft_consensus.cc:993] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower 6f381117554e49bb816791ab0a10f2b8 to start an election
I20260709 13:00:38.875397  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:38.877228  6652 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:38.878427  1570 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:38.878476  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:38.887547  6578 raft_consensus.cc:1081] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Signalling peer 6f381117554e49bb816791ab0a10f2b8 to start an election
I20260709 13:00:38.879753  1686 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:38.906002  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 104544us
I20260709 13:00:38.882625  6711 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:38.863338  6613 raft_consensus.cc:359] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 8 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:38.912086  1567 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:00:38.912521  6613 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Initialized, Role: LEARNER
I20260709 13:00:38.913182  1569 raft_consensus.cc:2393] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 10: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:38.914412  6718 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:38.914871  6718 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.915192  6718 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.913637  6613 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:38.915879  2436 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:38.918220  6613 ts_tablet_manager.cc:1434] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: Time spent starting tablet: real 0.157s	user 0.012s	sys 0.000s
I20260709 13:00:38.898267  6762 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.921475  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:38.923485  6762 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.923756  6617 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.924283  6617 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:38.926570  6617 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:38.927016  6684 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:38.927445  6684 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.927799  6684 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:38.929447  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:38.950687  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:38.953640  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:38.957720  1571 raft_consensus.cc:2393] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 12: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:38.954603  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:38.954726  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:38.958737  1569 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:00:38.959051  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:38.958734  1568 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:38.956681  6760 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:38.960367  6760 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:38.961813  1721 raft_consensus.cc:3055] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:38.962193  1721 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:38.963064  1721 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.910442  6711 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:38.964778  6711 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.959882  1567 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 12: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:38.968716  6670 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:38.970042  1570 raft_consensus.cc:2368] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10.
I20260709 13:00:38.973956  6670 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:38.976894  1730 tablet_copy_service.cc:342] P 66344ad7cd844754b2c81cc689a709b0: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-cbe76ebe20be4546bed4f95e2ee090bd received from {username='slave'} at 127.0.0.1:54412
I20260709 13:00:38.977655  1730 tablet_copy_service.cc:434] P 66344ad7cd844754b2c81cc689a709b0: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-cbe76ebe20be4546bed4f95e2ee090bd on tablet cbe76ebe20be4546bed4f95e2ee090bd with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:38.982398  6721 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:38.983072  6721 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:38.985394  6721 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:38.987679  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:38.989791  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:38.977684  6760 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:38.992885  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 87260.9us
I20260709 13:00:38.996402  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:39.002978  1645 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 12: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:38.997658  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:38.999017  1657 tablet_copy_service.cc:342] P a4be9cc90aca4dd4ad7db103062a7208: Request end of tablet copy session 6f381117554e49bb816791ab0a10f2b8-cc8f7aca67ac4df5b6f0b4f41d538dfd received from {username='slave'} at 127.0.0.1:38584
I20260709 13:00:39.004269  1657 tablet_copy_service.cc:434] P a4be9cc90aca4dd4ad7db103062a7208: ending tablet copy session 6f381117554e49bb816791ab0a10f2b8-cc8f7aca67ac4df5b6f0b4f41d538dfd on tablet cc8f7aca67ac4df5b6f0b4f41d538dfd with peer 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:39.004233  1639 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
W20260709 13:00:39.007320  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 76618.8us
I20260709 13:00:38.964298  1721 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:39.015616  6670 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:39.016960  2443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759"
dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:42646
I20260709 13:00:39.017728  2443 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:39.023851  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:39.024554  2443 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.026196  6760 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:39.027822  6715 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.044327  1721 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:39.052205  1611 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:39.053071  6451 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:39.053772  6451 raft_consensus.cc:697] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:39.054303  1721 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:00:39.054924  6451 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.058594  1717 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:39.059247  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:39.059556  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:39.060197  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.060716  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:39.061231  6572 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:39.061357  1718 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:39.061810  6572 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:39.064433  6572 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:39.065995  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:39.066393  6710 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:39.067296  6710 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.069835  6710 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:39.077849  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:39.083031  2436 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.080662  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:39.084661  2444 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:39.043973  6721 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:39.050462  6694 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:39.094518  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:39.094892  6803 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:00:39.102470  1568 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:00:39.103034  2447 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:39.103446  6600 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:00:39.105319  6721 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:39.096115  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:39.106452  1714 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.107808  6721 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:39.109272  6694 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.109670  6762 raft_consensus.cc:1064] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:39.113101  2443 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.076207  6760 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:39.126045  1645 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:39.097757  6718 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.130651  6718 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:39.131613  1717 raft_consensus.cc:2393] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:39.131759  6711 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.133040  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:39.087400  6736 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.138545  6685 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:39.141104   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:39.122581  6670 consensus_queue.cc:1059] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:00:39.145627  6684 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:39.147903  6760 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:39.148255  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:39.160934  1568 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:39.162313  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:39.163005  1640 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:00:39.163818  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:39.164412  1645 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:00:39.134902  6711 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:39.160997  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:39.166667  2448 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:39.169725  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:39.161492  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:39.170463  1720 raft_consensus.cc:2368] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 8. Current term is 9.
I20260709 13:00:39.170984  6736 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:39.171442  2406 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:39.173183  2406 leader_election.cc:400] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10.
I20260709 13:00:39.173475  2406 leader_election.cc:403] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:00:39.173812  6715 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:39.175441  1719 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:39.177438  6581 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:39.177875  6581 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.178251  6581 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.179152  2448 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
W20260709 13:00:39.180017  6807 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.056s	user 0.003s	sys 0.000s
I20260709 13:00:39.160297  6694 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:39.183122  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:39.183455  6684 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:39.184314  1715 raft_consensus.cc:2368] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13.
I20260709 13:00:39.184636  2405 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:39.186621  6784 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:00:39.187920  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.189343  1611 leader_election.cc:400] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13.
I20260709 13:00:39.189667  1611 leader_election.cc:403] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:39.194002  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:39.194850  2437 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:39.170428  2447 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:39.196390  2444 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:39.185892  2405 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:39.198359  6787 raft_consensus.cc:2764] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:00:39.199141  6694 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:39.200165  2406 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:39.200708  2405 leader_election.cc:400] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 8. Current term is 9.
I20260709 13:00:39.201031  2405 leader_election.cc:403] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:39.152283  1714 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
W20260709 13:00:39.201992  6762 raft_consensus.cc:1068] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: Unable to promote non-voter 6f381117554e49bb816791ab0a10f2b8: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:00:39.202297  6787 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:39.221630  6787 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.222002  6787 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:39.202399  6617 raft_consensus.cc:3055] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:39.226600  6617 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:39.227517  1704 tablet_service.cc:1558] Processing DeleteTablet for tablet 36627e4c13c74e8a9fd501f26c7aff53 with delete_type TABLET_DATA_TOMBSTONED (TS 66344ad7cd844754b2c81cc689a709b0 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:47746
I20260709 13:00:39.229274  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 216) took 1977 ms. Trace:
I20260709 13:00:39.211113  1537 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:39.211268  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:39.211596  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:39.232016  1569 raft_consensus.cc:2393] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:39.204929  1568 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:00:39.231916  1467 catalog_manager.cc:5697] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 12 to 13, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 13 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:39.231935  1567 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:39.230312  6710 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:39.205776  2448 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:39.233917  6710 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:39.227576  6617 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:39.236045  6617 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:39.236325  6710 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:39.171474  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:39.218801  6719 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:00:39.239756  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:39.208359  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:39.243160  6670 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:39.243692  6670 raft_consensus.cc:697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:39.244572  6670 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.246227  6762 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:39.247174  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 119598us
I20260709 13:00:39.248235  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:39.248816  1713 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:39.234130  1467 catalog_manager.cc:5697] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 13 to 14, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 14 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:39.233033  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:39.217542  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:39.256393  2437 raft_consensus.cc:2368] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 12. Current term is 13.
I20260709 13:00:39.259377  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:39.260139  1640 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 13:00:39.264374  2436 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:39.265522  2447 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:00:39.263437  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:39.270628  1686 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:39.272259  1641 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:00:39.280103  1686 leader_election.cc:400] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 12. Current term is 13.
I20260709 13:00:39.280421  1686 leader_election.cc:403] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:00:39.282429  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:39.282704  1567 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:39.269405  6760 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:39.269593  6685 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:39.270520  6694 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 8. Current term is 9.
I20260709 13:00:39.310431  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:39.311129  1645 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:39.285548  6600 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:39.286438  1467 catalog_manager.cc:5697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 8, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:39.217013  6690 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:00:39.303078  6601 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:39.270126  6710 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:00:39.349359  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:39.317454  2443 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:39.310454  6685 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.279844  6581 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.319038  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:39.359848  1713 raft_consensus.cc:3055] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:39.294528  6721 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:00:39.360163  1713 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:39.364754  1643 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:39.368834  6775 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:39.370143  6648 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:39.371001  6648 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } attrs { replace: true } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.229668  1470 rpcz_store.cc:276] 0709 13:00:37.251529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.251770 (+   241us) service_pool.cc:224] Handling call
0709 13:00:39.229078 (+1977308us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:37.945337 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:37.945724 (+   387us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:37.945747 (+    23us) write_op.cc:435] Acquired schema lock
0709 13:00:37.945758 (+    11us) tablet.cc:662] Decoding operations
0709 13:00:37.946046 (+   288us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:37.946157 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:37.946197 (+    40us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:37.946498 (+   301us) tablet.cc:701] Row locks acquired
0709 13:00:37.946526 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:00:37.946665 (+   139us) write_op.cc:270] Start()
0709 13:00:37.946773 (+   108us) write_op.cc:276] Timestamp: P: 1783602037946619 usec, L: 0
0709 13:00:37.946794 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:37.962843 (+ 16049us) log.cc:844] Serialized 919 byte log entry
0709 13:00:38.685803 (+722960us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b18000fa420. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1ab3f3 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd 000000000038f354 000000000038f199 00007f18ca18e83a
0709 13:00:38.858876 (+173073us) op_driver.cc:464] REPLICATION: finished
0709 13:00:39.175407 (+316531us) write_op.cc:301] APPLY: starting
0709 13:00:39.175536 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:39.177827 (+  2291us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:39.177865 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:39.211384 (+ 33519us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:39.211676 (+   292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:00:39.211722 (+    46us) write_op.cc:312] APPLY: finished
0709 13:00:39.212052 (+   330us) log.cc:844] Serialized 33 byte log entry
0709 13:00:39.216731 (+  4679us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:39.216950 (+   219us) write_op.cc:454] Released schema lock
0709 13:00:39.217012 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:39.217501 (+   489us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:39.217535 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":316177,"apply.run_cpu_time_us":5627,"apply.run_wall_time_us":42090,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12491,"num_ops":2,"prepare.queue_time_us":238376,"prepare.run_cpu_time_us":11419,"prepare.run_wall_time_us":164198,"raft.queue_time_us":84542,"raft.run_cpu_time_us":65317,"raft.run_wall_time_us":292366,"replication_time_us":897657,"spinlock_wait_cycles":38710656,"thread_start_us":564768,"threads_started":4,"wal-append.queue_time_us":148010}]]}
I20260709 13:00:39.373049  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:39.373257  6657 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10.
I20260709 13:00:39.346920  6600 raft_consensus.cc:697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 13:00:39.378248  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.358201  6685 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.378443  1713 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:39.385788  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 86472us
I20260709 13:00:39.299836  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 13:00:39.387738  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 87951.2us
I20260709 13:00:39.387931  1643 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:39.392310  6820 tablet_replica.cc:333] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:00:39.360877  6762 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:00:39.416849  1536 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:39.394037  6572 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:39.452586  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:39.453456  1639 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:39.452370  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:39.465041  6719 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13.
W20260709 13:00:39.452360  6801 log.cc:927] Time spent T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:39.498111  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:39.475274  6581 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:39.475941  6600 consensus_queue.cc:237] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.476833  6821 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:39.477029  6572 raft_consensus.cc:697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:39.479110  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:39.479430  1644 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:00:39.489603  6804 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:00:39.503953  1642 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:39.508255  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 154206us
I20260709 13:00:39.516652  1639 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
W20260709 13:00:39.517450  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 102761us
I20260709 13:00:39.485816  6787 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.530613  6451 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:39.531059  6451 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:39.531379  6451 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.538976  6451 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.558171  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:39.522301  6821 raft_consensus.cc:697] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:39.564344  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:39.569177  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 90162.9us
I20260709 13:00:39.575305  6451 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:39.596542  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 65821.5us
W20260709 13:00:39.599265  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 81604.8us
I20260709 13:00:39.611012  1642 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
W20260709 13:00:39.617739  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 62326.2us
I20260709 13:00:39.626087  2442 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEARNER]: Advancing to term 9
I20260709 13:00:39.626338  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:39.627018  1567 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.638891  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:39.639947  1570 raft_consensus.cc:2368] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 8. Current term is 9.
I20260709 13:00:39.645088  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:39.645748  1571 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.643764  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:39.652300  1567 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:39.658268  1565 raft_consensus.cc:2368] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13.
I20260709 13:00:39.658563  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:39.667367  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:39.648453  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:39.669237  1564 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:39.677440  2406 leader_election.cc:400] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 8. Current term is 9.
I20260709 13:00:39.678447  2406 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:00:39.744942  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 100329us
I20260709 13:00:39.604902  6572 consensus_queue.cc:237] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:39.755998  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 110158us
I20260709 13:00:39.741133  6601 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 12. Current term is 13.
I20260709 13:00:39.775701  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:00:39.792369  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 209637us
I20260709 13:00:39.794425  1612 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:39.795606  6721 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:39.797230  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:39.668673  6821 consensus_queue.cc:237] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:39.804112  6823 log.cc:927] Time spent T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:00:39.806151  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:39.808398  2442 raft_consensus.cc:2955] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:39.814483  1566 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:39.777050  6787 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:39.834093  6830 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:39.834789  6830 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:39.827492  6721 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:39.836143  6721 raft_consensus.cc:697] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:39.837435  6830 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:39.837116  6721 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.825965  1564 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:00:39.840445  6831 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:39.845346  6831 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:39.846553  6831 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:39.851819  1718 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:00:39.856138  6760 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:00:39.861289  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.873174  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.913846  1567 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:00:39.914436  1567 pending_rounds.cc:85] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 6
W20260709 13:00:39.919131  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 122021us
W20260709 13:00:39.920101  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 192991us
I20260709 13:00:39.914695  1567 pending_rounds.cc:107] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:00:39.925614  1567 raft_consensus.cc:2889] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:39.925753  6685 consensus_meta.cc:287] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.003s
W20260709 13:00:39.940258  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 261858us
I20260709 13:00:39.936724  6685 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:39.972819  1721 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
W20260709 13:00:39.988505  6766 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 13:00:39.988525  2446 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:39.997979  1571 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:40.005892  1647 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:40.012806  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:40.023954  6451 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:00:40.024722  1640 consensus_meta.cc:287] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 13:00:40.025353  1640 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:40.032717  1612 leader_election.cc:400] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13.
I20260709 13:00:40.033658  1612 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:40.022229  6711 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:40.038596  6451 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:40.044574  1571 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:00:40.045174  1685 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:40.045339  2446 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:00:40.047338  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:40.036933  6826 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:00:40.060954  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:40.023903  6710 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:00:40.066875  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 145713us
I20260709 13:00:40.070456  1686 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:40.080192  6685 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:40.097951  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 52844.3us
I20260709 13:00:40.123270  2437 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:00:40.132100  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:40.133133  2437 raft_consensus.cc:2368] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11.
I20260709 13:00:40.133661  1570 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:40.136271  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:40.137106  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:40.137632  1639 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:40.191071  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:00:40.188756  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 61940.8us
I20260709 13:00:40.191874  1564 raft_consensus.cc:2368] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11.
I20260709 13:00:40.208029  1639 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:40.211555  1565 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:40.220867  2436 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEARNER]: Advancing to term 9
I20260709 13:00:40.223237  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:40.227046  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:40.227246  1644 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:40.128530  6854 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 13:00:40.202200  6760 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:40.230525  1643 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:40.236342  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:40.249501  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 57572.7us
I20260709 13:00:40.257922  1612 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:40.268935  1644 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
W20260709 13:00:40.273669  6864 log.cc:927] Time spent T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:40.277665  2405 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:40.290443  2436 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:00:40.291144  2436 pending_rounds.cc:85] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 6
I20260709 13:00:40.293713  2436 pending_rounds.cc:107] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:00:40.298178  2436 raft_consensus.cc:2889] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:40.256207  6760 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:40.290484  6784 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:40.303151  6669 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:00:40.325421  6870 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:40.326398  6870 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:40.291577  6853 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.303859  6841 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:40.345189  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:40.325469  6669 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:00:40.399371  1716 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:40.298125  6617 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:00:40.334239  6853 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:40.403687  6867 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:40.411350  6840 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:40.423475  6863 log.cc:927] Time spent T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:00:40.425318  6674 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 13:00:40.427971  6860 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:00:40.432783  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54412 (request call id 1390) took 1095 ms. Trace:
I20260709 13:00:40.333604  6784 raft_consensus.cc:697] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:00:40.435527  6859 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:00:40.457453  1721 rpcz_store.cc:276] 0709 13:00:39.337369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.337518 (+   149us) service_pool.cc:224] Handling call
0709 13:00:40.432597 (+1095079us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b5400302354. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:40.432699 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986809728}
I20260709 13:00:40.468103  6710 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:00:40.454901  6645 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:40.470615  6645 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:40.472977  6645 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:40.474565  6648 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:40.446482  6853 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.475147  6871 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.475708  6871 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:40.401190  6670 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:40.478513  6670 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:40.480500  6670 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:40.459997  6867 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:40.483067  6867 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:40.489054  6784 consensus_queue.cc:237] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:40.477804  6871 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:40.495195  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3002) took 1232 ms. Trace:
I20260709 13:00:40.495589  1640 rpcz_store.cc:276] 0709 13:00:39.263024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.263140 (+   116us) service_pool.cc:224] Handling call
0709 13:00:40.495013 (+1231873us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b540033bdd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:40.495114 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549774208}
I20260709 13:00:40.496945  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:40.497776  6578 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:40.545362  2406 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:40.555369  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:40.568848  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 242000us
I20260709 13:00:40.460686  6870 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:00:40.544222  6645 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:40.458914  6674 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:40.581493  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:40.577453  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:40.555223  6827 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.594482  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:40.606367  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 271904us
I20260709 13:00:40.607425  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:40.611953  1612 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 13:00:40.612517  6822 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 1.219s	user 0.008s	sys 0.005s
I20260709 13:00:40.620792  6451 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:40.623540  1716 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:40.626063  1721 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:40.610342  6581 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:40.589102  6645 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:40.616448  6837 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.615242  6880 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:40.628396  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:40.638536  2438 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:40.599579  6827 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:40.638980  2442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 1170) took 1121 ms. Trace:
I20260709 13:00:40.645960  6842 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:40.638324  6832 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:00:40.647584  1563 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:00:40.649873  6872 log.cc:927] Time spent T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:40.655766  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:40.629801  6760 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:40.658298  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 113059us
I20260709 13:00:40.643731  6581 raft_consensus.cc:697] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:40.666885  1612 leader_election.cc:400] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11.
I20260709 13:00:40.667300  1612 leader_election.cc:403] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:00:40.659549  6880 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:40.670512  6870 consensus_queue.cc:1059] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:40.686470  6870 raft_consensus.cc:3055] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:40.686847  6870 raft_consensus.cc:740] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:40.687671  6870 consensus_queue.cc:260] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:40.665923  6760 raft_consensus.cc:2764] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:00:40.688980  6870 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:40.691673  6853 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:40.670817  6581 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:40.655896  2442 rpcz_store.cc:276] 0709 13:00:39.506225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.506993 (+   768us) service_pool.cc:224] Handling call
0709 13:00:39.562635 (+ 55642us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.808212 (+245577us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:40.226864 (+418652us) log.cc:844] Serialized 14 byte log entry
0709 13:00:40.354139 (+127275us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.413733 (+ 59594us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b18003c4f60. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1ab3f3 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd 000000000038f354 000000000038f199 00007f18ca18e83a
0709 13:00:40.487378 (+ 73645us) log.cc:844] Serialized 26 byte log entry
0709 13:00:40.487615 (+   237us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:40.487963 (+   348us) log.cc:844] Serialized 14 byte log entry
0709 13:00:40.488187 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.488292 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.625412 (+137120us) raft_consensus.cc:1685] finished
0709 13:00:40.625440 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.627714 (+  2274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18411,"prepare.queue_time_us":168,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":34736,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":182,"spinlock_wait_cycles":110959744,"thread_start_us":20499,"threads_started":1,"wal-append.queue_time_us":112121}
I20260709 13:00:40.695606  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:40.672928  6879 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:40.644124  6837 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:40.674038  6711 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:40.674361  6674 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:40.675730  6871 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:40.676087  6875 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:40.683025  6645 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:40.683543  6880 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:40.659330  6842 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:40.684454  6827 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:40.685058  6884 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11.
I20260709 13:00:40.685691  6617 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.711555  6842 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:40.702277  1612 leader_election.cc:400] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11.
I20260709 13:00:40.693832  6853 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:40.712471  6617 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:40.715018  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:40.705538  6871 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:40.729528  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:40.736570  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:40.733640  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 56716us
I20260709 13:00:40.741374  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:40.741781  2405 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:40.711591  6837 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:40.745821  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:40.719264  6880 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:40.748925  1565 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:40.749948  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:40.751645  6871 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:40.753724  1568 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:40.762889  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:40.768106  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:40.769683  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:40.783804  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:40.713862  6875 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:40.962744  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:40.787885  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:40.786160  1643 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:00:40.883045  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 65726.7us
I20260709 13:00:40.797112  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:40.836503  2446 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:40.897867  2406 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:40.833725  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:40.837836  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:40.976284  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 142617us
I20260709 13:00:40.839406  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:40.771555  6845 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:40.835050  6617 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:40.861972  6870 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:40.993808  1565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48208
I20260709 13:00:40.994603  1565 raft_consensus.cc:606] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Received request to transfer leadership
I20260709 13:00:40.995000  1565 raft_consensus.cc:614] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:40.781665  6837 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:41.015883  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:41.017827  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:41.052814  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:40.955045  6853 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:41.055270  6853 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:41.022032  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:40.987808  6670 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:40.822798  6884 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 13:00:41.058424  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 160673us
I20260709 13:00:41.068893  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:41.061168  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:40.877249  6844 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.055264  6645 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:00:41.062682  6670 raft_consensus.cc:697] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:41.017534  6711 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:00:41.066601  1713 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:41.092114  2443 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:41.097177  1611 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:41.103828  2406 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:41.020063  6845 raft_consensus.cc:697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:41.071280  6784 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:41.019591  6870 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:41.020391  6871 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:00:40.977845  6684 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:41.021914  6837 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:41.155792  6853 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:41.112888  6840 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.155251  6670 consensus_queue.cc:237] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:41.156428  6721 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:41.100320  6844 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:41.103462  6832 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:41.143003  6868 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:00:41.110935  6842 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:41.199254  1713 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
W20260709 13:00:41.212320  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 85916.4us
W20260709 13:00:41.222294  1713 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54412 (request call id 1389) took 1903 ms (client timeout 2022 ms). Trace:
W20260709 13:00:41.229125  1713 rpcz_store.cc:269] 0709 13:00:39.318567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.318768 (+   201us) service_pool.cc:224] Handling call
0709 13:00:39.847610 (+528842us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b1800289920. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2d3646 00007f18cd20d58e 00007f18cd28ef9e 00007f18cd2907de 00007f18cd29c27c 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c
0709 13:00:41.065953 (+1218343us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b58006b00d0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd1f40aa 00007f18cd276447 00007f18cd28efe7 00007f18cd2907de 00007f18cd29c27c 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c
0709 13:00:41.222234 (+156281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204825088}
I20260709 13:00:41.099174  6884 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:41.254513  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 133269us
I20260709 13:00:41.223717  6853 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:41.416131  6856 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:41.416430  6844 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:41.417164  6902 log.cc:927] Time spent T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:00:41.417984  6900 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.418520  6900 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:41.420727  6900 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:41.416785  6856 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:41.241066  6684 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:41.223932  6840 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:41.404656  6832 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.403378  6794 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:41.427013  6884 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:41.409411  6914 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:41.410459  6572 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:41.577657  1565 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:00:41.578773  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 282383us
W20260709 13:00:41.586236  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 334752us
I20260709 13:00:41.412062  6853 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:41.495433  6820 raft_consensus.cc:2243] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:00:41.707427  1712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.009s	sys 0.014s
W20260709 13:00:41.710992  1712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.010s	sys 0.014s
I20260709 13:00:41.579267  6900 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:41.579721  6842 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:41.395390  6845 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:41.798902  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:41.787657  6669 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:41.718376  6762 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:41.489032  6832 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:41.673527  6572 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:41.903075  1685 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:41.583604  6914 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:41.923691  1536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.012s	sys 0.038s
W20260709 13:00:41.940460  1536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.012s	sys 0.038s
W20260709 13:00:41.959088  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 54405.5us
I20260709 13:00:41.960886  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:41.963296  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:41.922605  6827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.011s	sys 0.012s
I20260709 13:00:41.809978  6900 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:41.871248  6870 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:41.809510  6842 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:41.992583  6918 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:00:41.999799  6827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.012s	sys 0.012s
I20260709 13:00:41.881400  6762 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.028190  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:41.999471  6922 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:41.868366  6669 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:42.001227  6844 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:42.006160  6837 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.012578  6648 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.028168  6820 raft_consensus.cc:2272] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:42.017264  6721 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:42.016657  6870 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.014251  6652 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:00:42.050227  6690 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.046653  6827 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.063738  6889 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:42.060302  6572 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:42.064253  6884 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.073375  6913 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.136536  1563 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:42.085553  6840 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.233958  6889 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.127947  6925 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.236195  6900 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:42.087416  6856 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.237309  6930 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.237962  6921 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.245738  6930 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.245920  6921 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.248325  6930 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.248747  6921 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.249415  6934 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.238385  6915 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.075501  6648 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.018883  6918 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:42.245074  6856 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.072095  6721 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:42.252782  6929 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.082437  6919 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.258472  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:42.287997  1712 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 13:00:42.086385  6690 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.101764  6684 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:42.137210  6827 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.240538  6853 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:42.240099  6884 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.047206  6922 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.289618  1611 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:42.252642  6934 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.286163  6891 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.296607  6918 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:42.296840  6820 ts_tablet_manager.cc:1916] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:42.298437  6914 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:42.080188  6870 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.261183  6930 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:42.324937  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 2866) took 1831 ms. Trace:
I20260709 13:00:42.309931  6832 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.330461  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.311393  6839 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.301517  6840 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:42.241379  6913 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.336462  1721 rpcz_store.cc:276] 0709 13:00:40.484257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.540361 (+ 56104us) service_pool.cc:224] Handling call
0709 13:00:40.625817 (+ 85456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.626549 (+   732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.315200 (+1688651us) spinlock_profiling.cc:243] Waited 85 ms on lock 0x7b54001a9350. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:42.315399 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195540864}
I20260709 13:00:42.311714  6924 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:42.284759  6856 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:42.330340  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.339571  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.320915  6891 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.264197  6915 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.342834  6936 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:42.344076  6870 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.343529  6839 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.346412  6939 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:42.334406  6670 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.353705  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:42.349896  6832 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.363430  6931 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.363592  6832 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.264528  6925 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:42.363938  6935 log.cc:927] Time spent T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:00:42.348887  6762 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.350836  6842 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.310972  6919 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.362607  6870 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:42.378759  6839 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.347971  6930 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:42.365648  6669 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.311498  6929 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.350319  6840 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:42.385320  6922 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.386297  6922 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.365422  6670 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.372324  6762 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:42.377722  6870 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.380788  6925 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.392422  1712 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 13:00:42.338896  6945 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.391222  6762 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.394044  6889 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.402532  6875 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.375247  6939 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:42.396543  6913 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.397521  6937 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:42.398753  6827 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.398936  6891 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.380757  6690 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.403156  1563 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:00:42.364431  6931 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:42.390254  6870 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:42.386803  6922 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:42.408424  6648 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.409454  6617 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:42.372728  6936 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:42.368506  6924 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:42.486158  6910 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.997s	user 0.002s	sys 0.007s
I20260709 13:00:42.486369  6762 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.461194  6840 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.458245  6915 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:42.465179  6884 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.488943  6832 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.498025  2437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 708) took 1700 ms. Trace:
I20260709 13:00:42.498482  2437 rpcz_store.cc:276] 0709 13:00:40.797508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.883867 (+ 86359us) service_pool.cc:224] Handling call
0709 13:00:40.884208 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.993744 (+109536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.993772 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.994286 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.202173 (+207887us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:41.202229 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.202369 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.485381 (+1283012us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:00:42.497735 (+ 12354us) raft_consensus.cc:1685] finished
0709 13:00:42.497760 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.497964 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103288,"raft.queue_time_us":109903,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":9721,"spinlock_wait_cycles":1030790528,"thread_start_us":138332,"threads_started":1,"wal-append.queue_time_us":246652}
I20260709 13:00:42.495965  6934 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.486219  6617 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.505538  2442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 1177) took 1802 ms. Trace:
I20260709 13:00:42.460314  6937 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.501451  6919 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.514179  6931 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.514330  6936 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.516119  6934 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.516857  6934 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.506722  2442 rpcz_store.cc:276] 0709 13:00:40.703396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.704888 (+  1492us) service_pool.cc:224] Handling call
0709 13:00:40.707329 (+  2441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.709475 (+  2146us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:40.712317 (+  2842us) log.cc:844] Serialized 14 byte log entry
0709 13:00:40.883623 (+171306us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:40.883674 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:40.928107 (+ 44433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.505229 (+1577122us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b5400a64854. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:42.505290 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.505464 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14165,"prepare.queue_time_us":2439,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":27865,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":2395520,"thread_start_us":144334,"threads_started":2,"wal-append.queue_time_us":34753,"wal-append.run_cpu_time_us":867,"wal-append.run_wall_time_us":1002805}
I20260709 13:00:42.520493  6937 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.520504  6930 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:42.522023  6924 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.523563  6934 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.515457  6670 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.526829  6922 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.528342  6617 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.422753  6945 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.534157  1645 raft_consensus.cc:1813] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Handling vote request from an unknown peer 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:42.534744  1645 raft_consensus.cc:2410] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:00:42.539001  6908 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 1.442s	user 0.001s	sys 0.023s
W20260709 13:00:42.549757  1518 auto_rebalancer.cc:893] Removing replace marker failed: Replica 338d817f94ee4c1bad162e9a5860b68a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 13:00:42.550277  1518 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:00:42.550578  1518 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:00:42.551091  6870 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.553293  6870 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.553956  6945 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.559509  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:42.559898  6710 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:42.559969  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:42.560843  6783 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:42.562351  6451 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.562812  6451 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.565917  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:42.566277  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:42.571280  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:42.571537  6451 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.572849  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:42.573559  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:42.574153  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:42.574345  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:42.575598  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:42.576107  6794 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:42.576220  2440 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:42.576638  6794 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:42.572933  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:42.581626  6451 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.582273  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:42.582206  6451 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.570047  6934 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.584674  6934 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.585654  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.587111  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.566145  6879 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.585767  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.586452  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.588454  1566 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
I20260709 13:00:42.586728  6934 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.587734  1564 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:42.565517  6870 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.598029  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.598737  6931 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.598836  6929 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.599756  6880 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.600848  6884 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.601058  6934 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:42.566349  6922 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.588182  6879 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:42.602042  6451 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.567549  6945 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 13:00:42.603335  6916 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.864s	user 0.003s	sys 0.005s
I20260709 13:00:42.603672  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.604784  6913 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.620591  6913 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.620481  6945 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:42.605190  6875 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.622329  6875 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.622776  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.609684  1572 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:42.560593  6710 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:42.617288  6934 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:42.621038  6879 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.623416  1641 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:42.616958  6922 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:42.626333  6913 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.617187  6884 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:42.637616  6922 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.639181  6884 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.639586  6934 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.612423  6931 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.626606  6875 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.635705  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 2825) took 1574 ms. Trace:
I20260709 13:00:42.646046  1569 rpcz_store.cc:276] 0709 13:00:41.060822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.060951 (+   129us) service_pool.cc:224] Handling call
0709 13:00:41.061255 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.092730 (+ 31475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.092755 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.101260 (+  8505us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.525581 (+424321us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:41.525640 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.525738 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.602689 (+1076951us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:00:42.626807 (+ 24118us) raft_consensus.cc:1685] finished
0709 13:00:42.626827 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.635616 (+  8789us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22132,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":7576,"spinlock_wait_cycles":341059456,"thread_start_us":367340,"threads_started":1,"wal-append.queue_time_us":366904}
I20260709 13:00:42.647321  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 2876) took 1574 ms. Trace:
I20260709 13:00:42.647760  1714 rpcz_store.cc:276] 0709 13:00:41.072826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.095421 (+ 22595us) service_pool.cc:224] Handling call
0709 13:00:41.108452 (+ 13031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.496447 (+387995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.496488 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.496530 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:41.496566 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.647085 (+1150519us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400229054. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:42.647134 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.647262 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891860864}
I20260709 13:00:42.617000  6880 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.649397  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:42.651715  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.659422  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.659847  6945 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.612828  6870 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.660662  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.663570  1641 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:00:42.660266  6775 raft_consensus.cc:2955] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:42.661320  6875 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:42.667049  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.667605  1641 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:42.648427  6794 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.661126  6931 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.671386  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.671483  6937 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.672310  6937 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.674336  6937 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.674719  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.676376  1644 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 13:00:42.677178  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.672822  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.683099  1641 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 13: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:42.661949  6880 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.691016  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:42.692034  6848 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.692703  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.693348  1644 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:42.687831  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.694684  1641 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:42.697131  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.692577  6848 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.699479  6710 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.700937  1641 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:00:42.702409  6645 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.703006  6848 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.703831  1641 pending_rounds.cc:85] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 5
I20260709 13:00:42.705253  6645 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.707618  1641 pending_rounds.cc:107] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:00:42.708045  1641 raft_consensus.cc:2889] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:42.703658  6821 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.842s	user 0.013s	sys 0.026s
I20260709 13:00:42.708619  6674 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:42.707935  6900 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:42.712345  6674 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.712443  6900 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.714888  6900 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.715173  6674 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.716039  6681 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.716711  6681 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.717324  6794 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:42.721901  6681 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:42.716029  6821 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.854s	user 0.014s	sys 0.026s
I20260709 13:00:42.724997  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.725447  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.725845  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.726387  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.726565  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.727885  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.722298  6794 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.735559  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.742578  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:42.750593  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 3703) took 1630 ms. Trace:
I20260709 13:00:42.751055  1716 rpcz_store.cc:276] 0709 13:00:41.119981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.121007 (+  1026us) service_pool.cc:224] Handling call
0709 13:00:41.165935 (+ 44928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.411148 (+245213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.411191 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.411262 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:41.438148 (+ 26886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.750351 (+1312203us) spinlock_profiling.cc:243] Waited 88.4 ms on lock 0x7b540013ced4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:42.750407 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.750531 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168657,"raft.queue_time_us":156564,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3952,"spinlock_wait_cycles":203291520}
I20260709 13:00:42.751976  6581 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.752682  6581 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.728979  6657 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:42.761386  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.762387  1640 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:42.766072  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.766739  6581 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.738801  6794 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.774565  6870 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.747620  6900 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:00:42.760046  6681 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.778573  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.782759  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.780841  6681 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.781683  6848 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.786856  6856 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:42.787029  6848 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:42.788269  6681 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.788594  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 2874) took 1799 ms. Trace:
I20260709 13:00:42.788985  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3008) took 2022 ms. Trace:
I20260709 13:00:42.764351  6657 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.781713  6569 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:42.784518  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 3705) took 1664 ms. Trace:
I20260709 13:00:42.797222  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.785351  6645 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:42.788950  1720 rpcz_store.cc:276] 0709 13:00:40.989350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.989483 (+   133us) service_pool.cc:224] Handling call
0709 13:00:40.989841 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.092480 (+102639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.092511 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.092549 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:41.092575 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.788394 (+1695819us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400065c54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:42.788437 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.788545 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235575680}
I20260709 13:00:42.795315  6928 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:42.796017  6794 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:42.797664  1718 rpcz_store.cc:276] 0709 13:00:41.120626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.121089 (+   463us) service_pool.cc:224] Handling call
0709 13:00:42.783921 (+1662832us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 13:00:42.784087 (+   166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.784241 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.784265 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.784303 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:42.784332 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.784381 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.784469 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5344000}
I20260709 13:00:42.773859  6820 ts_tablet_manager.cc:1929] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.10
I20260709 13:00:42.802969  1714 raft_consensus.cc:1240] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:42.789191  6848 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:42.804359  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:42.807547  1716 raft_consensus.cc:2410] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:00:42.807482  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:42.806128  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.808707  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.808904  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.809530  1566 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:42.810209  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.808586  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.810838  1570 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:00:42.811367  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.811630  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.789441  1638 rpcz_store.cc:276] 0709 13:00:40.765989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.775815 (+  9826us) service_pool.cc:224] Handling call
0709 13:00:40.816066 (+ 40251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.825495 (+  9429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.825525 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.882513 (+ 56988us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.072581 (+190068us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:41.121253 (+ 48672us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.522516 (+1401263us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b18002313a0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1ab3f3 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd 000000000038f354 000000000038f199 00007f18ca18e83a
0709 13:00:42.538418 (+ 15902us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:00:42.726701 (+188283us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b18002313a0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1792a6 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca18de07 00007f18d2fe8ab9
0709 13:00:42.727972 (+  1271us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b18002313a0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca18de07 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1a8455 00007f18cd290060 00007f18cd2a2716 00007f18cd2b3287 00007f18cd2b3208
0709 13:00:42.781939 (+ 53967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.782005 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.782043 (+    38us) raft_consensus.cc:1685] finished
0709 13:00:42.782072 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.788810 (+  6738us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32423,"prepare.queue_time_us":39992,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":284320,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":17075,"spinlock_wait_cycles":20585216,"thread_start_us":138963,"threads_started":2,"wal-append.queue_time_us":130330}
I20260709 13:00:42.815248  1568 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:42.816009  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:42.816480  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.816591  1716 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:42.817107  1640 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:00:42.818563  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.808562  6928 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.812501  6820 log.cc:1199] T 36627e4c13c74e8a9fd501f26c7aff53 P 66344ad7cd844754b2c81cc689a709b0: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-2-root/wals/36627e4c13c74e8a9fd501f26c7aff53
I20260709 13:00:42.820483  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:42.822183  1640 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:00:42.826759  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:42.803985  6569 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:42.829437  1568 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:43.045186  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:42.838747  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:43.055406  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:43.055104  1466 catalog_manager.cc:5697] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.869701  6657 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:43.057128  1466 catalog_manager.cc:5697] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:43.058097  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:43.058436  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:43.058632  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:42.853247  1685 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 3.010s (SENT)
I20260709 13:00:43.052434  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.059511  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.060105  2447 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:43.060164  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.060395  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:43.060772  2437 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:43.061309  1720 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:43.061568  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.062282  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.062672  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.067286  1466 catalog_manager.cc:5697] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:43.063309  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:42.976797  6939 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:41.109865   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:43.062922  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.045658  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3650) took 1816 ms. Trace:
I20260709 13:00:43.063480  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:43.063562  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:43.063815  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.063930  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.064294  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.064845  1719 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:43.064983  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.065434  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.066254  1467 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58250 (request call id 290) took 5779 ms. Trace:
I20260709 13:00:43.067063  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:42.885571  6721 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:43.067545  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:43.046738  6896 log.cc:927] Time spent T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 1.936s	user 0.023s	sys 0.023s
I20260709 13:00:43.053598  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 3706) took 1932 ms. Trace:
I20260709 13:00:43.068176  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.084182  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:43.084066  2437 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:43.069275  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.084507  2438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 1178) took 2378 ms. Trace:
I20260709 13:00:43.085436  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:43.073020  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:43.073655  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:42.975268  1645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3005) took 2759 ms (client timeout 3010 ms). Trace:
I20260709 13:00:43.086787  6451 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:43.073993  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:43.077008  1564 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:00:43.088054  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:43.081962  2448 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:00:42.829842  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.086656  1647 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
W20260709 13:00:43.088624  1645 rpcz_store.cc:269] 0709 13:00:40.216099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.339312 (+2123213us) service_pool.cc:224] Handling call
0709 13:00:42.950602 (+611290us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540035d254. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:42.975141 (+ 24539us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423853312}
I20260709 13:00:43.069305  1466 catalog_manager.cc:5697] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 8 to 9, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:43.076071  1565 rpcz_store.cc:276] 0709 13:00:41.229043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.229997 (+   954us) service_pool.cc:224] Handling call
0709 13:00:41.230335 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.582467 (+352132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.992878 (+1410411us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54003b3b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:43.045590 (+ 52712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":797659008}
I20260709 13:00:43.095086  1466 catalog_manager.cc:5697] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:43.083455  1715 rpcz_store.cc:276] 0709 13:00:41.120923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.126253 (+  5330us) service_pool.cc:224] Handling call
0709 13:00:42.976468 (+1850215us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173a22 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 13:00:43.053133 (+ 76665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.053305 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.053331 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.053370 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:43.053407 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.053456 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.053545 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5071616}
I20260709 13:00:43.096302  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.075687  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:43.098453  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.093494  6947 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.085753  2438 rpcz_store.cc:276] 0709 13:00:40.706192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.706353 (+   161us) service_pool.cc:224] Handling call
0709 13:00:40.707045 (+   692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.707511 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.707550 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.709943 (+  2393us) log.cc:844] Serialized 564 byte log entry
0709 13:00:40.785957 (+ 76014us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:40.785991 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.786067 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.992678 (+2206611us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:00:43.083684 (+ 91006us) raft_consensus.cc:1685] finished
0709 13:00:43.083710 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.084437 (+   727us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12882816,"thread_start_us":72837,"threads_started":1,"wal-append.queue_time_us":269196}
I20260709 13:00:43.100039  1719 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:43.080873  1718 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:43.102236  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:43.101577  6899 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:43.069790  6926 log.cc:927] Time spent T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 1.029s	user 0.044s	sys 0.073s
I20260709 13:00:43.068099  1720 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:43.105978  6451 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:42.853628  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.108665  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.109586  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.110176  2436 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 17.
I20260709 13:00:43.110706  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.112108  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.112805  6937 raft_consensus.cc:1064] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:43.114169  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.115221  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.115269  6937 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:43.116583  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.117012  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.119299  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.120358  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.121023  1720 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:43.093705  6721 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:43.110183  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:43.121411  6831 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:43.123219  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.123342  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:43.123778  1714 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:00:43.072185  6928 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:43.128984  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.124943  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:43.131665  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.132726  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.121706  6681 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:43.109230  6657 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:00:43.131285  1719 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 17.
I20260709 13:00:43.133549  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:43.134171  1716 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:43.134336  6900 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:43.096622  6887 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:00:43.097645  6711 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:00:43.176280  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.137837  6955 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:43.103807  6899 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:43.138554  6906 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 13:00:43.138978  2405 connection.cc:256] RPC call timeout handler was delayed by -1.839673782000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
I20260709 13:00:43.100461  6685 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:43.141745  1714 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:43.143767  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:43.080343  1467 rpcz_store.cc:276] 0709 13:00:37.286941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.287133 (+   192us) service_pool.cc:224] Handling call
0709 13:00:43.066159 (+5779026us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:39.611047 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:39.815043 (+203996us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:39.815098 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:00:39.815128 (+    30us) tablet.cc:662] Decoding operations
0709 13:00:39.815766 (+   638us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:39.815839 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:39.815871 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:00:39.816361 (+   490us) tablet.cc:701] Row locks acquired
0709 13:00:39.816413 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:00:39.816573 (+   160us) write_op.cc:270] Start()
0709 13:00:39.816752 (+   179us) write_op.cc:276] Timestamp: P: 1783602039816512 usec, L: 0
0709 13:00:39.816778 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:00:39.817600 (+   822us) log.cc:844] Serialized 1370 byte log entry
0709 13:00:40.082620 (+265020us) op_driver.cc:464] REPLICATION: finished
0709 13:00:40.272747 (+190127us) write_op.cc:301] APPLY: starting
0709 13:00:40.272844 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:40.429999 (+157155us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:40.430120 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:40.431903 (+  1783us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:40.432095 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:00:40.432139 (+    44us) write_op.cc:312] APPLY: finished
0709 13:00:40.432440 (+   301us) log.cc:844] Serialized 41 byte log entry
0709 13:00:40.432627 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:40.432725 (+    98us) write_op.cc:454] Released schema lock
0709 13:00:40.432776 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:40.466394 (+ 33618us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:40.478124 (+ 11730us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":399563,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":186998,"apply.run_cpu_time_us":6860,"apply.run_wall_time_us":179574,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16673,"num_ops":3,"prepare.queue_time_us":220369,"prepare.run_cpu_time_us":4159,"prepare.run_wall_time_us":217239,"replication_time_us":265662,"thread_start_us":271454,"threads_started":2}]]}
I20260709 13:00:42.835178  6820 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47746 (request call id 14) took 3608 ms. Trace:
I20260709 13:00:43.168912  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:43.169811  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.169880  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.171561  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.175715  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.130443  6920 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:43.182266  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.183204  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.196225  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:43.207018  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 143604us
I20260709 13:00:43.165735  6912 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:43.212108  6920 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:43.212294  6685 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:43.166524  6900 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:43.221293  6581 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:43.191481  6899 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.133455  6831 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:43.237385  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.200759  6694 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:43.175598  6681 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:43.218868  6912 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:43.233886  6900 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:43.201892  6906 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:43.249437  1686 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 13:00:43.250679  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 120103us
I20260709 13:00:43.252939  2443 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:43.258370  1537 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:43.258816  2448 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:00:43.258189  6928 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:43.251334  6912 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.265686  1686 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:43.247879  6694 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:43.275445  1640 raft_consensus.cc:1240] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:43.239259  6581 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:43.287989  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:43.289358  1640 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:43.289700  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:43.281600  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:43.266932  6928 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:43.269966  6847 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:43.279772  6844 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:00:43.293835  6929 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:43.294981  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:43.293043  2438 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:43.297163  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:43.300028  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:43.299381  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:43.301326  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:43.306211  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:43.306593  1640 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:43.306865  1644 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:00:43.313357  6640 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:43.200740  6820 rpcz_store.cc:276] 0709 13:00:39.226947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.227209 (+   262us) service_pool.cc:224] Handling call
0709 13:00:39.391646 (+164437us) ts_tablet_manager.cc:1151] Deleting tablet 36627e4c13c74e8a9fd501f26c7aff53
0709 13:00:39.391776 (+   130us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:00:42.525181 (+3133405us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:42.773711 (+248530us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:42.835081 (+ 61370us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1605221,"tablet-delete.queue_time_us":163284,"thread_start_us":160446,"threads_started":1}
I20260709 13:00:43.296813  6928 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:43.318382  1612 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:43.322574  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:43.294947  6847 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:43.308149  6856 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:43.316339  1647 raft_consensus.cc:2955] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:43.310163  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:43.335530  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:43.340405  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:43.314268  6920 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:43.349396  6685 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:43.355176  6581 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:43.362860  6906 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:43.363970  6831 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:43.327626  6711 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.339392  1455 catalog_manager.cc:5028] TS 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): tablet 36627e4c13c74e8a9fd501f26c7aff53 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:00:43.378651  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.379029  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:43.326407  6847 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.385010  6694 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:43.390647  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:43.342867  6929 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:43.395332  1638 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 13:00:43.334636  6856 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:43.344736  6871 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:43.373524  6955 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:43.405002  6955 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:43.405524  6955 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.408790  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.401156  6856 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:43.403631  6871 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 13:00:43.424229  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.424016  1720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:43.424760  1720 raft_consensus.cc:606] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:43.434235  1612 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:43.439478  1612 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:43.453161  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.423370  6871 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:43.472702  6932 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:43.496912  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 238585us
I20260709 13:00:43.497967  1537 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:43.438339  6867 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
W20260709 13:00:43.477210  6957 log.cc:927] Time spent T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:00:43.516458  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.517690  2448 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:43.477276  6711 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:43.516402  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:43.477063  6961 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:43.489118  6932 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:00:43.556257  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 378813us
W20260709 13:00:43.559665  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 347236us
I20260709 13:00:43.560057  1720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:43.561702  1720 raft_consensus.cc:606] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:43.562134  1720 raft_consensus.cc:614] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:43.562002  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:43.520205  6933 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:43.564060  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:43.533887  6569 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:43.567252  2405 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:43.523408  6961 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:43.581828  2405 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:43.584102  6906 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.565811  6932 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.554879  6681 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:43.585763  2405 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:43.522976  6711 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:43.586450  1536 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:43.571779  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 132357us
I20260709 13:00:43.568711  6920 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:43.603873  2405 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:43.608217  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:43.577469  6933 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:43.613054  1536 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:43.586236  6581 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:43.587700  6685 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:43.586613  6961 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.614114  6928 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:43.610672  6711 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:43.613776  1537 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:43.621881  2405 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:43.610397  6831 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:43.606025  6867 raft_consensus.cc:3055] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:43.632123  2405 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:43.577008  6674 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:00:43.611297  6821 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:43.610685  6920 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.636540  2405 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:43.622931  6933 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.623482  6906 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:43.650568  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:43.625412  6685 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:43.637065  6681 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:43.667519  6451 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:43.635102  6867 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:43.640870  6920 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.638461  6821 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:43.639762  6657 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:43.662238  6837 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:43.646943  6906 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:43.691661  1720 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:43.692598  1720 raft_consensus.cc:606] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:43.668763  6775 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:43.669267  6685 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:43.639429  6887 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 13:00:43.699981  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 71559.2us
I20260709 13:00:43.674686  6939 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:43.681829  6821 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.679564  6965 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.682034  6657 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:43.679476  6837 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:43.696341  6906 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:43.701820  6775 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:43.726553  6657 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:43.706727  6939 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:43.746646  6939 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.735930  6451 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:43.749758  6451 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.722922  6968 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:43.794631  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 180896us
I20260709 13:00:43.738327  6837 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.798687  1537 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:00:43.800823  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 116886us
I20260709 13:00:43.749392  6775 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:43.805508  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 192539us
I20260709 13:00:43.806241  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:43.794982  6968 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:43.812500  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:43.819478  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.819713  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:43.803081  6973 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:43.840785  2444 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:00:43.817806  6959 log.cc:927] Time spent T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:00:43.820979  6968 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.856264  6451 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:43.793569  6867 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:43.838613  6973 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:43.827692  6794 consensus_queue.cc:1059] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:00:43.849220  6912 consensus_meta.cc:287] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.001s
I20260709 13:00:43.847426  6928 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:00:43.901649  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.857439  6900 consensus_meta.cc:287] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.000s
W20260709 13:00:43.862972  6971 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:43.855818  6937 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:43.895625  6973 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:43.902616  6451 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:43.919886  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:43.922605  2448 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.935864  1568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:00:43.939041  6451 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:43.939707  6451 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:43.936582  1568 raft_consensus.cc:606] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:43.895955  6985 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:43.914551  6977 log.cc:927] Time spent T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:00:43.913523  6980 log.cc:927] Time spent T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:00:43.960961  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 90604.3us
I20260709 13:00:43.911676  6937 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 13:00:44.004221  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 182485us
I20260709 13:00:43.948065  6985 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:43.960688  6893 raft_consensus.cc:3055] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:43.911464  6900 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:43.909797  6912 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.001140  6937 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:43.909853  6856 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.039146  1568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
W20260709 13:00:44.039762  6967 log.cc:927] Time spent T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.425s	user 0.004s	sys 0.000s
I20260709 13:00:44.039870  1568 raft_consensus.cc:606] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:44.046860  6988 log.cc:927] Time spent T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:00:44.048182  6972 log.cc:927] Time spent T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
W20260709 13:00:44.049598  6978 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
W20260709 13:00:44.054289  1685 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.993s	user 0.008s	sys 0.012s
W20260709 13:00:44.054664  1685 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.008s	sys 0.012s
W20260709 13:00:44.054927  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 1.20162e+06us
W20260709 13:00:44.059023  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 243362us
W20260709 13:00:44.061842  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.063944  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:44.061805  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:44.066455  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:44.066725  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:44.069203  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:44.022046  6893 raft_consensus.cc:740] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:44.069916  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:44.070580  1640 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 3.
I20260709 13:00:44.070326  6920 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.072391  6920 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.080972  6912 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.082398   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:44.082811  6900 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:44.084133   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:44.087353  7002 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:44.087986  1714 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:44.088732  7001 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:44.019948  6985 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:44.034155  6992 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.119s	user 0.002s	sys 0.000s
I20260709 13:00:44.069372  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:44.094985  1685 connection.cc:256] RPC call timeout handler was delayed by -1.187822543999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
I20260709 13:00:44.063292  2447 raft_consensus.cc:2955] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:00:44.095499  1685 connection.cc:256] RPC call timeout handler was delayed by -1.0906225439999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
I20260709 13:00:44.087489  6856 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.090353  6451 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:44.068632  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 234215us
I20260709 13:00:44.098347  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:44.098873  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:44.099989  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:44.104117  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.105799  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:44.118212  6721 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:00:44.119079  6932 consensus_meta.cc:287] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.507s	user 0.005s	sys 0.012s
I20260709 13:00:44.118840  6721 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:44.119514  6932 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.123759  6893 consensus_queue.cc:260] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.125068  6893 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:44.126199  6681 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:44.126593  6968 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.128772  6968 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.129154  6937 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:44.130019  6847 consensus_meta.cc:287] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.727s	user 0.003s	sys 0.016s
I20260709 13:00:44.077808  6657 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.130499  6847 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:44.131898  6657 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:44.132648  2438 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:44.132731  6847 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:00:44.101610  6871 consensus_meta.cc:287] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.000s
I20260709 13:00:44.133926  6871 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:44.136276  6937 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:44.136592  6933 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.138942  6933 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:44.139312  6899 consensus_meta.cc:287] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.888s	user 0.012s	sys 0.000s
I20260709 13:00:44.139752  6899 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.140003  6939 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.142266  2436 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:44.142617  6955 consensus_meta.cc:287] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.000s
I20260709 13:00:44.141876  6899 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:44.137504  6775 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.143110  6955 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.138989  6965 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:44.147064  6775 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.150714  6899 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:44.151798  2405 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.152910  6899 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:44.153393  2405 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.154778  6899 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:00:44.155359  6711 consensus_meta.cc:287] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.503s	user 0.012s	sys 0.031s
I20260709 13:00:44.156040  6711 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.159082  6837 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.164021  2448 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:00:44.069422  6993 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:00:44.171666  1645 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:44.088022  7002 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.181981  1685 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.185516  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:44.185751  1685 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.190013  2405 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 13:00:44.187129  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 123822us
I20260709 13:00:44.199894  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:44.199975  2405 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.200311  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:44.201754  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:44.203090  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:44.185268  6847 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.208786  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:44.211069  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:44.216337  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:44.207685  6657 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:44.223495  6837 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:44.196882  6674 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:00:44.226763  7002 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.227828  6685 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:44.229899  6871 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:44.204039  6939 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.231817  6821 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.194267  6997 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:44.236761  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:44.238472  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:44.233428  1612 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:44.203806  6899 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:44.202538  6928 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:44.252869  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:44.243040  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:44.250165  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:44.225566  6985 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:44.229899  6685 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:44.246364  1719 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 18: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:44.254446  1685 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:44.254667  1641 raft_consensus.cc:1240] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:44.253558  1720 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
W20260709 13:00:44.251302  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 190435us
I20260709 13:00:44.261812  6937 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:00:44.265470  6961 consensus_meta.cc:287] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.629s	user 0.006s	sys 0.021s
I20260709 13:00:44.266036  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:44.250816  6899 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:44.270605  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:44.269814  6973 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.274380  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:44.275274  2448 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:44.252377  6921 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:44.283737  1685 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.288130  1640 raft_consensus.cc:2393] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 14: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:44.289021  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:44.293744  2405 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:44.246353  6871 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:44.298719  1563 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:44.235533  6847 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:44.287609  6906 consensus_meta.cc:287] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.534s	user 0.016s	sys 0.012s
I20260709 13:00:44.301714  1568 raft_consensus.cc:1240] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:44.302848  1685 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:44.296772  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.309192  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.310242  1685 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.314363  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.292147  6899 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:44.289191  6856 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:44.314438  1685 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:44.318195  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:44.318586  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.318847  1569 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:44.295589  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 90584.4us
I20260709 13:00:44.320691  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.323843  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:44.324571  2443 raft_consensus.cc:2393] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:44.325034  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.325724  1568 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:00:44.328156  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.328756  1563 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:44.317504  6900 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:44.322363  6856 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:44.306870  6871 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.308314  6921 raft_consensus.cc:697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:44.317737  6848 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:44.341812  1639 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:00:44.329262  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.331820  1570 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:44.332449  1564 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:44.344606  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.344281  1685 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.349076  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:44.329805  6581 consensus_queue.cc:1059] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:00:44.351423  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:44.352092  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:44.352463  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.353888  6821 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.289351  6961 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.354315  7009 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:44.354787  7009 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:44.355137  7009 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:44.328958  6999 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:44.356361  6961 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.341317  6848 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:44.307195  6996 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:44.358879  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.359673  6996 raft_consensus.cc:993] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:44.360137  6996 raft_consensus.cc:1081] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:44.331861  6900 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:44.361449  6900 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:44.336443  6856 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:44.363310  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:44.363853  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:44.365002  2447 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:44.318215  6929 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:44.367444  6985 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:44.333194  6932 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.368505  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:44.312350  6906 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.370102  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.371790  6906 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:44.371191  1565 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 13: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:44.338830  6711 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.340984  6921 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.373989  6775 consensus_queue.cc:1059] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:44.375003  6775 raft_consensus.cc:3055] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:44.375308  6775 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:44.375962  6569 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:44.375689  1685 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.358896  6848 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:44.377467  6569 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:44.334467  6867 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:44.377883  6775 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.378904  1685 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:44.379369  6775 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:44.379930  6569 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:44.380231  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.380292  6569 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:44.381439  6569 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:44.382956  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.385381  6899 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.340011  6914 raft_consensus.cc:993] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:44.392633  6914 raft_consensus.cc:1081] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:44.335861  6847 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:44.358348  6973 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.340526  6871 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.390166  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:44.372488  2444 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:44.394402  2448 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:44.395217  6976 raft_consensus.cc:1064] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:44.396536  6996 consensus_queue.cc:1059] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:44.397547  6996 raft_consensus.cc:3055] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:44.397949  6996 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:44.398959  6996 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.401037  2436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 1265) took 1286 ms. Trace:
I20260709 13:00:44.401400  2436 rpcz_store.cc:276] 0709 13:00:43.114637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.117873 (+  3236us) service_pool.cc:224] Handling call
0709 13:00:43.118170 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.142679 (+1024509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.400765 (+258086us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400453dd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:44.400985 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2354726784}
I20260709 13:00:44.402215  6933 raft_consensus.cc:993] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:44.402902  6933 raft_consensus.cc:1081] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:44.404749  6837 raft_consensus.cc:3055] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:44.405203  6987 consensus_queue.cc:1059] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:44.406522  6987 raft_consensus.cc:3055] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:44.406935  6987 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:44.407919  6987 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.409359  6987 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:44.414131  6955 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.390969  6685 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:44.415001  1717 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:44.415382  6685 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:44.416668  6685 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.391845  1685 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.429318  1569 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
W20260709 13:00:44.448808  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 57053.9us
I20260709 13:00:44.449862  1685 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.458457  1643 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:44.462409  2405 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:44.463526  1685 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:44.466346  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.470237  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:44.418936  6685 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:44.405253  6837 raft_consensus.cc:740] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:44.474465  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:44.478456  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:44.480155  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:44.462656  6847 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:44.470767  6996 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:44.498387  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:44.507860  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:44.508229  1717 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:44.516460  6640 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:44.516842  6939 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:44.470029  6928 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:44.520383  1569 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:44.460507  6997 consensus_queue.cc:1059] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:00:44.466465  6572 consensus_queue.cc:1059] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:00:44.494753  6989 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:44.466873  6929 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:00:44.530550  6721 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:44.475564  6995 consensus_queue.cc:1059] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.069s
I20260709 13:00:44.551059  1638 raft_consensus.cc:1240] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:44.538674  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:44.536577  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:44.559630  2405 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.540482  1569 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
W20260709 13:00:44.555757  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 92372.9us
I20260709 13:00:44.560691  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:44.556766  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.563679  1565 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 13:00:44.557166  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:44.523736  6966 consensus_queue.cc:1059] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:00:44.568284  6966 raft_consensus.cc:3055] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:44.568607  6966 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:44.524505  6939 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:44.570494  6939 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:44.571946  6831 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:44.572521  6831 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:44.573418  6831 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.556917  6989 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:44.576012  6989 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:44.576562  6899 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:44.557262  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:44.481751  6921 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
W20260709 13:00:44.539096  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.578904  6921 raft_consensus.cc:3055] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:44.579275  6921 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:44.580088  6921 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.581267  6921 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:44.582500  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:44.585995  1643 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:44.586726  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:44.587955  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:44.588387  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:44.588992  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:44.590224  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:44.578203  1563 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 17: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:44.588609  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:44.597540  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:44.540259  6569 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.601717  1716 raft_consensus.cc:1240] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:44.602348  6928 raft_consensus.cc:3055] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:44.602752  6928 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:44.603349  6640 raft_consensus.cc:3055] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:44.603909  6640 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:44.603222  6997 raft_consensus.cc:3055] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:44.604516  6997 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:44.604789  6640 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.605266  6997 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:44.601688  6995 raft_consensus.cc:3055] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:44.606451  6995 raft_consensus.cc:740] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:44.602792  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:44.607326  1644 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:44.604106  6928 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.608752  6569 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.609679  6928 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:44.611707  1612 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:44.617846  1685 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:44.626251  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.627414  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 157246us
I20260709 13:00:44.628274  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:44.487380  6976 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.634204  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:44.644271  1647 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 17: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:44.646095  1686 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 13:00:44.637149  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.638587  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:44.639426  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 13:00:44.640401  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.647511  1639 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:44.647905  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:44.641291  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.649379  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:44.649461  1612 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:44.569406  6966 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.641705  1685 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.642822  1642 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:44.533970  6900 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.654579  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:44.656122  1647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36692
I20260709 13:00:44.662241  1647 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:44.662597  1647 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:44.662746  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.663179  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:44.651600  1685 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.665512  1644 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:44.667100  1567 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:00:44.674887  7022 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:44.659687  6947 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:44.675853  6947 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:44.676245  6947 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:44.641774  6955 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:44.645721  6997 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:44.681087  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:44.651654  6929 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:44.698994  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:44.699841  1713 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:44.668613  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:44.660725  6844 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:44.595144  7009 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:44.720911  7009 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:44.597481  6856 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.722189  1719 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:44.722434  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:44.723212  7026 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:00:44.724174  6844 raft_consensus.cc:697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:44.646517  6572 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:44.655467  6640 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:44.696466  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:44.544359  6837 consensus_queue.cc:260] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.709559  1639 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:44.668251  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:44.685380  6914 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:44.672667  6711 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:44.712143  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:44.716110  6991 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:44.761214  6900 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:44.666416  6681 consensus_queue.cc:1059] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:00:44.706782  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:44.673931  6932 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:44.717229  6947 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:44.742646  1647 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:44.753985  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 85827.7us
I20260709 13:00:44.756038  1720 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:44.725363  6844 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:44.762934  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:44.832178  1716 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:44.763219  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:44.764603  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 13:00:44.765026  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 58382.6us
I20260709 13:00:44.607318  6995 consensus_queue.cc:260] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:44.833359  1713 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:44.845376  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:44.764433  6837 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:44.767302  6867 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:44.767437  6993 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:44.856813  1647 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:44.761330  6991 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.757977  6848 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:44.880858  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 117517us
W20260709 13:00:44.874748  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.874815  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:44.847777  6900 raft_consensus.cc:3055] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:44.847527  6914 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:44.892206  1716 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:44.898259  1713 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:00:44.859254  6711 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:44.901523  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:44.901172  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:44.905827  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:44.931677  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:44.935191  2440 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:44.950971  1714 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:44.890501  6900 raft_consensus.cc:740] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:00:44.765625  6784 consensus_queue.cc:1175] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a4be9cc90aca4dd4ad7db103062a7208" responder_term: 11 status { last_received { term: 10 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:44.972431  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 13:00:44.975565  6987 consensus_meta.cc:287] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.528s	user 0.003s	sys 0.005s
I20260709 13:00:44.977185  6991 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:44.978334  6947 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:44.981225  6939 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:44.984200  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.984829  7027 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
W20260709 13:00:44.985517  7030 log.cc:927] Time spent T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:00:44.987511  6848 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:44.988184  6856 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:44.989343  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.994810  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.000741  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:45.005530  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:45.007361  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:44.914525  6914 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:44.964447  6711 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:45.015547  1712 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 13:00:45.031477  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.026084  1718 raft_consensus.cc:1240] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:45.009292  6973 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:45.015486  6955 raft_consensus.cc:1027] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: attempt to promote peer 6f381117554e49bb816791ab0a10f2b8: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260709 13:00:45.044629  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 191290us
I20260709 13:00:45.046377  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.046314  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.009658  6933 consensus_queue.cc:1059] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:00:45.051714  2405 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:45.030408  6721 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:45.053678  2405 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:45.059824  1712 raft_consensus.cc:2393] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 10: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:45.063517  6914 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:45.044821  6973 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.066416  6973 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:45.049623  6900 consensus_queue.cc:260] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.075536  6711 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:45.076818  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.113101  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.116955  1712 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:45.117839  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.076198  7037 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:45.142853  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:45.144831  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.144861  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:45.145159  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:45.147142   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:45.111174  7031 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:45.148025  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.152309  1720 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
W20260709 13:00:45.153023  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 299980us
I20260709 13:00:45.160763  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.159981  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.180004  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.173596  1712 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:45.195209  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:45.200332  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.193135  7037 raft_consensus.cc:697] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:45.203476  7037 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.206140  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.201792  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:45.179334  6921 consensus_meta.cc:287] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.585s	user 0.006s	sys 0.005s
I20260709 13:00:45.144372  6914 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:45.076628  6581 consensus_queue.cc:1059] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.140s
W20260709 13:00:45.218021  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 57853.2us
I20260709 13:00:45.218600  6721 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.219283  6991 consensus_queue.cc:1059] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:45.219683  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.201148  1712 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:45.224125  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:45.224671  1713 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.251844  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.207252  7031 raft_consensus.cc:697] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:00:45.264705  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 45145.4us
W20260709 13:00:45.266263  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.270133  7038 log.cc:927] Time spent T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:00:45.266822  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.290609  7044 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:45.294834  7035 raft_consensus.cc:3055] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:45.295306  7035 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:45.296144  7035 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.297465  7035 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:45.313262  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:45.228541  7041 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:00:45.316246  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 49516us
I20260709 13:00:45.320499  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:45.323936  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:45.323011  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:45.328333  2448 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:45.330225  1638 raft_consensus.cc:1240] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:45.333263  1713 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:45.330665  6939 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:45.337782  1638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 13:00:45.344818  1638 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:45.345160  1638 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:45.263015  7046 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:45.220485  6721 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.327085  6912 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:45.356717  1643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 13:00:45.225683  6914 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.362012  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:45.357487  1643 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:45.364677  1643 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:45.326161  7044 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:45.363081  6912 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:45.321758  6848 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:00:45.366989  7040 log.cc:927] Time spent T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:45.367476  6867 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:45.369081  7031 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:45.370223  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.370357  6921 raft_consensus.cc:3055] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:45.372260  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:45.374857  6900 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:45.377557  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.378723  6966 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:45.480593  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 13:00:45.481137  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 434805us
I20260709 13:00:45.481248  1639 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:45.481974  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.444056  1712 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 13:00:45.382920  6893 consensus_queue.cc:1059] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:00:45.385691  6997 consensus_meta.cc:287] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.687s	user 0.005s	sys 0.002s
I20260709 13:00:45.329972  6933 consensus_queue.cc:1059] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:00:45.363976  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.406446  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:45.420018  6912 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.475189  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:45.500301  1647 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:45.493626  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:45.501130  1714 raft_consensus.cc:2393] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 13: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:45.484122  1716 raft_consensus.cc:2393] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:45.494796  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:45.496042  1642 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.413089  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.502461  1720 raft_consensus.cc:2376] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10. Re-sending same reply.
W20260709 13:00:45.439860  6837 consensus_meta.cc:287] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.580s	user 0.005s	sys 0.005s
I20260709 13:00:45.497171  1717 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 17.
I20260709 13:00:45.499140  1639 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:45.497905  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:45.398007  6685 consensus_meta.cc:287] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.919s	user 0.005s	sys 0.004s
W20260709 13:00:45.484660  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.424372  6995 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:45.505053  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.435998  6721 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:45.431727  6989 consensus_meta.cc:287] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.855s	user 0.010s	sys 0.000s
I20260709 13:00:45.512163  6989 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.513262  2436 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 14: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:45.514220  2436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 749) took 1041 ms. Trace:
I20260709 13:00:45.514556  2436 rpcz_store.cc:276] 0709 13:00:44.474041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.474202 (+   161us) service_pool.cc:224] Handling call
0709 13:00:45.514010 (+1039808us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54008241d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:45.514143 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2377979264}
I20260709 13:00:45.515547  6989 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:45.428848  6914 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:45.516654  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:45.440781  6867 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:45.522958  1715 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:45.524085  1715 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:45.524978  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:45.529541  1647 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:00:45.504302  7046 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:45.481163  6921 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:45.533685  1644 raft_consensus.cc:3055] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:45.574630  1644 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:45.535131  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.544883  1718 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:45.547930  6973 raft_consensus.cc:3055] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:45.550109  7046 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:45.558990  7043 raft_consensus.cc:3055] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:45.560770  1716 raft_consensus.cc:1240] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:45.567408  6899 raft_consensus.cc:3055] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:45.567874  1715 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:45.582028  1642 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:45.540037  1643 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.407804  7044 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:45.440227  6848 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.594002  1646 raft_consensus.cc:1240] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:45.595515  1645 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:45.596323  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 91381.4us
I20260709 13:00:45.587879  1638 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:45.607998  1640 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:45.608932  1611 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.615806  1638 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:45.599215  1644 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.617986  1644 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.619918  1611 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.621886  2436 raft_consensus.cc:1240] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:45.626070  6989 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:00:45.628192  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 302238us
I20260709 13:00:45.631529  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:45.636169  2436 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEARNER]: Advancing to term 10
I20260709 13:00:45.643164  2436 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:45.635972  6831 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:45.644407  6831 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:45.645934  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.647842  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:45.649305  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.653055  6831 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:45.653079  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:45.658743  2440 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:45.586756  6973 raft_consensus.cc:740] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:45.664312  1611 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:45.588459  7046 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:45.589071  7043 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:45.668068  1643 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:45.592084  6899 raft_consensus.cc:740] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:45.590351  6775 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:45.679939  1571 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:45.681330  1567 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:45.682331  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 64286.7us
I20260709 13:00:45.689778  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:45.690186  1611 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.690948  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:45.662678  6674 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:45.675766  6928 consensus_meta.cc:287] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 1.048s	user 0.012s	sys 0.000s
W20260709 13:00:45.697630  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.695827  1537 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:45.671638  6932 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:45.700183  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:45.690762  1470 catalog_manager.cc:5697] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 16 to 17, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 17 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:45.705735  1566 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:45.706636  1470 catalog_manager.cc:5697] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:45.698978  1611 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.665570  6871 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:45.711272  1611 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:45.708983  1470 catalog_manager.cc:5697] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 11 to 13, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:45.678488  6775 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.713567  1470 catalog_manager.cc:5697] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:45.666307  6937 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:00:45.721055  1644 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:00:45.729816  1644 pending_rounds.cc:85] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 7
I20260709 13:00:45.730294  1644 pending_rounds.cc:107] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 9.8
I20260709 13:00:45.730556  1644 raft_consensus.cc:2917] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Aborting config change with OpId 9.8: Aborted: Op aborted by new leader
I20260709 13:00:45.731035  1644 raft_consensus.cc:2889] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:45.721994  1611 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.715431  1470 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 11 to 12, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 12 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:45.733273  1470 catalog_manager.cc:5697] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 11 to 13, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:45.741336  1466 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58252 (request call id 331) took 6899 ms. Trace:
I20260709 13:00:45.701325  7001 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:45.745478  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.704442  6947 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:45.704247  6986 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:45.701454  7051 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:45.714201  6711 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:45.752427  1611 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:45.761576  2444 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:45.762394  1611 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:45.740255  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.716387  6775 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:45.742100  1466 rpcz_store.cc:276] 0709 13:00:38.842376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.843303 (+   927us) service_pool.cc:224] Handling call
0709 13:00:39.138668 (+295365us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54004254d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd202090 00007f18cd2a0f3a 00007f18d30571cc 00007f18d315537e 00007f18d16162a4 00007f18d1616232 00007f18d1616161 00007f18d16160dc 00007f18d1615392 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:45.741249 (+6602581us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:43.519121 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:43.548226 (+ 29105us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:43.548266 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:00:43.548285 (+    19us) tablet.cc:662] Decoding operations
0709 13:00:43.548993 (+   708us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:43.549075 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:43.549106 (+    31us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:00:43.549655 (+   549us) tablet.cc:701] Row locks acquired
0709 13:00:43.549675 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:00:43.549850 (+   175us) write_op.cc:270] Start()
0709 13:00:43.549969 (+   119us) write_op.cc:276] Timestamp: P: 1783602043549796 usec, L: 0
0709 13:00:43.549992 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:00:43.633838 (+ 83846us) log.cc:844] Serialized 2079 byte log entry
0709 13:00:44.356774 (+722936us) op_driver.cc:464] REPLICATION: finished
0709 13:00:44.640998 (+284224us) write_op.cc:301] APPLY: starting
0709 13:00:44.645694 (+  4696us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:44.968603 (+322909us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:44.968704 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:45.300901 (+332197us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b1800274240. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1ab522 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd 000000000038f354 000000000038f199 00007f18ca18e83a
0709 13:00:45.404276 (+103375us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:45.404561 (+   285us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:00:45.404633 (+    72us) write_op.cc:312] APPLY: finished
0709 13:00:45.405013 (+   380us) log.cc:844] Serialized 57 byte log entry
0709 13:00:45.627110 (+222097us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:45.627253 (+   143us) write_op.cc:454] Released schema lock
0709 13:00:45.627293 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:45.627691 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:45.627718 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":376665,"reported_tablets":14,"spinlock_wait_cycles":601165056,"child_traces":[["op",{"apply.queue_time_us":242713,"apply.run_cpu_time_us":31841,"apply.run_wall_time_us":1008387,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25037,"num_ops":5,"prepare.queue_time_us":341093,"prepare.run_cpu_time_us":24422,"prepare.run_wall_time_us":356175,"raft.queue_time_us":140632,"raft.run_cpu_time_us":11228,"raft.run_wall_time_us":162620,"replication_time_us":792458,"spinlock_wait_cycles":15592320,"thread_start_us":792234,"threads_started":5,"wal-append.queue_time_us":488760,"wal-append.run_cpu_time_us":18037,"wal-append.run_wall_time_us":1344322}]]}
I20260709 13:00:45.674073  6921 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.771514  1611 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:45.772979  1611 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:45.747323  6933 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:45.745028  7001 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:45.744068  6955 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:45.709059  6674 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.754462  6986 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:45.760519  6932 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:45.774197  6991 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:45.744629  6928 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:00:45.775678  6871 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:45.770344  7021 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:45.779392  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 83660.9us
I20260709 13:00:45.811585  1715 raft_consensus.cc:1240] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:45.774024  1611 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:45.767220  1721 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:45.777199  7042 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:45.816043  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.775501  6997 consensus_queue.cc:1059] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:00:45.796247  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.718111  6973 consensus_queue.cc:260] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:45.792308  1719 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:45.775888  6976 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:45.781706  7001 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:45.777146  6933 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:45.796985  6987 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:45.826714  6987 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.827378  7011 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:45.828819  7011 raft_consensus.cc:3055] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:45.829025  6987 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:45.829222  7011 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:45.796269  7032 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:45.801208  6939 consensus_queue.cc:1059] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:45.794274  6986 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:45.801988  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:45.802225  7010 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:45.807325  6674 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:45.760063  7043 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.784454  6955 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:00:45.800858  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 55449.2us
I20260709 13:00:45.770097  7062 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:00:45.796566  6991 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:45.819440  7021 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:45.826251  6933 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:45.831967  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:45.830670  1717 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 13:00:45.816749  6871 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.838651  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:45.841915  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:45.831390  6973 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.820953  7044 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:45.843703  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.822225  6848 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:45.777695  6899 consensus_queue.cc:260] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.817727  6947 consensus_queue.cc:1059] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:00:45.829927  7032 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.854991  1638 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 14: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:45.850781  2440 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 13:00:45.844163  6995 raft_consensus.cc:3055] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:45.821482  7052 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:00:45.859387  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.859910  1536 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.862020  1718 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 13:00:45.860538  1646 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:45.863590  1638 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:00:45.845234  6955 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:45.851513  6991 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:45.866000  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:45.867311  1712 raft_consensus.cc:3055] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:45.868387  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:45.867583  1712 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:45.869091  1714 raft_consensus.cc:2393] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 4: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:45.869534  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:45.871102  1638 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 13:00:45.821266  6976 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.870474  1685 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:45.872619  1685 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:45.874584  1685 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:45.876965  6572 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:45.878624  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 3737) took 1005 ms. Trace:
I20260709 13:00:45.879006  1719 rpcz_store.cc:276] 0709 13:00:44.873485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.900952 (+ 27467us) service_pool.cc:224] Handling call
0709 13:00:45.878459 (+977507us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b5400236754. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:45.878566 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1424669440}
I20260709 13:00:45.888928  6921 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:45.890553  6775 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.893086  6775 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:45.901247  6976 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:45.838732  7011 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.902431  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:45.902944  7011 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:45.904444  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:45.895233  6985 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.823887  7046 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.905366  1571 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:45.857218  7037 consensus_queue.cc:1059] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:00:45.905985  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:45.906375  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:45.906939  1569 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:45.907503  1686 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:45.909691  6844 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:45.910092  6844 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:45.910460  6844 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:45.894384  7043 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:45.912259  6937 raft_consensus.cc:3055] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:45.912648  6937 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:45.912737  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:45.879786  6867 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.861023  7044 consensus_queue.cc:1059] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:00:45.861061  7047 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:45.914626  7044 raft_consensus.cc:3055] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:45.914647  1640 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:45.915009  7044 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:45.915380  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.915886  7044 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:45.888996  7035 consensus_meta.cc:287] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
I20260709 13:00:45.917104  7044 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:45.917268  6914 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:45.897913  6939 consensus_queue.cc:1059] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:45.870611  7010 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:45.918701  6939 raft_consensus.cc:3055] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:45.918823  7010 raft_consensus.cc:697] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:45.919087  6939 raft_consensus.cc:740] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:45.919786  7010 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.899613  1567 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:00:45.860102  6995 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:45.921558  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 3732) took 1049 ms. Trace:
I20260709 13:00:45.921919  1721 rpcz_store.cc:276] 0709 13:00:44.872337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.874152 (+  1815us) service_pool.cc:224] Handling call
0709 13:00:45.140403 (+266251us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b58001e3398. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173b71 00007f18ca173eee 0000000000375939 00007f18d21e71e0 00007f18d22b00c4 00007f18d22b0131 00007f18d225e0a0 00007f18d225d984 00007f18cb7d86d4 00007f18cb7d8662
0709 13:00:45.921425 (+781022us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b540025add4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:45.921507 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314210688}
I20260709 13:00:45.922298  6995 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:45.875196  6848 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:45.923501  6995 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:45.875483  6997 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:45.924129  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:45.894316  7032 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:45.905501  6985 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.926556  6899 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.927801  6985 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:45.929639  1565 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:00:45.929957  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.904592  1570 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:00:45.910374  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:45.931332  2444 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:00:45.932174  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:45.932875  1570 raft_consensus.cc:2393] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 13: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:45.933337  2405 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:45.931354  1567 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:45.934962  7032 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:45.935366  7032 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.935690  7032 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.938422  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:45.938238  1712 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.939498  1712 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:45.941171  6912 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.942277  1644 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:45.943667  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:45.944397  1565 raft_consensus.cc:2393] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 13: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:45.945070  6867 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:45.946470  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.948274  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:45.948398  6912 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:45.898686  1718 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:45.896220  6711 raft_consensus.cc:3055] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:45.950693  6711 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:45.951603  6711 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.952872  6711 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:45.952600  6955 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:45.954406  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:45.957530  1716 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:00:45.955717  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:45.954456  6871 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:45.906894  7046 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:45.913484  6937 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.959043  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:45.979892  1568 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 18.
I20260709 13:00:45.959266  1566 raft_consensus.cc:2393] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 13: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:45.962443  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:45.958611  1569 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:00:45.964564  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:45.982765  2436 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 14: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:45.963865  6939 consensus_queue.cc:260] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:45.984773  6939 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:45.970583  6966 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:00:45.988812  6900 consensus_queue.cc:1059] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:45.961609  6955 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:45.989977  7035 raft_consensus.cc:3055] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:45.972813  6986 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:45.990411  7035 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:45.991300  7035 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.968182  6937 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.992499  7035 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.972813  6991 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:46.001101  6991 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:45.976382  1685 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 13:00:46.002671  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 125992us
I20260709 13:00:46.003436  1685 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:46.004204  6939 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:46.004570  1685 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:46.004985  6914 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:46.005532  6914 raft_consensus.cc:697] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:45.977392  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:45.969455  6844 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:45.975665  6933 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.006744  6914 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.007660  1564 raft_consensus.cc:1240] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:46.008175  6844 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:46.009563  6939 raft_consensus.cc:697] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:46.005640  6929 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:45.978771  2405 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:46.011505  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:45.961174  2440 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:46.011636  6939 consensus_queue.cc:237] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:45.975730  1571 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:00:46.012933  6900 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:46.013563  6900 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:46.005666  1685 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:46.018527  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:46.019104  1571 raft_consensus.cc:3055] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:46.019472  1571 raft_consensus.cc:740] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:46.018502  2436 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:46.021085  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:46.025269  2406 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 13:00:46.030097  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.030537  1611 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.107.254:33273, user_credentials={real_user=slave}} blocked reactor thread for 45891.2us
I20260709 13:00:46.029155  1712 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:46.035030  1569 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:46.026520  6674 consensus_queue.cc:1059] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:00:46.023785  1571 consensus_queue.cc:260] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:46.045621  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 68293.9us
I20260709 13:00:46.059965  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:46.056424  1571 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:46.037544  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:46.062937  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:46.057845  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:46.063561  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:46.063952  1568 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:46.064365  1569 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 14: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:45.991953  6986 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:46.065588  1611 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:46.066443  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:46.065929  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:46.067945  1611 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:46.010643  6933 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:46.061674  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:46.026974  6837 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:00:46.069514  6991 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:46.058192  6899 consensus_queue.cc:1059] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:00:46.070732  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:46.073549  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:46.089432  1716 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:46.042893  7037 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:46.078141  1567 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:46.091181  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:46.078653  1566 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:46.079312  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:46.090934  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:46.103060  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:46.103515  1721 raft_consensus.cc:2393] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 13: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:46.037771  2406 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:46.079546  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:46.104247  1714 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:46.071187  7046 consensus_queue.cc:1059] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:00:46.036194  6844 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:46.058173  6928 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:00:46.027228  6966 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:00:45.976948  7001 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:46.103641  1716 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:46.109210  1611 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:46.090493  7042 raft_consensus.cc:697] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:46.117338  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:46.117906  1714 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:46.090504  6871 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.059446  7065 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:46.105399  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 190083us
W20260709 13:00:46.132614  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.105902  1571 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:46.059540  7043 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:46.026014  7035 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:00:46.101825  6976 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:46.139832  1565 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
W20260709 13:00:46.077699  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.071535  6955 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:46.070292  6921 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:46.109972  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 72304us
I20260709 13:00:46.104820  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:46.144505  2406 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:46.144888  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:46.146401  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 78463.9us
I20260709 13:00:46.122400  1567 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:46.148017  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:46.148686  1644 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 13:00:46.143824  6955 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.146812  1536 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:46.149436  6955 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:46.149832  6968 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:46.150285  6973 raft_consensus.cc:3055] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:46.150561  6968 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:46.152503  6674 raft_consensus.cc:3055] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:46.152882  6674 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:46.147686  1719 raft_consensus.cc:2955] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:46.101871  6933 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:46.155107  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:46.155853  1641 raft_consensus.cc:2393] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 8: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:46.156461  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:46.157847  7065 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:46.158507  7035 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:46.159206  7001 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:46.143632  7043 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:46.160948  6775 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:46.161609  6775 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:46.163728  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:46.164402  6893 raft_consensus.cc:3055] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:46.164826  6893 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:00:46.165834  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.165889  7001 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:46.135597  1611 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:46.166756  7031 raft_consensus.cc:3055] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:46.167148  7031 raft_consensus.cc:740] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:46.167172  1611 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:46.168115  7031 consensus_queue.cc:260] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.136607  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:46.081616  6929 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:00:46.169162  7031 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:46.169682  7044 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:46.116743  6900 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:46.170857  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:46.147920  1720 raft_consensus.cc:1240] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:46.171573  1641 raft_consensus.cc:2393] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 8: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:46.172101  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:46.172387  1537 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:46.168622  6991 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:46.165701  6893 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.173420  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:46.173570  6991 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:46.143035  1721 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:46.173197  6937 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:46.174031  6991 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:46.174420  6937 raft_consensus.cc:697] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:46.143623  7066 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:46.106982  6711 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:46.153666  6674 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.071242  6993 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:46.178871  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:46.058328  6995 consensus_queue.cc:1059] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:00:46.169323  7032 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.181628  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:46.176458  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:46.182361  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:46.107932  6986 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:46.218814  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:46.185545  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.219813  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.175304  6937 consensus_queue.cc:237] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.182024  7066 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:46.182750  6973 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:46.115864  6844 raft_consensus.cc:697] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:46.210544  1714 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:46.239392  1717 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:46.190174  1716 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:00:46.134934  6871 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.241710  1721 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:46.241954  2440 raft_consensus.cc:2368] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9.
I20260709 13:00:46.226590  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:46.240274  1611 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:46.242935  1611 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:46.243103  1641 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:46.243468  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:46.243711  7044 raft_consensus.cc:2804] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:46.203984  6711 raft_consensus.cc:697] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:46.204270  6893 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:46.245981  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:46.247509  1643 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:46.247565  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:46.251854  1641 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:46.183336  6976 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.224015  6993 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:46.265587  6867 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:46.244267  7065 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:46.266533  7065 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:46.266285  6867 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.267427  7065 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:46.191709  6887 consensus_queue.cc:1059] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:00:46.269623  6887 raft_consensus.cc:3055] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:46.269932  1712 raft_consensus.cc:3055] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:46.270358  1712 raft_consensus.cc:740] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:46.271135  1712 consensus_queue.cc:260] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:46.271010  6844 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:46.244233  7044 raft_consensus.cc:697] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:46.274940  7044 consensus_queue.cc:237] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:46.278220  6989 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.278869  6989 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.280972  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:46.281355  6989 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:46.281741  1638 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 14: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:46.239943  6968 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:46.282686  6968 raft_consensus.cc:697] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:46.282840  1564 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:46.283584  6968 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.284144  6993 raft_consensus.cc:697] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:46.214593  6899 consensus_queue.cc:1059] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:00:46.227535  7066 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:46.305493  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:46.306281  1571 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:46.264292  6674 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:46.272251  1712 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:46.291303  1686 leader_election.cc:400] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9.
I20260709 13:00:46.308084  1686 leader_election.cc:403] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:46.263547  6986 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:46.262585  6711 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.252911  6912 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:00:46.293558  7070 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:00:46.292122  6887 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:46.294332  1721 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:00:46.295092  1563 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:46.295624  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:46.446384  1564 raft_consensus.cc:2376] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12. Re-sending same reply.
I20260709 13:00:46.296388  1567 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:00:46.447283   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:46.296283  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:46.297793  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:46.301095  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.285295  6993 consensus_queue.cc:237] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:46.314260  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:46.453868  1716 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 13: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:46.253648  6775 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:46.326324  6914 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:46.317982  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:46.463428  1568 raft_consensus.cc:2376] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13. Re-sending same reply.
I20260709 13:00:46.318089  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:46.318738  7046 consensus_queue.cc:1059] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:46.319370  6899 raft_consensus.cc:3055] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:46.319831  7047 consensus_queue.cc:1059] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:46.320710  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:46.321007  6939 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.324847  6955 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.253244  7043 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:46.254863  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:46.334160  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:46.336434  1571 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:46.344695  1712 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:46.474648  1566 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:00:46.474895  1611 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:46.325488  6973 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.477177  6973 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:46.435745  1719 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:46.422729  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:00:46.382799  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.312144  6867 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:46.455335  1572 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 13: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:46.315028  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:46.459928  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:46.460764  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:46.341051  6989 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:46.345320  6995 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:46.493537  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.463251  6572 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.506408  1564 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
W20260709 13:00:46.511684  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.493536  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 159506us
I20260709 13:00:46.521400  2406 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:46.465988  6899 raft_consensus.cc:740] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:00:46.506364  6929 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:00:46.472045  6997 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.298486  7042 consensus_queue.cc:237] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:46.538389  2406 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:46.544633  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:46.508651  7035 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:46.525300  6867 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:46.540710  6966 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:00:46.554070  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.517200  7046 consensus_queue.cc:1243] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:46.534135  6893 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.504233  6837 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:00:46.434988  6887 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.498481  6939 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.569512  6893 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.571008  6837 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:46.553887  7044 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:46.577404  6955 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:46.578550  6871 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:46.586292  1565 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
W20260709 13:00:46.597776  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.553982  6900 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:46.533753  6572 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:46.525223  6995 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:46.599388  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 124576us
I20260709 13:00:46.525043  6989 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.537460  6991 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:46.609429  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 354650us
I20260709 13:00:46.613334  1612 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:46.549129  6997 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.631978  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:46.599018  6912 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.635215  6912 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.636068  7061 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.636770  7061 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.637738  6912 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:46.638463  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:46.639113  1719 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:46.607918  6837 raft_consensus.cc:697] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:46.611174  7044 raft_consensus.cc:697] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:46.641976  1611 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:46.645910  7032 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:46.647795  7037 consensus_meta.cc:287] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.002s
I20260709 13:00:46.654367  1612 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:46.617396  6900 raft_consensus.cc:697] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:46.657598  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:46.640879  6871 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:00:46.655786  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 111244us
I20260709 13:00:46.666966  2406 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:46.677838  2406 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:46.651772  7088 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:46.653254  6912 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:46.652197  6966 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 18 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:46.660537  6955 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:46.688859  2440 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:00:46.665495  7037 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:46.701460  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:46.704634  1715 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 13:00:46.686194  7072 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.232s	user 0.001s	sys 0.001s
I20260709 13:00:46.676862  7065 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:46.688108  7032 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:46.686825  6694 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:46.687489  7088 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.677423  6906 consensus_queue.cc:1059] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:00:46.704654  7075 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:46.711081  6921 consensus_meta.cc:287] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.002s
I20260709 13:00:46.677641  6721 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:00:46.718321  7032 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.745754  7032 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:46.741348  6955 consensus_queue.cc:1059] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:00:46.750455  7085 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:00:46.751801  7087 raft_consensus.cc:3055] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:46.749842  6939 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:46.752233  7087 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:46.720410  6694 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:46.753679  6694 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:46.758313  6893 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:46.759068  6572 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:46.759194  6989 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:46.759765  6900 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.760339  6997 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:46.762591  7083 log.cc:927] Time spent T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:00:46.764798  6921 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:46.719666  6837 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.742041  7010 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:00:46.680511  6871 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.740940  7044 consensus_queue.cc:237] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:46.779157  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:46.753296  7087 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:46.722797  7088 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:46.759343  6991 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:46.716665  7095 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:46.801515  6694 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.802291  6995 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:46.770576  7075 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.816030  6899 consensus_queue.cc:260] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.817296  6899 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:46.817476  7075 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:46.819329  7066 consensus_meta.cc:287] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.001s
I20260709 13:00:46.814225  6694 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:00:46.808677  7031 consensus_meta.cc:287] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.003s
W20260709 13:00:46.821698  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 144836us
I20260709 13:00:46.829438  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:46.803953  7095 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.800168  6966 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.854981  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:46.864177  1718 raft_consensus.cc:1275] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:46.825076  7066 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:46.875641  7066 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:46.876231  7066 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:46.877033  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:46.852317  6721 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.879086  6721 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:46.881253  6721 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:46.871584  6775 raft_consensus.cc:3055] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:46.851833  7100 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:46.881848  6775 raft_consensus.cc:740] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:46.882086  7100 raft_consensus.cc:697] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:46.882870  6775 consensus_queue.cc:260] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:46.884495  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:46.886076  6871 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:46.851636  6995 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.886844  6995 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:46.888872  7086 log.cc:927] Time spent T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:00:46.889000  6995 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:46.889643  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.890447  7076 log.cc:927] Time spent T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:00:46.890558  6914 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 8. Current term is 9.
I20260709 13:00:46.891606  1715 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:46.851513  7095 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:46.883030  7100 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:46.895183  6976 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:46.898969  7077 log.cc:927] Time spent T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.580s	user 0.003s	sys 0.000s
W20260709 13:00:46.911957  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 209023us
I20260709 13:00:46.911906  1717 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:46.917212  1719 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:00:46.920746  1644 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:46.921202  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:46.918629  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 65197.8us
I20260709 13:00:46.915997  1611 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:46.935986  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.971035  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:46.931543  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:46.925256  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:46.976302  1638 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:00:46.968969  6914 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.980237  6914 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:46.924213  7106 log.cc:927] Time spent T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:00:46.982494  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.922390  7051 raft_consensus.cc:2764] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:46.972824  7042 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:46.905139  7066 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.991709  1641 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:00:46.974463  1715 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 13:00:46.994683  2437 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:46.996915  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:46.999243  1641 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:46.997366  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:47.003428  1646 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:46.911445  6871 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:00:47.011284  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:47.012082  1645 raft_consensus.cc:2393] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 10: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:47.012261  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:47.013025  1641 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:47.013526  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:47.014282  1647 raft_consensus.cc:2393] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 14: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:47.014732  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:47.015479  1645 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 13:00:47.019686  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.021124  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:47.011830  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:47.029883  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:47.031689  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:47.032130  1564 raft_consensus.cc:3055] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:47.032517  1564 raft_consensus.cc:740] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:47.032948  2447 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:00:47.027598  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:47.001277  7042 raft_consensus.cc:697] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:47.034170  1643 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:47.040684  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.041442  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.043340  1565 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:00:47.043710  1565 pending_rounds.cc:85] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 9
I20260709 13:00:47.043936  1565 pending_rounds.cc:107] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 9.10
I20260709 13:00:47.044159  1565 raft_consensus.cc:2917] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Aborting config change with OpId 9.10: Aborted: Op aborted by new leader
I20260709 13:00:47.044504  1565 raft_consensus.cc:2889] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:47.036674  2443 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:47.044852  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.045539  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:47.045539  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:46.990512  7032 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.046281  1567 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:00:47.051187  1641 raft_consensus.cc:1275] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:00:47.033205  1564 consensus_queue.cc:260] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:47.052677  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:47.053320  1572 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:00:47.042793  7101 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:47.054277  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:47.054847  1563 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:00:47.047520  6867 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:47.028816  6914 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:47.059820  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:47.060959  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:47.061589  1570 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:47.062407  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:47.062965  1569 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 18.
I20260709 13:00:47.049322  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.051481  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:47.066787  1647 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:00:47.002135  7047 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:00:47.068125  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:47.069348  1645 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:47.070677  1564 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:47.071790  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.072613  2448 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:47.075347  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.076354  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.077855  1642 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:00:47.035183  6921 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:00:47.078969  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 67198.4us
I20260709 13:00:47.079330  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.006640  7066 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.082669  1645 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:47.082690  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.080295  6966 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.086581  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:47.086042  2444 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:47.088014  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:47.088209  6966 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.090245  6914 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:47.092816  6966 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:47.080633  7099 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:00:47.084106  6921 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:47.096242  6921 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:47.097085  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:47.097833  1642 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:47.102371  1646 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:00:47.085867  1686 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:47.087697  7095 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:47.113947  2405 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:47.118371  1646 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:47.106559  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:47.109383  2443 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
I20260709 13:00:47.112828  1564 raft_consensus.cc:1275] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:00:47.112453  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:47.123414  2444 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:00:47.124575  2444 pending_rounds.cc:85] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 9
I20260709 13:00:47.124890  2444 pending_rounds.cc:107] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 9.10
I20260709 13:00:47.089462  7088 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.175552  2444 raft_consensus.cc:2917] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Aborting config change with OpId 9.10: Aborted: Op aborted by new leader
I20260709 13:00:47.127305  6976 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.119959  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 13:00:47.195053  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 75162.4us
I20260709 13:00:47.130935  7048 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:47.131695  7042 consensus_queue.cc:237] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:47.134157  6929 consensus_queue.cc:1048] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:47.134929  6995 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:47.135895  7032 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:47.136761  7061 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:47.137300  7099 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:47.132825  6928 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:47.138377  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.138787  2405 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:47.115057  6987 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:47.116207  7095 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.196276  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:47.197286  2444 raft_consensus.cc:2889] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:47.212509  1641 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:47.197158  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:47.133141  7031 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:47.223780  1638 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:00:47.226408  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:47.150529  6848 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:47.225221  6987 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.236797  6987 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:47.229257  7095 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:47.193975  7104 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:47.217305  6997 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:47.241221  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 102503us
I20260709 13:00:47.247285  2405 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:47.218395  7098 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.240978  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 43892us
I20260709 13:00:47.269587  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:47.270470  6711 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:47.270596  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:47.271358  6711 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:47.271472  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:47.271785  6711 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:47.233264  6848 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.254558  7067 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:47.281085  7067 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.281596  7067 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:47.282449  6848 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:47.272212  6711 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:47.256102  6572 consensus_queue.cc:1048] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:47.224740  6928 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.287496  6928 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:47.289599  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:47.260344  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:47.292390  6899 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:47.293138  6899 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:47.232131  7031 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:47.293978  7031 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:47.295176  6844 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:47.266170  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.243175  6955 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:47.214610  7051 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:47.293534  6899 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:47.299263  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.232828  6939 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:47.302639  2448 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:47.267999  7103 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:47.246466  6997 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.213621  6976 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.317183  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:47.319731  1715 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:00:47.320281  1570 raft_consensus.cc:2393] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 11: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:47.302284  6921 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:47.302009  6871 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:47.336097  6871 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.338650  6921 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:47.309731  7051 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.339668  6921 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.341166  7051 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:47.340991  7031 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.308147  6939 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.342738  7088 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:47.268167  7104 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.304880  6899 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:47.343508  7031 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:47.344764  7104 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:47.301095  7098 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:47.350898  7087 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:47.354300  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.354357  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:47.355005  2448 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:47.342646  6939 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:47.356333  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:47.357347  6867 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:47.315462  7103 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.357718  6867 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:47.358014  7103 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:47.358186  6867 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:47.360268  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.295910  6844 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 13:00:47.369578  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.321470  6997 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:47.422688  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.440986  7098 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:47.477432  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:47.478016  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 186030us
I20260709 13:00:47.478768  2405 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:47.483454  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:47.484218  1718 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
I20260709 13:00:47.483338  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:47.485168  1646 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 4.
W20260709 13:00:47.486426  7073 log.cc:927] Time spent T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.887s	user 0.006s	sys 0.009s
I20260709 13:00:47.487573  2436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 1303) took 1353 ms. Trace:
I20260709 13:00:47.488225  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:47.452680  7098 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.488047  2436 rpcz_store.cc:276] 0709 13:00:46.135772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.135893 (+   121us) service_pool.cc:224] Handling call
0709 13:00:46.136201 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.136515 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.136541 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.136938 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.255950 (+119012us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:46.255983 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.256042 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.438766 (+1182724us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:00:47.487283 (+ 48517us) raft_consensus.cc:1685] finished
0709 13:00:47.487311 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.487496 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2948,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":37803,"spinlock_wait_cycles":95540992,"thread_start_us":118752,"threads_started":1,"wal-append.queue_time_us":407964}
I20260709 13:00:47.491353  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:47.495102  1646 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:47.499981  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:47.505362  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:47.509284  6887 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:47.520656  1639 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:00:47.521060  1646 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:00:47.479041  7066 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:47.515033  2405 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:47.524860  1716 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:47.526151  1718 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:47.528189  1686 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:47.533906  7043 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:00:47.534622  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 52197.1us
I20260709 13:00:47.534899  6775 raft_consensus.cc:3060] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:47.500181  7104 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:47.546027  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:47.549249  1639 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 17.
I20260709 13:00:47.574165  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:47.574833  1563 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 17.
W20260709 13:00:47.547958  6933 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:00:47.494318  6993 consensus_queue.cc:1059] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:00:47.553488  6995 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:47.503958  7098 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:47.588040  1647 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
W20260709 13:00:47.578523  7102 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:00:47.593286  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 53264.3us
I20260709 13:00:47.595355  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:47.596670  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:00:47.596777  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 51024.2us
I20260709 13:00:47.597303  1567 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:00:47.601744  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 86791us
I20260709 13:00:47.608193  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:47.613057  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:47.615998  1563 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 14: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:47.614562  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:47.581826  7128 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.618168  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:47.619269  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.556289  6721 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:00:47.588068  6995 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:00:47.622465  7129 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:00:47.622934  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:47.623248  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:47.622984  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:47.681447  1567 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
W20260709 13:00:47.682757  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 61328.8us
I20260709 13:00:47.684952  1572 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 12: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:47.690671  1563 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 10: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:47.691802  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:47.601504  7104 raft_consensus.cc:697] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:47.613147  6831 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:47.619019  6572 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.701514  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:47.706545  1567 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:00:47.685828  7124 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:00:47.710486  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:47.716965  7123 log.cc:927] Time spent T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:00:47.725145  6871 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:47.726737  6929 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:47.708150  6572 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:47.729346  6976 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:47.731026  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.733616  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.680148  6995 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:47.684686  6837 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.701972  6831 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.766636  2405 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:47.764724  6966 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.790602  7125 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:00:47.800197  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 182727us
I20260709 13:00:47.635447  7128 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:47.757083  6929 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:47.812866  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 181115us
I20260709 13:00:47.756913  7047 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.821494  1536 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:47.807559  6831 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.756810  6937 consensus_queue.cc:1059] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:00:47.830760  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54412 (request call id 1483) took 1129 ms. Trace:
I20260709 13:00:47.839630  1719 rpcz_store.cc:276] 0709 13:00:46.701018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.701162 (+   144us) service_pool.cc:224] Handling call
0709 13:00:47.830595 (+1129433us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b540038f9d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:47.830704 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435168512}
I20260709 13:00:47.817826  6929 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:47.826215  7131 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.829277  7104 consensus_queue.cc:237] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.856771  7043 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:47.857486  7043 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.862809  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.863402  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.865468  7131 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:47.861770  6928 consensus_meta.cc:287] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.000s
I20260709 13:00:47.869257  2443 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:47.813941  6966 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.807375  6837 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.838693  6993 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:47.864374  7075 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:47.829033  7047 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:47.925304  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:47.868866  7087 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:47.857920  7043 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.927215  7126 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.937495  2444 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:47.891702  7146 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:47.930410  7141 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:47.928499  6993 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.905181  7144 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:00:47.937987  7095 consensus_meta.cc:287] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.699s	user 0.010s	sys 0.001s
I20260709 13:00:47.948760  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:47.953866  1715 raft_consensus.cc:2393] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:47.895007  6928 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.934841  7075 raft_consensus.cc:697] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:47.959951  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:47.962752  1720 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:47.962476  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:47.963155  1638 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:47.967195  1565 raft_consensus.cc:1275] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:47.967447  1716 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:47.965375  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:47.967226  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 145843us
I20260709 13:00:47.972858  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.973646  2443 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:47.975715  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:47.952404  7098 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:47.989286  1537 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:00:47.969851  6867 consensus_meta.cc:287] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.000s
W20260709 13:00:47.962512  6939 consensus_meta.cc:287] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.002s
W20260709 13:00:47.993183  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 226613us
I20260709 13:00:47.942031  7087 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.946344  7126 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:47.998546  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:48.008582  7087 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:48.011190  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:47.975140  6775 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.977628  7131 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:47.960321  7095 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.031481  7094 consensus_queue.cc:1059] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:48.017635  7149 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:48.072415  7149 raft_consensus.cc:697] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:48.073186  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:48.073357  7149 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.074430  2444 raft_consensus.cc:2410] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:00:48.034822  6775 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.035259  6928 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:48.036027  7138 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:00:48.041406  6995 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.040011  6929 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.061741  6572 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.063654  7128 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.065541  7126 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:48.067597  7043 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:48.068859  7133 log.cc:927] Time spent T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:00:48.002889  7132 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:48.079048  2448 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:00:47.996347  7148 consensus_queue.cc:1059] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:00:48.001660  6937 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:47.949527  7146 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.156399  6929 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.095978  6848 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.157243  6848 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.157809  7146 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:48.091220  6871 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:00:48.148684  7132 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.159345  7132 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.160359  7042 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:48.091188  1716 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:47.955788  7144 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.143308  2437 raft_consensus.cc:2368] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
W20260709 13:00:48.086958  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.163846  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.164682  7144 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:47.999821  6867 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.086630  7152 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.005667  6939 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.092330  6887 raft_consensus.cc:3055] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:48.142599  7145 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.149044  7067 consensus_meta.cc:287] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.867s	user 0.007s	sys 0.004s
I20260709 13:00:48.193465  1719 raft_consensus.cc:606] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:48.194032  1719 raft_consensus.cc:614] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:48.194901  1712 raft_consensus.cc:2368] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14.
W20260709 13:00:48.199842  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 354969us
I20260709 13:00:48.179137  6887 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:48.203193  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:48.203863  1565 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:48.205664  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:48.206331  1565 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.206589  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:48.191669  7148 consensus_queue.cc:1243] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer a4be9cc90aca4dd4ad7db103062a7208 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:00:48.211802  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 215065us
I20260709 13:00:48.212520  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:48.193188  7043 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:48.228477  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:48.229156  1570 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:48.198827  7047 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:48.143090  7075 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.232631  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:48.199373  6837 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.233647  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:48.237615  1572 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
W20260709 13:00:48.205515  6987 consensus_meta.cc:287] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.968s	user 0.011s	sys 0.001s
I20260709 13:00:48.235694  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:48.238665  1564 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:48.185405  7067 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.240847  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:48.241761  2438 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:00:48.240921  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:48.248041  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:48.185029  7145 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.253023  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:48.180439  7152 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.254096  1564 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 18.
I20260709 13:00:48.260030  1713 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:48.240247  7001 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:00:48.254853  6711 consensus_meta.cc:287] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.968s	user 0.004s	sys 0.009s
I20260709 13:00:48.263878  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:48.272822  1570 raft_consensus.cc:2393] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 14: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 13:00:48.256291  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 250852us
I20260709 13:00:48.258796  7042 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.264981  1686 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:48.280355  1686 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:48.278254  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:48.259709  7148 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:48.237224  7043 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:48.272893  6899 consensus_meta.cc:287] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.925s	user 0.010s	sys 0.001s
I20260709 13:00:48.282724  7001 raft_consensus.cc:697] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 13:00:48.286409  7139 log.cc:927] Time spent T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.456s	user 0.004s	sys 0.000s
I20260709 13:00:48.290436  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:48.246258  6987 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.261571  6848 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.293141  1570 raft_consensus.cc:2393] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 11: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:48.281719  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:48.319649  1568 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:00:48.298600  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:48.300014  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:48.321332  1640 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.295449  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:48.283039  7161 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:48.306622  1686 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:48.283623  7095 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:48.259248  6887 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.322659  7104 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.330771  6887 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:48.330943  7160 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:48.330703  7104 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.325037  7135 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:48.331972  7135 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.332325  7135 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.332957  7104 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.294394  7141 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.333755  7141 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.315093  6899 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.333949  7001 consensus_queue.cc:237] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.334476  7145 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:48.335145  2447 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:48.336010  6899 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.315691  7165 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:48.336643  7165 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.337035  7165 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.314931  6995 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:48.338624  7163 consensus_queue.cc:1059] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:48.314623  6775 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:48.338675  7161 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:48.340747  7161 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.341400  7163 raft_consensus.cc:3055] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:48.342278  6939 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:48.274809  6711 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.347352  6711 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:48.351616  7103 consensus_meta.cc:287] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.993s	user 0.007s	sys 0.004s
I20260709 13:00:48.352200  7103 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:48.353241  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 46684.7us
I20260709 13:00:48.354142  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:48.354889  2440 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:00:48.356595  7145 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:48.357009  7145 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.357350  7145 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.359723  6987 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.361521  7067 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:48.292411  7042 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.365543  7042 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:48.366953  7152 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.367260  1565 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:48.323566  1716 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:48.370985  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:48.371891  1638 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:48.372221  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:48.372557  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:48.373194  1721 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.375547  1647 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:48.382368  2405 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:00:48.390209  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 142258us
I20260709 13:00:48.391649  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:48.392663  1686 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:48.392620  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:48.394598  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:48.395430  6939 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:48.395970  6939 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.396361  6939 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:48.398679  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.399885  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:48.402271  6837 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:48.402709  6837 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:48.403079  6837 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:48.391171  1640 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
W20260709 13:00:48.386662  7169 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:00:48.411924  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:48.417150  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:48.418166  1570 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 13: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:48.412714  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:48.417809  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:48.341925  7163 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:48.415632  2405 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:48.418821  1564 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.424631  2436 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:48.427608  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:48.434211  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.434347  7155 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:48.458036  1570 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:48.418769  1565 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:48.394490  6997 consensus_meta.cc:287] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.955s	user 0.010s	sys 0.002s
I20260709 13:00:48.435019  7155 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.406550  7067 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:48.477186  1570 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:48.419487  7152 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:48.474412  1564 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:00:48.415516  1571 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:48.469964  2440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 1318) took 1172 ms. Trace:
I20260709 13:00:48.480026  1568 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:00:48.459295  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:48.491809  1721 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:00:48.492213  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:48.495275  1640 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:48.487941  2440 rpcz_store.cc:276] 0709 13:00:47.297286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.298016 (+   730us) service_pool.cc:224] Handling call
0709 13:00:47.298416 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:48.355343 (+1056927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.469739 (+114396us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400a54e54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:48.469907 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2429039488}
I20260709 13:00:48.495182  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:48.478982  7155 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.478313  6900 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:00:48.504454  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:48.507128  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:48.507699  7044 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:48.501221  6921 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.534478  6721 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:48.534672  6921 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.522710  7103 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:48.536829  6921 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:48.509037  6831 consensus_meta.cc:287] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.663s	user 0.008s	sys 0.000s
I20260709 13:00:48.537179  6939 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.513582  1565 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:00:48.537498  6831 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.499210  7152 raft_consensus.cc:697] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:48.539760  7152 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.540830  7135 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.522993  7163 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.543380  7163 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.488970  7141 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:48.546504  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 59262.4us
I20260709 13:00:48.547490  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:48.548044  1715 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.553517  7146 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:48.554036  7146 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.559006  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 1498) took 1040 ms. Trace:
I20260709 13:00:48.559458  1713 rpcz_store.cc:276] 0709 13:00:47.518505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.518693 (+   188us) service_pool.cc:224] Handling call
0709 13:00:47.549672 (+ 30979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.260440 (+710768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.558796 (+298356us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5400016654. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:48.558949 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633202944}
I20260709 13:00:48.562927  6921 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:48.523448  1643 raft_consensus.cc:1240] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:48.500834  6899 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:48.564320  6899 raft_consensus.cc:697] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:48.565222  6899 consensus_queue.cc:237] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.566854  1569 raft_consensus.cc:3055] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:48.567209  1569 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:48.567963  1569 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.488231  7099 raft_consensus.cc:1064] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:48.526593  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:48.569748  7128 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:00:48.570209  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 43705.7us
I20260709 13:00:48.570256  7128 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.573176  1612 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:48.528110  7132 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.573679  7128 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.531669  7165 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.563117  1611 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:48.478072  6997 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.576458  1611 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:48.577862  1717 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:48.578105  1612 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:48.569155  1569 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:48.569245  2406 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.655s (SENT) [suppressed 20 similar messages]
W20260709 13:00:48.582748  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.556075  7146 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.510973  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:48.587417  2405 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:48.588333  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:48.589388  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:48.584669  1564 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
W20260709 13:00:48.592836  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.491158  7067 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 18 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:48.502170  7043 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:48.577051  7099 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.540872  6831 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:48.619522  1569 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:48.583782  7044 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:48.625093  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 2893) took 1027 ms. Trace:
I20260709 13:00:48.585410  7042 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:48.585139  6711 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:48.612504  6887 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:48.620765  6921 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:48.639019  7067 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.618929  7146 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:48.585090  7103 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
W20260709 13:00:48.634126  7134 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:00:48.650619  6711 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:48.618294  6721 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:00:48.631264  1569 rpcz_store.cc:276] 0709 13:00:47.597541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.703298 (+105757us) service_pool.cc:224] Handling call
0709 13:00:47.724764 (+ 21466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.566770 (+842006us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54003a0aa0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd20fdc0 00007f18cd29a1c0 00007f18cd29b231 00007f18cd297d8f 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c
0709 13:00:48.624798 (+ 58028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.625038 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243821824}
I20260709 13:00:48.595729  6837 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.634419  6997 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:48.664229  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 94989.7us
I20260709 13:00:48.675524  7103 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:48.669982  6831 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:48.660974  7146 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.679049  7132 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:48.631399  7155 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.679412  7135 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.691465  7145 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.693344  7146 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.695278  7155 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:00:48.727188  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 86852.9us
I20260709 13:00:48.740922  1564 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:48.743139  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:48.743773  1571 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:48.745579  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:48.747112  1566 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 12: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:48.748821  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:48.748957  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:48.749836  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 172138us
I20260709 13:00:48.751291  1721 raft_consensus.cc:2393] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 13: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:48.677990  7035 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:00:48.755944  6976 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.743425  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:48.684669  6831 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:48.761013  1716 raft_consensus.cc:2393] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 11: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:48.765019  7145 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.765316  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:48.767448  1716 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
W20260709 13:00:48.767587  7184 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:00:48.771816  6831 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.772754  2406 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:48.774184  6939 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.761112  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:48.781939  7103 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:48.782245  7141 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.782526  7103 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:48.783064  7103 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:48.757069  6976 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.785151  1570 raft_consensus.cc:2368] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11.
I20260709 13:00:48.786679  6837 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:48.785146  7132 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.780915  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 188205us
I20260709 13:00:48.783154  7141 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.793815  1720 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:00:48.795867  1720 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:00:48.796567  7141 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:48.797839  1713 raft_consensus.cc:1275] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:48.799894  7179 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 13:00:48.801512  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.802030  7179 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.802364  7132 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:48.804627  7179 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:48.804797  7132 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:48.797679  1720 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:00:48.806672  1716 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:48.807812  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:48.809536  1716 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:48.783813  6831 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:48.820207  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 47746.8us
I20260709 13:00:48.814231  7132 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:48.822278  7035 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:48.822909  7132 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:48.827052  1568 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:48.830592  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54412 (request call id 1496) took 1325 ms. Trace:
I20260709 13:00:48.831192  1712 rpcz_store.cc:276] 0709 13:00:47.504912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.505054 (+   142us) service_pool.cc:224] Handling call
0709 13:00:48.830100 (+1325046us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b5400228b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:48.830362 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583347072}
I20260709 13:00:48.866384  7043 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:48.870793  7151 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.871690  7151 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.874408  7151 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:48.875874  7103 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:48.887113  7103 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:48.887475  7132 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:48.852151  1611 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:48.894778  7143 raft_consensus.cc:3055] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:48.895357  7143 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:48.896772  7143 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:48.911682  7178 log.cc:927] Time spent T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 13:00:48.912678  7143 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.898494  7042 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:48.894857  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 77558.8us
I20260709 13:00:48.937963  1612 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:48.939474  7044 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:48.942167  6721 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:48.944664  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:48.945488  1611 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:48.946873  7044 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:48.947304  7044 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.947695  7044 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.950989  6711 consensus_queue.cc:1059] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:48.951958  2405 leader_election.cc:400] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14.
I20260709 13:00:48.952330  2405 leader_election.cc:403] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:48.952255  6721 raft_consensus.cc:3055] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:48.952972  6721 raft_consensus.cc:740] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:48.953330  6831 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.957093  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:48.953965  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 103439us
I20260709 13:00:48.974406  2436 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:48.995579  1715 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 13:00:49.004777  6921 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:00:49.006538  6867 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.010411  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:49.011014  6831 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14.
W20260709 13:00:49.012603  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.954365  6721 consensus_queue.cc:260] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:49.017021  6721 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:49.023152  7195 consensus_queue.cc:1059] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:49.020354  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:49.027810  2437 raft_consensus.cc:2410] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:00:49.034106  7099 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:49.034775  7099 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.036885  7099 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.038290  2405 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:49.039089  6887 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:49.039619  6837 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:49.040273  6837 raft_consensus.cc:697] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:49.039865  6887 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.042656  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:49.043275  6887 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:49.044579  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42630 (request call id 61) took 1075 ms. Trace:
I20260709 13:00:49.044958  1719 rpcz_store.cc:276] 0709 13:00:47.924963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.925148 (+   185us) service_pool.cc:224] Handling call
0709 13:00:48.992830 (+1067682us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b5400228b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd292853 00007f18d226060a 00007f18cb7e67d4 00007f18cb7e6762 00007f18cb7e6691 00007f18cb7e660c 00007f18cb7e58c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:49.000269 (+  7439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614801152}
I20260709 13:00:49.031663  2436 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:49.046309  7043 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:49.046731  7043 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.047097  7043 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:49.049408  6993 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.056838  2446 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
W20260709 13:00:49.060957  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 119471us
I20260709 13:00:49.062287  6867 consensus_queue.cc:1048] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:49.065933  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.041512  6837 consensus_queue.cc:237] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.068668  6976 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.057308  7044 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:49.083431  7156 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:49.084355  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:49.084551  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:49.085265  7192 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:00:49.085647  7144 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:49.086563  7159 raft_consensus.cc:1064] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: attempting to promote NON_VOTER 6f381117554e49bb816791ab0a10f2b8 to VOTER
I20260709 13:00:49.086692  7161 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:49.105047  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:49.086998  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:49.085583  7165 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:49.087249  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:49.091979  7186 log.cc:927] Time spent T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:00:49.092749  6694 raft_consensus.cc:670] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:49.079545  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:49.100517  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:49.104240  7144 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:49.076378  7195 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:00:49.117806  7195 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:49.118526  7195 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.122609  1568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:00:49.123888  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:49.125082  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:49.125739  2444 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:49.126310  2438 raft_consensus.cc:2368] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11.
I20260709 13:00:49.101915  6976 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:00:49.124066  1568 raft_consensus.cc:606] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:49.127792  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:49.136099  6933 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:49.136935  6933 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.138283  7156 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.139886  1718 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 13:00:49.116010  7099 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:49.146014  2436 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:49.081246  7179 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
W20260709 13:00:49.160694  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 95059.3us
I20260709 13:00:49.120976  7195 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.143659  6933 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:49.174352  7170 log.cc:927] Time spent T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.854s	user 0.003s	sys 0.000s
I20260709 13:00:49.176136  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.177013  1720 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:49.180522  7043 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:49.171164  7165 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:49.188714  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:49.189872  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 89550.4us
I20260709 13:00:49.191125  2443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 1268) took 1163 ms. Trace:
W20260709 13:00:49.191130  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.190393  2437 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:00:49.192329  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.192366  1612 leader_election.cc:400] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11.
I20260709 13:00:49.192855  1612 leader_election.cc:403] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:00:49.150518  7161 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.203374  7196 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:49.204108  7196 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:49.211288  2447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 1260) took 1459 ms. Trace:
I20260709 13:00:49.211778  2447 rpcz_store.cc:276] 0709 13:00:47.751979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.752136 (+   157us) service_pool.cc:224] Handling call
0709 13:00:47.752516 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.335510 (+582994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.210820 (+875310us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54006a0c54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:49.211108 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339486976}
I20260709 13:00:49.177876  7156 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:49.216593  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 44409.9us
I20260709 13:00:49.217377  2436 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:49.187844  7165 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:49.287434  1611 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:49.287887  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 1495) took 1790 ms. Trace:
I20260709 13:00:49.288341  1717 rpcz_store.cc:276] 0709 13:00:47.497680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.497955 (+   275us) service_pool.cc:224] Handling call
0709 13:00:47.522171 (+ 24216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.578272 (+1056101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.287362 (+709090us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540002a3d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:49.287664 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2427424000}
I20260709 13:00:49.218564  7044 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:49.320324  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:49.321118  1720 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:49.290091  7165 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:49.324082  7193 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:49.316838  7043 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:49.191571  2443 rpcz_store.cc:276] 0709 13:00:48.024061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.024558 (+   497us) service_pool.cc:224] Handling call
0709 13:00:48.025020 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:48.195835 (+170815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.195869 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:48.198679 (+  2810us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.307269 (+108590us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:48.307305 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.307369 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.173319 (+865950us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:00:49.177507 (+  4188us) raft_consensus.cc:1685] finished
0709 13:00:49.177525 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.187182 (+  9657us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6490,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":10451200,"thread_start_us":250352,"threads_started":2,"wal-append.queue_time_us":115603}
I20260709 13:00:49.317338  7179 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.331946  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.334167  7099 consensus_queue.cc:1059] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:49.334625  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:49.336673  7099 raft_consensus.cc:3055] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:49.337036  7099 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:49.337349  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.317982  7204 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:49.338737  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.338660  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.346890  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.338898  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.338203  1716 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:49.327392  7193 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:49.349697  7193 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:49.350443  1719 raft_consensus.cc:2393] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 10: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:49.339214  6966 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:49.338447  7098 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:49.354566  2436 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:49.355295  7206 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:49.355741  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.356001  7206 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.356490  1569 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:49.356782  6933 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.357414  6933 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.342160  1712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:49.358460  1712 raft_consensus.cc:606] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:49.358855  1712 raft_consensus.cc:614] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:49.359368  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:49.359670  6933 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.360833  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:49.362236  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.363032  1566 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:49.346381  7044 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.326825  6775 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:49.395248  6775 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.333873  7134 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.399050  7134 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.401507  7134 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.342176  7200 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:00:49.404668  7044 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.406312  7179 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.408771  7179 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:49.409962  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.365605  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.418674  1568 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:49.370609  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:49.421241  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:49.421924  1570 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:49.372428  7196 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:49.374357  7161 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.375308  7144 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:49.378753  7043 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.430961  7043 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.432413  1537 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:49.433372  7043 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.433575  1537 leader_election.cc:400] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11.
I20260709 13:00:49.380121  7151 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 13:00:49.433954  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.434386  7151 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:49.436021  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.436894  7151 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:49.380889  1712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:49.437498  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.437772  1712 raft_consensus.cc:606] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:49.367698  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.438174  1712 raft_consensus.cc:614] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:49.387686  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.438690  1572 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:00:49.439143  1566 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:49.439658  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.440112  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:49.440840  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:49.441423  1572 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.388900  7098 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:49.444263  7098 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.319007  7159 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 9, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.394479  7206 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:49.454613  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.458621  7194 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.459280  7194 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:49.461560  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:49.433890  1537 leader_election.cc:403] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:49.462785  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:49.475739  2440 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:49.461951  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:49.486213  2440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42646 (request call id 1330) took 1017 ms. Trace:
I20260709 13:00:49.486763  2440 rpcz_store.cc:276] 0709 13:00:48.469126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.315085 (+845959us) service_pool.cc:224] Handling call
0709 13:00:49.486152 (+171067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.434020  7043 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:49.497059  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.397871  6775 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:49.498603  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.498562  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:49.503207  1563 raft_consensus.cc:2410] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 10 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:00:49.503427  7194 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:49.503661  2446 raft_consensus.cc:2410] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:00:49.504190  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:49.499461  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 66105.5us
I20260709 13:00:49.502014  1612 leader_election.cc:400] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 13:00:49.505344  1612 leader_election.cc:403] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:49.505214  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.475240  7200 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.506551  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.507856  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.508708  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.507953  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:49.510082  1568 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:49.476740  7195 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:49.510753  7204 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11.
I20260709 13:00:49.520394  1570 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 19.
I20260709 13:00:49.517120  1716 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:49.518947  1719 raft_consensus.cc:2393] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 5: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:49.500223  7043 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.495844  7196 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.338017  7099 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.522276  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:49.502503  7151 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:00:49.529455  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:49.501437  7206 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:49.531211  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:49.533030  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:49.530807  7194 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 13:00:49.534578  7195 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.535398  7207 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:49.536049  7207 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.537279  7195 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:49.540930  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 82857.4us
I20260709 13:00:49.542192  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:49.546212  7206 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:49.552850  7165 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.527722  7043 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:49.555382  7196 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:49.558496  7189 log.cc:927] Time spent T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.542s	user 0.006s	sys 0.008s
I20260709 13:00:49.561318  1536 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:49.573359  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:49.572394  7061 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.659s	user 0.004s	sys 0.060s
I20260709 13:00:49.519771  7200 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:49.573187  7044 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.575960  1716 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:49.576260  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.574872  1568 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:49.578624  2438 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEARNER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:49.581578  7200 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:49.585000  7193 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:49.586810  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 44795.2us
I20260709 13:00:49.587842  7195 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:49.590363  7210 consensus_queue.cc:1059] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:49.590628  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.590447  1646 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:49.592826  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.594506  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:49.579481  1537 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:49.577502  1720 raft_consensus.cc:2468] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:49.591377  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:49.577677  7061 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.760s	user 0.004s	sys 0.061s
I20260709 13:00:49.597098  1643 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:49.606658  2438 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:49.591581  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.589731  7194 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:00:49.591948  6933 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:49.619059  1647 raft_consensus.cc:2410] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:49.592546  7134 consensus_queue.cc:1059] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:00:49.611604  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.618168  7165 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.619035  7161 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:49.619515  7010 consensus_queue.cc:1059] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:49.620966  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:49.632014  1567 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:00:49.624032  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:49.624845  1572 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:49.615082  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.639511  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:49.636696  1568 raft_consensus.cc:2376] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14. Re-sending same reply.
I20260709 13:00:49.639519  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.625447  7140 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:00:49.659056  1638 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 10: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:49.633433  7200 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.664060  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:49.641685  7193 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.637849  7161 raft_consensus.cc:697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:49.658311  7207 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.672072  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.672854  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:49.673368  1643 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:49.673791  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:49.675199  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.675769  1686 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:49.679018  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.679260  7200 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:49.680567  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.681073  6921 raft_consensus.cc:3055] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:49.681921  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.682667  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:49.683575  7206 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:49.687593  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.692167  1571 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:00:49.708243  1644 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:49.692868  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:49.697036  1569 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:00:49.697584  6985 raft_consensus.cc:3055] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:49.703454  1570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
W20260709 13:00:49.710392  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 90828.2us
I20260709 13:00:49.719380  1720 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:00:49.707913  7195 raft_consensus.cc:697] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:49.714165  1642 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 13:00:49.725579  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.717195  1570 raft_consensus.cc:606] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:49.726950  1570 raft_consensus.cc:614] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:49.728693  1611 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:49.729156  2436 raft_consensus.cc:2410] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:00:49.729818  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.699790  7161 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.711139  6921 raft_consensus.cc:740] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:49.735592  1718 raft_consensus.cc:2393] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 10: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:49.737349  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:49.715919  6985 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:49.740826  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.743448  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.742805  1721 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:49.747793  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:49.748572  1720 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:49.733664  7210 raft_consensus.cc:2804] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:49.731617  7165 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:49.737370  7061 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.757869  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 121259us
I20260709 13:00:49.761830  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.762859  7067 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:49.763154   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:00:49.763682  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.764964  6921 consensus_queue.cc:260] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:49.753012  7134 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:00:49.772763  1469 catalog_manager.cc:5697] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 11 to 12, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:00:49.775015  7152 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.177s	user 0.010s	sys 0.015s
W20260709 13:00:49.775458  7152 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.208s	user 0.011s	sys 0.015s
I20260709 13:00:49.778618  1641 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:49.774034  1571 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:49.785175  1644 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:49.784595  1647 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:49.785267  7210 raft_consensus.cc:697] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:49.791357  6985 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.785722  7206 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.793081  6985 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.793009  7206 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:49.794158  7219 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:49.794829  7219 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.797243  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.798579  6711 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:49.799177  6711 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.801787  7200 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:49.802666  7219 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.803301  1567 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:49.803433  7143 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:49.804507  1720 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:00:49.805751  7196 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.804102  7143 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:49.807655  7143 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:49.801226  6711 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.804122  7195 consensus_queue.cc:237] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.814352  2406 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:49.815056  7103 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:49.814996  7061 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.815745  7103 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.817447  7061 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.791456  7210 consensus_queue.cc:237] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:49.818990  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.827486  1641 raft_consensus.cc:2410] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:49.836853  1611 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:49.817895  7103 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:49.849175  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:49.849954  2437 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:00:49.785945  7165 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.850931  7048 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:49.851346  7048 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.851671  7048 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:49.852515  7165 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.854904  1571 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:49.857342  1721 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:49.810778  7067 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:49.859369  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.823299  6921 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:49.863454  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.846191  2406 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:49.843891  7075 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.309s	user 0.007s	sys 0.032s
I20260709 13:00:49.863343  1714 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
W20260709 13:00:49.872206  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.879884  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 55998.1us
W20260709 13:00:49.893997  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.896682  1713 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:49.896838  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:49.902287  1570 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:49.878981  1611 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:49.881167  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.874899  7075 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.340s	user 0.008s	sys 0.033s
I20260709 13:00:49.864876  7219 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:49.913142  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 86809.3us
I20260709 13:00:49.913879  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:49.916074  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.916708  1537 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:49.917965  6993 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:49.844867  7043 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.918402  6993 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.844559  7098 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:00:49.896176  7094 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:49.921492  1644 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:00:49.926200  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:49.927424  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.927805  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.940776  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.928112  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.929944  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:49.941787  1643 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.930681  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.910758  7219 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.910672  6711 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:49.946640  1715 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:49.936887  7048 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.921907  7151 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11.
I20260709 13:00:49.950835  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:49.952481  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:49.919080  7152 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:49.955966  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.956908  7099 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:49.957159  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 13:00:49.958907  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.867102  6939 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:00:49.967605  1644 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:49.968313  1647 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:49.969501  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 49142.5us
I20260709 13:00:49.923182  6993 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:49.948758  7219 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:49.977728  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.975250  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:49.979547  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.983872  1642 raft_consensus.cc:2393] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:49.984763  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:49.985064  7043 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.985616  1642 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 14: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:49.986519  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:49.987480  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:49.987954  1642 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.944031  7210 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:49.991245  7210 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:49.993557  7210 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.994993  7043 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:49.995617  7043 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:49.998301  7209 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.601s	user 0.004s	sys 0.000s
I20260709 13:00:49.999948  6721 raft_consensus.cc:3055] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:50.000383  6721 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:49.970593  6711 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:50.001320  6721 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.010725  1563 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:50.016148  1647 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 18.
I20260709 13:00:50.017853  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:50.021016  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:50.021664  1646 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:50.023267  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:50.029527  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:50.030652  1641 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:50.030805  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:50.032464  1570 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:00:50.033526  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:50.038546  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:50.037380  6721 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:50.041354  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:50.043035  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:50.043766  2442 raft_consensus.cc:2393] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 15: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:50.030303  7090 raft_consensus.cc:3055] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:50.044260  7090 raft_consensus.cc:740] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 13:00:50.044947  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 74694.2us
I20260709 13:00:50.045135  7090 consensus_queue.cc:260] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:50.046227  7090 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.046322  2406 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.051738  7043 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:49.977290  7067 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.045930  1611 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:50.043618  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:50.054494  1571 raft_consensus.cc:2393] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 10: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:50.055521  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:50.056143  6976 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:50.056548  6976 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.056658  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:50.056921  6976 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:50.060125  7048 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:50.060416  7149 consensus_queue.cc:1059] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:50.060914  7048 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:50.061414  7048 raft_consensus.cc:697] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:50.065155  1642 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5.
I20260709 13:00:49.982710  7152 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.069147  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:50.069944  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.057775  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:50.070966  1567 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:50.073208  7149 raft_consensus.cc:3055] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:50.068646  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:50.074865  1646 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:50.076418  1646 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:00:50.076767  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.077798  1646 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:50.077868  7241 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:50.083559  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:50.086510  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:50.074422  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.094084  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:50.073752  7149 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:50.111948  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.113225  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:50.113127  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:50.120528  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.117918  2406 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:00:50.122229  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 54925.9us
W20260709 13:00:50.205202  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.239569  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.208042  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.125646  7156 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:50.144033  7206 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:50.129830  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.099267  7067 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:50.128984  6993 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.213516  1612 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 13:00:50.142884  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 76051.8us
I20260709 13:00:50.143410  7237 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:00:50.118019  6711 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.184557  1643 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:50.122325  6775 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:50.122340  7094 consensus_queue.cc:1059] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:00:50.147322  2448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 1336) took 1010 ms. Trace:
I20260709 13:00:50.200345  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:50.150287  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:50.183915  1638 raft_consensus.cc:2410] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:00:50.203336  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:50.138223  2437 raft_consensus.cc:1240] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:50.284550  7156 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:50.184911  1644 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:50.227434  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:50.267369  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 149514us
I20260709 13:00:50.285640  7156 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.278952  1564 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:50.226709  6966 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.288233  6966 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.290482  6966 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:50.291256  7203 raft_consensus.cc:2764] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:00:50.292145  1644 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:50.293416  1644 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:50.294942  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:50.283438  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.296188  1567 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:50.282433  2448 rpcz_store.cc:276] 0709 13:00:49.028321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.915327 (+887006us) service_pool.cc:224] Handling call
0709 13:00:49.915605 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.915808 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:49.916056 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 13:00:50.038068 (+122012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:50.038124 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:50.038180 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.038265 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.038416 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31122,"prepare.queue_time_us":1622,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":32,"raft.queue_time_us":29180,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5088,"spinlock_wait_cycles":33460480,"thread_start_us":95150,"threads_started":1,"wal-append.queue_time_us":166434}
I20260709 13:00:50.302371  7159 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:50.302639  1714 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 14: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:50.302997  7159 raft_consensus.cc:697] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:50.303172  1686 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:50.304145  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.304015  7159 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.149855  7048 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.301489  7067 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:50.320654  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 123308us
I20260709 13:00:50.322471  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:50.322489  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 109060us
I20260709 13:00:50.323849  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:50.329941  2442 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:50.332186  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.305523  7233 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:50.359455  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 158978us
W20260709 13:00:50.362430  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 55294.7us
I20260709 13:00:50.317384  7230 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.369903  7233 raft_consensus.cc:697] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:50.370926  7233 consensus_queue.cc:237] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:50.376132  7249 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.376690  7249 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.378961  7249 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:50.382835  7211 consensus_queue.cc:1059] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:00:50.383666  7246 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:50.384384  7246 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.383806  7211 raft_consensus.cc:3055] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:50.368512  1686 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:50.324965  1612 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:50.324203  7242 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:50.392830  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 67922.3us
I20260709 13:00:50.393684  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 13:00:50.386173  6985 consensus_meta.cc:287] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.575s	user 0.002s	sys 0.010s
I20260709 13:00:50.394481  2442 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:50.373644  6976 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:50.406666  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:50.329773  7245 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:00:50.394758  7242 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:50.416682  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:50.420526  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:50.424078  1566 raft_consensus.cc:2393] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 14: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:50.358346  7144 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:00:50.424664  7206 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:50.400120  6921 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:50.401448  1537 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:50.396642  7210 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:50.392187  7211 raft_consensus.cc:740] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:50.426542  6921 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:50.431825  7223 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:50.434476  1685 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.435643  6993 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:50.421074  7203 consensus_queue.cc:1059] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:00:50.400130  6929 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:50.443732  6775 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:50.438043  7219 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:50.445778  1572 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:50.427597  7242 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:50.454875  7210 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.448848  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:50.464283  6921 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:50.458834  1716 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:00:50.409103  7098 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:50.462381  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:50.486503  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.447032  6976 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:50.459858  6985 raft_consensus.cc:2764] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:50.496874  1647 raft_consensus.cc:2368] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12.
I20260709 13:00:50.456898  1641 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:00:50.470007  7204 raft_consensus.cc:3055] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:00:50.495756  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 61379.8us
I20260709 13:00:50.471586  7156 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:50.474491  7223 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:50.490839  7210 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:50.503412  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 54724.8us
I20260709 13:00:50.491477  7203 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.514192  7206 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:50.532645  1685 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.522976  7067 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:50.524327  7219 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:50.524705  7099 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:50.498471  7204 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:50.545378  1685 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:50.539227  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.525452  7223 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.543905  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:50.551692  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:50.545035  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 13:00:50.552443  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 313404us
I20260709 13:00:50.553028  2436 raft_consensus.cc:2368] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 14. Current term is 15.
I20260709 13:00:50.521279  7211 consensus_queue.cc:260] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:50.471006  6929 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:50.555392  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 69057.9us
I20260709 13:00:50.556373  2440 pending_rounds.cc:85] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 10
I20260709 13:00:50.561748  1640 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:50.534355  6985 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.557600  7219 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.562196  2440 pending_rounds.cc:107] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:00:50.576910  2440 raft_consensus.cc:2889] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:50.577158  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:50.579512  1685 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.580782  2436 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:50.588212  1718 raft_consensus.cc:2410] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:00:50.589861  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:50.561380  7067 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:50.590749  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.566505  7159 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:50.534803  7203 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:50.595853  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:50.598869  6929 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:50.599642  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:50.575129  7211 raft_consensus.cc:3060] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:50.603284  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.574826  7098 raft_consensus.cc:697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:50.541181  7156 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.608613  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:50.609571  2405 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.601713  6985 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:00:50.613938  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 70157.9us
I20260709 13:00:50.615896  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:50.616279  1721 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:50.607429  7043 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:50.620102  2405 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.621145  2405 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.622679  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.625654  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.614962  7159 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:50.629163  7203 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:50.630235  7098 consensus_queue.cc:237] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:50.632930  1685 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.636127  7264 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.615576  6985 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:50.640136  6921 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:50.646168  6985 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:50.640967  1685 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.646976  7159 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:50.641669  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:50.640551  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:50.641238  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:50.619038  7204 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:50.622411  6837 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:50.650525  6921 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:50.644807  7242 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.651316  1718 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:00:50.656445  7242 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:50.656584  1568 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:00:50.652196  7210 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.624116  6976 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:50.658437  6976 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.658830  6976 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:50.659497  7210 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:50.659940  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:50.661128  7264 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:50.661796  1721 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:50.663625  7156 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:50.624511  7250 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.627552  1612 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.666128  6867 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:50.666383  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.667080  6867 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:50.668974  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.675206  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:50.677210  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:50.679059  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.656545  6985 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.683866  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:50.684650  1718 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:50.623962  7237 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:00:50.642657  7254 log.cc:927] Time spent T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:00:50.690619  1612 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.693130  7210 consensus_queue.cc:1059] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:50.694347  6921 raft_consensus.cc:3055] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:50.694787  6921 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:50.695786  6921 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.697105  6921 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:50.627341  6711 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:50.705483  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.685817  6867 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.688406  7265 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:50.707176  6939 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:50.707401  7210 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:50.721477  6939 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:50.732209  6939 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:50.742868  1686 leader_election.cc:400] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 14. Current term is 15.
I20260709 13:00:50.743376  1686 leader_election.cc:403] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:00:50.743636  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 58027.7us
I20260709 13:00:50.746192  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.747682  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:50.748314  7211 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:50.749543  7156 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:00:50.750878  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 45515us
I20260709 13:00:50.750039  6985 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:50.760227  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:50.765532  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:50.766072  1685 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.756045  1718 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:00:50.774524  1641 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:00:50.776476  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.777016  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:50.777664  1644 raft_consensus.cc:2393] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 15: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 13:00:50.778301  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.778991  1685 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.780398  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:50.783376  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:50.784456  1641 raft_consensus.cc:2393] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:50.786870  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:50.788949  1640 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:50.790015  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:50.787978  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:50.741580  6976 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.796993  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:50.798045  1644 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:00:50.774107  7210 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:50.800859  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:50.775223  7230 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 14. Current term is 15.
I20260709 13:00:50.805426  1718 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:50.790568  7067 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.807561  1642 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:50.781421  7223 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:50.814466  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:50.817449  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:50.792320  6929 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:50.819298  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.817622  1640 raft_consensus.cc:2393] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:50.825532  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:50.790792  7043 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:00:50.832708  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.807611  7263 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:50.819744  7223 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:50.815259  7262 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:00:50.854841  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:50.859423  2448 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:00:50.865450  2440 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:00:50.868023  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 87509.1us
I20260709 13:00:50.823559  7159 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:00:50.851763  7067 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:50.874837  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:50.857966  7223 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:50.905870  1718 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:00:50.868013  7250 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.873745  7211 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:50.917526  6985 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.920465  7043 consensus_queue.cc:1059] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:00:50.858433  7260 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:00:50.903509  1686 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:50.872912  7237 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.927412  7250 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.930081  7237 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:50.932852  7237 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:50.918895  7274 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:50.926812  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 13:00:50.933949  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.872013  6711 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:00:50.941385  1642 raft_consensus.cc:1240] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:00:50.944509  1640 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:50.933480  7237 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:50.946540  7250 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:50.946915  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:50.949566  1642 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:00:50.906216  7263 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:00:50.961922  1719 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:50.963466  7161 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.964015  7161 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:50.964452  6775 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:50.964998  6775 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:50.967000  6775 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:50.979846  6976 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:50.939024  7203 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:00:50.928891  7048 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:00:50.958746  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.960687  1718 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: []
W20260709 13:00:50.998026  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 149297us
I20260709 13:00:50.986284   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:50.996507  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:51.011649  1685 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 13:00:51.013049  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.015908  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:50.997650  6985 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:50.994844  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 91470.2us
I20260709 13:00:50.998848  7260 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:50.990681  7161 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:51.025055  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:51.041182  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:51.021543  6993 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:51.046293  2437 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:51.046788  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 121848us
I20260709 13:00:51.045418  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:51.021938  7211 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:51.022665  7260 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:51.043322  7043 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:51.050549  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:51.043016  7161 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:51.048768  7159 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:51.051471  7260 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:51.052794  6775 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:51.054978  7279 consensus_queue.cc:1059] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:00:51.044508  6993 consensus_queue.cc:1059] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:00:51.134021  2405 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:51.132870  7250 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:00:51.141999  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 91519.6us
I20260709 13:00:51.147405  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:51.146184  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:51.149849  1685 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:51.139845  7103 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:51.152047  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:51.148258  1639 raft_consensus.cc:2376] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11. Re-sending same reply.
I20260709 13:00:51.151976  7103 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.154613  7103 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:51.156006  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:51.144536  6775 raft_consensus.cc:3055] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:51.158440  6775 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:51.159294  6775 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:51.160511  6775 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:51.164021  7010 raft_consensus.cc:993] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:51.164688  7010 raft_consensus.cc:1081] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:51.147831  7242 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:00:51.167351  7103 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:51.169648  7103 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:51.171061  7242 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.171591  7242 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:51.171873  7098 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:51.172744  7271 log.cc:927] Time spent T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
I20260709 13:00:51.173727  7242 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:00:51.174336  7270 log.cc:927] Time spent T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:00:51.193758  7223 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:51.175112  7280 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:51.148758  7250 consensus_queue.cc:1243] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer a4be9cc90aca4dd4ad7db103062a7208 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:00:51.178071  7090 raft_consensus.cc:3055] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:51.202245  7090 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:51.203109  7090 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:51.206377  6993 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:51.207109  6993 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:51.181149  7273 log.cc:927] Time spent T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:00:51.177181  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:51.461696  1639 raft_consensus.cc:2376] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 5. Re-sending same reply.
W20260709 13:00:51.212194  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 62495.6us
I20260709 13:00:51.204552  7090 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:51.193476  7203 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.685967  7203 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:51.686565  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:51.687438  1721 raft_consensus.cc:2393] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 13: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:51.688093  1713 raft_consensus.cc:1275] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:51.687697  7149 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:51.688416  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 13:00:51.237864  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.689013  1721 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:51.689083  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:51.385198  7103 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:00:51.416980  1568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.021s	sys 0.031s
W20260709 13:00:51.690765  1568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.022s	sys 0.031s
I20260709 13:00:51.690726  7103 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:51.691774  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3771) took 1033 ms. Trace:
I20260709 13:00:51.691875  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3091) took 1758 ms. Trace:
W20260709 13:00:51.428474  1571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.008s	sys 0.001s
I20260709 13:00:51.693046  7103 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:51.449270  1563 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38394 (request call id 972) took 1925 ms (client timeout 1533 ms). Trace:
W20260709 13:00:51.693619  1563 rpcz_store.cc:269] 0709 13:00:49.524285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.527383 (+  3098us) service_pool.cc:224] Handling call
0709 13:00:51.449045 (+1921662us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b5400014854. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:51.449168 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029693184}
I20260709 13:00:51.459060  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 13:00:51.694811  1645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.009s	sys 0.000s
W20260709 13:00:51.695180  1645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.009s	sys 0.000s
I20260709 13:00:51.463547  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:51.695811  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:51.695921  1565 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:51.464886  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:51.696702  1570 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 19.
I20260709 13:00:51.697526  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:51.697949  1570 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:51.466953  1567 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:00:51.475196  7286 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:51.715030  7286 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.496431  6985 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.517313  6775 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.533293  7288 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:51.534186  7262 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:51.534674  7043 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:51.536065  7161 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:51.537083  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:51.538419  7090 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.541428  7260 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:51.541950  7278 raft_consensus.cc:3055] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:51.544524  7159 raft_consensus.cc:697] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 13:00:51.551770  1716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60088 (request call id 2977) took 1832 ms (client timeout 1821 ms). Trace:
I20260709 13:00:51.561425  1469 catalog_manager.cc:5697] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 8 to 9, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 9 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
W20260709 13:00:51.571046  1470 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 217) took 11943 ms (client timeout 15000 ms). Trace:
I20260709 13:00:51.580860  6976 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:51.583451  6966 raft_consensus.cc:3055] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:51.584291  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3765) took 2024 ms. Trace:
I20260709 13:00:51.598875  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:51.617964  7152 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:51.626302  2447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 1352) took 1084 ms. Trace:
I20260709 13:00:51.629096  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:51.634439  2444 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:51.641522  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:51.649721  6939 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:51.668042  7246 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:51.675729  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:51.679785  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:51.683202  2405 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:51.683516  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:51.692284  1647 rpcz_store.cc:276] 0709 13:00:49.933778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.062449 (+128671us) service_pool.cc:224] Handling call
0709 13:00:51.691668 (+1629219us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b540022b5d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:51.691788 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948454144}
W20260709 13:00:51.693248  1571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.008s	sys 0.002s
I20260709 13:00:51.430727  2438 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:00:51.696015  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.466991  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:51.694809  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:51.711023  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:51.714911  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:51.692199  1568 rpcz_store.cc:276] 0709 13:00:50.658074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.660986 (+  2912us) service_pool.cc:224] Handling call
0709 13:00:50.661265 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:50.661462 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:50.661484 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:50.661926 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:00:51.172174 (+510248us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:00:51.691349 (+519175us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:51.691394 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:51.691464 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:51.691511 (+    47us) raft_consensus.cc:1685] finished
0709 13:00:51.691526 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:51.691720 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2755968,"thread_start_us":1029044,"threads_started":1,"wal-append.queue_time_us":202111}
I20260709 13:00:51.491201  7151 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:51.730031  1565 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:00:52.002578  1713 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
W20260709 13:00:52.002728  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 319568us
I20260709 13:00:51.729331  1570 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:51.688750  7149 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:52.032382  1563 raft_consensus.cc:2410] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:00:51.899577  1721 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
W20260709 13:00:51.752677  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.766191  1537 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:52.058177  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 292131us
I20260709 13:00:52.061347  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3769) took 1416 ms. Trace:
I20260709 13:00:52.058297  2447 rpcz_store.cc:276] 0709 13:00:50.542239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.542440 (+   201us) service_pool.cc:224] Handling call
0709 13:00:50.543136 (+   696us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:50.546520 (+  3384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:50.546551 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:50.562891 (+ 16340us) log.cc:844] Serialized 564 byte log entry
0709 13:00:50.563108 (+   217us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:50.563160 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.563251 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:51.626045 (+1062794us) raft_consensus.cc:1685] finished
0709 13:00:51.626083 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:51.626240 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:51.894757  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 245519us
I20260709 13:00:52.065917  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:52.058602  1564 rpcz_store.cc:276] 0709 13:00:49.560100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.773696 (+213596us) service_pool.cc:224] Handling call
0709 13:00:50.271883 (+498187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:50.287872 (+ 15989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:51.372412 (+1084540us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b54002b5a54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:51.584044 (+211632us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54002b5a50. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:51.584212 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149111552}
I20260709 13:00:52.002938  1569 raft_consensus.cc:2376] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11. Re-sending same reply.
I20260709 13:00:51.211977  6993 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.062085  1571 rpcz_store.cc:276] 0709 13:00:50.644917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.645082 (+   165us) service_pool.cc:224] Handling call
0709 13:00:50.645680 (+   598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:50.646086 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:50.646118 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:50.647371 (+  1253us) log.cc:844] Serialized 564 byte log entry
0709 13:00:52.060932 (+1413561us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:52.060988 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.061077 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:52.061131 (+    54us) raft_consensus.cc:1685] finished
0709 13:00:52.061149 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.061285 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1412995,"threads_started":1,"wal-append.queue_time_us":175834,"wal-append.run_cpu_time_us":2946,"wal-append.run_wall_time_us":1095338}
I20260709 13:00:52.068643  1570 raft_consensus.cc:2393] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 11: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:52.070307  2448 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:00:52.033073  1716 rpcz_store.cc:269] 0709 13:00:49.719022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.719151 (+   129us) service_pool.cc:224] Handling call
0709 13:00:51.551531 (+1832380us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b540013c9d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:51.551673 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1684336384}
I20260709 13:00:52.067498  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:51.807941  7248 log.cc:927] Time spent T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 1.433s	user 0.000s	sys 0.005s
I20260709 13:00:52.074481  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:52.093504  7144 consensus_queue.cc:1059] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:51.730562  7210 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.867933  7204 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:51.944047  7234 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.095517  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:52.002199  6966 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:51.757728  6921 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:51.756233  7223 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:52.034016  7237 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:51.881574  7203 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:51.925051  7245 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:51.799764  7294 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:52.030915  7278 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:51.822216  7297 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:51.715663  7286 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.103008  1720 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:00:52.103929  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 363723us
I20260709 13:00:52.104125  1563 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 15: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 13:00:52.103312  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 325841us
I20260709 13:00:52.066015  7211 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:51.715786  6985 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.115455  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:51.756976  7043 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.127601  7043 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:51.731971  6775 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.127835  2443 raft_consensus.cc:2955] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 6 to 9, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:52.129623  6775 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:51.732857  7288 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.131557  7288 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.132705  1641 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:52.058501  7151 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.122107  7237 raft_consensus.cc:697] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:52.135087  7151 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.038262  7090 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.135013  7237 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.136991  7090 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.126040  1645 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:00:52.114770  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:52.132572  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:52.122540  1569 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:00:52.138645  1564 raft_consensus.cc:2410] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:00:51.733042  7262 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.139235  1641 raft_consensus.cc:1275] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:52.040307  6939 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.145170  1567 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:52.071213  6976 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.071044  7161 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.151409  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:52.152097  1641 raft_consensus.cc:2393] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:52.152639  1567 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:52.141778  1644 raft_consensus.cc:2955] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 6 to 9, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:52.103675  7246 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:00:52.162571  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:52.059355  1470 rpcz_store.cc:269] 0709 13:00:39.627895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.630700 (+  2805us) service_pool.cc:224] Handling call
0709 13:00:51.570804 (+11940104us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:45.940649 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:45.941205 (+   556us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:45.941241 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:00:45.941258 (+    17us) tablet.cc:662] Decoding operations
0709 13:00:45.942096 (+   838us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:45.942154 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:45.942181 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:00:45.942659 (+   478us) tablet.cc:701] Row locks acquired
0709 13:00:45.942677 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:00:45.942818 (+   141us) write_op.cc:270] Start()
0709 13:00:45.942914 (+    96us) write_op.cc:276] Timestamp: P: 1783602045942772 usec, L: 0
0709 13:00:45.942933 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:00:45.943520 (+   587us) log.cc:844] Serialized 2452 byte log entry
0709 13:00:46.175484 (+231964us) op_driver.cc:464] REPLICATION: finished
0709 13:00:46.548430 (+372946us) write_op.cc:301] APPLY: starting
0709 13:00:46.559966 (+ 11536us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:46.642841 (+ 82875us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:46.642945 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:46.706553 (+ 63608us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:46.716062 (+  9509us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:00:46.721525 (+  5463us) write_op.cc:312] APPLY: finished
0709 13:00:46.750301 (+ 28776us) log.cc:844] Serialized 65 byte log entry
0709 13:00:46.750510 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:46.750626 (+   116us) write_op.cc:454] Released schema lock
0709 13:00:46.750667 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:46.751043 (+   376us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:46.751075 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":622208,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":355367,"apply.run_cpu_time_us":11365,"apply.run_wall_time_us":211462,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29219,"num_ops":6,"prepare.queue_time_us":134385,"prepare.run_cpu_time_us":3154,"prepare.run_wall_time_us":4738,"replication_time_us":232375,"thread_start_us":167858,"threads_started":2}]]}
I20260709 13:00:52.168489  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:52.169274  1642 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 13:00:52.170401  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:52.174044  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:52.174789  1563 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:52.177983  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:52.180719  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:52.181443  1569 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:52.182310  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:52.105844  7210 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.123236  7298 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:52.146162  7288 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.148569  7043 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.206548  1567 raft_consensus.cc:1275] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:00:52.218544  1567 pending_rounds.cc:85] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 7
I20260709 13:00:52.218820  1567 pending_rounds.cc:107] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:00:52.219098  1567 raft_consensus.cc:2889] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.220604  1567 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:52.218303  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 147698us
I20260709 13:00:52.118446  7234 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.167017  1645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36692
I20260709 13:00:52.230046  1645 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:52.233296  1645 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:52.120759  6921 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.228228  1638 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:52.124385  7294 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:52.237360  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 166840us
I20260709 13:00:52.243870  1642 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:52.214301  7152 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:52.223959  7292 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:52.231304  7156 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:00:52.259369  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5600 after lost signal to thread 434
W20260709 13:00:52.263913  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003470c0 after lost signal to thread 1504
I20260709 13:00:52.259572  7308 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:52.261559  6976 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:52.138512  7245 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.227734  7263 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:52.142445  7297 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.277470  1566 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
W20260709 13:00:52.265460  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003b18a0 after lost signal to thread 1596
I20260709 13:00:52.238317  7144 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:52.287395  1537 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:52.241641  7299 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:51.865006  7067 raft_consensus.cc:2955] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 6 to 9, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:00:52.297847  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003e15a0 after lost signal to thread 1671
W20260709 13:00:52.303644  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003e1520 after lost signal to thread 1672
I20260709 13:00:52.283151  7152 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.185176  7159 consensus_queue.cc:237] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.230266  7288 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.230185  7043 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.202937  6966 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.307942  1537 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:52.310954  1611 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:52.336648  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad9a0 after lost signal to thread 1745
W20260709 13:00:52.337020  1593 debug-util.cc:398] Leaking SignalData structure 0x7b0800333be0 after lost signal to thread 1746
W20260709 13:00:52.338399  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce520 after lost signal to thread 2477
W20260709 13:00:52.338666  1593 debug-util.cc:398] Leaking SignalData structure 0x7b0800337960 after lost signal to thread 2478
W20260709 13:00:52.338951  1593 debug-util.cc:398] Leaking SignalData structure 0x7b080035ad80 after lost signal to thread 6721
W20260709 13:00:52.339926  1593 debug-util.cc:398] Leaking SignalData structure 0x7b080033ba40 after lost signal to thread 7205
W20260709 13:00:52.340564  1593 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6b40 after lost signal to thread 7244
I20260709 13:00:52.301441  7301 raft_consensus.cc:3055] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:52.355360  1645 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.301260  7090 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:00:52.215801  7278 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.381532  7278 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.384479   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:52.355783  7310 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:00:52.390425  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:52.390722  7262 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:52.367236  7294 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.366675  1645 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:52.298312  7308 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.371634  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:52.371842  7043 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:52.372650  6985 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.304358  7263 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.355034  7301 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:52.375612  6939 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:52.376525  7152 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:52.361395  6929 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.377218  6921 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.489087  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:52.377969  1570 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:52.378446  7297 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:52.379215  7234 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:52.358083  7296 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.380290  7210 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:52.355531  7321 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:52.344383  7203 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:52.287117  7156 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.333863  7298 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:52.410111  2447 raft_consensus.cc:2368] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16.
W20260709 13:00:52.473448  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 248437us
I20260709 13:00:52.478461  2437 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:00:52.501859  2437 pending_rounds.cc:85] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 12
I20260709 13:00:52.502136  2437 pending_rounds.cc:107] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:00:52.502379  2437 raft_consensus.cc:2889] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.303354  7307 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:00:52.361846  7260 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.305063  7144 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.488337  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:52.283456  7292 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.305704  7299 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.418921  7262 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:52.472930  7304 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.499567  1570 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:52.515837  1570 raft_consensus.cc:1275] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:52.517446  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:52.500080  1571 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:00:52.503625  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 250404us
I20260709 13:00:52.504388  1612 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:52.512385  1686 leader_election.cc:400] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16.
I20260709 13:00:52.518639  1686 leader_election.cc:403] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:00:52.519676  2406 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:52.501614  7103 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.535341  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:52.538610  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 227708us
I20260709 13:00:52.535575  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:52.541085  1719 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:52.504047  7286 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:52.493037  6929 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.511438  7264 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.521857  7219 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.580261  1571 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:52.506677  7203 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.590656  1646 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:00:52.586030  1570 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:00:52.586228  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 81974.2us
I20260709 13:00:52.593072  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:52.526044  7304 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.575425  6921 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:00:52.617487  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 98220us
I20260709 13:00:52.618670  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:52.599608  2405 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:52.600459  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 59702.5us
I20260709 13:00:52.526422  7262 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.584113  7234 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:52.626169  1611 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:52.583853  7161 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.502915  7321 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.535626  7103 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.632922  1612 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 13:00:52.614645  7314 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.139s	user 0.001s	sys 0.001s
I20260709 13:00:52.594398  7320 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.615070  7206 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:52.606478  7286 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.627135  7149 consensus_meta.cc:287] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 13:00:52.594851  7317 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:52.652997  7319 log.cc:927] Time spent T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:00:52.653086  7334 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:52.653252  7327 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:00:52.653893  7103 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:52.643460  7320 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.584303  7264 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.655074  7308 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.655614  7308 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:00:52.638233  7237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.016s	sys 0.010s
I20260709 13:00:52.656183  7246 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:52.656039  7308 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:52.656512  7237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.016s	sys 0.010s
I20260709 13:00:52.654925  7042 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:52.637215  6976 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:52.657946  7042 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.639272  7210 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:52.651141  7286 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.627736  6921 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.649277  1569 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:00:52.587525  7219 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.654299  7322 consensus_queue.cc:1048] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:52.654528  7103 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:52.651295  7307 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.660084  2442 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:00:52.681354  2442 pending_rounds.cc:85] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 10
I20260709 13:00:52.681679  2442 pending_rounds.cc:107] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:00:52.681950  2442 raft_consensus.cc:2889] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.595858  7241 consensus_queue.cc:1059] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:00:52.661733  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:52.638939  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 119191us
I20260709 13:00:52.636891  7288 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.671307  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 983) took 1207 ms. Trace:
I20260709 13:00:52.672251  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 2934) took 1202 ms. Trace:
I20260709 13:00:52.689042  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:52.690117  1565 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:00:52.688341  1572 rpcz_store.cc:276] 0709 13:00:51.464271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.858426 (+394155us) service_pool.cc:224] Handling call
0709 13:00:51.858878 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:51.880662 (+ 21784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:51.880728 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:51.881314 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.214790 (+333476us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:52.214849 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.214942 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:52.671043 (+456101us) raft_consensus.cc:1685] finished
0709 13:00:52.671071 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.671235 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3569,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":75661,"thread_start_us":184144,"threads_started":1,"wal-append.queue_time_us":682846}
I20260709 13:00:52.687752  2406 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:52.688525  1569 rpcz_store.cc:276] 0709 13:00:51.469556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.148826 (+679270us) service_pool.cc:224] Handling call
0709 13:00:52.671421 (+522595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:52.695062  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:52.664966  7321 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.654538  7316 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.691368  7307 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.703006  7316 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.658072  7203 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.669915  7219 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.663533  7245 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:52.704440  7307 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:52.659576  7206 raft_consensus.cc:697] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:52.704960  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:52.705155  7316 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.658366  6976 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.706334  7090 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:52.705824  7206 consensus_queue.cc:237] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:52.715986  1610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.019s	sys 0.011s
W20260709 13:00:52.716423  1610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.019s	sys 0.011s
I20260709 13:00:52.637554  7234 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.641924  7325 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:52.596035  7328 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:00:52.575060  7301 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:52.666626  7324 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 13:00:52.667351  7315 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:52.723853  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:52.724829  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:52.658023  7308 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.727005  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:52.763675  1565 raft_consensus.cc:3055] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:52.675586  7317 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.725751  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:52.726830  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 82618.2us
I20260709 13:00:52.768224  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:52.728065  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:52.770908  1644 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:52.728478  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:52.772598  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:52.731279  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:52.731417  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:52.668581  6921 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.664173  7286 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:52.732262  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:52.811322  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:52.710366  2406 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:52.668463  7263 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.660179  7042 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.819177  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:52.666296  6939 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.749401  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.707897  7210 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:52.773988  6985 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:52.826864  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:52.763659  1569 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:00:52.827530  1570 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
W20260709 13:00:52.764817  1685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.021s	sys 0.009s
I20260709 13:00:52.764868  1565 raft_consensus.cc:740] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:52.662359  7204 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:00:52.718416  7245 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:52.718570  6993 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:52.671229  7292 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.774405  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:52.725711  7219 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.795310  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:52.862699  1645 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 13:00:52.862841  1572 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 13:00:52.773212  1713 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:52.687399  7322 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:00:52.796458  1571 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:52.711524  7090 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.819010  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:52.819370  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 109106us
I20260709 13:00:52.867849  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:52.669607  7103 raft_consensus.cc:697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:52.875597  7090 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.832959  7304 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:52.675547  7161 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.828246  1685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.022s	sys 0.009s
W20260709 13:00:52.887581  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.815241  7310 consensus_queue.cc:1059] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:00:52.773736  7149 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:52.812000  7237 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.860158  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:52.863615  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:52.814394  7156 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:52.959203  7149 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.975656  1719 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:00:52.990870  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:52.991801  1720 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
I20260709 13:00:52.989481  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:52.953786  7144 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:52.874953  7333 log.cc:927] Time spent T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:00:52.877650  1642 raft_consensus.cc:2393] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 15: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:52.821609  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:52.880277  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.876163  7090 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.769968  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:52.773866  7317 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:52.890479  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:52.895324  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3782) took 1260 ms. Trace:
I20260709 13:00:52.893644  7299 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:53.008098  1568 rpcz_store.cc:276] 0709 13:00:51.634729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.386603 (+751874us) service_pool.cc:224] Handling call
0709 13:00:52.386853 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.387158 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.387182 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.420053 (+ 32871us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.602546 (+182493us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:52.602825 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.603098 (+   273us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:52.895024 (+291926us) raft_consensus.cc:1685] finished
0709 13:00:52.895055 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.895240 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4206,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":18159,"thread_start_us":95128,"threads_started":1,"wal-append.queue_time_us":239072}
I20260709 13:00:52.917006  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:52.979594  7152 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16.
I20260709 13:00:52.931596  7263 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:52.932092  7264 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:52.865314  7242 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:52.872932  1644 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:00:52.934535  2440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 1371) took 1281 ms. Trace:
I20260709 13:00:53.062091  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.061003  2440 rpcz_store.cc:276] 0709 13:00:51.653085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.057313 (+404228us) service_pool.cc:224] Handling call
0709 13:00:52.057631 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.070764 (+ 13133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.070804 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.090795 (+ 19991us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.248140 (+157345us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:52.248206 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.248307 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:52.934329 (+686022us) raft_consensus.cc:1685] finished
0709 13:00:52.934350 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.934479 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":813,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":21593,"thread_start_us":118878,"threads_started":1,"wal-append.queue_time_us":397414}
I20260709 13:00:52.934674  1638 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:52.934749  7230 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:52.897827  6966 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:52.935684  1685 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:52.936729  7234 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:52.857805  7245 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:52.937929  7320 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:52.833582  6939 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.941708  1565 consensus_queue.cc:260] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.885761  7219 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:52.899142  6899 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.943388  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:52.930226  7331 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:52.876174  7103 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:52.900394  7329 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:00:52.929529  7278 consensus_meta.cc:287] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.002s
I20260709 13:00:52.915424  7301 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:53.114324  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:52.951917  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.114959  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3779) took 1620 ms. Trace:
I20260709 13:00:53.115078  1641 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:00:53.116345  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.116444  1714 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:00:52.894163  7161 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:52.918598  7067 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.115355  1567 rpcz_store.cc:276] 0709 13:00:51.494810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.222729 (+727919us) service_pool.cc:224] Handling call
0709 13:00:52.223049 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.236023 (+ 12974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.236051 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.241281 (+  5230us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.516676 (+275395us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:52.516718 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.516795 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.114774 (+597979us) raft_consensus.cc:1685] finished
0709 13:00:53.114793 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.114909 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6664,"raft.queue_time_us":7605,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4683,"thread_start_us":222953,"threads_started":1,"wal-append.queue_time_us":421910}
I20260709 13:00:53.013322  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.013824  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.121665  1713 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:00:53.016180  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:53.017535  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38394 (request call id 986) took 1551 ms. Trace:
W20260709 13:00:53.053323  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3099) took 2246 ms (client timeout 2054 ms). Trace:
I20260709 13:00:53.122570  1715 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:53.122642  1612 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:53.055333  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 2990) took 1374 ms. Trace:
W20260709 13:00:53.056625  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.019111  2436 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:53.123589  1712 rpcz_store.cc:276] 0709 13:00:51.680794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.682813 (+  2019us) service_pool.cc:224] Handling call
0709 13:00:51.683090 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.199568 (+516478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.199611 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:52.199666 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:52.199719 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.052945 (+853226us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b54003aaf54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:53.055132 (+  2187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.055277 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1187242368}
I20260709 13:00:52.933758  7348 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:52.973312  7237 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.012343  6985 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:53.004832  7350 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:00:53.068552  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.122524  1566 rpcz_store.cc:276] 0709 13:00:51.466636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.466757 (+   121us) service_pool.cc:224] Handling call
0709 13:00:53.017313 (+1550556us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540031bfd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:53.017462 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565507328}
I20260709 13:00:53.069850  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:53.070559  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 134938us
I20260709 13:00:53.131536  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.133036  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.011037  7090 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:53.075481  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.105122  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.111541  6939 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:53.113209  7219 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:53.072139  7245 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.072985  7264 raft_consensus.cc:3055] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:52.997866  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.117244  1714 pending_rounds.cc:85] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 9
I20260709 13:00:53.137351  1714 pending_rounds.cc:107] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:00:53.137607  1714 raft_consensus.cc:2889] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:53.006894  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 237272us
I20260709 13:00:53.138186  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.119729  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.011468  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.139936  1720 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
W20260709 13:00:53.122882  1646 rpcz_store.cc:269] 0709 13:00:50.765461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.776746 (+ 11285us) service_pool.cc:224] Handling call
0709 13:00:53.011357 (+2234611us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b540033bdd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:53.011481 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4169420032}
I20260709 13:00:53.127555  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.134016  1638 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:00:53.135470  1644 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:00:53.078076  7242 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:53.074481  7342 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:53.077867  7331 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:53.139039  1536 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:53.129758  1639 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:53.143332  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:53.144620  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.145236  1643 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
W20260709 13:00:53.143985  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 275214us
I20260709 13:00:53.144805  1611 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:53.184652  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:53.186390  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:53.186681  1715 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:53.190608  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:53.192312  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 47568.5us
I20260709 13:00:53.191260  2448 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
W20260709 13:00:53.194190  1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.001s	sys 0.045s
W20260709 13:00:53.194818  1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.002s	sys 0.045s
I20260709 13:00:53.192126  1713 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 13:00:53.196316  1611 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:53.195046  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.197566  1643 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:53.197832  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.128759  6985 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:53.200165  1567 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:00:53.200958  1611 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:53.201646  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:53.201833  1611 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:53.202556  1567 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:53.137118  7264 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:53.142696  7206 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:53.198482  2440 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:53.114334  6899 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.226990  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.146551  7342 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:53.222786  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.228997  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:53.232589  1715 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:53.232808  1566 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:53.229151  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.230327  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:53.234534  1571 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:00:53.191462  7303 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:53.235563  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.188651  7361 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:53.192328  7010 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:53.190749  7298 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:53.126890  7067 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.239055  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:53.204612  7320 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.242317  7303 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.243292  1643 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:00:53.198607  7219 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:53.260594  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.247586  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.205034  7297 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:53.252756  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 119563us
I20260709 13:00:53.265945  1611 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:53.205580  6985 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.217648  7299 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:53.184602  7331 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:53.254830  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.257647  1612 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:53.218128  7322 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:53.258157  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 124423us
I20260709 13:00:53.271983  1715 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:00:53.263036  7219 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:53.263684  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.269549  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:53.272845  2405 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:53.242559  7357 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.238967  7342 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:53.243721  7206 raft_consensus.cc:697] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:53.250463  7010 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.274097  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:53.283636  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 80599us
I20260709 13:00:53.283768  1572 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:00:53.250329  7234 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:53.275373  7264 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.276503  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:53.280864  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.281190  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:53.284641  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:53.260530  7303 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:53.287451  1612 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:53.281963  1611 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:53.290376  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.271502  7299 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.301226  1611 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:53.301903  7327 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:53.302843  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:53.312000  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:53.303328  7338 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:53.274680  7320 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:53.297221  7042 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:53.282543  7219 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.320562  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.288667  7010 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:53.243475  7242 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.321430  1611 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:53.329221  1611 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:53.324805  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:53.270681  7297 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.331315  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:53.261580  7361 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.332818  7204 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:53.289740  7357 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.335498  7230 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:00:53.312875  7299 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:53.342607  2446 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:00:53.344841  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:53.349702  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.321108  7210 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:53.369228  1686 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:53.338820  7358 log.cc:927] Time spent T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:00:53.326032  7300 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:53.375938  1686 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 13:00:53.338002  7351 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:00:53.338456  7149 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:53.454241  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 171699us
I20260709 13:00:53.338562  6921 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:53.434691  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 150149us
I20260709 13:00:53.338827  7090 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:53.455709  1685 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:53.340313  7204 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:53.340534  6966 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:53.463313  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.338397  7161 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:53.459127  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 83306.8us
I20260709 13:00:53.335726  7346 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:53.464991  2405 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:53.462244  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.337904  7322 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:53.463949  1643 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:00:53.360337  7327 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:53.465240  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 136137us
I20260709 13:00:53.394155  7230 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:53.460250  6921 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:53.461629  7278 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:53.484369  7278 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:53.484689  7367 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:53.484788  7278 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:53.485347  7367 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.487548  7367 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:53.343878  7323 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.119s
I20260709 13:00:53.344405  7144 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:00:53.498809  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.499095  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.344652  7365 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:53.394500  7300 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:53.337400  7363 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:53.343493  7356 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
I20260709 13:00:53.474555  7362 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:53.471321  6966 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.478633  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:53.344975  7292 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.119s
I20260709 13:00:53.463970  7204 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:53.483757  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:53.542894  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 1335) took 1377 ms. Trace:
I20260709 13:00:53.495772  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.485812  6929 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:53.543464  1640 rpcz_store.cc:276] 0709 13:00:52.152679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.204659 (+ 51980us) service_pool.cc:224] Handling call
0709 13:00:52.230947 (+ 26288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.284963 (+ 54016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.285092 (+   129us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.295953 (+ 10861us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.719453 (+423500us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:52.719518 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.719661 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.530349 (+810688us) raft_consensus.cc:1685] finished
0709 13:00:53.530368 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.530504 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68995,"raft.queue_time_us":251776,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":12644,"thread_start_us":466378,"threads_started":2,"wal-append.queue_time_us":814010}
I20260709 13:00:53.545967  6929 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:53.468477  7346 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.546389  6929 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.546672  7346 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:53.470283  7237 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:53.469585  7103 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:53.547622  7361 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:53.547451  7103 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.549597  7103 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:53.550714  1643 raft_consensus.cc:2368] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16.
I20260709 13:00:53.374096  7210 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.471925  7322 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:53.495711  7317 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:53.489449  6921 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:53.540186  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:53.540870  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 62278.7us
I20260709 13:00:53.465438  7260 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:53.546790  6929 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:53.398021  7288 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:53.489616  7230 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:53.508448  7300 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:53.591029  7371 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:00:53.593607  7297 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:53.459589  7206 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.528327  7365 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:53.509361  7342 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.576501  1716 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:53.604113  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:53.604792  1716 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.606153  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.606909  2438 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 13:00:53.508354  7327 raft_consensus.cc:697] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:53.582719  1566 raft_consensus.cc:2955] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 6 to 9, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:53.588286  7317 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:53.572554  7322 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:53.572382  7361 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:53.590147  7230 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:53.596359  1685 leader_election.cc:400] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16.
I20260709 13:00:53.601394  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.549714  6985 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:53.562633  7245 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:53.611171  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.589932  1641 raft_consensus.cc:2393] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 13: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:53.562896  7210 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:53.625801  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 155216us
I20260709 13:00:53.639163  1537 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:53.603000  7365 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:53.616276  7067 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:53.641178  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:53.644088  2405 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 13:00:53.646674  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.651152  1537 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:53.652550  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.655901  2444 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:53.668851  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.631850  6985 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:53.674363  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.674928  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.675478  7377 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:53.652765  7241 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:53.665887  7338 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:53.652727  7308 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:53.678750  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.673799  2437 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:53.679904  2446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 812) took 2078 ms. Trace:
I20260709 13:00:53.687915  1716 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:00:53.649252  7298 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:53.688040  2446 rpcz_store.cc:276] 0709 13:00:51.601092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.619540 (+ 18448us) service_pool.cc:224] Handling call
0709 13:00:51.619867 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.363386 (+1743519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.679678 (+316292us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400631d54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:53.679849 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3961098112}
I20260709 13:00:53.622722  7361 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.697403  2442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 1365) took 2061 ms. Trace:
I20260709 13:00:53.639165  7317 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:00:53.708559  2442 rpcz_store.cc:276] 0709 13:00:51.636363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.638962 (+  2599us) service_pool.cc:224] Handling call
0709 13:00:51.639341 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.682396 (+1043055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.697137 (+1014741us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400453dd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:53.697334 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2346633088}
I20260709 13:00:53.748642  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:53.749881  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 82918us
I20260709 13:00:53.687134  7241 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.752530  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.758839  2444 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:53.681603  7377 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.753840  1537 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:53.756994  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.707991  7327 consensus_queue.cc:237] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:53.653668  7278 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:53.762846  1537 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:53.763017  6985 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:53.708796  7042 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:53.775139  7352 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.772677  7373 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:53.761566  7241 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:53.775665  7374 consensus_queue.cc:1059] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:00:53.761183  7298 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 13:00:53.775908  7379 log.cc:927] Time spent T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:00:53.770004  7380 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:00:53.793737  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3775) took 2300 ms. Trace:
I20260709 13:00:53.762212  7377 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:53.800150  1563 rpcz_store.cc:276] 0709 13:00:51.493754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.207818 (+714064us) service_pool.cc:224] Handling call
0709 13:00:53.018089 (+810271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.018351 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.059150 (+ 40799us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:53.059259 (+   109us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:53.059334 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.059467 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.793583 (+734116us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b540031bfd0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:53.793684 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1809037696}
I20260709 13:00:53.696671  7338 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.785435  7362 raft_consensus.cc:697] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:53.710340  7308 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.793321  7042 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.800223  7357 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:53.832845  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 74611.9us
I20260709 13:00:53.792059  6985 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.815490  7103 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:53.818694  7342 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:53.822880  7306 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:53.784611  7352 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.794299  7346 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.878170  1721 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:53.838320  7303 consensus_meta.cc:287] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
I20260709 13:00:53.836750  7317 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.884881  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.796195  7373 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:53.902593  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.806293  7298 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.834364  6929 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:53.890375  7329 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:00:53.887267  7338 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:53.885655  7245 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:53.843567  7365 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.901839  7368 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:53.952561  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.951224  1715 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:53.956802  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.904486  7303 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.959676  1714 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60082 (request call id 3797) took 2317 ms. Trace:
I20260709 13:00:53.960650  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.959806  7326 raft_consensus.cc:3055] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:53.960436  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:53.960429  1714 rpcz_store.cc:276] 0709 13:00:51.642228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.642345 (+   117us) service_pool.cc:224] Handling call
0709 13:00:51.642601 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.138103 (+1495502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.950711 (+812608us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400301954. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:53.959555 (+  8844us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3385161600}
I20260709 13:00:53.964107  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.965353  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:53.966244  1647 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 15: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 13:00:53.978183  7383 log.cc:927] Time spent T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:00:53.969324  7368 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.980400  7368 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:53.906157  7394 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:53.981699  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.928453  6966 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:53.990226  2446 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:00:53.879643  7103 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.995877  2440 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 14: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:53.995325  7326 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:53.886699  7306 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:53.922883  7242 consensus_queue.cc:1059] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:00:53.915635  7317 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:54.018359  7331 consensus_meta.cc:287] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.002s
I20260709 13:00:53.977696  7230 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:54.032246  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:54.036320  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:53.928089  6921 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.017446  7278 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:54.041708  1642 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 17.
I20260709 13:00:53.920113  7362 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.080204  7352 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.081456  7103 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:54.081957  6976 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.082854  7308 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:54.085436  7010 consensus_meta.cc:287] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.752s	user 0.010s	sys 0.000s
W20260709 13:00:54.064185  7385 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.271s	user 0.002s	sys 0.000s
I20260709 13:00:54.093622  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:54.089919  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:54.040151  7331 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:54.087069  7400 log.cc:927] Time spent T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:00:54.065066  7326 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.140906  7389 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:54.141566  7312 raft_consensus.cc:3055] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:54.031133  7394 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.076898  7262 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.090624  7103 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:54.086035  7010 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:54.153849  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:54.155427  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:54.157116  7264 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:54.162352  2442 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:54.170280  7361 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:54.174216  2448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 824) took 1194 ms. Trace:
I20260709 13:00:54.334311  2448 rpcz_store.cc:276] 0709 13:00:52.980261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.989167 (+  8906us) service_pool.cc:224] Handling call
0709 13:00:54.173999 (+1184832us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54005901d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:54.174123 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450241792}
I20260709 13:00:54.176117  7149 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.176925  7373 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:54.181362  6929 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.324530  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:54.322831  7310 raft_consensus.cc:3055] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:54.187027  7090 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.225850  7312 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:54.233078  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:54.383661  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:54.132019  6985 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.324100  1645 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
W20260709 13:00:54.329864  7359 log.cc:927] Time spent T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 1.083s	user 0.003s	sys 0.000s
I20260709 13:00:54.089208  7298 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.336648  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:54.338850  1568 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:54.378955  7149 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:54.333750  7300 consensus_meta.cc:287] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.743s	user 0.011s	sys 0.010s
I20260709 13:00:54.332816  7296 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:54.393546  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:54.325534  7338 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:54.426604  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:54.335142  7326 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:54.396600  7042 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.339561  7361 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:54.333060  7103 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.378212  7394 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:54.391113  7090 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.428948  7300 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.439553  7338 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.445298  6921 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.446307  7010 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:54.448133  7219 consensus_meta.cc:287] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 1.087s	user 0.007s	sys 0.007s
I20260709 13:00:54.449241  2446 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:00:54.395929  6993 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:54.383186  7310 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:54.523142  2448 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 7.
W20260709 13:00:54.456182  7322 consensus_meta.cc:287] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.834s	user 0.008s	sys 0.002s
I20260709 13:00:54.449859  7317 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.452185  7306 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.478776  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:54.429067  7298 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.509987  1537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:39297 timed out after 2.142s (SENT) [suppressed 8 similar messages]
I20260709 13:00:54.514356  7042 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:54.515950  7308 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:54.458549  7367 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:54.518004  7204 consensus_meta.cc:287] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.955s	user 0.013s	sys 0.000s
I20260709 13:00:54.481242  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:54.526474  1646 raft_consensus.cc:2410] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:54.511999  7303 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.457191  7230 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:54.527411  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 1548) took 1755 ms. Trace:
I20260709 13:00:54.337872  7389 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:54.531621  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3119) took 1305 ms. Trace:
I20260709 13:00:54.518937  7312 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:54.528113  7377 consensus_meta.cc:287] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.710s	user 0.011s	sys 0.002s
I20260709 13:00:54.539410  1647 rpcz_store.cc:276] 0709 13:00:53.225874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.477709 (+1251835us) service_pool.cc:224] Handling call
0709 13:00:54.531547 (+ 53838us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.536201  1718 rpcz_store.cc:276] 0709 13:00:52.771776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.771885 (+   109us) service_pool.cc:224] Handling call
0709 13:00:52.772264 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.772570 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.772599 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.796012 (+ 23413us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.926985 (+130973us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b4800061158. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d21c1aa1 00007f18d21b8b37 00007f18d21b89ca 00007f18d22b026f 00007f18d22aff37 00007f18d22c455c 00007f18d22c4508 00007f18d22c4488 00007f18d22c4443 00007f18d22c36ec 00007f18d11eda96
0709 13:00:53.115602 (+188617us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:53.117097 (+  1495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.117172 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.324158 (+1206986us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:00:54.527192 (+203034us) raft_consensus.cc:1685] finished
0709 13:00:54.527213 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.527352 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48533,"raft.run_cpu_time_us":1264,"raft.run_wall_time_us":95640,"spinlock_wait_cycles":62727296,"thread_start_us":242129,"threads_started":1,"wal-append.queue_time_us":315394}
I20260709 13:00:54.530210  7331 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.478812  7361 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.543529  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:54.546458  1647 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:54.546859  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3117) took 1321 ms. Trace:
I20260709 13:00:54.547127  1647 rpcz_store.cc:276] 0709 13:00:53.225352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.543329 (+1317977us) service_pool.cc:224] Handling call
0709 13:00:54.546816 (+  3487us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.547936  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:54.548390  1647 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 13:00:54.524701  6993 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:54.536919  7299 consensus_meta.cc:287] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 1.163s	user 0.013s	sys 0.000s
I20260709 13:00:54.523052  7219 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.556012  7338 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.554208  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:54.562318  1647 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:00:54.563292  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3126) took 1065 ms. Trace:
I20260709 13:00:54.533730  7042 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:54.527455  7322 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.550916  7312 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:54.533741  7298 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:54.568447  1538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.014s	sys 0.035s
I20260709 13:00:54.565866  2437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 817) took 1797 ms. Trace:
W20260709 13:00:54.586421  1538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.014s	sys 0.035s
I20260709 13:00:54.564666  1647 rpcz_store.cc:276] 0709 13:00:53.497610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.553937 (+1056327us) service_pool.cc:224] Handling call
0709 13:00:54.563201 (+  9264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.535318  7204 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.573956  7149 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:54.559619  7210 consensus_meta.cc:287] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.907s	user 0.014s	sys 0.000s
I20260709 13:00:54.574779  6993 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:54.574903  7368 consensus_meta.cc:287] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.002s
I20260709 13:00:54.576370  7219 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.576617  6899 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:54.574792  7042 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:54.553443  7299 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:54.603374  7299 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:54.583729  2436 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 825) took 1452 ms (client timeout 1771 ms). Trace:
W20260709 13:00:54.603951  2436 rpcz_store.cc:269] 0709 13:00:53.131173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.131314 (+   141us) service_pool.cc:224] Handling call
0709 13:00:54.583537 (+1452223us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b5400899ed4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:54.583664 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1723151104}
I20260709 13:00:54.586591  2437 rpcz_store.cc:276] 0709 13:00:52.768135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.770661 (+  2526us) service_pool.cc:224] Handling call
0709 13:00:52.813038 (+ 42377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.687676 (+874638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.565629 (+877953us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b54008b3154. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:54.565807 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1969793920}
W20260709 13:00:54.568595  7241 consensus_meta.cc:287] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.759s	user 0.005s	sys 0.006s
I20260709 13:00:54.608450  7241 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.610213  6993 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.610865  6993 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:54.611231  7241 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:54.613099  7298 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.613288  6993 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:54.574982  7103 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:54.600345  1639 raft_consensus.cc:2393] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 10: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:54.601554  1716 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:54.594187  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:54.544456  7377 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.616608  1647 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:54.593528  7303 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:54.619632  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:54.618908  2405 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:54.549795  7310 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.623600  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3110) took 1402 ms. Trace:
I20260709 13:00:54.626587  1647 rpcz_store.cc:276] 0709 13:00:53.221006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.618149 (+1397143us) service_pool.cc:224] Handling call
0709 13:00:54.623540 (+  5391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.627724  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:54.632119  7409 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.632694  7409 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:54.634045  2443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 1311) took 1125 ms. Trace:
I20260709 13:00:54.634575  2443 rpcz_store.cc:276] 0709 13:00:53.510295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.530507 (+ 20212us) service_pool.cc:224] Handling call
0709 13:00:53.530841 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.564256 (+ 33415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.564305 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:53.564363 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:53.564406 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.633764 (+1069358us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b54008c5fd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:54.633815 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.633977 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76168576}
I20260709 13:00:54.635519  7409 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:54.637981  6966 raft_consensus.cc:3055] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:54.638396  6966 raft_consensus.cc:740] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:54.639153  6966 consensus_queue.cc:260] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.622520  7303 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.597450  7210 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.625201  7103 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:54.644037  1647 raft_consensus.cc:2393] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 13:00:54.644953  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 135012us
I20260709 13:00:54.640268  6966 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:54.600469  7368 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.650233  1638 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 16: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:54.647149  7300 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.654318  7090 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.645660  7103 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:54.656049  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:54.657302  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:54.657956  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:54.658560  1647 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:54.662099  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38584 (request call id 1352) took 1406 ms. Trace:
I20260709 13:00:54.665140  7389 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:54.662621  1642 rpcz_store.cc:276] 0709 13:00:53.255391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.016508 (+761117us) service_pool.cc:224] Handling call
0709 13:00:54.661879 (+645371us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b54002c47d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:54.662006 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8053120}
I20260709 13:00:54.668327  7322 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.675738  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3121) took 1438 ms. Trace:
I20260709 13:00:54.676215  1639 rpcz_store.cc:276] 0709 13:00:53.237549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.480896 (+1243347us) service_pool.cc:224] Handling call
0709 13:00:54.675498 (+194602us) spinlock_profiling.cc:243] Waited 65.7 ms on lock 0x7b54002413d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:54.675673 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150997376}
I20260709 13:00:54.659152  7103 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:54.681756  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3128) took 1043 ms. Trace:
I20260709 13:00:54.682418  1640 rpcz_store.cc:276] 0709 13:00:53.638433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.680886 (+1042453us) service_pool.cc:224] Handling call
0709 13:00:54.681227 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.681415 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.681449 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:54.681496 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:54.681545 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.681606 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.681705 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.678016  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3125) took 1180 ms. Trace:
I20260709 13:00:54.684935  1639 rpcz_store.cc:276] 0709 13:00:53.497329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.677103 (+1179774us) service_pool.cc:224] Handling call
0709 13:00:54.677484 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.677673 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.677702 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:54.677746 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:54.677797 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.677854 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.677961 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.679452  7361 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:54.681326  7368 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.724246  1639 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:00:54.736018  1639 raft_consensus.cc:1240] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:54.727356  7377 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:54.768524  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3123) took 1433 ms. Trace:
I20260709 13:00:54.769147  1647 rpcz_store.cc:276] 0709 13:00:53.335094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.660269 (+1325175us) service_pool.cc:224] Handling call
0709 13:00:54.660640 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.660968 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.661003 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.668072 (+  7069us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.722066 (+ 53994us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:54.722123 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.722218 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.768217 (+ 45999us) raft_consensus.cc:1685] finished
0709 13:00:54.768247 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.768441 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":234,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":53500,"threads_started":1,"wal-append.queue_time_us":64107}
I20260709 13:00:54.771924  1647 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:00:54.775142  1647 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:54.777885  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.778558  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.753641  7368 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:54.782430  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:54.783728  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:54.774140  7210 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.783929  1647 raft_consensus.cc:1240] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:54.786666  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:54.788250  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:54.907892  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 1552) took 1263 ms. Trace:
I20260709 13:00:54.907039  2437 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
I20260709 13:00:54.908528  1715 rpcz_store.cc:276] 0709 13:00:53.644791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.653590 (+  8799us) service_pool.cc:224] Handling call
0709 13:00:53.653883 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.955664 (+301781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.859690 (+904026us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400302354. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:54.907834 (+ 48144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683350912}
I20260709 13:00:54.919900  1611 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:54.791455  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:54.798882  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:54.926327  2436 raft_consensus.cc:2393] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 15: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:54.787631  7346 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.834539  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 13:00:54.838371  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.927838  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.843225  1645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3115) took 1618 ms (client timeout 1678 ms). Trace:
I20260709 13:00:54.844722  2405 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:54.929731  1638 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38584 (request call id 1354) took 1236 ms (client timeout 1603 ms). Trace:
W20260709 13:00:54.930277  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 85605.8us
I20260709 13:00:54.847007  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:54.850980  7204 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:54.852288  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3116) took 1627 ms (client timeout 2060 ms). Trace:
I20260709 13:00:54.906093  7230 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:54.944816  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54412 (request call id 1556) took 1252 ms. Trace:
I20260709 13:00:54.945218  1716 rpcz_store.cc:276] 0709 13:00:53.692837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.699407 (+  6570us) service_pool.cc:224] Handling call
0709 13:00:54.944666 (+1245259us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b540022e7d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:54.944754 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932436224}
I20260709 13:00:54.946558  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:54.947129  2448 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:54.947669  1572 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:00:54.948359  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:54.784417  7368 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:54.906041  1641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 3907) took 2133 ms (client timeout 2085 ms). Trace:
I20260709 13:00:54.921509  7300 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.932982  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:54.910703  6929 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:54.928797  7042 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:54.787915  7263 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.930361  1638 rpcz_store.cc:269] 0709 13:00:53.692981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.153479 (+460498us) service_pool.cc:224] Handling call
0709 13:00:54.929437 (+775958us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54001e0354. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:54.929613 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732869504}
W20260709 13:00:54.939064  1646 rpcz_store.cc:269] 0709 13:00:53.225060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.155180 (+930120us) service_pool.cc:224] Handling call
0709 13:00:54.852008 (+696828us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400218754. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:54.852208 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448724864}
I20260709 13:00:54.941543  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3124) took 1445 ms. Trace:
I20260709 13:00:54.980607  1642 rpcz_store.cc:276] 0709 13:00:53.496565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.666683 (+1170118us) service_pool.cc:224] Handling call
0709 13:00:54.682481 (+ 15798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.682683 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:54.726741 (+ 44058us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.941124 (+214383us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:54.941199 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:54.941264 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.941340 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.941476 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1282,"prepare.queue_time_us":77135,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":53,"raft.queue_time_us":102,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10742,"thread_start_us":253818,"threads_started":2}
W20260709 13:00:54.929075  1645 rpcz_store.cc:269] 0709 13:00:53.224776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.495498 (+270722us) service_pool.cc:224] Handling call
0709 13:00:54.843065 (+1347567us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b540019ffd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:54.843170 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534103936}
I20260709 13:00:54.843212  7103 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.798398  7264 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:54.860595  7303 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.950544  1640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 1355) took 1255 ms. Trace:
I20260709 13:00:54.950977  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:54.906216  7322 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:54.958657  1643 raft_consensus.cc:1240] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:54.965154  2437 raft_consensus.cc:2368] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
I20260709 13:00:54.967397  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:54.964633  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 3011) took 1699 ms. Trace:
W20260709 13:00:54.960500  1641 rpcz_store.cc:269] 0709 13:00:52.772984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.116126 (+343142us) service_pool.cc:224] Handling call
0709 13:00:54.864846 (+1748720us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b540035c854. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:54.905948 (+ 41102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1086941440}
I20260709 13:00:54.984403  1640 rpcz_store.cc:276] 0709 13:00:53.694872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.683434 (+988562us) service_pool.cc:224] Handling call
0709 13:00:54.687766 (+  4332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.688039 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:54.779826 (+ 91787us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.950212 (+170386us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:54.950271 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:54.950322 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.950382 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.950491 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72051,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":31,"raft.queue_time_us":175,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":14701,"thread_start_us":246475,"threads_started":2}
I20260709 13:00:55.025076  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:55.025068  1570 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:55.026036  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:55.026624  1572 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:55.024055  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:54.987782  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:54.943936  7312 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:54.950513  7386 consensus_queue.cc:1059] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:00:54.965248  7230 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:54.979187  6929 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.063563  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:55.067471  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 13:00:55.046972  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.055601  1566 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:00:54.987792  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:54.964694  7347 consensus_queue.cc:1059] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
W20260709 13:00:55.080291  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.035470  7264 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.092394  7368 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:54.977555  6966 consensus_queue.cc:1059] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.114s
I20260709 13:00:55.093290  7264 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.081180  7312 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:55.035645  7303 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:54.987498  7263 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.093858  7264 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:55.095081  7264 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.035066  7322 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.097079  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:55.097781  7322 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.099009  7303 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.093930  7312 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:55.100034  7090 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:55.100591  7090 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.101218  7303 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.101552  7365 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:55.082166  7161 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.102277  7264 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.102869  7264 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:55.103353  7264 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.105118  7264 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.099309  7263 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.093431  7230 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.108973  2448 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
I20260709 13:00:55.114617  7103 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:00:55.115823  7419 log.cc:927] Time spent T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:00:55.115522  7161 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.117143  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3122) took 1870 ms. Trace:
I20260709 13:00:55.117517  1644 rpcz_store.cc:276] 0709 13:00:53.248470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.658121 (+1409651us) service_pool.cc:224] Handling call
0709 13:00:54.658417 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.658746 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.658778 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.663107 (+  4329us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.785119 (+122012us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:54.785175 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.785278 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.116928 (+331650us) raft_consensus.cc:1685] finished
0709 13:00:55.116950 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.117085 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3496,"thread_start_us":93478,"threads_started":1,"wal-append.queue_time_us":252291}
I20260709 13:00:55.118582  1537 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:55.120306  7409 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:55.120800  7409 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:55.121227  7409 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.034493  1712 rpcz_store.cc:276] 0709 13:00:53.264839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.265284 (+   445us) service_pool.cc:224] Handling call
0709 13:00:53.265632 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.280345 (+ 14713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.280386 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.280840 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.332091 (+ 51251us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:53.333111 (+  1020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.938693 (+1605582us) spinlock_profiling.cc:243] Waited 8.44 ms on lock 0x7b5400017a54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:54.938742 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.938784 (+    42us) raft_consensus.cc:1685] finished
0709 13:00:54.938798 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.964567 (+ 25769us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23104,"raft.queue_time_us":5611,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":19659,"spinlock_wait_cycles":19417344,"thread_start_us":23809,"threads_started":1,"wal-append.queue_time_us":153686,"wal-append.run_cpu_time_us":2439,"wal-append.run_wall_time_us":1130055}
I20260709 13:00:55.123980  7298 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.124768  1565 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.124617  7298 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.126008  7312 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.127264  7298 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.128130  7312 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:55.129518  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 1360) took 1248 ms. Trace:
I20260709 13:00:55.129995  7090 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.130012  1639 rpcz_store.cc:276] 0709 13:00:53.880833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.756901 (+876068us) service_pool.cc:224] Handling call
0709 13:00:54.854193 (+ 97292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.854484 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:54.854907 (+   423us) log.cc:844] Serialized 14 byte log entry
0709 13:00:55.050619 (+195712us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:55.050694 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:55.050761 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.050846 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.129301 (+ 78455us) spinlock_profiling.cc:243] Waited 96.9 ms on lock 0x7b5400218750. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:55.129447 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68709,"prepare.queue_time_us":920,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":66,"raft.queue_time_us":64035,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":9792,"spinlock_wait_cycles":234209920,"thread_start_us":131174,"threads_started":1,"wal-append.queue_time_us":218028}
I20260709 13:00:55.135757  1685 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:55.141027  1572 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
W20260709 13:00:55.142169  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 221623us
I20260709 13:00:55.050387  7211 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:55.143965  1570 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:00:55.037050  7042 raft_consensus.cc:697] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:55.155733  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:55.156980  1612 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:55.158476  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:55.159498  2444 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 10: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:55.165691  1638 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:54.978883  7300 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:55.141927  7230 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:55.146402  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:55.042011  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:55.041601  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:55.175272  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 133738us
I20260709 13:00:55.148324  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:55.179080  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:55.179647  1646 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.150861  1565 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:55.082674  7346 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:55.151612  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:55.183461  1641 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:55.145643  1685 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:55.170907  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:55.172653  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:55.152099  7211 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.176194  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 13:00:55.188685  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 152228us
I20260709 13:00:55.189383  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.190213  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.150547  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 13:00:55.190829  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 45231.7us
I20260709 13:00:55.191224  1644 raft_consensus.cc:2368] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14.
I20260709 13:00:55.181023  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:55.191515  1685 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:55.191872  2444 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 13: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:55.152992  7210 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.197532  7210 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.199769  7210 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.200150  7427 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:55.200618  7427 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:55.200978  7427 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:55.201376  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:55.202189  7161 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.202608  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:55.203154  7300 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:55.203491  7286 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:55.203697  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:55.203949  7286 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.204340  7211 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.204406  7286 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:55.204784  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:55.207406  1642 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:55.209558  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.210350  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:55.205847  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:55.186314  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:55.187288  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:55.213922  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 13:00:55.187415  1565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46634 (request call id 2941) took 2465 ms (client timeout 1995 ms). Trace:
I20260709 13:00:55.213054  1646 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:55.187569  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:55.214655  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:55.215133  2436 raft_consensus.cc:2410] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:00:55.215155  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:55.190241  1712 raft_consensus.cc:2410] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:00:55.216507  1645 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 15: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:55.183066  7322 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:55.163744  7320 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:55.194633  7042 consensus_queue.cc:237] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:55.196229  7263 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:55.196867  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.179524  2446 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:00:55.207989  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:55.201983  2444 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:55.213778  1641 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:00:55.193012  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:55.217249  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:55.217335  1536 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:55.251545  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:55.214686  1565 rpcz_store.cc:269] 0709 13:00:52.714462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.724536 (+ 10074us) service_pool.cc:224] Handling call
0709 13:00:52.941388 (+216852us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b54003a28a0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd21606f 00007f18cd28ef60 00007f18cd2907de 00007f18cd29c27c 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2
0709 13:00:54.486500 (+1545112us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b18001155c0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2d3646 00007f18cd20d58e 00007f18cd28ef9e 00007f18cd2907de 00007f18cd29c27c 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c
0709 13:00:55.124475 (+637975us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b58006029d0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd1f40aa 00007f18cd276447 00007f18cd28efe7 00007f18cd2907de 00007f18cd29c27c 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c
0709 13:00:55.180111 (+ 55636us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3292018688}
W20260709 13:00:55.270792  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.269713  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:55.272286  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.273310  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:55.224439  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:55.269441  2437 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 14: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:55.275002  1715 raft_consensus.cc:2393] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 13: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:55.218477  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:55.276435  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 84976.4us
I20260709 13:00:55.189924  7307 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:55.276813  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.183256  7393 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.277622  1638 raft_consensus.cc:2410] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:00:55.203980  7361 raft_consensus.cc:3055] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:55.286345  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 13:00:55.282168  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 74908.7us
W20260709 13:00:55.288069  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 80122.4us
I20260709 13:00:55.281582  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.283432  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.290007  1718 raft_consensus.cc:2410] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:00:55.290254  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.290997  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.294687  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:55.297909  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:55.298051  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 80788.3us
I20260709 13:00:55.302554  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.303416  1536 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:55.303503  1721 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:55.302204  1612 leader_election.cc:400] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
I20260709 13:00:55.304433  1612 leader_election.cc:403] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:00:55.304665  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:55.306294  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:55.307596  1714 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:55.307762  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.308983  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:55.309765  2446 raft_consensus.cc:2393] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:55.221517  7322 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.224902  7320 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.221191  7403 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:55.313302  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:55.206504  7346 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.318121  2446 raft_consensus.cc:2410] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:00:55.271099  7230 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:55.319321  1719 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:00:55.320009  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:55.213353  7331 consensus_queue.cc:1059] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:00:55.320710  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:55.286084  7361 raft_consensus.cc:740] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:55.304358  7210 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:55.325834  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.223698  7090 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:00:55.327059  1645 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:55.321004  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.335328  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:55.335767  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:55.341445  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:55.341614  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:55.348909  7409 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.352293  7426 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:55.316608  7322 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:55.357034  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:55.330363  1712 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:55.320176  7320 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:55.359361  7294 consensus_queue.cc:1059] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:55.360585  7294 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:55.361189  7294 raft_consensus.cc:3055] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:55.361519  7294 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:55.362147  1714 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:55.336882  7366 consensus_queue.cc:1059] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:00:55.313833  7389 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:55.313719  7298 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:55.285108  7393 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:55.317519  7368 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:55.282967  7263 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:55.328832  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.381366  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:55.431255  2446 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:55.388051  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:55.432904  2438 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 16: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:00:55.413436  7296 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:55.324954  7307 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:55.340159  7210 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.349526  7427 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:55.313925  6976 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10.
I20260709 13:00:55.324003  7241 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:55.428527  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.429438  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.321630  7347 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 13:00:55.440412  1718 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:55.438649  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:55.441769  1717 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.450615  1721 raft_consensus.cc:2393] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:55.369568  7389 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:55.437880  7296 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:55.454075  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:55.452425  1611 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:55.526796  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 74478.3us
I20260709 13:00:55.528265  1611 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:55.530347  7300 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:55.531127  7300 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:55.531878  7300 consensus_queue.cc:1059] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:55.533921  1718 raft_consensus.cc:2410] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:00:55.470572  1716 raft_consensus.cc:2410] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:00:55.439903  7210 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:55.475135  1641 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 10: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:55.438275  7307 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:55.439679  7294 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.539037  7307 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:55.539400  7294 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:55.459657  7389 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:55.421743  7298 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:55.548062  7298 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:55.464155  6929 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.453409  7241 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.462229  1720 raft_consensus.cc:2468] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:00:55.552165  7241 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:55.574014  1714 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
W20260709 13:00:55.613289  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.617353  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 1370) took 1099 ms. Trace:
I20260709 13:00:55.617655  7210 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.617923  1647 rpcz_store.cc:276] 0709 13:00:54.517563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.920911 (+403348us) service_pool.cc:224] Handling call
0709 13:00:54.921190 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.096236 (+175046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.096283 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:55.096330 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:55.096366 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.617050 (+520684us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54002c4cd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:55.617114 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.617282 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":402154752}
I20260709 13:00:55.619732  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:55.620501  7210 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.621263  7210 raft_consensus.cc:3055] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:55.569725  1645 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:00:55.525858  7310 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:55.591872  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:55.621724  7210 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:55.579986  2446 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:00:55.638535  1647 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:00:55.459317  7361 consensus_queue.cc:260] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.639882  1642 raft_consensus.cc:2368] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 18.
W20260709 13:00:55.762694  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 405701us
W20260709 13:00:55.768021  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 318578us
I20260709 13:00:55.780776  1536 leader_election.cc:400] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14.
I20260709 13:00:55.781174  1536 leader_election.cc:403] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:00:55.782492  1536 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:55.783399  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 497972us
W20260709 13:00:55.784498  2406 leader_election.cc:336] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.693s (SENT)
I20260709 13:00:55.784943  2406 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 13:00:55.844663  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 62251.8us
W20260709 13:00:55.845584  1715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.025s	sys 0.052s
W20260709 13:00:55.845996  1715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.025s	sys 0.052s
I20260709 13:00:55.845804  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:55.849246  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.868798  1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.012s	sys 0.050s
W20260709 13:00:55.869185  1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.012s	sys 0.050s
W20260709 13:00:55.869493  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 558374us
I20260709 13:00:55.870806  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:55.622624  7298 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.596135  7409 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.883033  1686 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:55.889482  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:55.585613  7346 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.602934  6929 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:00:55.894232  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.929730  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:55.880203  7042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.016s	sys 0.066s
I20260709 13:00:55.941901  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:55.947399  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:55.943363  1565 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:55.866345  7406 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:55.868948  7374 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:55.954905  7263 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:55.945055  7367 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:55.935530  7298 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.958261  7298 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:55.959009  7286 consensus_meta.cc:287] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.754s	user 0.007s	sys 0.014s
I20260709 13:00:55.959430  7286 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:55.961408  7286 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:55.963572  7406 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14.
I20260709 13:00:55.964234  2405 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:55.964843  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:55.965443  1568 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:55.967092  7374 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:55.967602  7374 raft_consensus.cc:697] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:00:55.967868  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.968091  1564 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:55.968472  7374 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.969359  1537 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:55.971668  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:55.972723  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:55.972951  7393 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:55.974246  7377 consensus_queue.cc:1059] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:55.979245  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:55.979647  1537 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:55.980484  7367 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:55.980535  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:55.980691  7438 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:55.981026  7367 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:55.981460  7367 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.982630  7389 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.983445  2443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 840) took 1157 ms. Trace:
I20260709 13:00:55.984740  7389 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:55.983811  2443 rpcz_store.cc:276] 0709 13:00:54.826823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.827060 (+   237us) service_pool.cc:224] Handling call
0709 13:00:54.979059 (+151999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.986931 (+  7872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.986958 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.987425 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.326390 (+338965us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:55.326426 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.326493 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.597915 (+271422us) raft_consensus.cc:1685] finished
0709 13:00:55.597935 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.983178 (+385243us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400631d50. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:55.983389 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":197,"raft.queue_time_us":1047,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":12019,"spinlock_wait_cycles":348750080,"thread_start_us":262097,"threads_started":1,"wal-append.queue_time_us":436316}
I20260709 13:00:55.986622  6966 raft_consensus.cc:3055] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:55.986989  6966 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:55.987331  1537 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:55.988166  7298 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:55.987762  6966 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.973219  2447 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:55.989451  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:55.990149  1564 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:55.990507  7365 raft_consensus.cc:3055] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:55.990880  7365 raft_consensus.cc:740] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:55.991688  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:55.991946  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:55.991663  7365 consensus_queue.cc:260] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.993088  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:55.993633  1572 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 17.
I20260709 13:00:55.994861  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:55.995926  7237 raft_consensus.cc:3055] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:55.996308  7237 raft_consensus.cc:740] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:55.997061  7237 consensus_queue.cc:260] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:55.997756  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:55.999320  1537 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:55.876885  7294 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:55.948892  7042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.017s	sys 0.066s
I20260709 13:00:56.000187  7294 raft_consensus.cc:697] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:56.000420  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:56.001143  7294 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.001991  1645 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:56.001156  1647 raft_consensus.cc:2368] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16.
I20260709 13:00:55.999415  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:56.005004  1642 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:00:55.877772  7246 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:55.601125  7211 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:55.987754  1717 consensus_meta.cc:287] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.000s
I20260709 13:00:55.928530  7090 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:55.928175  7429 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:56.009575  1568 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
W20260709 13:00:56.010962  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 128002us
I20260709 13:00:56.147461  1686 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:56.151974  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:56.153148  1686 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:56.012463  1572 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:55.997521  7367 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:56.090613  7322 consensus_meta.cc:287] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.737s	user 0.004s	sys 0.004s
I20260709 13:00:56.088160  7246 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:56.095197  7320 consensus_meta.cc:287] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.737s	user 0.008s	sys 0.000s
I20260709 13:00:56.095849  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:55.949337  6929 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.087688  7427 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:56.169763  1642 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
W20260709 13:00:56.038756  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.000192  7286 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:56.173903  7286 raft_consensus.cc:697] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:56.175042  7286 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.116128  2436 raft_consensus.cc:1240] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:56.146468  7426 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:56.015687  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:56.116864  1717 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
W20260709 13:00:56.091352  7307 consensus_meta.cc:287] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.002s
I20260709 13:00:55.946762  7409 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:56.092018  7230 consensus_queue.cc:1059] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:56.089887  2447 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 18.
I20260709 13:00:55.989002  6966 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:56.114615  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 107296us
I20260709 13:00:56.130165  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:56.134455  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:56.130971  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:56.194378  1563 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:56.167564  7450 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:56.132346  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.195978  1564 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 18.
I20260709 13:00:56.157464  2437 raft_consensus.cc:2368] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16.
I20260709 13:00:56.161365  1570 raft_consensus.cc:2393] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 13: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 13:00:56.144855  6976 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.009s	sys 0.001s
I20260709 13:00:56.162408  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.194995  1685 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:56.199136  1572 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:56.200479  1572 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:56.164992  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:56.201555  1568 raft_consensus.cc:2376] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10. Re-sending same reply.
I20260709 13:00:56.014945  7042 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.160760  7263 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:00:56.214404  1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.070s	sys 0.049s
I20260709 13:00:56.203670  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:56.204367  7230 raft_consensus.cc:3055] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:56.217084  7230 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:56.218144  7427 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:56.217991  7230 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:56.218561  7427 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.218968  7427 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:56.219090  7296 consensus_meta.cc:287] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.752s	user 0.010s	sys 0.000s
I20260709 13:00:56.219202  7230 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:56.219605  7296 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.180764  7320 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.220896  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:56.221728  7296 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:56.211745  1565 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:55.951345  7210 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:56.219341  7367 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:56.204726  6929 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:56.211606  1685 leader_election.cc:400] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16.
I20260709 13:00:56.226930  1685 leader_election.cc:403] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:56.222366  1638 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:56.222582  2446 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:00:56.227560  2446 pending_rounds.cc:85] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 10
I20260709 13:00:56.227852  2446 pending_rounds.cc:107] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:00:56.228130  2446 raft_consensus.cc:2889] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:56.180164  7439 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:56.234185  1563 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
I20260709 13:00:56.224291  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:00:56.211346  6976 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.010s	sys 0.001s
W20260709 13:00:56.238759  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.169413  7322 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:56.198959  7409 raft_consensus.cc:697] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 13:00:56.241408  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 276317us
I20260709 13:00:56.235531  1564 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:56.223263  7263 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.225184  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:56.194126  7307 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:56.223516  1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.070s	sys 0.050s
I20260709 13:00:56.257194  2447 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:56.225498  7246 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:56.258291  1639 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 16: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 13:00:56.257299  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 727521us
I20260709 13:00:56.275095  1611 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:56.210819  7450 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:56.261705  2405 leader_election.cc:400] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 18.
I20260709 13:00:56.260622  1645 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:00:56.278637  2405 leader_election.cc:403] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:00:56.240833  7429 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:56.222970  7042 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.259852  7263 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:56.242488  7426 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:00:56.282776  1611 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:56.284535  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 134389us
W20260709 13:00:56.292129  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 137160us
I20260709 13:00:56.293282  1686 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:56.293848  1685 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:56.295845  2447 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:00:56.301290  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:56.297160  7374 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 18.
I20260709 13:00:56.303583  7440 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:56.304397  1712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 3827) took 1053 ms. Trace:
I20260709 13:00:56.304778  1712 rpcz_store.cc:276] 0709 13:00:55.250984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.251195 (+   211us) service_pool.cc:224] Handling call
0709 13:00:56.304214 (+1053019us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b54003ab454. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:56.304337 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132307840}
I20260709 13:00:56.289654  7297 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:56.306114  7439 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:56.302073  1645 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:56.310891  1564 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 18.
I20260709 13:00:56.281816  7331 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:56.313512  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.316198  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.292630  1536 connection.cc:256] RPC call timeout handler was delayed by -1.3334888729999648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:00:56.316740  1536 connection.cc:256] RPC call timeout handler was delayed by -1.3325888729999633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 13:00:56.317028  1536 connection.cc:256] RPC call timeout handler was delayed by -1.3325888729999633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 13:00:56.317298  1536 connection.cc:256] RPC call timeout handler was delayed by -1.1768888729999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 13:00:56.306361  7297 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.318140  7374 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.318682  7374 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.320865  7374 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:56.325062  2442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 1339) took 1161 ms. Trace:
I20260709 13:00:56.325646  2442 rpcz_store.cc:276] 0709 13:00:55.170747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.430498 (+259751us) service_pool.cc:224] Handling call
0709 13:00:55.454122 (+ 23624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.454400 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:55.895652 (+441252us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.324620 (+428968us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.324692 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:56.324763 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.324852 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.324994 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":490767,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":850687,"threads_started":2}
W20260709 13:00:56.317593  1536 connection.cc:256] RPC call timeout handler was delayed by -1.0985888729999829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
W20260709 13:00:56.334617  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 51966.8us
I20260709 13:00:56.314108  7320 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:56.337423  1536 connection.cc:256] RPC call timeout handler was delayed by -1.094988872999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
I20260709 13:00:56.337903  1611 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:00:56.339499  1536 connection.cc:256] RPC call timeout handler was delayed by -1.094988872999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 13:00:56.339898  1536 connection.cc:256] RPC call timeout handler was delayed by -1.0742888730000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 13:00:56.341001  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.341447  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.342510  1572 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:00:56.342561  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.343160  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.343914  1563 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 16: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:56.343770  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.344211  1572 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:56.344451  1565 raft_consensus.cc:2393] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:56.346125  1571 raft_consensus.cc:2410] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:00:56.346491  7210 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:56.351030  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.355456  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.356877  7317 raft_consensus.cc:3055] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:56.357293  7317 raft_consensus.cc:740] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:56.357671  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.355563  7450 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:56.363088  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:56.288672  7429 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.362331  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.328447  7264 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:56.367578  1611 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:56.330972  7211 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:56.372242  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.387056  1564 raft_consensus.cc:2368] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 18.
I20260709 13:00:56.387786  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.373180  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:00:56.359190  1746 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:33273 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:33273 timed out after 15.000s (SENT)
I20260709 13:00:56.358510  1572 raft_consensus.cc:2393] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 14: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:56.382776  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.360842  7350 raft_consensus.cc:3055] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:56.383141  1570 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:56.398586  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.333633  7331 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:00:56.383140  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.387319  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 84360.4us
I20260709 13:00:56.402438  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:56.403752  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.404654  1572 raft_consensus.cc:2393] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 8: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:56.373018  7300 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:56.424747  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.429584  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.405750  1611 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:56.432617  1611 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:56.436204  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.436893  1563 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:56.436930  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:56.438511  1563 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:00:56.443410  2437 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:56.447443  1570 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:56.439291  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 90769.8us
I20260709 13:00:56.336774  7457 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.084s
I20260709 13:00:56.489737  1686 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:56.490440  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.389729  7450 raft_consensus.cc:2764] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:00:56.331645  7409 consensus_queue.cc:237] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:56.456332  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.515451  1572 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:56.513765  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:56.393008  7307 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:56.491740  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:56.521651  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:56.522639  1570 raft_consensus.cc:2368] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 18.
I20260709 13:00:56.449293  7320 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:00:56.514427  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 81935.7us
W20260709 13:00:56.514994  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.393471  7350 raft_consensus.cc:740] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:56.517838  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 3821) took 1328 ms. Trace:
I20260709 13:00:56.528993  1716 rpcz_store.cc:276] 0709 13:00:55.189353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.190333 (+   980us) service_pool.cc:224] Handling call
0709 13:00:56.517632 (+1327299us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540022ae54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:56.517779 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452803968}
I20260709 13:00:56.358065  7317 consensus_queue.cc:260] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.489400  7264 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:56.514580  7322 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:56.517338  7300 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:56.436936  7331 raft_consensus.cc:697] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:56.535082  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:56.537539  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 100701us
I20260709 13:00:56.513063  7230 consensus_queue.cc:1059] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:00:56.540391  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:56.546027  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:56.546366  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.546725  1716 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 13:00:56.547117  1563 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 16: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:56.542446  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.542796  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:56.523519  7463 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:56.449745  7427 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.548589  1717 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:56.545830  7350 consensus_queue.cc:260] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.555751  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.560132  1563 raft_consensus.cc:2368] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 18.
I20260709 13:00:56.560920  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.561329  2446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 848) took 1255 ms. Trace:
I20260709 13:00:56.539177  7450 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:56.558954  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:56.543828  7438 consensus_meta.cc:287] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
I20260709 13:00:56.579315  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 2947) took 3849 ms. Trace:
W20260709 13:00:56.562886  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.580682  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:56.579769  1569 rpcz_store.cc:276] 0709 13:00:52.716119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.858566 (+142447us) service_pool.cc:224] Handling call
0709 13:00:52.858968 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.142754 (+283786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.142799 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.687069 (+1544270us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b1800338fe0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1792a6 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cbb91a11 00007f18cbba1372 00007f18cd2d3a01 00007f18cd29843a
0709 13:00:55.269779 (+582710us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b2c00000658. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cbb91a11 00007f18cbba1372 00007f18cd2d3a01 00007f18cd29843a 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2
0709 13:00:55.270284 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.728417 (+458133us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:55.728473 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.564697 (+836224us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540035a554. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:56.564765 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.564828 (+    63us) raft_consensus.cc:1685] finished
0709 13:00:56.564849 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.565024 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5321,"raft.queue_time_us":3014,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":1372,"spinlock_wait_cycles":676548480,"thread_start_us":419649,"threads_started":1,"wal-append.queue_time_us":783244}
I20260709 13:00:56.581482  2437 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 19.
I20260709 13:00:56.561704  2446 rpcz_store.cc:276] 0709 13:00:55.305813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.759179 (+453366us) service_pool.cc:224] Handling call
0709 13:00:55.759587 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.228656 (+469069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.561104 (+332448us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54006a9ad4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:56.561273 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1063950080}
I20260709 13:00:56.562726  1638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 1372) took 1243 ms. Trace:
I20260709 13:00:56.571748  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:56.582620  1638 rpcz_store.cc:276] 0709 13:00:55.318897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.319013 (+   116us) service_pool.cc:224] Handling call
0709 13:00:55.323928 (+  4915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.230573 (+906645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.562458 (+331885us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b540035d254. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:56.562642 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2065808256}
I20260709 13:00:56.585507  1717 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
I20260709 13:00:56.544186  7320 raft_consensus.cc:697] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:56.561905  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.550617  7297 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:56.594417  1563 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:56.550730  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:56.557628  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.597193  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:56.554243  7317 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:56.539409  7264 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.549620  7463 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:56.602034  1567 raft_consensus.cc:2393] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 14: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:56.592602  7161 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:56.596174  7211 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:56.586817  7350 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:56.615842  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 70280.8us
I20260709 13:00:56.615603  2406 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:56.732820  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 117271us
W20260709 13:00:56.732841  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 241242us
W20260709 13:00:56.607211  7454 log.cc:927] Time spent T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:00:56.603555  7230 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:56.691438  7458 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
W20260709 13:00:56.607668  7468 log.cc:927] Time spent T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:00:56.616787  7450 raft_consensus.cc:697] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:56.734344  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:56.733866  6966 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:56.617465  7463 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:56.617296  7211 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.758395  7211 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:56.758526  7472 log.cc:927] Time spent T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:00:56.759927  7149 consensus_queue.cc:1059] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:00:56.761445  1469 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58260 (request call id 329) took 16222 ms (client timeout 15000 ms). Trace:
I20260709 13:00:56.622557  7161 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:56.763176  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:56.735805  7374 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:00:56.764298  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:56.764760  7161 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:56.677062  7471 raft_consensus.cc:3055] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:56.765594  7300 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:56.765719  7471 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:56.766222  7473 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:56.766690  7473 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:56.767112  7473 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:56.771134  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.622519  7322 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:56.749110  2406 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:56.780036  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:56.605980  7438 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:56.682258  7474 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:00:56.754778  7469 log.cc:927] Time spent T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:00:56.774621  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 1375) took 1454 ms. Trace:
I20260709 13:00:56.807864  1715 raft_consensus.cc:1240] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:56.807281  1646 rpcz_store.cc:276] 0709 13:00:55.319961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.320690 (+   729us) service_pool.cc:224] Handling call
0709 13:00:55.320970 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.372012 (+ 51042us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:55.414390 (+ 42378us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.010946 (+596556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.011013 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:56.011058 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.774402 (+763344us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b54002c42d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:00:56.774446 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.774566 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48325,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":350380,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":127,"spinlock_wait_cycles":116869888,"thread_start_us":596129,"threads_started":2,"wal-append.queue_time_us":525776}
I20260709 13:00:56.808261  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:56.738445  1686 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:56.769829  7211 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
W20260709 13:00:56.809417  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 71054us
I20260709 13:00:56.776736  7475 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:56.776970  7361 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:56.811187  7450 consensus_queue.cc:237] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.781965  2406 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:56.618129  7042 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:56.790452  7327 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:56.815016  7327 raft_consensus.cc:697] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 16 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:56.815377  2406 leader_election.cc:400] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 18.
I20260709 13:00:56.815923  7327 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:56.761865  1469 rpcz_store.cc:269] 0709 13:00:40.546493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.575400 (+ 28907us) service_pool.cc:224] Handling call
0709 13:00:56.761367 (+16185967us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:52.875455 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:52.876326 (+   871us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:52.876402 (+    76us) write_op.cc:435] Acquired schema lock
0709 13:00:52.876430 (+    28us) tablet.cc:662] Decoding operations
0709 13:00:52.993170 (+116740us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:53.010924 (+ 17754us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:53.015183 (+  4259us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:53.015647 (+   464us) tablet.cc:701] Row locks acquired
0709 13:00:53.015715 (+    68us) write_op.cc:260] PREPARE: finished
0709 13:00:53.015898 (+   183us) write_op.cc:270] Start()
0709 13:00:53.016057 (+   159us) write_op.cc:276] Timestamp: P: 1783602053015834 usec, L: 0
0709 13:00:53.016099 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:00:53.183651 (+167552us) log.cc:844] Serialized 982 byte log entry
0709 13:00:53.594886 (+411235us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18ca18e0ac 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1aac02 00007f18cce3220b
0709 13:00:54.455067 (+860181us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b54004254d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd293e28 00007f18d0cce581 00007f18d0ccdd58 00007f18d0cd29f1 00007f18d0cd29a9 00007f18d0cd2939 00007f18d0cd2901 00007f18d0cd1b2d 000000000038f354 000000000038f199
0709 13:00:54.685541 (+230474us) op_driver.cc:464] REPLICATION: finished
0709 13:00:54.821163 (+135622us) write_op.cc:301] APPLY: starting
0709 13:00:54.821298 (+   135us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:54.824617 (+  3319us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:54.824660 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:54.826005 (+  1345us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:54.827829 (+  1824us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:00:54.827972 (+   143us) write_op.cc:312] APPLY: finished
0709 13:00:54.828855 (+   883us) log.cc:844] Serialized 33 byte log entry
0709 13:00:54.829559 (+   704us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:54.829835 (+   276us) write_op.cc:454] Released schema lock
0709 13:00:54.829977 (+   142us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:54.831421 (+  1444us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:54.831535 (+   114us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4184824,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":129065,"apply.run_cpu_time_us":5796,"apply.run_wall_time_us":10090,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12491,"num_ops":2,"prepare.queue_time_us":422789,"prepare.run_cpu_time_us":56516,"prepare.run_wall_time_us":1628701,"raft.queue_time_us":499444,"raft.run_cpu_time_us":16062,"raft.run_wall_time_us":131018,"replication_time_us":1651017,"spinlock_wait_cycles":17169280,"thread_start_us":1039662,"threads_started":4,"wal-append.queue_time_us":470883,"wal-append.run_cpu_time_us":70492,"wal-append.run_wall_time_us":2121978}]]}
I20260709 13:00:56.816489  2406 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:56.818950  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 3020) took 1536 ms. Trace:
I20260709 13:00:56.819453  1571 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:56.790711  7374 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:56.820250  7374 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:56.820890  7374 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:56.819423  1713 rpcz_store.cc:276] 0709 13:00:55.282754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.282861 (+   107us) service_pool.cc:224] Handling call
0709 13:00:56.305680 (+1022819us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:56.333120 (+ 27440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.333170 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:56.335105 (+  1935us) log.cc:844] Serialized 52 byte log entry
0709 13:00:56.492567 (+157462us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:56.492653 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.492819 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.762273 (+269454us) raft_consensus.cc:1685] finished
0709 13:00:56.762298 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.818637 (+ 56339us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b54003ab450. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:56.818879 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18679,"raft.queue_time_us":25132,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3083,"spinlock_wait_cycles":2281616128,"thread_start_us":64752,"threads_started":1,"wal-append.queue_time_us":153298}
I20260709 13:00:56.731942  7320 consensus_queue.cc:237] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:00:56.810537  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 181341us
I20260709 13:00:56.781761  7300 raft_consensus.cc:697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:56.795359  7473 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:56.767143  7471 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:56.796389  1639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 3916) took 1649 ms (client timeout 1960 ms). Trace:
W20260709 13:00:56.835453  1639 rpcz_store.cc:269] 0709 13:00:55.147036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.147145 (+   109us) service_pool.cc:224] Handling call
0709 13:00:56.796192 (+1649047us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540033bdd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:56.796331 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2462355328}
W20260709 13:00:56.798321  1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60082 (request call id 3830) took 1517 ms (client timeout 1983 ms). Trace:
I20260709 13:00:56.800891  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38584 (request call id 1374) took 1481 ms. Trace:
I20260709 13:00:56.802460  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:56.805716  7448 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.612761  7331 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.806209  7427 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:56.806418  7429 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:56.767112  7470 log.cc:927] Time spent T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:00:56.845782  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:56.852852  7473 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:56.854151  7264 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:56.833474  7246 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:56.836308  7457 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:56.783197  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:56.781152  7456 log.cc:927] Time spent T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:00:56.809603  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:56.859570  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 76453us
I20260709 13:00:56.861490  7440 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:56.861943  7440 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:56.862100  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:56.792173  7263 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.862761  7440 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.863005  1639 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:56.864526  7263 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:56.829545  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:56.783900  7210 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:00:56.865988  1565 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:56.867087  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:56.867806  1646 raft_consensus.cc:2393] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 13: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 13:00:56.867836  7426 consensus_meta.cc:287] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.570s	user 0.012s	sys 0.000s
I20260709 13:00:56.868599  7426 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16.
I20260709 13:00:56.868983  7300 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.817744  2406 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:56.836969  1641 rpcz_store.cc:276] 0709 13:00:55.319676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.319784 (+   108us) service_pool.cc:224] Handling call
0709 13:00:56.800717 (+1480933us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000276d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:56.800837 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347497856}
W20260709 13:00:56.870882  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 53217.2us
W20260709 13:00:56.838130  1720 rpcz_store.cc:269] 0709 13:00:55.281345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.297485 (+ 16140us) service_pool.cc:224] Handling call
0709 13:00:56.798156 (+1500671us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400325854. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:56.798265 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293704576}
I20260709 13:00:56.871659  2406 leader_election.cc:400] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 18.
I20260709 13:00:56.844915  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:56.872466  2406 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:56.873901  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:56.874994  1641 raft_consensus.cc:2393] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 12: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:56.875561  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:56.876072  1565 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:56.833176  6929 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:56.828917  7475 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.884655  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:56.891353  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:56.892784  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:56.894693  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:56.895689  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:56.913851  1642 raft_consensus.cc:2393] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 19: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:56.914394  1641 raft_consensus.cc:2393] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 13: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 13:00:56.915810  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.916821  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:56.917626  1639 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:00:56.918907  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:56.919488  1720 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:56.915900  1686 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:56.921273  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:56.882961  7457 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:56.888315  7246 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:56.929875  1686 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:56.810329  7474 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.931520  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:56.935637  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:56.931643  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.920753  6966 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.913640  6929 raft_consensus.cc:697] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:56.872347  7448 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:56.894181  7475 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:56.958139  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.932262  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:56.960722  1714 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:00:56.961633  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:56.945207  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:56.952553  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:56.962533  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:56.963338  1720 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:56.921553  7264 consensus_queue.cc:1059] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
W20260709 13:00:56.966439  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.934954  7435 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:00:56.968811  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.968376  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:56.930693  7478 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:56.970433  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:56.974535  1647 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:00:56.976384  1644 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:56.976869  1638 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:56.972337  1642 raft_consensus.cc:2368] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16.
I20260709 13:00:56.973268  2405 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:56.981812  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:56.983705  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:56.984449  2440 raft_consensus.cc:2410] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:56.965765  7476 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:56.987411  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:56.987648  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:56.969165  7480 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.993431  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:56.955278  6966 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.998797  7426 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:56.998526  6929 consensus_queue.cc:237] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.999330  7426 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:57.000224  7426 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:57.002012  7322 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.005720  7474 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:56.988236  7327 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:56.994855  7476 raft_consensus.cc:697] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:57.008818  7476 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:57.010597  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 48162.8us
I20260709 13:00:57.014240  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:57.014096  7480 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:56.993042  7435 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:57.016583  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:57.016629  7480 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:57.016770  7435 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:57.019090  7463 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.021420  7463 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:57.022323  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.024017  6966 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:57.026499  1719 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 16: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:00:57.028339  7427 raft_consensus.cc:3055] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:57.028733  7427 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:57.030220  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:57.031667  7451 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.755s	user 0.002s	sys 0.000s
I20260709 13:00:57.030244  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:57.034809  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:57.042215  1638 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:00:57.044377  1713 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
W20260709 13:00:57.045477  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 53151.4us
I20260709 13:00:56.986469  7457 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:57.046833  7457 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:57.047207  7457 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.029606  7427 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.050397  7312 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:57.050863  7237 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:57.052253  7465 log.cc:927] Time spent T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.513s	user 0.000s	sys 0.004s
I20260709 13:00:57.053435  7368 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:57.053933  7368 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:57.056612  7455 log.cc:927] Time spent T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.779s	user 0.002s	sys 0.000s
I20260709 13:00:56.994884  7149 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:57.059576  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:57.063086  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.065253  1565 raft_consensus.cc:1240] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:57.065852  7322 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.050859  7427 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:57.068049  7149 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.070456  7149 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:57.072664  7327 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.073189  7327 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:57.074198  7211 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:57.075220  7327 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:57.075393  7368 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:57.077632  7368 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:57.077888  7457 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.079998  7457 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:57.084103  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.084551  1537 leader_election.cc:400] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16.
I20260709 13:00:57.084890  1537 leader_election.cc:403] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:00:57.085497  1537 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:57.086772  1537 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:57.087445  7307 consensus_queue.cc:1059] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:57.088461  7307 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16.
I20260709 13:00:57.089080  7307 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:57.089550  7307 raft_consensus.cc:697] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:57.090238  7161 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:57.090741  7161 raft_consensus.cc:697] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:57.091572  7161 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.092510  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:00:57.091894  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 95255.5us
I20260709 13:00:57.094271  7327 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:57.096221  7402 raft_consensus.cc:3055] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:57.096606  7402 raft_consensus.cc:740] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:57.101285  1611 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:57.102524  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:57.103610  1647 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:57.105610  2448 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:00:57.107954  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:57.110069  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:57.111294  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:57.111567  1571 raft_consensus.cc:1240] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:57.115993  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:57.116695  1647 raft_consensus.cc:2393] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 10: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 13:00:57.116786  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.118098  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:57.119386  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.120625  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:57.120689  2444 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:57.121451  1564 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 15: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:57.124567  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:57.127699  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.128088  1537 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:57.128804  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:57.128965  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:57.129832  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:57.130582  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:57.131163  1639 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:57.131960  7204 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:57.132699  7204 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.134685  7307 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.135270  7204 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:57.136417  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:57.136669  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:57.137064  1642 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:00:57.137218  2442 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:57.139294  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:57.139909  1642 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:00:57.097369  7402 consensus_queue.cc:260] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.141196  7402 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:57.147138  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:57.148555  7481 log.cc:927] Time spent T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:00:57.148785  7448 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:57.151479  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 50327.3us
I20260709 13:00:57.152932  1611 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:56.990097  7361 consensus_queue.cc:1059] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.122s
I20260709 13:00:57.155876  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:57.157927  1571 raft_consensus.cc:1240] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:57.159548  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:57.160378  7473 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:57.160723  7440 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:57.169623  1639 raft_consensus.cc:2468] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 17.
W20260709 13:00:57.169615  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.171181  1712 raft_consensus.cc:1240] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:57.171859  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.181267  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:57.179204  1644 raft_consensus.cc:1240] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 16. Current term is 17. Ops: [14.14-16.15]
I20260709 13:00:57.183255  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.183459  1641 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 12: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:57.183597  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:57.184782  1685 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:57.185638  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.187117  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.185926  1685 leader_election.cc:400] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16.
I20260709 13:00:57.188597  1685 leader_election.cc:403] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:00:57.189611  1712 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:57.193786  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.196768  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.198000  2447 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:57.190964  2442 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:00:57.201305  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.206424  1715 raft_consensus.cc:2410] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:00:57.207012  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.200896  7204 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.207726  7204 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.208590  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.195379  7263 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:57.209267  7263 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:57.202186  7429 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16.
I20260709 13:00:57.209817  7263 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:57.210004  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 81111.4us
I20260709 13:00:57.172540  7264 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:57.212184  7264 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:57.212633  6993 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.213119  6993 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:57.209817  7204 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:57.214995  6993 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:57.178798  7473 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:57.218338  7473 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.218981  7365 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:57.218719  7263 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.221043  7263 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:57.197268  7440 raft_consensus.cc:697] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:57.231660  2406 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:57.190303  7377 raft_consensus.cc:3055] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:57.252251  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.253329  2406 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:57.233732  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:57.256682  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.257972  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.258869  1721 raft_consensus.cc:2410] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:00:57.259812  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.261583  7264 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:57.263736  7374 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.266570  7440 consensus_queue.cc:237] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:57.274857  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:57.275503  2448 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:57.252400  7377 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:57.280386  7103 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:57.285030  7103 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:57.285396  7103 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.285351  7377 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.286599  7377 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:57.290380  7471 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:57.290484  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.291378  1712 raft_consensus.cc:2410] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:00:57.278617  2440 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:57.297020  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.298122  2448 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:00:57.279829  1714 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:00:57.298786  1714 pending_rounds.cc:85] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 10
I20260709 13:00:57.298996  1714 pending_rounds.cc:107] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:00:57.299249  1714 raft_consensus.cc:2889] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:57.279963  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.279490  2406 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:57.292352  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.298175  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.300493  1715 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:57.300794  1721 raft_consensus.cc:2368] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14.
I20260709 13:00:57.290295  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.300940  1718 raft_consensus.cc:2393] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 16: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 13:00:57.281384  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 47763.6us
I20260709 13:00:57.269587  7475 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:00:57.308851  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.308969  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:57.311712  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.311924  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.312747  1712 raft_consensus.cc:2410] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:00:57.309764  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:57.314527  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.314456  2444 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:00:57.301602  2405 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:57.305780  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 13:00:57.334442  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 55010.8us
I20260709 13:00:57.265736  7374 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:57.334892  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:57.348984  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:57.336474  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.338238  1571 raft_consensus.cc:1240] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:57.315657  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:57.340356  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.351399  1712 raft_consensus.cc:2410] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:00:57.223974  7350 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.102s
W20260709 13:00:57.341980  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 103655us
I20260709 13:00:57.357906  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.358208  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:57.358417  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:57.307914  7457 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:57.361363  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:57.362344  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:57.363173  1572 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 12: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:57.365072  1685 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:57.366514  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.367290  1712 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:00:57.342855  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.336715  7476 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.350390  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.351513  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:57.352402  1565 raft_consensus.cc:2368] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12.
I20260709 13:00:57.352715  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:57.380069  1569 raft_consensus.cc:2376] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14. Re-sending same reply.
I20260709 13:00:57.350277  1686 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.354513  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:57.397631  7264 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:57.397905  7161 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:57.355096  7362 consensus_queue.cc:1059] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:57.356838  2405 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:00:57.306877  7361 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.368700  1567 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:00:57.347247  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.360193  7477 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 13:00:57.409466  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 52879us
I20260709 13:00:57.409410  7477 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:57.410965  7361 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:57.411381  7361 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:57.411732  7361 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:57.412186  7477 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:57.370097  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:57.364480  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:57.372088  7463 raft_consensus.cc:2804] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:57.347693  7149 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:57.371752  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:57.435999  1572 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:57.395892  7474 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:57.395140  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:57.396198  1718 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:57.397276  1715 raft_consensus.cc:2410] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:00:57.442535  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:57.439946  1640 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:00:57.452908  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:57.398394  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 48109.8us
I20260709 13:00:57.460856  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.461897  1715 raft_consensus.cc:2410] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:00:57.399446  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:00:57.399827  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 45428.5us
I20260709 13:00:57.359076  7312 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:57.401825  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:57.369432  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:57.365356  7457 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.408620  7362 raft_consensus.cc:3055] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:57.468252  7362 raft_consensus.cc:740] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:57.468537  7473 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.469290  7362 consensus_queue.cc:260] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.471175  7362 raft_consensus.cc:3060] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:57.471715  7473 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:57.419468  2442 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:57.420017  7103 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:57.422267  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.413058  1563 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:57.420910  1466 catalog_manager.cc:5697] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 9 to 10, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:57.370872  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.496075  1466 catalog_manager.cc:5697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 8 to 10, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } } }
I20260709 13:00:57.498327  1641 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:57.426316  2405 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.384166  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:57.465529  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:57.461540  7475 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:57.501319  2442 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:57.503060  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:57.415614  6966 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:57.458885  7474 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:57.474953  7327 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:57.475347  7457 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.476608  1647 raft_consensus.cc:1240] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:57.459070  7322 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.457522  7463 raft_consensus.cc:697] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 17 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:57.480480  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:57.483883  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.497714  1466 catalog_manager.cc:5697] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 9 to 11, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 11 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.513142  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:57.514830  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:57.499261  2448 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:57.513865  1466 catalog_manager.cc:5697] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 12 to 13, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 13 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.465036  7312 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:57.501052  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 74863.4us
I20260709 13:00:57.517102  2405 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:57.511296  1686 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.499063  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:57.515496  2442 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:00:57.518858  2442 pending_rounds.cc:85] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 8
I20260709 13:00:57.519106  2442 pending_rounds.cc:107] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:00:57.519320  2442 raft_consensus.cc:2889] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:57.519658  7475 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:57.467878  1644 raft_consensus.cc:2393] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 12: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:57.520565  7473 raft_consensus.cc:3055] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:57.520921  7473 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:57.521493  7478 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:57.521636  7366 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.522013  7478 raft_consensus.cc:697] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:57.522207  7366 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.525048  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:00:57.528466  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.529542  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:57.529788  2405 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.536034  1572 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:00:57.536302  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.505652  7490 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:57.507922  7310 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:57.517302  1466 catalog_manager.cc:5697] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 15 to 16, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 16 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.507139  7409 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:57.533502  7453 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:57.515195  7297 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:57.544890  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.524353  7312 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:57.512844  7327 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:57.525061  7374 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.531450  7246 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:57.549059  1466 catalog_manager.cc:5697] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 11 to 13, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:57.512117  7368 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:00:57.512013  7263 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:00:57.600705  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.602705  1466 catalog_manager.cc:5697] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 10 to 11, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 11 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.605015  1466 catalog_manager.cc:5697] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 12 to 13, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 13:00:57.607273  1466 catalog_manager.cc:5697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 10 to 13, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:57.524223  7429 consensus_queue.cc:1059] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:00:57.609742  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.538385  7427 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.551342  7365 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:00:57.624185  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 98656.8us
I20260709 13:00:57.551923  7453 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.602274  7490 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:57.552129  7297 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:57.609826  6993 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:57.611385  7211 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:57.610477  1466 catalog_manager.cc:5697] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 8 to 10, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 10 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.554378  7327 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:57.623875  7427 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:57.650285  1466 catalog_manager.cc:5697] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 13 to 14, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 14 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:57.638491  7499 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:00:57.602104  7374 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.654006  1466 catalog_manager.cc:5697] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 7 to 8, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.554369  7409 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.635389  7453 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.642437  7297 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.670152  7508 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.673045  7490 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:57.673441  6993 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:57.638984  7463 consensus_queue.cc:237] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.639153  7478 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.622622  7474 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.665515  1466 catalog_manager.cc:5697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 7 to 9, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:00:57.738140  2442 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:57.748844  7366 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:57.746886  1466 catalog_manager.cc:5697] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 12 to 13, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 13 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:57.735632  7368 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:57.751398  7368 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.754631  1466 catalog_manager.cc:5697] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 12 to 13, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 13 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:57.761529  1716 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:57.654531  7429 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
W20260709 13:00:57.768936  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 159292us
I20260709 13:00:57.769757  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:00:57.771504  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 84099.2us
I20260709 13:00:57.785862  1611 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:57.786967   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:57.740373  7361 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.797156  7361 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:57.797569  6929 raft_consensus.cc:3055] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:57.797999  6929 raft_consensus.cc:740] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:57.798686  7453 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.798926  6929 consensus_queue.cc:260] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.800197  6929 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:57.800866  7453 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:57.791513  7204 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:00:57.802309  7368 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:57.802764  7103 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:57.805092  2444 raft_consensus.cc:1240] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:57.740504  7508 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.809104  1712 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:00:57.811299  7500 log.cc:927] Time spent T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:57.791904  7331 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:57.792572  7374 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:57.829514  1712 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:57.838037  1713 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:00:57.841151  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 211164us
I20260709 13:00:57.804565  7312 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.811304  7211 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:57.817888  7103 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.850780  7508 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:57.855252  7297 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.857241  7297 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:57.839288  7453 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:00:57.860517  1713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:00:57.860921  1713 raft_consensus.cc:606] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.861115  1713 raft_consensus.cc:614] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:57.863272  1686 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.864442  1686 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.842792  7409 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:57.875734  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:57.848408  7211 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:57.891922  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:57.893692  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:57.895903  7312 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:57.862251  7103 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.904218  7103 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:57.905164  7476 consensus_queue.cc:1059] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:57.914018  7517 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:57.894032  7477 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:57.893621  7464 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:57.916811  7211 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.873952  7471 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:57.918762  7471 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:57.919715  7471 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.923091  7464 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.892277  7230 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:57.923661  7464 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.924265  7230 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:57.924710  7230 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.862756  7299 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:00:57.931224  7427 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:57.848218  7331 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:00:57.931919  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:57.933179  1564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:00:57.933794  1564 raft_consensus.cc:606] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.934165  7211 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 20 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:57.921754  7457 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.947806  6993 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:57.923231  7327 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:57.959820  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:57.961306  1685 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.964905  2442 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:00:57.969609  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:57.972520  2442 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:57.975872  1564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:00:57.976734  1564 raft_consensus.cc:606] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.977160  1564 raft_consensus.cc:614] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:57.980206  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 86574.4us
I20260709 13:00:57.983707  1686 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:57.985466  7509 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:58.016865  1641 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:58.017982  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:58.017867  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:58.013896  7463 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:58.032353  1564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:00:58.033250  1564 raft_consensus.cc:606] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.033730  1564 raft_consensus.cc:614] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:58.034106  7327 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:58.039695  7473 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.043758  7457 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:58.046113  7230 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.048523  7230 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:58.022787  6929 consensus_queue.cc:1059] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:00:58.050486  7464 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:58.032262  7331 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:00:58.024905  7517 consensus_queue.cc:1059] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:00:58.026247  1686 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.055258  1564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:00:58.056064  1564 raft_consensus.cc:606] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.056522  1564 raft_consensus.cc:614] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:58.057874  6929 raft_consensus.cc:3055] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:58.058408  6929 raft_consensus.cc:740] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:58.059473  6929 consensus_queue.cc:260] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:58.060981  6929 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.062250  7448 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:00:58.068264  7525 consensus_queue.cc:1059] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:58.069325  7450 raft_consensus.cc:3055] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:58.069741  7450 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:58.070587  7450 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.074709  7517 raft_consensus.cc:3055] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:58.075150  7517 raft_consensus.cc:740] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:58.076010  7517 consensus_queue.cc:260] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:58.077286  7517 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.078310  7519 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:58.078466  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 53065.1us
I20260709 13:00:58.080657   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:58.082890   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:58.083879  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.076373  7263 raft_consensus.cc:3055] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:58.088615  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:58.090636  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:58.091470  2440 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:58.103950  2442 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:58.106624  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:58.107635  2440 raft_consensus.cc:2368] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15.
I20260709 13:00:58.110582  2444 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:58.119092  1612 leader_election.cc:400] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15.
I20260709 13:00:58.088156  7457 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:58.119870  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:58.119796  1612 leader_election.cc:403] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:00:58.120898  1640 raft_consensus.cc:2393] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 10: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:58.116865  2436 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:58.093293  7263 raft_consensus.cc:740] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:58.145702  7263 consensus_queue.cc:260] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.131498  7457 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.148831  7457 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:58.151319  7497 log.cc:927] Time spent T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.725s	user 0.004s	sys 0.000s
I20260709 13:00:58.133671  7531 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:00:58.143239  7518 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:00:58.135602  7331 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:58.166683  7510 raft_consensus.cc:3055] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:58.167260  7510 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:58.168319  7510 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.169665  7510 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:58.172425  1716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54412 (request call id 1576) took 1299 ms (client timeout 1576 ms). Trace:
I20260709 13:00:58.172605  2440 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 13:00:58.173089  2440 pending_rounds.cc:85] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 11
W20260709 13:00:58.172888  1716 rpcz_store.cc:269] 0709 13:00:56.873031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.887576 (+ 14545us) service_pool.cc:224] Handling call
0709 13:00:58.172269 (+1284693us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b540025b2d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:00:58.172371 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724319104}
I20260709 13:00:58.173540  2440 pending_rounds.cc:107] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:00:58.173866  2440 raft_consensus.cc:2889] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:58.175387  7448 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:00:58.185281  7506 log.cc:927] Time spent T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.394s	user 0.003s	sys 0.000s
I20260709 13:00:58.186299  7264 raft_consensus.cc:3055] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:58.186743  7264 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:58.187212  2447 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:00:58.187513  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 417830us
I20260709 13:00:58.190629  7402 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:58.191498  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 407550us
I20260709 13:00:58.193655  7368 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:58.194110  7514 consensus_queue.cc:1059] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:58.195077  7513 raft_consensus.cc:3055] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:58.195462  7513 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:58.196280  7513 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.198390  1567 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:00:58.198712  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:58.199285  1564 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:58.199441  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:58.199815  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:58.200227  1570 raft_consensus.cc:2410] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:00:58.200356  1644 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.201377  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:58.202198  1571 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:58.201961  6976 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:58.202436  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:58.203146  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:58.203598  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:58.200412  1572 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:58.205130  2447 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:58.205359  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.206210  7438 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:58.216266  1713 raft_consensus.cc:1240] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:58.216429  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:58.220268  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:58.220986  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:58.226042  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:58.226043  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:58.242570  7402 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:58.243294  7457 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.243821  7457 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.237582  1644 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:00:58.246901  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:58.254041  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.268529  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:58.269255  1638 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.269290  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:58.270001  1570 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:00:58.269865  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:58.270329  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:58.270807  1564 raft_consensus.cc:2376] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12. Re-sending same reply.
I20260709 13:00:58.271193  1571 raft_consensus.cc:2393] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 14: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:58.272219  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:58.272905  1563 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:58.274351  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:58.280838  2405 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:58.248900  7299 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.253053  7402 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:58.296301  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:58.277014  7297 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:58.282138  7211 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:58.306073  1638 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:00:58.303424  2446 raft_consensus.cc:1240] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:58.304366  1564 raft_consensus.cc:1240] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:58.304780  1686 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.305162  1571 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:58.306385  2438 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:00:58.309343  2438 pending_rounds.cc:85] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 11
I20260709 13:00:58.309710  2438 pending_rounds.cc:107] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:00:58.310109  2438 raft_consensus.cc:2889] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:58.304557  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 111623us
I20260709 13:00:58.266237  7103 consensus_queue.cc:1059] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:00:58.319569  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:58.321422  1563 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
I20260709 13:00:58.324548  2437 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:58.299403  7362 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.187538  7264 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:58.328953  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:58.304102  7297 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.306710  7429 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.335523  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:58.336551  2446 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:58.320617  7402 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:00:58.300591  7299 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.334947  7297 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:58.334265  7327 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:58.345302  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:58.341573  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:58.357499  2437 raft_consensus.cc:2410] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 17 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:00:58.358832  2437 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:58.309580  7427 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:00:58.340258  7478 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:58.360334  7478 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:58.360736  7478 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.345108  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:58.366889  2438 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 13: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
W20260709 13:00:58.373095  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 261624us
I20260709 13:00:58.378067  1685 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.389528  1563 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 19.
I20260709 13:00:58.364092  7427 consensus_queue.cc:1059] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:00:58.339407  7429 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:58.394292  1647 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:58.399534  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:58.412318  1686 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.377738  7331 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15.
I20260709 13:00:58.426846  1638 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:58.432152  1644 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:58.424067  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 134372us
I20260709 13:00:58.433884  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:58.435007  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:58.435539  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:58.435752  1569 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 14: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:58.383637  7508 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:58.366163  7327 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.438967  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:58.439800  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:58.433806  2405 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.504076  1567 raft_consensus.cc:2393] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 12: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:58.504172  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:58.504338  1563 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:58.504902  1569 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 14: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:00:58.391616  7490 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.505594  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:58.507300  2406 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.391214  7534 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:58.540223  1645 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:58.426266  7526 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:58.550493  1638 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:58.552999  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:58.514040  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:58.509711  1567 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:58.517765  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.542587  1568 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:00:58.541455  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 136871us
I20260709 13:00:58.556079  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:58.558715  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:58.414197  6993 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 13:00:58.550748  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:58.512820  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:58.561571  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:58.422619  7511 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.117s
I20260709 13:00:58.428951  7477 consensus_queue.cc:1059] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.127s
W20260709 13:00:58.565835  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 153613us
I20260709 13:00:58.566080  1567 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:00:58.573992  1686 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.574903  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:58.575693  1567 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:00:58.576668  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:58.577270  1567 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:58.564931  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.541538  7473 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:58.571455  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:58.508754  7457 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:58.617763  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:58.619305  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:58.570716  1647 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:58.620587  1612 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:58.610698  1645 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:00:58.611361  1569 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:58.429129  7509 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.134s
I20260709 13:00:58.616171  1568 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:58.429131  7402 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:58.568905  7230 raft_consensus.cc:3055] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:00:58.913678  7539 log.cc:927] Time spent T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:00:58.638154  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 204401us
I20260709 13:00:58.764905  7103 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:58.719309  7547 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:58.939289  7551 log.cc:927] Time spent T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:00:58.930727  7327 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:58.941337  7510 consensus_meta.cc:287] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.768s	user 0.005s	sys 0.006s
W20260709 13:00:58.941738  7555 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:58.942085  7557 consensus_queue.cc:1059] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 13.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:00:58.943372  7350 raft_consensus.cc:3055] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:58.943717  7350 raft_consensus.cc:740] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:58.944482  7350 consensus_queue.cc:260] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.945547  7350 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:58.930400  7362 consensus_meta.cc:287] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.003s
I20260709 13:00:58.946363  7362 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:58.945595  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.765818  7537 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:00:58.947832  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:58.634790  7211 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:58.929267  7513 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:58.915974  7550 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:00:58.923827  7450 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:58.722491  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:58.773738  7409 raft_consensus.cc:993] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:58.969282  7409 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.969790  7409 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:58.781989  7556 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.972388  7556 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.950533  7263 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.974133  7453 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.974740  7453 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.966424  7327 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.962168  7542 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:58.978801  7556 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:58.978597  7327 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.971979  7409 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:58.966856  7557 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:58.980690  7327 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:58.980727  7409 raft_consensus.cc:1081] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:00:58.640820  7346 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:58.745358  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 189352us
W20260709 13:00:58.987438  7478 consensus_meta.cc:287] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.000s
I20260709 13:00:58.987884  1536 leader_election.cc:400] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14.
I20260709 13:00:58.980865  7557 raft_consensus.cc:697] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:58.988768  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.989156  7557 consensus_queue.cc:237] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.802785  7368 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.990422  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 1397) took 1034 ms. Trace:
I20260709 13:00:58.990316  7368 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.990767  1639 rpcz_store.cc:276] 0709 13:00:57.956379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.956496 (+   117us) service_pool.cc:224] Handling call
0709 13:00:57.987060 (+ 30564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.079334 (+ 92274us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b1800490420. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18cce404bc 00007f18ca18e48b 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1a8455 00007f18cd290060 00007f18cd290bfb 00007f18cd29b64b
0709 13:00:58.079507 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.079549 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.088363 (+  8814us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.334046 (+245683us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:58.334113 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.335455 (+  1342us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.990118 (+654663us) raft_consensus.cc:1685] finished
0709 13:00:58.990137 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.990361 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6789,"raft.queue_time_us":15205,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":2981,"spinlock_wait_cycles":10044288,"thread_start_us":266423,"threads_started":2,"wal-append.queue_time_us":462959}
I20260709 13:00:58.845600  7299 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:58.992255  7368 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:58.992364  7570 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:58.989874  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.994063  7429 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:58.994288  7368 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:58.994534  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:58.994987  7368 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:58.996354  7368 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:58.994897  1563 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:00:58.987879  7478 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:58.999289  7478 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:58.758950  7464 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:58.851172  7548 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:00:58.569450  7526 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.732507  7161 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.915525  7264 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:59.008033  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 434089us
I20260709 13:00:59.010147  7429 consensus_queue.cc:1059] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:59.011180  7429 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:59.012128  7526 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.012890  7510 raft_consensus.cc:3055] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:59.013283  7510 raft_consensus.cc:740] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:59.014022  7510 consensus_queue.cc:260] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.015570  2448 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:59.015677  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:59.016273  2436 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:59.016624  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:59.017125  1719 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:59.018078  2442 raft_consensus.cc:1240] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:59.012508  7429 consensus_queue.cc:1059] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:00:59.018338  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:59.019441  2446 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
I20260709 13:00:59.019788  2446 pending_rounds.cc:85] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 14
I20260709 13:00:59.020004  2446 pending_rounds.cc:107] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 13:00:59.020241  2446 raft_consensus.cc:2889] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:58.767946  7540 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:00:58.732240  7457 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:59.012754  7464 raft_consensus.cc:697] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 13:00:58.767247  7544 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
W20260709 13:00:58.766577  7541 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:00:58.541463  7490 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.023167  7464 consensus_queue.cc:237] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.024700  7490 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:00:58.925269  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 309910us
W20260709 13:00:58.892347  7297 consensus_meta.cc:287] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.006s
I20260709 13:00:59.026298  7297 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:59.026887  7264 consensus_queue.cc:1059] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:59.027812  7429 consensus_queue.cc:1059] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:59.028474  7297 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:59.028599  7429 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:58.825954  7366 raft_consensus.cc:3055] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:59.029418  7366 raft_consensus.cc:740] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:59.029857  7536 consensus_queue.cc:1059] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:59.030694  7366 consensus_queue.cc:260] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.032045  7366 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.632766  7534 consensus_queue.cc:1059] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:00:58.731956  7322 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:59.033010  7322 raft_consensus.cc:697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:59.033593  1720 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:00:58.788023  1640 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:00:58.845436  7524 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:59.045243  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:58.624076  7471 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:00:58.932089  2437 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.007s	sys 0.006s
W20260709 13:00:59.049641  2437 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.007s	sys 0.006s
I20260709 13:00:59.046279  1715 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:59.045615  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:59.047991  1719 raft_consensus.cc:1240] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:59.041769  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:58.948726  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 441603us
W20260709 13:00:58.967128  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 244722us
I20260709 13:00:58.967615  7320 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:58.962196  7103 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:58.968379  7546 log.cc:927] Time spent T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:00:58.935534  7230 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:59.005097  7161 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.021624  2436 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:58.732081  7531 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.022497  7517 raft_consensus.cc:3055] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:58.509859  7508 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:58.608074  6929 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:59.002931  7346 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:00:59.067610  2406 leader_election.cc:336] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.576s (SENT)
I20260709 13:00:59.099424  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 13:00:59.070417  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.100962  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.059900  7264 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:00:59.071277  7457 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.111099  7230 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:59.103111  7346 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:59.112180  7103 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:59.112282  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:59.098285  7517 raft_consensus.cc:740] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:59.071880  7471 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.099118  6929 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:59.192713  6929 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.933283  1567 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:00:59.000437  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:58.879988  1565 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:00:59.168438  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 94701.4us
W20260709 13:00:59.201862  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 201360us
I20260709 13:00:59.204031  1536 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:59.070909  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:59.178747  1712 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 7.
W20260709 13:00:59.208194  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 137249us
I20260709 13:00:59.043726  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:59.181320  1687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.015s	sys 0.044s
W20260709 13:00:59.210312  1687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.015s	sys 0.044s
I20260709 13:00:59.210244  1717 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:59.214272  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:59.209233  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:59.218647  1612 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:59.186307  1572 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:59.186492  2406 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:59.225095  2406 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:59.226125  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:00:59.227442  2406 leader_election.cc:400] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12.
I20260709 13:00:59.227830  2406 leader_election.cc:403] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:59.228302  1569 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:59.233680  7103 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.234637  7264 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:59.237447  7264 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:59.238250  7161 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.238621  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:59.234717  7103 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.240567  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:59.266654  7103 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:59.267513  7103 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:59.243337  1611 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:59.268786  7211 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:59.269258  6976 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:59.269790  6976 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.270205  6976 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.246636  7204 consensus_queue.cc:1059] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:59.274848  7204 raft_consensus.cc:3055] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:59.275274  7204 raft_consensus.cc:740] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:59.276605  7204 consensus_queue.cc:260] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:59.247913  7297 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:59.248859  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 45084.1us
I20260709 13:00:59.279013  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:59.281397  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:59.282442  7211 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:59.283705  7211 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:59.285619  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:59.034031  7322 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.286382  7204 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.253803  7327 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:59.291785  7350 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:59.292845  7350 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:59.239547  1717 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 7.
I20260709 13:00:59.109808  7457 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.258911  7331 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:59.242744  7264 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.249014  7299 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:59.256569  7320 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:59.065784  7524 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:59.129848  7553 log.cc:927] Time spent T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.308s	user 0.000s	sys 0.005s
I20260709 13:00:59.415247  7346 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.416148  7524 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.106371  7557 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:59.130722  7565 raft_consensus.cc:3055] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:59.335963  7350 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12.
I20260709 13:00:59.349340   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:59.419334  7565 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:59.421296  7565 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.354254  6976 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.374101  2406 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:59.378448  7467 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.379925  7299 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:59.380667  7457 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:00:59.381633  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 96197.9us
I20260709 13:00:59.382886  7558 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:59.383747  7264 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.128063  7508 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.402729  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:59.408550  7230 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:59.422693  7435 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:00:59.350939  1640 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:00:59.386329  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:59.369328  7426 consensus_queue.cc:1059] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.142s
I20260709 13:00:59.449018  7346 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.448493  6976 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.466758  1640 pending_rounds.cc:85] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 13
I20260709 13:00:59.477102  1640 pending_rounds.cc:107] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:00:59.493464  1640 raft_consensus.cc:2889] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:59.501184  1569 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:00:59.505110  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:59.506238  7558 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:59.511408  1641 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:59.513991  7299 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:59.521667  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:59.522469  1714 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.523027  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:59.544749  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 58357.7us
I20260709 13:00:59.124344  7517 consensus_queue.cc:260] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:59.556233  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 216273us
I20260709 13:00:59.523712  7331 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.494099  6929 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.562209  7426 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.567263  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 124979us
I20260709 13:00:59.566854  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:59.575372  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:00:59.578378  1644 raft_consensus.cc:1275] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:00:59.578444  7510 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.563243  7346 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:59.580565  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:59.587878  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:59.574092  7426 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:59.598845  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.593719  7453 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.600533  7531 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:59.601504  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:59.589404  2447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 880) took 1336 ms. Trace:
I20260709 13:00:59.592440  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:59.513839  7467 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:00:59.606280  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.606801  7567 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:59.607596  7560 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:00:59.607931  7467 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.608240  7560 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.619985  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:59.621337  1718 raft_consensus.cc:1240] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:59.608242  6993 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.623355  6993 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.625784  6993 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.589341  7331 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.633610  1644 raft_consensus.cc:2393] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 9: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:00:59.629954  7346 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:59.625891  7471 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.642998  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:59.643893  2446 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 13:00:59.644750  7426 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.641314  7103 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:59.645471  1647 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:00:59.645036  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:59.646479  2438 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:00:59.648728  6929 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.649031  7346 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:59.651033  7582 log.cc:927] Time spent T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:59.651170  7560 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.605052  2447 rpcz_store.cc:276] 0709 13:00:58.209673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.209808 (+   135us) service_pool.cc:224] Handling call
0709 13:00:58.210096 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.210680 (+   584us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:58.382256 (+171576us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.539362 (+157106us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.551922 (+ 12560us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.552229 (+   307us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:58.552277 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.552363 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.098551 (+546188us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:00:59.495529 (+396978us) raft_consensus.cc:1685] finished
0709 13:00:59.495689 (+   160us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.546338 (+ 50649us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":521330,"prepare.run_cpu_time_us":3269,"prepare.run_wall_time_us":51406,"raft.queue_time_us":42168,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":19914,"spinlock_wait_cycles":4918656,"thread_start_us":216581,"threads_started":2,"wal-append.queue_time_us":231803}
I20260709 13:00:59.655539  7439 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.655699  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:59.656280  7439 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:59.657143  7508 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:00:59.660022  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:59.660643  1712 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:00:59.663735  1611 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:59.664098  7263 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.664665  7263 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.665864  7474 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:59.666313  7474 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:59.666635  7565 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.656649  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:59.667534  1717 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 13:00:59.668594  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:59.669337  1647 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:00:59.672744  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:00:59.666718  7474 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.678292  7566 raft_consensus.cc:3055] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:59.678753  7566 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 13:00:59.678952  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.679986  1611 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:59.679827  7566 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:59.682264  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:00:59.682726  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 48322.4us
I20260709 13:00:59.680979  7566 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:59.686643  7439 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:59.690258  7463 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:59.691002  7560 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.693826  7517 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.694213  7471 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:59.686663  1644 raft_consensus.cc:1240] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:59.699216  1645 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:59.706925  1714 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
W20260709 13:00:59.714205  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.703727  7463 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:00:59.716205  7463 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.717711  7463 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:59.722668  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 51112.4us
I20260709 13:00:59.723603  2406 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:59.726615  7103 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:59.726975  2406 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:00:59.727138  7103 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:59.728356  2406 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:59.728243  7103 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.729444  7585 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:59.729945  7585 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:59.730365  7585 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:59.730554  7557 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:59.731015  7557 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:00:59.731395  7557 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:59.740471  7592 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
I20260709 13:00:59.743600  7570 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.718734  7204 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:59.744266  7570 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.744400  7585 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.745704  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:59.746330  1644 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:00:59.746644  7570 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.747030  7585 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:59.747350  7331 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.748364  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:00:59.748934  1641 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:00:59.751570  1569 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:00:59.756203  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:59.757141  1565 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:00:59.759126  2405 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:59.759410  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:59.759966  2437 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 13:00:59.760432  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:59.760849  7585 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:59.761539  7585 raft_consensus.cc:697] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:00:59.761807  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:00:59.762501  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:59.720697  7560 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:59.763089  2447 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:00:59.762676  7585 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.764936  7560 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:00:59.760747  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:59.765653  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:59.766857  7263 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.768628  2440 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:00:59.793723  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 49745.5us
W20260709 13:00:59.793673  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 67555us
I20260709 13:00:59.801084  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:59.802786  1611 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:00:59.801898  1565 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:00:59.805459  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:00:59.806828  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:00:59.808719  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 48383.7us
I20260709 13:00:59.806257  1686 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:59.810593  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:59.817919  7204 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.813552  7508 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:59.818219  7312 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:59.819332  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:00:59.823637  1569 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 19.
W20260709 13:00:59.819442  7581 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.193s	user 0.001s	sys 0.001s
I20260709 13:00:59.808615  7346 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:59.801714  7525 consensus_queue.cc:1059] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:00:59.834797  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:00:59.813155  7560 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:59.845192  7435 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:59.855072  7508 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.858667  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:59.864102  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:59.865473  1714 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:00:59.872772  1714 pending_rounds.cc:85] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 9
I20260709 13:00:59.837340  7312 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.846988  1686 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:59.873170  1714 pending_rounds.cc:107] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:00:59.836170  7204 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.875070  1714 raft_consensus.cc:2889] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:59.847224  7560 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.870738  7263 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:59.898729  2440 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:00:59.890460  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:59.861768  7557 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.901578  2444 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:00:59.877055  7312 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.874207  7346 raft_consensus.cc:697] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:00:59.882625  7585 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:00:59.789832  7474 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:59.893134  7560 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:59.914433  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 95231.4us
W20260709 13:00:59.912289  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 65871.7us
I20260709 13:00:59.892663  7263 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.882045  7435 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.933713  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:59.932029  7264 raft_consensus.cc:2764] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:00:59.932457  7263 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:59.945454  7565 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.956388  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:00:59.958177  7547 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:00:59.970841  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 44528.9us
I20260709 13:00:59.971776  1686 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:00:59.984496  7435 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.987772  7402 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:00:59.988444  7402 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:00:59.990710  7402 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:00:59.995294  7603 log.cc:927] Time spent T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:00:59.995425  7474 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:00:59.996042  7473 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:59.996522  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:00:59.927402  7585 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.980052  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:00:59.953714  7517 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.953158  7361 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:01:00.019917  2406 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.596s (SENT) [suppressed 37 similar messages]
I20260709 13:01:00.021113  1537 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:00.022782  7508 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:00:59.934947  7567 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:01:00.000345  7565 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:00.026340  7402 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.026816  7558 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:00.033275  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:00.034142  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:00.001001  7510 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:00.021627  7547 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:00:59.958352  7346 consensus_queue.cc:237] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.052477  1537 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:01:00.053973  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.052233  7463 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:00.027141  6993 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 13:01:00.063293  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 83373.5us
I20260709 13:01:00.050768  7510 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:00.046542  7361 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.071187  7426 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.071674  7435 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.071939  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:00.072124  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:00.072662  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:00.072988  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:00.074898  7547 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:00.076568  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:00.077440  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:00.079653  7299 raft_consensus.cc:3055] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:00.063719  7331 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:00.085052  7204 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.086130  7402 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.106848  7508 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:00.112968  7508 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.113327  7508 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:00.113857  7402 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.056849  7264 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:01:00.100680  7557 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:00.119248  7585 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:00.088852  6929 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:00.098407  7510 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.122351  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:00.122391  7475 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:00.123235  7475 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.089752  7536 consensus_queue.cc:1048] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:01:00.126116  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.126164  7570 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:00.127341  7570 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.127893  2437 raft_consensus.cc:2393] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 14: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:00.128089  7570 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.066282  7558 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:00.133323  7558 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:00.108572  1719 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:01:00.108898  1713 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:01:00.134727  1717 raft_consensus.cc:2410] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:01:00.136776  2405 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:00.138314  7557 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:00.138705  7557 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:00.139019  7361 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:00.093575  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:00.094343  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:00.095122  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:00.102787  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:00.140753  2443 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:01:00.140993  2442 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:00.054530  7517 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.104696  7426 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.143122  7560 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:00.144282  1718 raft_consensus.cc:2368] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12.
I20260709 13:01:00.129768  7312 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.106876  7299 raft_consensus.cc:740] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:00.111078  1565 raft_consensus.cc:2393] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 14: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:00.110719  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:00.147310  2436 raft_consensus.cc:2393] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 9: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:00.111711  2438 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:00.147490  7299 consensus_queue.cc:260] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.098012  7471 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:01:00.148960  7299 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.149760  7312 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:00.139056  7557 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.152740  1685 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:00.153755  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 53247us
I20260709 13:01:00.154541  7566 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:00.144145  7426 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.108794  7331 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.155407  7331 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.146363  7517 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.106693  7435 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.159751  7263 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.160288  2438 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:01:00.164436  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.165796  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:00.167649  2405 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:00.168632  2405 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:00.170068  7570 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.170536  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:00.171003  7374 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:00.171432  7374 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:00.171801  7374 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.172219  7585 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:00.172362  7570 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.172708  7585 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:00.173164  7585 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:00.174795  7361 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:00.175261  7361 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.175806  7361 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.091693  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:00.178670  7204 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:00.179124  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 87518.3us
I20260709 13:01:00.127509  7565 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:00.181737  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:00.181967  2436 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:00.182430  1565 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:00.179268  7517 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:00.183791  7517 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.184154  7517 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:00.188691  7508 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.191835  7435 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.192525  7560 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:00.198369  1611 leader_election.cc:400] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12.
I20260709 13:01:00.198740  1611 leader_election.cc:403] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:00.199411  7263 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.200136  7204 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:00.204211  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:00.211274  1569 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 13:01:00.204406  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:00.204556  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:00.212664  2442 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 8.
I20260709 13:01:00.213109  1565 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:01:00.202013  7510 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.204970  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:00.267751  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 62870.9us
I20260709 13:01:00.209055  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:00.205704  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:00.269404  1570 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:00.203841  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:00.273520  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:00.205919  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:00.275712  1564 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:00.276417  1718 raft_consensus.cc:2393] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 9: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:00.271716  2436 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:01:00.278415  1686 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:00.280468  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:00.282150  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:00.284677  1686 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:00.291721  1719 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.287190  1685 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:00.293216  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:00.313397  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:00.315635  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:00.316102  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:00.319850  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:00.315565  7557 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.320901  1638 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:00.296962  7565 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:00.321899  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:00.322702  2442 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:00.324281  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:00.324508  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:00.285957  7471 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.327256  1718 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:00.206697  7475 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:00.330538  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 310151us
I20260709 13:01:00.209545  7331 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.208022  7585 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.333236  1686 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:00.292954  7426 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:00.343087  1686 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:00.322072  7565 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.286165  7560 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:01:00.352129  7547 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:01:00.362463  1570 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:01:00.352398  1639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36692
I20260709 13:01:00.363682  1639 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:00.364068  1639 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.353080  7450 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.354419  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:00.356755  7475 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:00.344524  7426 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.285940  7374 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:00.351614  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 72169.5us
I20260709 13:01:00.330507  7557 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:00.338460  7566 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:00.368288  1717 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.369270  2438 raft_consensus.cc:1240] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:00.347343  7264 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:00.351130  7565 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.386811  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:00.391471  7558 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.384841  7426 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:00.389583  7439 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:00.389915  7566 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.391789  7264 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:00.410437  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 86048.3us
I20260709 13:01:00.399022  7567 raft_consensus.cc:3055] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:00.400041  7508 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.409603  7560 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:00.403736  7439 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.411984  7566 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:00.415519  7264 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.446411  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:00.427471  7567 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:00.396605  7450 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:00.472111  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 445573us
I20260709 13:01:00.477843  1685 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:00.482204  7467 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:00.482928  7525 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:00.484485  7263 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:00.484589  7361 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.485081  7263 raft_consensus.cc:697] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:00.486126  7263 consensus_queue.cc:237] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:00.488252  7570 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:00.488376  7475 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:00.490288  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:00.495348  1717 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:01:00.441599  7439 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:00.475821  1639 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.427141  7558 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:00.497270  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 62848.4us
I20260709 13:01:00.466440  7510 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.444324  7560 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 13:01:00.514329  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 446374us
I20260709 13:01:00.525692  2438 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:00.527472  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 140751us
I20260709 13:01:00.538254  1719 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:01:00.539719  1639 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.475548  7453 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:01:00.500517  7517 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:00.560204  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 70021.6us
I20260709 13:01:00.522744  7331 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.546396  2405 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:00.549746  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:00.568018  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:00.542040  7510 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.578488  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:00.592667  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:00.597550  2438 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 8.
I20260709 13:01:00.605365  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:00.605996  2444 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:00.610574  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:00.610741  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:00.611174  2442 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.608392  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:00.573107  6929 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:01:00.627563  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 72660.9us
I20260709 13:01:00.538502  7567 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.594905  7510 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:00.620832  7263 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 13:01:00.635886  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 93491.9us
I20260709 13:01:00.616720  7230 consensus_queue.cc:1059] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:01:00.615638  7440 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.145s
I20260709 13:01:00.643061  1639 raft_consensus.cc:1240] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:00.637841  1611 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:00.644012  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:00.650413  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:00.646528  7453 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:01:00.637840  7570 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:00.652462  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:00.651301  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:00.652290  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:00.648473  7366 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.671120  7366 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.666954  7557 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:00.673254  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:00.673647  7557 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.674556  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:00.675702  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:00.646766  7426 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:00.653659  7610 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:01:00.679080  7426 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:00.652782  7583 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:00.679826  7583 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:00.680188  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:00.680972  2448 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 13: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:00.680776  7583 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.656616  7230 raft_consensus.cc:3055] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:00.682269  7230 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:00.633801  7307 consensus_queue.cc:1059] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:01:00.682971  1647 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:01:00.683395  7307 raft_consensus.cc:3055] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:00.683775  7307 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:00.682281  7558 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.686178  7517 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:00.626102  6929 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.694522  6929 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:00.698601  7624 log.cc:927] Time spent T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:00.701107  1718 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.700731  7230 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.644711  7263 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:00.646651  7331 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:00.667218  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 91845.9us
W20260709 13:01:00.686440  7611 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:01:00.707307  7435 raft_consensus.cc:3055] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:00.650638  7619 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.725456  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:00.725980  7619 consensus_queue.cc:1059] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:00.727712  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:00.728482  1565 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 20: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:00.719125  2443 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:01:00.649335  7204 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12.
I20260709 13:01:00.724647  7435 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:00.730100  1640 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:01:00.730732  7435 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.731889  7435 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:00.732466  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:00.726318  7402 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:00.734366  7402 raft_consensus.cc:697] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:00.735316  7402 consensus_queue.cc:237] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.728534  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:00.729183  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:00.737567  1569 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:01:00.703007  1645 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:00.673432  7366 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:00.634291  7560 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.753728  1564 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:01:00.730000  7619 raft_consensus.cc:3055] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:00.755131  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:00.758909  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:00.760099  2444 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:01:00.756618  7331 raft_consensus.cc:697] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:00.749835  7230 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:00.765619  2442 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:01:00.738422  7307 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.752970  7463 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:00.782370  1569 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.757519  7510 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:00.781313  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:00.757179  7619 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:00.785933  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:00.791973  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:00.779816  7570 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.793220  7570 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.795457  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:00.800283  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:00.800873  2443 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:00.800948  1643 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:01:00.801826  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:00.803356  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:00.804098  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:00.804565  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:00.804868  1641 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:00.805295  1640 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 9: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:00.806118  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:00.803412  1645 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:00.805841  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:00.815069  7331 consensus_queue.cc:237] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:00.815836  7628 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:01:00.816331  7426 consensus_queue.cc:1059] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:00.819595  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:00.820181  1685 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:00.827512  2406 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:00.784494  7463 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.817454  7536 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.834510  7557 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:00.834407  7536 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.835109  7557 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:00.836826  7439 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.840245  1640 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:00.845647  1716 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:01:00.823408  7629 raft_consensus.cc:3055] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:00.847608  7629 raft_consensus.cc:740] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:00.817377  7510 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.848330  7510 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.848825  7629 consensus_queue.cc:260] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.830438  7440 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.850914  7440 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.852092  7619 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.852984  7440 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.856913  7629 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.859704  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:00.860446  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:00.861032  2440 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:00.846091  1716 pending_rounds.cc:85] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 8
I20260709 13:01:00.863267  1716 pending_rounds.cc:107] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:01:00.863500  1716 raft_consensus.cc:2889] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:00.864440  7566 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:00.865219  7625 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.140s	user 0.002s	sys 0.000s
I20260709 13:01:00.866400  1572 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:00.839174  6929 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:00.867401  1720 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:00.867597  6929 raft_consensus.cc:697] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:00.868497  6929 consensus_queue.cc:237] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.874526  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:00.875662  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:00.876608  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:00.877154  1719 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:00.879824  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.814005  7565 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.882692  1714 raft_consensus.cc:2393] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 9: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:00.874596  1715 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:00.884615  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:00.885682  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:00.886373  7426 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.888067  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:00.893148  1718 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 13:01:00.791302  7264 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.895573  1715 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:01:00.920426  2406 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:00.921875  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:00.923691  1686 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:00.924099  7558 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:00.924770  7558 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:00.926654  2406 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:00.928083  1612 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:00.886910  7426 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.925366  7230 raft_consensus.cc:2764] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:01:00.941200  1569 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:01:00.935729  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:00.959739  1719 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:01:00.962904  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:00.968669  7565 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.963784  2437 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
W20260709 13:01:00.969949  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.970741  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:00.971298  2437 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:00.929884  7473 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:01:00.975612  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 48903.7us
I20260709 13:01:00.978384  1686 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:00.934095  7631 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:00.984197  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:00.984947  2438 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.987104  7586 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 13:01:00.972529  7634 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.177s	user 0.002s	sys 0.000s
I20260709 13:01:00.982827  7473 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:00.993748  7473 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.997741  7558 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:00.999070  7426 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:01.000550  7471 consensus_meta.cc:287] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.001s
I20260709 13:01:01.001147  7471 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:01.001804  1714 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:01:00.935588  7346 consensus_queue.cc:1059] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:01:01.011935  1536 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:01.009693  2438 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:01:01.013562  2440 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 13:01:01.011516  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:00.980994  7439 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:00.959175  7630 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:01:00.988013  7230 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:01.044811  2438 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:01.050884  2437 raft_consensus.cc:2468] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:01:01.054877  7620 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:01.046301  7346 raft_consensus.cc:3055] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:01.056062  7346 raft_consensus.cc:740] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:01.056937  7361 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:01.057293  7570 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:01.024865  7558 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:01.027384  7230 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.059087  7440 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:01.060017  7230 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:01.057017  7346 consensus_queue.cc:260] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.060954  7346 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.067220  1686 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:01:01.068527  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 57116.1us
I20260709 13:01:01.069240  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:01.071108  7161 consensus_queue.cc:1059] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:01.071734  1572 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:01:01.071841  7161 consensus_queue.cc:1243] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:01.072482  7161 raft_consensus.cc:3055] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:01.072781  7161 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:01.071162  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:01.074548  1563 raft_consensus.cc:2368] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12.
I20260709 13:01:01.018476  7366 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.018636  7633 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:01.075649  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:01.073632  7161 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:00.987835  7586 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.076663  7161 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:01.078200  7586 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:01.080230  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:01.083876  1564 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:01:01.086575  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:01.080250  7560 raft_consensus.cc:2804] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:01.088191  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:01.082432  7630 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.083420  7204 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:01.092839  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:01.093436  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:01.093943  7307 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.094542  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:01.090574  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.096411  7264 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:01.096638  7463 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:01.087477  7299 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:01:01.099339  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:01.089947  1642 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:01.112314  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.101187  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:01.101312  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:01.116616  1647 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:01:01.100425  1640 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:01:01.050621  7402 consensus_queue.cc:1059] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:01:01.174360  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:01.177175  1564 raft_consensus.cc:2368] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12.
W20260709 13:01:01.175086  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 62849.1us
I20260709 13:01:01.177757  1686 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.234124  1638 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 9: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 13:01:01.236438  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.237865  1717 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:01.248153  2446 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:01.248809  7631 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:01.250154  7312 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:01.251986  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 74343.5us
I20260709 13:01:01.100358  7586 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:01.267472  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:01.260520  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:01.261034  1565 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:01:01.261227  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.264840  1537 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:01.265475  7616 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:01.179299  7557 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:01.101445  7560 raft_consensus.cc:697] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:01.181196  7361 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.272696  2448 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:01:01.267915  7439 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:01.292258  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:01.291524  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:01.294960  1572 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:01.250898  7103 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:01:01.284220  7620 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.281147  7570 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:01.313130  7621 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:01:01.314597  7642 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:01:01.315407  7263 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:01.318889  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.319782  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:01.321839  7331 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:01.322382  7331 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:01.322916  7374 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:01.324316  7536 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:01.324688  7331 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:01.325014  7536 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.325677  7560 consensus_queue.cc:237] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.326587  7566 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:01.322862  7510 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:01.313741  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:01.339964  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:01.340634  2447 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:01.271018  7586 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:01.342187  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 242923us
I20260709 13:01:01.296919  7585 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:01.348129  1567 raft_consensus.cc:3055] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:01.349386  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:01.350430  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:01.350916  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:01.351089  2444 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 20.
I20260709 13:01:01.351469  2437 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.348620  1567 raft_consensus.cc:740] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:01.354578  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:01.346257  1572 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 20.
I20260709 13:01:01.358860  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:01.309964  7439 raft_consensus.cc:697] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:01.359428  1641 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.360069  1646 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:01:01.363385  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:01.363612  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 171961us
I20260709 13:01:01.342286  7510 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.364500  1720 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:01.341440  7621 raft_consensus.cc:697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:01.394754  7621 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.399281  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:01.361140  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:01.373255  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:01.373459  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:01.373502  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:01.376086  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:01.406770  1638 raft_consensus.cc:2393] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:01.376240  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:01.377238  7644 log.cc:927] Time spent T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:01.377456  7558 raft_consensus.cc:3055] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:01.377703  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:01.378041  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:01.378787  1570 raft_consensus.cc:2410] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:01.352202  7475 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.380935  7586 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:01.381670  7439 consensus_queue.cc:237] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:01.348057  7570 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:01.346930  7620 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.383901  7619 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.384537  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.386364  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:01.303810  7616 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:01.358870  1567 consensus_queue.cc:260] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.371731  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:01.391150  7312 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:01.393673  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:01.408224  2447 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
I20260709 13:01:01.409677  1685 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:01.411263  1642 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:01:01.445053  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:01.445696  1642 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:01:01.446694  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:01.411139  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:01.411676  1644 raft_consensus.cc:2393] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 11: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:01.403307  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:01.360591  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:01.418900  2444 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:01:01.419044  1641 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:01:01.443769  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:01.418211  7558 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:01.448668  1642 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:01.418444  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:01.449589  1567 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:01.431282  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.347956  7230 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.440161  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:01.442740  1571 raft_consensus.cc:3060] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:01.466542  2405 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:01:01.460551  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 57345us
I20260709 13:01:01.464178  1572 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:01:01.419567  2437 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:01:01.468998  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:01.473281  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 13:01:01.471508  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 87047us
I20260709 13:01:01.437600  7299 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.474314  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.475231  1564 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 20.
I20260709 13:01:01.475955  1645 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.479723  1685 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:01.475145  1686 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.412734  7510 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:01.486758  7510 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:01.486825  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:01.487799  1572 raft_consensus.cc:2410] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:01:01.488687  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:01.489295  1572 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.484490  7536 raft_consensus.cc:2804] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:01.466156  7463 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:01.490425  1717 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 17.
I20260709 13:01:01.490777  1567 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 13:01:01.477063  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:01.502305  1568 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:01.502780  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:01.494141  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:01.481716  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 196241us
I20260709 13:01:01.498085  1686 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:01.437849  7475 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.506381  1686 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.507170  1537 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:01.477938  7204 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:01.469930  7435 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:01.478500  7646 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.448661  7331 consensus_queue.cc:1059] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:01:01.489741  7361 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:01.529166  1645 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:01:01.521574  1537 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:01.521317  7435 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.533414  7435 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:01.533703  1721 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:01.522430  7536 raft_consensus.cc:697] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:01.534942  7536 consensus_queue.cc:237] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:01.501755  7463 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.537155  1572 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:01:01.507988  7510 raft_consensus.cc:2804] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:01.538383  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:01.559859  1567 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:01:01.558085  1537 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:01.514909  7629 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:01.515581  7567 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:01.539070  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 58937.9us
I20260709 13:01:01.565634  1536 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:01.571436  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 66026.4us
I20260709 13:01:01.572657  2405 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.574092  2405 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:01.532879  7361 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.540395  6993 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:01.540710  7463 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:01.579659  1720 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 17.
I20260709 13:01:01.514797  7471 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:01:01.560918  7204 raft_consensus.cc:697] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:01.590544  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:01.501468  7299 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.560652  7453 raft_consensus.cc:3055] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:01.558637  7570 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:01.601715  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.539104  7264 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:01.586557  7586 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.554862  7655 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.584386  7374 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:01.564292  7629 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.553779  7620 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:01.611778  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:01.576264  7346 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:01:01.618950  2405 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.620981  1685 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.556627  7475 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:01.571552  7510 raft_consensus.cc:697] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 20 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:01.646287  7650 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:01:01.646368  7510 consensus_queue.cc:237] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:01.628062  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:01.649377  7263 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:01.649904  1686 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:01.650600  1685 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:01.630285  1567 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 17.
I20260709 13:01:01.653558  7264 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:01.654276  7661 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:01.655329  7661 raft_consensus.cc:697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:01.591562  7361 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:01.656288  7661 consensus_queue.cc:237] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.654321  7264 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:01.658818  7264 raft_consensus.cc:697] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:01.659780  7264 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.660689  7204 consensus_queue.cc:237] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.532631  7646 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.662400  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:01.606891  7517 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:01.633718  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:01.637594  1645 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.615710  1612 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:01.640007  7654 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:01.644467  7656 log.cc:927] Time spent T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:01:01.626032  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.588217  7566 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:01.616979  7453 raft_consensus.cc:740] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 13:01:01.675625  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 61665.2us
W20260709 13:01:01.676067  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 57223.7us
I20260709 13:01:01.536180  7558 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.631417  7621 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:01.764722  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.825868  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:01.829670  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.839926  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:01.675168  7366 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:01.848965  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:01.720093  7652 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:01.703094  7654 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:01.769791  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.638067  7629 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:01.883459  7453 consensus_queue.cc:260] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:01.872951  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 307381us
I20260709 13:01:01.884517  7453 raft_consensus.cc:3060] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:01.884920  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.719079  6993 raft_consensus.cc:697] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:01.705212  7374 raft_consensus.cc:697] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:01:01.854897  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 290069us
I20260709 13:01:01.849869  1638 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:01:01.907009  1568 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 9.
W20260709 13:01:01.880838  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.843116  7230 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:01.916307  1645 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:01:01.191407   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:01.721570  7263 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:01.702565  7475 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:01.846181  7646 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:01.934687  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.719403  7517 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.936244  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.929351  7230 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.894758  7616 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:01.945833  7649 log.cc:927] Time spent T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:01:01.794822  7566 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.936619  2447 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:01.937537  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:01.933885  7663 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:01:01.946152  7657 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:01:01.946923  7299 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:01.879696  7654 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:01.915531  7558 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.956504  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.971171  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:01.934477  7331 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:01.893280  7631 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:01.917207  7508 raft_consensus.cc:2764] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:01:01.892840  7366 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.921550  7346 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.963366  1568 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.927616  7263 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.931147  7402 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:01.927542  7473 consensus_queue.cc:1059] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260709 13:01:01.989856  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.973615  7652 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.962819  7450 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:01.934186  6993 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.000828  7473 raft_consensus.cc:3055] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:01:02.001513  1571 consensus_meta.cc:287] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.000s
I20260709 13:01:02.002774  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:02.017354  1569 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.974965  7663 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:02.021679  1571 raft_consensus.cc:2468] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
W20260709 13:01:02.012971  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.959079  7230 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:01.988272  7263 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:02.058210  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:01:02.050244  7619 consensus_meta.cc:287] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.003s
I20260709 13:01:02.016302  7473 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:01.983219  7346 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:02.084350  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:01.994675  7331 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.053102  7651 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.975229  7631 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.019213  7402 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.094256  1568 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:01.988531  7374 consensus_queue.cc:237] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:02.095634  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 311694us
I20260709 13:01:02.049932  7435 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.098590  1569 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:01:02.111037  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:02.088006  7668 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:02.081122  7361 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.124007  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:02.118333  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:01:02.118871  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 223584us
I20260709 13:01:02.110188  7620 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:02.110234  7557 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:02.141896  2446 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:02.143244  2436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 902) took 1335 ms. Trace:
I20260709 13:01:02.143330  7346 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:02.115492  7663 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.145943  7361 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:02.146577  2437 raft_consensus.cc:2393] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:02.147218  7230 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:02.135535  7674 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.209s	user 0.001s	sys 0.001s
I20260709 13:01:02.147956  7473 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.192001  7473 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.193706  7629 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.150640  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:02.156522  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:02.194986  7567 consensus_meta.cc:287] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.000s
I20260709 13:01:02.195174  2442 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 20.
I20260709 13:01:02.196496  7629 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:02.149981  7659 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.178s	user 0.001s	sys 0.001s
W20260709 13:01:02.199450  7586 consensus_meta.cc:287] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.000s
I20260709 13:01:02.166528  7566 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.199970  7586 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:02.201278  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:02.202370  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:02.203341  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:02.204869  7646 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.205538  7646 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:02.169328  7463 consensus_meta.cc:287] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.547s	user 0.006s	sys 0.001s
I20260709 13:01:02.207141  2446 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:02.207444  7463 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:02.179625  2436 rpcz_store.cc:276] 0709 13:01:00.807888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.046220 (+238332us) service_pool.cc:224] Handling call
0709 13:01:01.055637 (+  9417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.088310 (+ 32673us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:01.176566 (+ 88256us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.437615 (+261049us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.437686 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:01.441155 (+  3469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.142306 (+701151us) spinlock_profiling.cc:243] Waited 872 us on lock 0x7b1800335860. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1792a6 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419
0709 13:01:02.142981 (+   675us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b540017b6d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:02.143030 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.143183 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3757,"prepare.queue_time_us":78994,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":7492,"raft.queue_time_us":1804,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":6923,"spinlock_wait_cycles":59196672,"thread_start_us":170739,"threads_started":1,"wal-append.queue_time_us":329742}
I20260709 13:01:02.212759  2438 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:01:02.210609  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:02.213181  2438 pending_rounds.cc:85] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 12
I20260709 13:01:02.213462  2438 pending_rounds.cc:107] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:01:02.213712  2438 raft_consensus.cc:2889] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:02.214762  2447 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:02.128649  7161 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:02.175190  7435 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 21 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.176242  7366 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:02.178220  7661 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.094173  7651 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.224193  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:02.228579  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:02.135957  7679 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.231523  2443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 909) took 1139 ms. Trace:
I20260709 13:01:02.231886  2443 rpcz_store.cc:276] 0709 13:01:01.092148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.098686 (+  6538us) service_pool.cc:224] Handling call
0709 13:01:01.241546 (+142860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.365163 (+123617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.365204 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.365259 (+    55us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:01:01.365310 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.231305 (+865995us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400747f54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:02.231357 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.231471 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283727744}
I20260709 13:01:02.170935  7402 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.238919  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:02.176239  7517 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.210031  7463 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:02.219743  7557 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.240960  7366 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:02.289762  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:01:02.343338  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.354678  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 126177us
W20260709 13:01:02.384096  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.385361  7687 log.cc:927] Time spent T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:01:02.241364  7679 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.236294  7661 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.375624  7665 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:02.576908  1568 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:01:02.578620  7677 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:02.579387  7331 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:02.580214  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.675263  1570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.029s	sys 0.074s
I20260709 13:01:02.618474  6929 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:01:02.675592  1570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.029s	sys 0.074s
I20260709 13:01:02.630793  7629 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:02.583791  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:02.678970  1572 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:01:02.616680  2438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 1474) took 1254 ms. Trace:
I20260709 13:01:02.679561  1567 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:02.576478  7517 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:01:02.604135  7683 log.cc:927] Time spent T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.228s	user 0.000s	sys 0.008s
I20260709 13:01:02.630009  1563 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:02.637042  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:02.235072  7586 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:01:02.639528  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:02.690044  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3873) took 1130 ms. Trace:
I20260709 13:01:02.639942  1721 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:01:02.641077  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:02.640290  1646 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.015s	sys 0.053s
I20260709 13:01:02.690444  1572 rpcz_store.cc:276] 0709 13:01:01.559224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.689273 (+1130049us) service_pool.cc:224] Handling call
0709 13:01:02.689568 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.689766 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.689790 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.689829 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:02.689863 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.689914 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.689999 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:02.691200  1646 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.015s	sys 0.053s
I20260709 13:01:02.240882  7346 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:02.645529  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:02.640275  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:02.692430  1685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.028s	sys 0.056s
I20260709 13:01:02.692548  2437 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:01:02.692818  1685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.028s	sys 0.056s
I20260709 13:01:02.648677  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:02.650847  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 13:01:02.602193  7654 consensus_meta.cc:287] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.004s
W20260709 13:01:02.668618  1612 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.020s	sys 0.042s
I20260709 13:01:02.672479  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:02.696297  1612 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.020s	sys 0.042s
I20260709 13:01:02.530843  7463 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:02.671327  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:02.697209  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 1430) took 1080 ms. Trace:
I20260709 13:01:02.697582  1646 rpcz_store.cc:276] 0709 13:01:01.611967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.612076 (+   109us) service_pool.cc:224] Handling call
0709 13:01:01.629770 (+ 17694us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.848269 (+218499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.848313 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.892736 (+ 44423us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.086414 (+193678us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:02.691662 (+605248us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.691925 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.692003 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.692042 (+    39us) raft_consensus.cc:1685] finished
0709 13:01:02.692052 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.692160 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8930,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":924823,"threads_started":3,"wal-append.queue_time_us":374776}
I20260709 13:01:02.698328  7463 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.699493  7346 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:02.701611  7652 consensus_meta.cc:287] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.683s	user 0.006s	sys 0.000s
I20260709 13:01:02.692282  7440 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:02.703080  7557 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:02.667713  2406 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:02.689189  7629 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.705276  7672 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:02.704879  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 57283.9us
I20260709 13:01:02.705829  7672 raft_consensus.cc:697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:02.706462  7629 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.706589  2406 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:02.706892  7672 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.707692  7547 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:02.688910  6929 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.710124  7547 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.681823  7677 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.710637  7547 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.712046  7677 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.712414  7679 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.712627  7547 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:02.680449  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3871) took 1290 ms. Trace:
I20260709 13:01:02.713136  1567 rpcz_store.cc:276] 0709 13:01:01.390417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.678706 (+1288289us) service_pool.cc:224] Handling call
0709 13:01:02.679101 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.680110 (+  1009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.680382 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:02.713835  7473 consensus_meta.cc:287] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
I20260709 13:01:02.714095  1567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:01:02.606835  1467 catalog_manager.cc:5697] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 12 to 13, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:02.714738  1567 raft_consensus.cc:606] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:02.677265  7439 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:01:02.716141  1567 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:02.688421  1720 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 21: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:02.689819  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 3032) took 1305 ms. Trace:
I20260709 13:01:02.578137  7453 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:02.701709  7346 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.710999  2436 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:02.716622  7654 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.679828  2438 rpcz_store.cc:276] 0709 13:01:01.361929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.362099 (+   170us) service_pool.cc:224] Handling call
0709 13:01:01.362345 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.214130 (+851785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.616404 (+402274us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54009f4554. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:02.616615 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1954989312}
W20260709 13:01:02.696681  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 720568us
I20260709 13:01:02.686005  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:02.694957  1718 raft_consensus.cc:2393] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 12: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:02.717872  1563 rpcz_store.cc:276] 0709 13:01:01.384233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.934016 (+549783us) service_pool.cc:224] Handling call
0709 13:01:01.957510 (+ 23494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.619856 (+662346us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b5400463aa0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd20fdc0 00007f18cd29a1c0 00007f18cd29b231 00007f18cd297d8f 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c
0709 13:01:02.689566 (+ 69710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.689767 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13033728}
I20260709 13:01:02.709385  2406 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:02.677569  7631 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:02.678340  7312 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.732829  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:02.733399  1644 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:02.732888  7312 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.735944  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:02.736119  7312 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:02.736698  2446 raft_consensus.cc:2368] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15.
I20260709 13:01:02.733474  1720 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:01:02.731348  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:02.739068  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:02.739154  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:02.739243  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 3024) took 1445 ms. Trace:
I20260709 13:01:02.727923  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:02.742111  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:02.743104  1645 raft_consensus.cc:3060] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:02.746615  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:02.747237  1718 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 17.
I20260709 13:01:02.749454  2437 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 21.
I20260709 13:01:02.724210  7652 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:02.750922  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:02.751266  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.751736  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.752173  1612 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.751735  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:02.754842  2437 raft_consensus.cc:2410] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:02.754966  1571 raft_consensus.cc:2368] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15.
I20260709 13:01:02.755167  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:02.756582  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:02.757794  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:02.758736  1718 raft_consensus.cc:2393] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 12: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:02.760859  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:02.762828  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:02.763787  1643 raft_consensus.cc:2393] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:02.761621  1647 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:01:02.755983  2436 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:01:02.723858  7646 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:02.768453  2405 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:02.773708  1612 leader_election.cc:400] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12.
I20260709 13:01:02.738955  7651 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.692203  7517 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.749135  7346 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.772645  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:02.723877  7453 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:02.794668  1718 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:01:02.764981  7567 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:02.741357  1566 rpcz_store.cc:276] 0709 13:01:01.273188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.284832 (+ 11644us) service_pool.cc:224] Handling call
0709 13:01:01.301597 (+ 16765us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.444595 (+142998us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:01.663131 (+218536us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.100190 (+437059us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.122461 (+ 22271us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.122638 (+   177us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:02.126614 (+  3976us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.126925 (+   311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.127090 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.717977 (+590887us) raft_consensus.cc:1685] finished
0709 13:01:02.717995 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.718140 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41750,"prepare.queue_time_us":479839,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":38461,"raft.queue_time_us":39069,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":10976,"thread_start_us":648023,"threads_started":3,"wal-append.queue_time_us":572360}
I20260709 13:01:02.789160  2405 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:02.801836  1718 raft_consensus.cc:1240] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 20 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:01:02.804723  1718 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:01:02.788954  7583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.036s	sys 0.025s
I20260709 13:01:02.791312  7699 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:02.796849  7586 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:02.795135  7547 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:02.815707  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:02.816885  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:02.812923  7646 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.804555  7698 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:01:02.807756  7583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.036s	sys 0.025s
W20260709 13:01:02.814428  7558 consensus_meta.cc:287] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.838s	user 0.014s	sys 0.004s
I20260709 13:01:02.820442  2448 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:02.822525  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 44611.5us
I20260709 13:01:02.840576  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:02.808171  6929 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.828032  1645 raft_consensus.cc:2468] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:01:02.814143  7331 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:02.819850  7698 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.856649  7698 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:02.820720  7646 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.829927  1611 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:02.818714  7699 raft_consensus.cc:697] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:02.860714  7654 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.818974  7547 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.819656  1569 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:01:02.843991  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:02.816304  7630 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.814677  7586 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:02.797086  7346 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:02.850571  7691 log.cc:927] Time spent T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
W20260709 13:01:02.834718  7689 log.cc:927] Time spent T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:01:02.860070  7453 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:02.888495  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 58669.9us
I20260709 13:01:02.890633  7547 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:02.891670  7517 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.896054  1712 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:02.870222  7586 raft_consensus.cc:3060] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:02.871003  7692 log.cc:927] Time spent T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.265s	user 0.002s	sys 0.001s
I20260709 13:01:02.871170  7700 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:02.873298  7263 consensus_meta.cc:287] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.815s	user 0.008s	sys 0.003s
W20260709 13:01:02.874610  7684 log.cc:927] Time spent T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 13:01:02.876492  7630 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.831213  7312 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.877417  7661 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.866364  7331 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.879895  7346 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.927552  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 1431) took 1315 ms. Trace:
I20260709 13:01:02.927928  1641 rpcz_store.cc:276] 0709 13:01:01.612291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.612401 (+   110us) service_pool.cc:224] Handling call
0709 13:01:01.612687 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.626108 (+ 13421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.626140 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.626601 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.099902 (+473301us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:02.099940 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.099997 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.874087 (+774090us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:01:02.927275 (+ 53188us) raft_consensus.cc:1685] finished
0709 13:01:02.927296 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.927498 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13797,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":7148,"spinlock_wait_cycles":57618816,"thread_start_us":376058,"threads_started":1,"wal-append.queue_time_us":746144}
I20260709 13:01:02.881716  1565 raft_consensus.cc:2393] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 17: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 13:01:02.933804  7693 log.cc:927] Time spent T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:01:02.934516  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:02.935410  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:02.936568  7374 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.937086  7374 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:02.939136  7686 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:01:02.939276  7374 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:02.942138  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.943317  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.944100  7698 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.945802  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:02.885054  7646 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:02.903893  2406 leader_election.cc:336] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.714s (SENT)
I20260709 13:01:02.961140  2406 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:02.861027  7699 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.901401  7453 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:02.975806  7453 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:02.976290  7453 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:02.908396  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:02.937656  7586 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.911770  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:02.912225  7473 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:02.914114  1686 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:02.914796  7688 log.cc:927] Time spent T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
W20260709 13:01:02.915807  7694 log.cc:927] Time spent T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:01:02.916419  7707 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:02.906582  7700 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.917348  7312 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.917852  7463 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.909425  7263 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:03.021359  7586 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:02.923038  2447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 1478) took 1005 ms. Trace:
I20260709 13:01:03.022485  7161 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:02.924511  7331 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.926193  7630 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:03.023044  7161 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:02.955457  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:03.024039  1714 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:01:02.962848  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:02.988400  7651 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:02.965487  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:03.025727  1563 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:03.025316  7651 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.027938  7651 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.963677  1467 catalog_manager.cc:5697] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 9 to 12, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.973654  7508 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:03.029218  7508 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.031454  7508 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:02.975312  7698 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:03.032555  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.022260  2447 rpcz_store.cc:276] 0709 13:01:01.917227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.968852 (+ 51625us) service_pool.cc:224] Handling call
0709 13:01:02.143842 (+174990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.215193 (+ 71351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.618983 (+403790us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b540017b6d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:02.922845 (+303862us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b540017b6d0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:01:02.922977 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563695104}
I20260709 13:01:02.983166  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 13:01:02.986222  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 72210.7us
I20260709 13:01:02.988648  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:03.034370  1712 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:03.034819  1566 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:03.005160  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 3029) took 1621 ms. Trace:
W20260709 13:01:03.011521  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 107648us
I20260709 13:01:03.019039  7654 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.019424  7558 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:03.006320  7567 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:03.039161  7558 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:03.042610  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.044322  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:03.044910  2447 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:03.046119  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:03.038400  1564 rpcz_store.cc:276] 0709 13:01:01.383324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.931898 (+548574us) service_pool.cc:224] Handling call
0709 13:01:01.932163 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.952874 (+ 20711us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:02.096186 (+143312us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.987404 (+891218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.987457 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:03.004859 (+ 17402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.004953 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.005087 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":382426,"prepare.queue_time_us":63653,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":409052,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":82089728,"thread_start_us":611262,"threads_started":2,"wal-append.queue_time_us":601894}
I20260709 13:01:03.052793  1563 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:01:03.053639  1719 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:01:03.056406  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 13:01:03.058128  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 165200us
I20260709 13:01:03.069134  2447 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:01:03.006490  7621 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:03.046640  7263 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:03.090919  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 247002us
I20260709 13:01:03.054908  7567 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:03.073500  7694 log.cc:927] Time spent T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:03.071394  7264 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:03.100907  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:03.102411  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.111940  1567 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:01:03.112870  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.113457  1567 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:01:03.113502  1714 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:01:03.114440  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.115001  2405 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:03.103664  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:03.112928  1566 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 21.
I20260709 13:01:03.103055  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.116664  1563 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:01:03.117026  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.038698  7654 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.118417  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.119166  7654 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:03.116040  1564 raft_consensus.cc:2376] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13. Re-sending same reply.
I20260709 13:01:03.122012  1566 raft_consensus.cc:2410] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:03.122444  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:03.091377  7620 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:03.117440  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:03.115442  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.149994  1563 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:01:03.150202  2438 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:03.150563  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.093468  7567 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.130671  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.132570  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.134387  2448 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:01:03.080150  7473 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:01:03.160357  1566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:01:03.160506  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:03.161005  1566 raft_consensus.cc:606] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:03.100114  7263 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:03.140626  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.144256  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.145040  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.146108  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.146715  1712 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 18.
I20260709 13:01:03.147176  1569 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:03.152815  1564 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:03.146143  1537 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:03.147887  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.158200  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:03.134933  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.121101  7440 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:03.249308  1647 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:03.169922  1563 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 18.
I20260709 13:01:03.267773  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:03.217803  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 111208us
W20260709 13:01:03.270185  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.271450  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.272439  1569 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:03.156188  7567 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:03.266659  1571 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:01:03.248329  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:03.219156  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.124457  7508 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.274948  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:03.278137  1712 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:03.151664  7374 raft_consensus.cc:2804] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:03.279351  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:03.281826  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:03.284686  1640 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:01:03.285977  1563 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:03.292636  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:03.294262  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:03.301522  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 155458us
I20260709 13:01:03.163051  7663 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.162319  7719 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.270545  7440 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:03.271796  7630 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.303375  6929 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:03.312390  7710 log.cc:927] Time spent T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:03.307977  7651 raft_consensus.cc:2764] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:01:03.304365  7471 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:03.314184  7471 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 21 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:03.315047  7471 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.321441  1712 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:01:03.340646  1563 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 18.
W20260709 13:01:03.343590  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 73261.8us
I20260709 13:01:03.275764  7263 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:03.279850  7705 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:01:03.343466  2406 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:03.335232  7440 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:03.380862  2406 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:03.382653  2406 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:03.156740  7620 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.317461  7374 raft_consensus.cc:697] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:03.354040  7652 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:01:03.341012  7630 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.354317  7665 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:01:03.372691  1537 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:01:03.507932  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 135291us
I20260709 13:01:03.338296  7663 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.365111  7161 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:03.338804  7654 consensus_queue.cc:1059] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:01:03.296505  7566 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
W20260709 13:01:03.497936  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 115346us
I20260709 13:01:03.539971  2406 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:03.507207  7698 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:03.503724  7557 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:03.497282  7700 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:03.377723  7666 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:03.519426  7705 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.520084  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 3027) took 2178 ms. Trace:
I20260709 13:01:03.363282  7453 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:03.496124  7570 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:03.503804  7646 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:03.282259  7508 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:03.560226  7263 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:03.521632  7651 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:03.564607  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 220359us
I20260709 13:01:03.561482  1570 rpcz_store.cc:276] 0709 13:01:01.341238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.629205 (+287967us) service_pool.cc:224] Handling call
0709 13:01:01.629531 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.950029 (+320498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.950074 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.955082 (+  5008us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.675981 (+720899us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:02.696878 (+ 20897us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.121899 (+425021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.506394 (+384495us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b540028c654. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:03.506459 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.506518 (+    59us) raft_consensus.cc:1685] finished
0709 13:01:03.519876 (+ 13358us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.520024 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":294686,"prepare.queue_time_us":15645,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":3055,"raft.queue_time_us":321780,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":7479,"spinlock_wait_cycles":672018816,"thread_start_us":847607,"threads_started":2,"wal-append.queue_time_us":840055}
I20260709 13:01:03.544718  7557 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:03.333585  7719 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:03.613655  7721 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:01:03.608965  7680 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:03.614913  7680 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.566468  7666 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.620114  7346 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:03.609042  7557 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:03.620894  7346 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:03.584707  7646 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.623953  1565 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:01:03.642794  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 347468us
I20260709 13:01:03.564010  7567 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.584372  6929 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:01:03.674237  1563 raft_consensus.cc:1275] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:03.617918  7680 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:03.582214  7705 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.584843  7570 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.611032  7651 raft_consensus.cc:697] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:03.635670  7646 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:03.706609  7651 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.707370  7708 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.708106  7708 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:03.708837  7630 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:03.684794  7654 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.709712  7654 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.711704  7654 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:03.693660  7661 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:03.695134  7700 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:03.713220  7620 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:03.687769  7680 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.697042  7453 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:03.593132  7374 consensus_queue.cc:237] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.714190  7680 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.698030  7735 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:03.682695  7263 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:01:03.697304  7570 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:03.713569  7700 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:03.716835  7680 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:03.700341  7508 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:03.718024  7463 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:03.720324  7463 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.723017  7346 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:03.724056  7718 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:01:03.724249  7646 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.726790  7705 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:03.739902  7567 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:03.718927  7700 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:03.713971  7312 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:03.756166  7663 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:03.757000  7700 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:03.739840  7708 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:03.740815  7570 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:03.758571  7570 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:03.742194  1467 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:03.743080  7696 log.cc:927] Time spent T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 1.027s	user 0.015s	sys 0.000s
W20260709 13:01:03.764474  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.769295  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 229401us
I20260709 13:01:03.770761  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:03.771636  7726 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:03.773434  7726 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:03.776973  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:03.778203  7719 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:03.743690  1641 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:03.744621  7463 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:03.781929  1714 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:03.762302  7646 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:03.746306  7508 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.784348  2406 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:03.784682  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:03.784636  7508 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:03.786237  7567 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:03.782771  7558 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:03.786970  7508 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:03.790509  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.791440  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:03.795280  1467 catalog_manager.cc:5697] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 13 to 14, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:03.797565  7161 raft_consensus.cc:3055] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:03.797932  7161 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:03.798717  7161 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:03.799849  7161 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:03.797271  1467 catalog_manager.cc:5697] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 11 to 14, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.801508  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:03.802208  1718 raft_consensus.cc:2368] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 17. Current term is 18.
I20260709 13:01:03.802095  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:03.802654  1466 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58250 (request call id 291) took 12328 ms (client timeout 15000 ms). Trace:
I20260709 13:01:03.803280  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:03.803033  1719 raft_consensus.cc:2410] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:01:03.804050  1718 raft_consensus.cc:2393] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 16: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:03.805033  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:03.806298  1572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:01:03.806726  1611 leader_election.cc:400] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 17. Current term is 18.
I20260709 13:01:03.807029  1611 leader_election.cc:403] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:01:03.807389  7666 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:03.807981  7705 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:03.810756  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:03.811110  7631 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.811797  7699 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:03.811579  7631 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.812300  7699 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.813616  7631 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:03.730783  7557 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.814471  7631 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:03.815012  7631 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.815871  7557 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:03.816288  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:03.817044  7631 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:03.818360  7699 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:03.819478  2405 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:03.745572  7440 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.820710  7699 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:03.821152  7699 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.821534  7699 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:03.805505  1467 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 13 to 14, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.822680  7440 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:03.823668  1467 catalog_manager.cc:5697] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 11 to 14, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.790695  7570 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:03.829097  7699 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.831439  7699 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:03.833226  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 244707us
I20260709 13:01:03.782644  7698 raft_consensus.cc:697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:01:03.844336  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 60053.1us
I20260709 13:01:03.845439  2406 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:03.825948  1467 catalog_manager.cc:5697] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 11 to 12, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.837942  1612 leader_election.cc:400] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15.
I20260709 13:01:03.849246  1612 leader_election.cc:403] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:03.850455  7726 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:03.854128  7557 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:03.854817  7557 raft_consensus.cc:697] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 18 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:01:03.848452  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 71534.5us
I20260709 13:01:03.859404  1467 catalog_manager.cc:5697] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 14 to 15, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.861766  1467 catalog_manager.cc:5697] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 10 to 11, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.865347  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.866163  2437 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 16: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:03.866812  1567 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:03.873801  1568 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:03.875428  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:03.876036  1569 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:03.877882  1612 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:03.881387  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.882007  1563 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:01:03.882222  2437 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:01:03.882620  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.883386  2436 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 13:01:03.883844  1718 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:03.884532  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:03.885334  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.885360  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.885936  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:03.886197  2436 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:01:03.887090  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:03.888969  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.889501  1571 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:01:03.895064  2437 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:03.896104  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:03.898392  1569 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 17.
I20260709 13:01:03.899901  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.901640  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.904065  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.879165  7699 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:03.934303  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.908681  2440 raft_consensus.cc:2393] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 14: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:03.935336  1572 raft_consensus.cc:606] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:03.942952  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:03.936715  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.881399  7473 raft_consensus.cc:3060] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:03.936995  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.937952  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:03.934518  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:03.945767  2438 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:03.950539  1567 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:03.951133  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:03.955960  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:03.956563  1717 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:01:03.957867  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:03.888423  7440 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:03.890646  7713 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:03.962214  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.959138  1567 raft_consensus.cc:2468] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
W20260709 13:01:03.963187  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 137958us
I20260709 13:01:03.855789  7557 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:03.965227  2440 raft_consensus.cc:1240] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:01:03.972932  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.973297  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.902645  7346 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:03.973907  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:03.970625  2437 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:01:03.965943  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:03.974273  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:03.984170  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:03.986985  1567 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:01:03.983096  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 13:01:03.961656  7715 log.cc:927] Time spent T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.056s	user 0.001s	sys 0.002s
I20260709 13:01:03.996088  7700 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:03.984498  7463 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:01:03.997006  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:03.999832  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:04.014277  2446 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:01:04.014354  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:04.009434  1647 raft_consensus.cc:1275] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:04.009493  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:04.015589  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:04.010273  1640 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:03.960497  7699 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.020834  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:04.021651  1643 raft_consensus.cc:2393] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:04.023856  1646 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:04.024081  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.025920  1645 raft_consensus.cc:1275] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:04.027230  1568 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:01:04.027746  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:04.029985  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:04.031031  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:03.984719  7739 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:03.993438  7346 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.028347  1564 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:01:03.984339  7736 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.039930  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.803083  1466 rpcz_store.cc:269] 0709 13:00:51.474301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.475815 (+  1514us) service_pool.cc:224] Handling call
0709 13:01:03.802464 (+12326649us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:58.189785 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:58.190356 (+   571us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:58.190399 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:00:58.190416 (+    17us) tablet.cc:662] Decoding operations
0709 13:00:58.191805 (+  1389us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:58.191888 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:58.191915 (+    27us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:00:58.193006 (+  1091us) tablet.cc:701] Row locks acquired
0709 13:00:58.193025 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:00:58.193182 (+   157us) write_op.cc:270] Start()
0709 13:00:58.193296 (+   114us) write_op.cc:276] Timestamp: P: 1783602058193124 usec, L: 0
0709 13:00:58.193316 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:00:58.334925 (+141609us) log.cc:844] Serialized 6176 byte log entry
0709 13:00:59.107016 (+772091us) op_driver.cc:464] REPLICATION: finished
0709 13:00:59.737819 (+630803us) write_op.cc:301] APPLY: starting
0709 13:00:59.737985 (+   166us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:00.014211 (+276226us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:00.014371 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:00.357810 (+343439us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:00.358286 (+   476us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:01:00.358352 (+    66us) write_op.cc:312] APPLY: finished
0709 13:01:00.358917 (+   565us) log.cc:844] Serialized 139 byte log entry
0709 13:01:00.586044 (+227127us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:00.656193 (+ 70149us) write_op.cc:454] Released schema lock
0709 13:01:00.675889 (+ 19696us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:00.676417 (+   528us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:00.676449 (+    32us) write_op.cc:454] Released schema lock
0709 13:01:00.864345 (+187896us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
Metrics: {"mutex_wait_us":122974,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":628895,"apply.run_cpu_time_us":38261,"apply.run_wall_time_us":938706,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66857,"num_ops":15,"prepare.queue_time_us":255233,"prepare.run_cpu_time_us":23048,"prepare.run_wall_time_us":314128,"raft.queue_time_us":38859,"raft.run_cpu_time_us":20973,"raft.run_wall_time_us":276217,"replication_time_us":879624,"spinlock_wait_cycles":30424448,"thread_start_us":724165,"threads_started":5,"wal-append.queue_time_us":776752,"wal-append.run_cpu_time_us":24291,"wal-append.run_wall_time_us":2382339}]]}
I20260709 13:01:04.078253  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:04.078931  1712 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:04.041252  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:04.064390  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:04.081779  1567 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:01:04.083292  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.083971  1640 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:01:04.084766  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.085193  1537 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:04.086076  1537 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:04.086294  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.087690  1537 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:01:04.087775  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 46621.8us
I20260709 13:01:04.088581  1537 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:04.088299  7717 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:04.088876  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:04.020285  7699 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.087731  7716 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:04.091924  1712 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:01:04.092875  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.095757  7716 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:04.019836  6929 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
W20260709 13:01:04.136699  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 55121us
I20260709 13:01:04.013660  7264 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:01:04.105212  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:04.144661  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 56131.6us
I20260709 13:01:03.977274  7698 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.092303  7346 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:04.158341  1456 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bfbaf6c33e5b45ea9c75342b1011f209 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 338d817f94ee4c1bad162e9a5860b68a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:04.159617  7471 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:04.159801  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:04.159979  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.160559  7621 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:04.178900  7621 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:04.181536  7621 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:04.040194  7700 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 13:01:04.182159  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.182348  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.182726  7700 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:04.185096  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.136523  1643 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
W20260709 13:01:04.165594  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 78611.9us
I20260709 13:01:04.099629  7719 consensus_queue.cc:1059] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:01:04.171756  1567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:34298
W20260709 13:01:04.172906  7743 log.cc:927] Time spent T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:01:04.094280  7717 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.198843  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.173784  2405 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:04.094070  7672 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:04.154773  7716 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.162758  7508 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:04.155714  7161 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:04.202020  2437 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:04.039904  7741 consensus_queue.cc:1059] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.144s
I20260709 13:01:04.080015  7739 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.192102  1567 raft_consensus.cc:606] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Received request to transfer leadership to TS 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:04.162469  7726 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.090s
W20260709 13:01:04.251891  1456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 314200us
I20260709 13:01:04.098068  7661 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:04.265013  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 365120us
I20260709 13:01:04.207119  2405 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:04.259793  7508 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:04.203265  7717 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.081952  7736 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:04.278769  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.262777  1644 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:04.258566  7547 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:04.260637  7621 raft_consensus.cc:3055] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:04.258092  7734 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:04.262517  7161 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:04.282660  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:04.283975  7346 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.284614  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:04.285944  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:04.309885  1640 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 13:01:04.304636  2406 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:04.310317  1564 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:01:04.311277  2406 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:04.311539  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:04.313172  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:04.199491  7471 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.287956  1647 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:04.288818  7735 consensus_queue.cc:1059] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:04.289461  7736 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:04.290289  1642 raft_consensus.cc:1275] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:01:04.290964  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:04.314818  1566 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:04.315559  1569 raft_consensus.cc:2368] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 17. Current term is 18.
I20260709 13:01:04.314857  1642 pending_rounds.cc:85] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 9
I20260709 13:01:04.319118  1642 pending_rounds.cc:107] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:01:04.319402  1642 raft_consensus.cc:2889] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:04.294752  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:04.296128  1612 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:04.297140  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:04.297780  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.320761  1567 raft_consensus.cc:2368] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12.
I20260709 13:01:04.301260  1536 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:04.303035  2438 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:01:04.296159  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:04.307998  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:04.322026  1572 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:01:04.322482  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:01:04.309392  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 220523us
I20260709 13:01:04.320123  1566 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:04.321295  1643 raft_consensus.cc:2410] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:04.325090  1644 raft_consensus.cc:2393] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:04.281466  7508 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:04.328402  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.324662  1686 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:04.323101  1565 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
I20260709 13:01:04.327126  2406 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:04.255931  7672 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.335011  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:04.280038  7331 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:04.313709  7740 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:04.340096  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:04.324064  7741 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:04.334017  1565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:01:04.323093  7631 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:04.343282  1565 raft_consensus.cc:606] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:04.343796  1565 raft_consensus.cc:614] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:04.303999  7621 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:04.309285  7161 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:04.334718  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:04.333666  2406 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:04.346982  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:04.341379  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.343950  1686 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:04.309056  7665 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:01:04.353158  7566 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:04.358068  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:04.392884  7631 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:04.393643  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.394330  1647 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:01:04.337225  7707 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:04.394886  7707 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:04.395396  7707 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.358163  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.396154  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:04.393896  7631 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.334579  7558 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:04.324695  7570 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:01:04.337316  7463 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:04.459533  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.402846  1718 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:04.337005  7547 raft_consensus.cc:2804] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:04.345875  7712 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:04.317549  7734 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.347409  7741 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:04.359112  7666 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:04.398092  7737 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:04.479179  7346 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:04.349220  7264 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.122s
I20260709 13:01:04.481050  7734 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:04.472827  7741 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.483096  2444 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:01:04.547443  7680 raft_consensus.cc:3055] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:04.547910  7680 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:04.548738  7680 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:04.484170  7713 consensus_meta.cc:287] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.509s	user 0.003s	sys 0.007s
W20260709 13:01:04.484748  7746 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.509s	user 0.002s	sys 0.000s
W20260709 13:01:04.490825  7744 log.cc:927] Time spent T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
W20260709 13:01:04.500958  7753 log.cc:927] Time spent T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
I20260709 13:01:04.458233  7374 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:04.554587  7737 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.399137  7566 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:04.556931  7737 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:04.557137  7566 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.459884  7651 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:04.341312  7331 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.345696  7736 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
W20260709 13:01:04.480175  7749 log.cc:927] Time spent T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.294s	user 0.002s	sys 0.000s
I20260709 13:01:04.397966  7567 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:04.462037  7463 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:04.550558  7713 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:04.567929  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b968f124f3854f20bff4af609192c41a"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:01:04.560596  7680 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.570554  7264 raft_consensus.cc:3055] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:04.565582  1643 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:01:04.350188  7740 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.597463  1718 raft_consensus.cc:606] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:04.568241  7739 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:04.531208  7547 raft_consensus.cc:697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:04.599025  7756 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:01:04.640180  7547 consensus_queue.cc:237] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.609272  7699 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.534832  7666 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.537034  7621 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.607005  7471 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:04.598697  7463 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.600889  7264 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:04.609021  7161 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:04.617149  7705 consensus_meta.cc:287] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.809s	user 0.005s	sys 0.005s
I20260709 13:01:04.619012  7374 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:04.619298  7331 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:04.631028  7672 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:04.631174  7717 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:04.636757  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.644773  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 437701us
I20260709 13:01:04.597699  7567 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:04.641970  7473 consensus_meta.cc:287] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.677s	user 0.006s	sys 0.002s
I20260709 13:01:04.645829  7666 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:04.683979  1571 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:04.685124  2405 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:04.719532  1639 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:01:04.663638  7713 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:04.727310  7713 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.728075  7698 raft_consensus.cc:2804] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:04.728631  7698 raft_consensus.cc:697] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:04.729563  7698 consensus_queue.cc:237] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.730252  7713 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:04.743104  2405 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:04.744282  7557 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:04.678942  7374 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.677321  7705 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 17. Current term is 18.
W20260709 13:01:04.746121  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 401558us
I20260709 13:01:04.752857   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:04.756145  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.720069  7567 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.760025  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:04.758697  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 408250us
I20260709 13:01:04.757457   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:04.773453  1643 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:01:04.765136  2405 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:04.774032  1643 pending_rounds.cc:85] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 9
I20260709 13:01:04.774315  1643 pending_rounds.cc:107] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:01:04.774605  1643 raft_consensus.cc:2889] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:04.777849  1712 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:04.753587  7473 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15.
I20260709 13:01:04.677613  7707 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:04.781237  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.785125  1646 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:01:04.782758  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:04.782065  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 435098us
I20260709 13:01:04.786780  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:04.787910  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.788491  1647 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:04.789459  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:04.789788  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.796850  1638 raft_consensus.cc:1275] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:01:04.799291  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:04.801343  1536 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:04.797739  2405 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:04.802968  1645 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 18.
W20260709 13:01:04.795106  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 387272us
I20260709 13:01:04.753795  7741 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:04.825196  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 246535us
I20260709 13:01:04.825598  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.827919  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:04.870838  2406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.003s	sys 0.018s
W20260709 13:01:04.871547  1566 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.006s	sys 0.019s
I20260709 13:01:04.816118  7663 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:04.816470  7740 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:04.964890  1566 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.010s	sys 0.019s
W20260709 13:01:04.965135  2406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.007s	sys 0.022s
I20260709 13:01:04.781404  7264 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:04.960188  1571 consensus_queue.cc:237] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:04.937532  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.963023  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 137159us
I20260709 13:01:04.971992  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.064807  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.064404  2446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 1504) took 1044 ms. Trace:
I20260709 13:01:05.106674  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.070233  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.007579  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.018183  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.070588  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.131429  1647 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:01:05.054616  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:04.804644  7763 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:05.139375  1456 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bfbaf6c33e5b45ea9c75342b1011f209 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 338d817f94ee4c1bad162e9a5860b68a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:05.011042  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.134714  1640 raft_consensus.cc:2410] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:01:05.021034  1685 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.819s (SENT) [suppressed 16 similar messages]
I20260709 13:01:04.829053  7570 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:05.074729  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 55688.9us
I20260709 13:01:05.002013  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:05.137430  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.128111  2446 rpcz_store.cc:276] 0709 13:01:04.019753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.019876 (+   123us) service_pool.cc:224] Handling call
0709 13:01:04.020177 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.032007 (+ 11830us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:04.032040 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.075551 (+ 43511us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.492729 (+417178us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b180045a9c0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca18de07 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1aac02 00007f18cce3220b 00007f18cce37d23 00007f18cce380d1 00007f18cd253a0f
0709 13:01:04.792958 (+300229us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:04.793007 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.793067 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.064079 (+271012us) raft_consensus.cc:1685] finished
0709 13:01:05.064110 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.064337 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2856,"raft.queue_time_us":4994,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":43156,"spinlock_wait_cycles":24508288,"thread_start_us":300060,"threads_started":1,"wal-append.queue_time_us":979653}
W20260709 13:01:05.147552  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 126551us
W20260709 13:01:05.069063  7767 log.cc:927] Time spent T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
W20260709 13:01:05.070684  7765 log.cc:927] Time spent T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:01:05.161211  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:05.069621  7754 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
I20260709 13:01:05.210094  7570 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.073172  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.208828  7707 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:05.161119  7775 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:01:05.165853  1645 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:01:05.011791  7726 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.004473  7739 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.006445  7663 raft_consensus.cc:697] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:04.971010  7772 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:05.107280  7769 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:05.133407  7651 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:05.161268  7650 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.140398  1638 raft_consensus.cc:2468] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 20.
I20260709 13:01:05.209110  1612 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:05.250121  7508 consensus_meta.cc:287] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.916s	user 0.009s	sys 0.003s
W20260709 13:01:05.264324  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 55303.3us
I20260709 13:01:05.265606  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:05.234793  7631 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:01:05.273407  2447 raft_consensus.cc:1240] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:05.256984  7769 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.219805  2446 raft_consensus.cc:1240] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:05.206485  7716 consensus_meta.cc:287] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.937s	user 0.007s	sys 0.004s
I20260709 13:01:05.012125  7719 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.200s
I20260709 13:01:04.977809  7738 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.229s
W20260709 13:01:05.220896  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 49494.7us
I20260709 13:01:05.172447  7776 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.224433  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:05.230813  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:05.209524  7717 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.072567  2448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 1425) took 1171 ms. Trace:
W20260709 13:01:05.068362  7764 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:01:05.222896  7727 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.227356  7771 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:05.235757  7680 consensus_meta.cc:287] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.633s	user 0.005s	sys 0.005s
I20260709 13:01:05.222721  7708 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:01:05.208892  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 68050.5us
W20260709 13:01:05.280019  1569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.014s	sys 0.030s
I20260709 13:01:05.267789  7772 raft_consensus.cc:993] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: : Instructing follower 6f381117554e49bb816791ab0a10f2b8 to start an election
I20260709 13:01:05.245440  7570 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.282487  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:05.266961  7713 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:05.286433  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:05.269553  7757 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:01:05.257277  7739 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.320951  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:01:05.310324  1569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.015s	sys 0.030s
I20260709 13:01:05.311060  1566 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:01:05.273506  7740 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:05.254374  7726 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:05.328536  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 46146us
I20260709 13:01:05.315167  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:05.284246  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 230623us
I20260709 13:01:05.279989  7769 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:05.320951  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:05.298180  7621 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:05.291615  2448 rpcz_store.cc:276] 0709 13:01:03.901642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.901871 (+   229us) service_pool.cc:224] Handling call
0709 13:01:03.902174 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.902516 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.902543 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.291015 (+388472us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b2c00012be8. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cbb91a11 00007f18cbba1372 00007f18cd2d3a01 00007f18cd29843a 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2
0709 13:01:04.291374 (+   359us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.692498 (+401124us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:04.692552 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.692660 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.072276 (+379616us) raft_consensus.cc:1685] finished
0709 13:01:05.072298 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.072507 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":10320,"spinlock_wait_cycles":74246528,"thread_start_us":400714,"threads_started":1,"wal-append.queue_time_us":532868}
I20260709 13:01:05.265483  7651 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.291874  7346 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:05.325096  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:05.312716  7741 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:05.270144  7508 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.325618  1566 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:05.356997  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.357630  1645 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 5.
I20260709 13:01:05.356999  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.358472  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.358850  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.323099  7717 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:05.307814  7566 consensus_meta.cc:287] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.742s	user 0.011s	sys 0.000s
I20260709 13:01:05.334690  1638 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:05.336591  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:05.268178  7650 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:05.320592  7785 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:01:05.284668  7716 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.347555  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.347500  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.369813  1641 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:01:05.370177  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3898) took 1012 ms. Trace:
I20260709 13:01:05.371744  1638 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:05.372164  1641 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:05.353065  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:05.355621  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:05.372816  1642 raft_consensus.cc:2376] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12. Re-sending same reply.
I20260709 13:01:05.331621  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:05.338099  7679 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:05.302114  7736 consensus_queue.cc:1059] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:01:05.364321  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 105421us
I20260709 13:01:05.375108  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:05.370591  2405 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:05.370548  1572 rpcz_store.cc:276] 0709 13:01:04.357759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.358226 (+   467us) service_pool.cc:224] Handling call
0709 13:01:04.358515 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.621852 (+263337us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b48000b0958. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d21c1aa1 00007f18d21b8b37 00007f18d21b89ca 00007f18d22b026f 00007f18d22aff37 00007f18d22c455c 00007f18d22c4508 00007f18d22c4488 00007f18d22c4443 00007f18d22c36ec 00007f18d11eda96
0709 13:01:04.756261 (+134409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.756312 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.763614 (+  7302us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.125855 (+362241us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:05.125893 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.125962 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.369905 (+243943us) raft_consensus.cc:1685] finished
0709 13:01:05.369923 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.370121 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":173836,"raft.run_cpu_time_us":2516,"raft.run_wall_time_us":85891,"spinlock_wait_cycles":8157952,"thread_start_us":725774,"threads_started":2,"wal-append.queue_time_us":452701}
I20260709 13:01:05.311733  7727 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:05.345187  7763 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:05.427443  1639 raft_consensus.cc:1275] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:01:05.430676  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 55637.8us
I20260709 13:01:05.324322  7708 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:05.432231  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 49766.5us
I20260709 13:01:05.432968  1568 raft_consensus.cc:1240] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:05.361161  6929 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:05.306370  7776 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.344015  7705 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:01:05.373946  7620 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:05.343343  7740 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:05.372826  7790 raft_consensus.cc:1081] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Signalling peer 6f381117554e49bb816791ab0a10f2b8 to start an election
I20260709 13:01:05.316843  7771 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:05.433825  7463 consensus_meta.cc:287] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.766s	user 0.011s	sys 0.000s
I20260709 13:01:05.338696  7663 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.428753  7741 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:05.432675  7774 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:05.463138  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:05.475903  7708 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.378573  7698 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:01:05.477988  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:01:05.450171  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 79634.8us
I20260709 13:01:05.480218  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:05.438347  7783 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 13:01:05.397691  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.481830  2405 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:05.445712  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:05.374003  7717 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:05.373258  7566 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:05.450771  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:05.378191  7737 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:01:05.492134  1640 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:05.445155  7620 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:05.467645  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 93227.6us
I20260709 13:01:05.488672  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:05.489040  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:05.437978  7794 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:05.449999  7646 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:05.493053  2405 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:05.444980  7680 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:05.436612  7775 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:01:05.497685  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:05.498871  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 64566.9us
I20260709 13:01:05.541520  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:01:05.542344  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 49358.4us
I20260709 13:01:05.542692  7801 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:01:05.493839  7547 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:05.435891  7763 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:05.555245  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 57641.7us
I20260709 13:01:05.580490  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:05.581648  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:05.438341  6929 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.558947  1572 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:01:05.468277  7463 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:05.575984  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:05.576483  7789 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 13:01:05.576644  7791 log.cc:927] Time spent T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
W20260709 13:01:05.576906  7796 log.cc:927] Time spent T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:01:05.545210  7680 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.577090  7739 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:05.577209  7793 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:01:05.588141  7804 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:05.605449  7650 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.606796  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46634 (request call id 3045) took 1319 ms. Trace:
I20260709 13:01:05.607201  1568 rpcz_store.cc:276] 0709 13:01:04.287046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.294114 (+  7068us) service_pool.cc:224] Handling call
0709 13:01:04.294383 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.433361 (+1138978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.606573 (+173212us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540031c9d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:05.606740 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2618062592}
I20260709 13:01:05.607780  7771 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.555671  7646 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:05.608392  7771 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:05.608465  7646 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:05.609144  7471 raft_consensus.cc:993] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:01:05.608973  7771 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:05.568399  7786 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.269s	user 0.001s	sys 0.001s
I20260709 13:01:05.491484  7741 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.610913  7727 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:05.612576  7716 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.583685  1563 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:05.613693  7508 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.574956  7799 consensus_queue.cc:1048] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:01:05.584044  1612 leader_election.cc:400] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 17. Current term is 18.
I20260709 13:01:05.493058  7797 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
W20260709 13:01:05.574487  7787 log.cc:927] Time spent T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:01:05.568224  7679 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:05.636893  7679 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.637315  7679 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:05.638231  7771 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.643743  7740 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:05.644187  1717 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:05.645570  7717 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:05.646075  7463 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:05.647819  7778 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.480s	user 0.004s	sys 0.000s
I20260709 13:01:05.496219  7757 consensus_queue.cc:1048] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:01:05.609016  7646 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:05.588093  7570 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.584302  7705 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:05.630784  7567 consensus_meta.cc:287] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.849s	user 0.011s	sys 0.000s
I20260709 13:01:05.655416  7567 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:05.656260  7810 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:01:05.579324  7726 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.660696  7769 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.617316  7620 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.619432  6929 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.631357  7566 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:05.498764  7738 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:05.668299  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3896) took 1313 ms. Trace:
I20260709 13:01:05.668717  1569 rpcz_store.cc:276] 0709 13:01:04.354686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.354809 (+   123us) service_pool.cc:224] Handling call
0709 13:01:04.355113 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.966536 (+611423us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b48000b0958. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d21c1aa1 00007f18d21b8b37 00007f18d21b89ca 00007f18d22b026f 00007f18d22aff37 00007f18d22c455c 00007f18d22c4508 00007f18d22c4488 00007f18d22c4443 00007f18d22c36ec 00007f18d11eda96
0709 13:01:05.321808 (+355272us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:05.344911 (+ 23103us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.497868 (+152957us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.500004 (+  2136us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.500202 (+   198us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:05.500249 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.500340 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.653962 (+153622us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:01:05.668080 (+ 14118us) raft_consensus.cc:1685] finished
0709 13:01:05.668103 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.668240 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57007,"prepare.queue_time_us":25605,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":192996,"raft.run_cpu_time_us":2161,"raft.run_wall_time_us":454643,"spinlock_wait_cycles":120498304,"thread_start_us":1078115,"threads_started":2,"wal-append.queue_time_us":255437}
I20260709 13:01:05.672413  7651 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.672664  7567 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:05.498617  7790 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:05.598371  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3897) took 1243 ms. Trace:
W20260709 13:01:05.634557  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 50665.9us
I20260709 13:01:05.678440  7769 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.680085  7707 consensus_queue.cc:1059] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:05.681382  7705 raft_consensus.cc:3055] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:05.681751  7705 raft_consensus.cc:740] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:05.678215  1570 rpcz_store.cc:276] 0709 13:01:04.355283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.355417 (+   134us) service_pool.cc:224] Handling call
0709 13:01:04.355701 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.758197 (+402496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.758236 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.793128 (+ 34892us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.241603 (+448475us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:05.241651 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.241818 (+   167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.598109 (+356291us) raft_consensus.cc:1685] finished
0709 13:01:05.598130 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.598296 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":171038,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":4312,"thread_start_us":812840,"threads_started":2,"wal-append.queue_time_us":507840}
I20260709 13:01:05.682642  7705 consensus_queue.cc:260] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:05.686480  7666 consensus_meta.cc:287] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.932s	user 0.010s	sys 0.001s
I20260709 13:01:05.686928  7666 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:05.688922  7666 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:05.690557  7471 raft_consensus.cc:1081] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
W20260709 13:01:05.616276  7374 consensus_meta.cc:287] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.860s	user 0.004s	sys 0.004s
I20260709 13:01:05.698663  7374 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.700387  7680 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:05.701099  7763 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:05.700913  7374 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:05.711845  1640 raft_consensus.cc:2410] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:01:05.677759  7264 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:05.717422  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 148402us
I20260709 13:01:05.717941  1612 leader_election.cc:400] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12.
I20260709 13:01:05.718757  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:05.720148  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:05.739012  7651 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.739691  7651 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.741531  7741 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:05.742364  7651 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.740577  7811 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.743042  7811 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:05.745076  7811 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:05.748188  7784 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.475s	user 0.001s	sys 0.001s
I20260709 13:01:05.732962  7739 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:05.726358  7804 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:05.750137  7161 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.750277  7804 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.750716  7804 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:05.761365  7346 raft_consensus.cc:3055] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:05.761827  7346 raft_consensus.cc:740] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:05.762838  7346 consensus_queue.cc:260] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.764380  7346 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:05.765738  7699 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:05.768427   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:05.768321  7705 raft_consensus.cc:3060] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:05.776063  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:05.801347  2443 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:05.663527  7679 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:05.802443  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 259364us
I20260709 13:01:05.803408  2443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58"
dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
 from {username='slave'} at 127.0.0.1:42636
I20260709 13:01:05.804076  2443 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:05.804548  2443 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:05.780993  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 51983.6us
I20260709 13:01:05.806823  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:05.807478  1612 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:05.810084  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:05.810811  2442 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:05.803409  1685 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:05.809274  7558 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.820791  7757 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:05.820669  7558 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.821347  7757 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:05.821794  7757 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.822331  7161 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:05.822979  7558 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.822882  7161 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.818423  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:05.823997  7471 consensus_queue.cc:1048] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:05.819793  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:05.720148  7547 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:05.825049  2444 raft_consensus.cc:2410] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:05.824852  7547 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.824307  2436 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 10: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:05.824958  7161 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.831763  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:05.832653  2436 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 10: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
W20260709 13:01:05.834434  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 329344us
I20260709 13:01:05.835790  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:05.837716  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:05.838923  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:05.843487  1714 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:05.845774  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.846407  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.847198  1720 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:01:05.809432  7772 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:05.817199  7707 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:05.849205  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:05.854039  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:05.854388  1718 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.855957  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.856653  7679 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:05.854679  2438 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 13:01:05.862742  7797 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:05.863322  7797 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.860317  2405 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:05.853132  2443 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.830499  7740 consensus_queue.cc:1059] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:01:05.873917  2442 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 17.
I20260709 13:01:05.875370  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:05.876194  2438 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:05.876716  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:05.849314  7780 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.011s	sys 0.009s
I20260709 13:01:05.877559  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:05.879685  7811 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:05.880734  7811 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:05.881901  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:05.849727  7699 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:05.883612  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:05.883968  2443 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:05.885329  1712 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:01:05.885304  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.885625  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.886081  1719 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 18.
I20260709 13:01:05.886570  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.886905  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.887228  1712 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:01:05.887482  1719 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 17.
I20260709 13:01:05.888044  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.888707  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:05.889369  1719 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:05.889873  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.891446  7776 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:05.859155  7646 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.891477  7811 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.892580  1716 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:05.893007  7811 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:05.893947  7646 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:05.888700  7679 consensus_queue.cc:1059] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:01:05.853905  7707 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:05.895987  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:05.897869  2436 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:01:05.898420  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:05.898885  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:05.899077  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:05.886590  7663 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:05.899539  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:05.980621  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:05.951170  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.981310  1641 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:01:05.951524  1720 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:01:05.928256  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.982009  1720 pending_rounds.cc:85] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 12
I20260709 13:01:05.900997  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:05.982290  1720 pending_rounds.cc:107] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:01:05.958884  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.982535  1720 raft_consensus.cc:2889] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:05.961905  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 66141.4us
I20260709 13:01:05.983871  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:05.970809  7558 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:05.970672  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 87127.8us
I20260709 13:01:05.900770  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.900432  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.984962  1647 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:01:05.904000  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.973770  1640 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:05.975749  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:05.977914  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:05.978432  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:05.978593  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:05.869962  7463 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.081s
W20260709 13:01:05.887979  7780 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.011s	sys 0.010s
I20260709 13:01:05.974872  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:05.985005  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:05.998610  1567 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 18.
I20260709 13:01:05.987783  1638 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:01:05.990679  1718 raft_consensus.cc:2410] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:05.991330  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.992519  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:05.870229  7631 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.111s
I20260709 13:01:05.953644  7739 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:05.995623  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:05.996011  1719 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 17.
I20260709 13:01:05.894598  7804 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:06.024816  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:05.981850  7707 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:06.001101  1643 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:06.001070  1642 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 17.
I20260709 13:01:06.001253  1640 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:01:06.002187  7806 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:05.983093  7818 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.138s
I20260709 13:01:06.003353  7264 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.006176  7773 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.155s
I20260709 13:01:06.006842  7726 raft_consensus.cc:2955] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Committing config change with OpId 10.11: config changed from index 8 to 11, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:01:06.009022  7817 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:01:05.983191  7663 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:06.012760  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:06.015553  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:06.040514  2440 raft_consensus.cc:1240] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:05.860234  7772 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:05.997754  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:06.042748  2443 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:06.028725  1646 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 16: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:05.953488  7776 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:01:06.047097  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:06.035912  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:06.041251  1638 raft_consensus.cc:2410] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 19 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:01:06.043118  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:06.048062  2442 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 10: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:06.048184  1572 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 21.
I20260709 13:01:06.048605  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:06.049132  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:06.049876  1572 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 18.
I20260709 13:01:06.043380  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:06.046382  1568 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:01:06.002995  7471 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:06.027470  7161 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:05.986256  7672 consensus_queue.cc:1059] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:01:06.060727  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:06.061002  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:06.031045  7547 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:06.063236  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:06.064925  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.000666  7699 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:01:06.158546  1563 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:06.063887  1568 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:05.997262  7741 consensus_queue.cc:1048] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:01:06.078890  1569 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:06.046084  7663 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:06.106377  1565 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:06.030709  7739 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:06.075860  7471 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:06.043922  7264 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:06.058010  7558 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:06.060997  7679 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:06.043789  7797 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:06.633126  1643 consensus_meta.cc:287] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.003s
W20260709 13:01:06.635015  2446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.002s	sys 0.010s
W20260709 13:01:06.652477  2446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.003s	sys 0.011s
I20260709 13:01:06.627422  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:01:06.642781  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.655682  1721 raft_consensus.cc:1240] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:06.662671  1566 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 12: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:06.675829  1565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 1106) took 1229 ms. Trace:
W20260709 13:01:06.669090  1456 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bfbaf6c33e5b45ea9c75342b1011f209 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 338d817f94ee4c1bad162e9a5860b68a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:06.160157  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:01:06.656358  1687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.012s	sys 0.000s
I20260709 13:01:06.679311  1714 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:06.350510  1563 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:01:06.682286  1687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.012s	sys 0.002s
I20260709 13:01:06.652105  1643 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
W20260709 13:01:06.565666  7705 consensus_meta.cc:287] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.763s	user 0.006s	sys 0.001s
I20260709 13:01:06.082705  7740 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:06.686547  1686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.005s	sys 0.008s
I20260709 13:01:06.258001  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:06.768754  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:06.683254  7557 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.002s	sys 0.010s
W20260709 13:01:06.619626  7757 consensus_meta.cc:287] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.797s	user 0.008s	sys 0.002s
W20260709 13:01:06.427273  7828 log.cc:927] Time spent T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.346s	user 0.000s	sys 0.000s
I20260709 13:01:06.741864  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:06.603490  7775 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.004s	sys 0.008s
I20260709 13:01:06.318643  7735 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.427224  7830 log.cc:927] Time spent T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:01:06.484972  7770 consensus_queue.cc:1059] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.741s
W20260709 13:01:06.780748  7557 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.003s	sys 0.011s
I20260709 13:01:06.762653  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:06.483958  7831 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:06.762156  7463 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:06.772917  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:06.676620  1565 rpcz_store.cc:276] 0709 13:01:05.446101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.494788 (+ 48687us) service_pool.cc:224] Handling call
0709 13:01:06.082265 (+587477us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b5800004e98. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca173e9c 00007f18ca173a5b 00007f18d308cc09 00007f18d21e6ee0 00007f18d22b00ab 00007f18d22b0131 00007f18d2271fc0 00007f18d225c929 00007f18d225c3d2 00007f18cb7d3bd4
0709 13:01:06.082433 (+   168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.675485 (+593052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.675755 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3899648}
W20260709 13:01:06.767554  1686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.006s	sys 0.008s
I20260709 13:01:06.486832  7772 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:06.659562  7804 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:06.676064  7811 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:06.427773  7161 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:06.686372  7558 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:06.760654  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 13:01:06.788203  7775 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.009s	sys 0.013s
I20260709 13:01:06.763526  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:06.813330  1714 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:06.814484  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:06.826741  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 171468us
I20260709 13:01:06.827040  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:06.827899  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:06.834676  1565 raft_consensus.cc:2955] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 8 to 11, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:06.854743  2438 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:06.856118  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:06.857738  2446 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:06.819494  1569 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:06.783092  7757 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:06.823534  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:06.821581  7463 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:06.816123  7831 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:06.929523  1714 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:01:06.843030  7772 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:06.954770  7772 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.955184  7772 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:06.844141  7818 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.106s
I20260709 13:01:06.843243  7811 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:06.958153  7811 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.958582  7811 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:06.958673  7646 raft_consensus.cc:3055] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:06.959118  7646 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:06.960023  7646 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:06.961239  7646 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:06.840483  7780 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:06.936048  7471 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:06.923867  7566 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.962857  7566 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:06.938728  7264 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:06.939668  7707 consensus_meta.cc:287] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.901s	user 0.007s	sys 0.004s
I20260709 13:01:06.947053  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 1681) took 1104 ms. Trace:
I20260709 13:01:06.823428  7558 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:06.970397  7713 raft_consensus.cc:3055] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:06.970840  7713 raft_consensus.cc:740] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:06.971797  7713 consensus_queue.cc:260] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:06.972826  7713 raft_consensus.cc:3060] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:06.918169  7829 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:01:06.953749  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:06.976111  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:06.976837  1716 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 17: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:06.977567  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:06.978569  7739 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:06.970233  1717 rpcz_store.cc:276] 0709 13:01:05.842509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.844699 (+  2190us) service_pool.cc:224] Handling call
0709 13:01:05.844912 (+   213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.875028 (+ 30116us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:05.875057 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.889788 (+ 14731us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.272083 (+382295us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:06.272144 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.272242 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.946772 (+674530us) raft_consensus.cc:1685] finished
0709 13:01:06.946804 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.946970 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23651,"raft.queue_time_us":30268,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":97550,"threads_started":1,"wal-append.queue_time_us":918051}
I20260709 13:01:06.980273  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:06.980762  1713 raft_consensus.cc:1240] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:06.826260  7161 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:06.982606  1716 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:01:06.984470  2405 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:06.924127  7700 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:06.924327  7775 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:06.997589  1713 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:06.969530  7707 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:06.811175  7735 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:07.008298  1570 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.009s	sys 0.038s
W20260709 13:01:07.011298  1570 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.009s	sys 0.038s
I20260709 13:01:07.019724  1685 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:07.004834  7726 consensus_meta.cc:287] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.616s	user 0.005s	sys 0.005s
I20260709 13:01:07.021744  1645 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:07.022745  1571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.021s	sys 0.025s
I20260709 13:01:07.006706  7346 raft_consensus.cc:3055] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:07.008425  7813 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:01:07.025377  1571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.021s	sys 0.026s
I20260709 13:01:07.028345  1685 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:07.027112  2437 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.079s	sys 0.127s
W20260709 13:01:07.033455  2437 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.080s	sys 0.127s
I20260709 13:01:07.035092  1645 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 17.
W20260709 13:01:07.037905  2448 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.055s	user 0.021s	sys 0.029s
W20260709 13:01:07.039361  2448 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.021s	sys 0.029s
W20260709 13:01:07.036849  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.020s	sys 0.030s
W20260709 13:01:07.040297  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.020s	sys 0.030s
W20260709 13:01:07.040800  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 992187us
I20260709 13:01:07.041497  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:07.042465  1612 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:07.037719  2447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.026s	sys 0.027s
W20260709 13:01:07.043833  2447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.026s	sys 0.027s
I20260709 13:01:07.026283  7346 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:07.010973  7700 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.070147  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:07.071545  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:07.101797  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:07.101926  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:07.101142  1640 raft_consensus.cc:2410] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:01:07.071069  1646 raft_consensus.cc:1275] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:07.068424  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:07.095842  7735 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:07.010380  7775 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:07.097365  7161 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:07.063675  7813 raft_consensus.cc:697] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:07.058990  7739 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:07.099891  1613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.005s	sys 0.045s
I20260709 13:01:07.104739  1642 raft_consensus.cc:2393] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 13:01:07.111297  1613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.005s	sys 0.045s
I20260709 13:01:07.036237  7846 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:07.062165  7740 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:07.036103  7833 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:07.028329  7557 consensus_queue.cc:1059] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
W20260709 13:01:07.115057  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.115191  7739 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.115861  7739 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.119442  7739 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:07.121621  7797 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.071159  7772 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.099236  7770 consensus_queue.cc:1059] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:01:07.130286  1642 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: [12.10-14.12]
I20260709 13:01:07.132411  7700 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:07.133103  7813 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.113381  7161 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:07.125526  7833 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:07.145869  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 1688) took 1297 ms. Trace:
I20260709 13:01:07.147151  1720 rpcz_store.cc:276] 0709 13:01:05.848273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.848669 (+   396us) service_pool.cc:224] Handling call
0709 13:01:05.848853 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.983190 (+134337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.145587 (+1162397us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b5400228b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:07.145809 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128011520}
I20260709 13:01:07.143615  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:07.149338  1642 raft_consensus.cc:2393] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 12: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:07.154551  7775 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:07.157294  7811 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:07.157841  7707 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:07.134019  7346 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.159235  7346 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:07.159461  7566 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:07.154883  7833 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.124831  7846 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.163215  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 4011) took 1167 ms. Trace:
I20260709 13:01:07.163589  1645 rpcz_store.cc:276] 0709 13:01:05.995316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.995443 (+   127us) service_pool.cc:224] Handling call
0709 13:01:07.163030 (+1167587us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54002c56d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:01:07.163137 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292426496}
I20260709 13:01:07.164170  7846 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:07.164660  7705 consensus_queue.cc:1175] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6f381117554e49bb816791ab0a10f2b8" responder_term: 17 status { last_received { term: 16 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:07.165984  7772 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:07.147187  7161 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:07.166666  7772 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:07.171401  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:07.172886  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:07.192996  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:07.194751  1645 raft_consensus.cc:1275] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:07.196998  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:07.198555  1645 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 14: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:07.128667  7797 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.202695  7558 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:07.204783  7558 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:07.205807  1571 raft_consensus.cc:1240] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:07.157835  7831 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:07.207369  7663 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.167336  7646 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:01:07.208366  1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.007s	sys 0.027s
I20260709 13:01:07.201006  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:07.208709  1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.007s	sys 0.027s
I20260709 13:01:07.194196  7741 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:07.167152  7772 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:07.220923  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 13:01:07.235577  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 207280us
I20260709 13:01:07.236872  1685 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:07.205724  7833 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.216410  7161 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:07.257274  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:07.258076  1645 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
W20260709 13:01:07.258540  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.253449  7831 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.260895  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:07.262778  1642 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:07.262863  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 412205us
I20260709 13:01:07.263911  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:07.269599  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:07.275066  1685 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:07.288369  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:07.289530  1567 raft_consensus.cc:2410] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:01:07.213963  7646 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.346426  1642 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:01:07.218415  7741 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:07.352573  1572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.014s
W20260709 13:01:07.442868  1572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.000s	sys 0.014s
I20260709 13:01:07.354885  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:07.431831  7705 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.438946  7811 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:07.456888  7808 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:07.468523  2448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 1511) took 1509 ms. Trace:
W20260709 13:01:07.469370  1568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.042s	sys 0.047s
W20260709 13:01:07.469600  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.005s	sys 0.010s
I20260709 13:01:07.253731  7775 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:01:07.412930  7739 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:07.483953  7739 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.413621  7547 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:07.487237  7547 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.488237  7833 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:07.489132  7843 log.cc:927] Time spent T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:01:07.490135  7547 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:07.347290  1611 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:07.491605  7741 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:07.420389  1719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.015s	sys 0.069s
W20260709 13:01:07.492519  1719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.016s	sys 0.070s
I20260709 13:01:07.267194  7161 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:07.493290  7161 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:07.495332  7161 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:07.287703  7566 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:07.422724  2440 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:01:07.424054   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:07.288859  7770 consensus_queue.cc:1059] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 13:01:07.496873  7770 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:07.497470  7770 raft_consensus.cc:3055] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:07.497787  7770 raft_consensus.cc:740] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:07.498550  7770 consensus_queue.cc:260] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:07.416642  1537 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:07.423362  7700 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:07.499898  7770 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:07.500097  7700 raft_consensus.cc:697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:07.312179  7679 consensus_queue.cc:1059] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.113s
W20260709 13:01:07.432971  1565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.003s	sys 0.012s
I20260709 13:01:07.288444  2438 raft_consensus.cc:1240] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:07.434592  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 1108) took 1393 ms. Trace:
I20260709 13:01:07.434705  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 1691) took 1551 ms. Trace:
W20260709 13:01:07.511065  1565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.004s	sys 0.012s
W20260709 13:01:07.433339  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 434633us
W20260709 13:01:07.513185  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.401908  1536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.000s	sys 0.014s
I20260709 13:01:07.461889  7663 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:07.470503  1568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.042s	sys 0.047s
W20260709 13:01:07.470788  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.005s	sys 0.010s
W20260709 13:01:07.407739  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 132739us
I20260709 13:01:07.464012  7797 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:07.483132  7838 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:07.550745  1685 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:07.490336  2447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 1513) took 1510 ms. Trace:
I20260709 13:01:07.552405  2447 rpcz_store.cc:276] 0709 13:01:05.980055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.981422 (+  1367us) service_pool.cc:224] Handling call
0709 13:01:06.000069 (+ 18647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.000395 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.000421 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.023761 (+ 23340us) log.cc:844] Serialized 26 byte log entry
0709 13:01:07.044171 (+1020410us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:07.044221 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.044286 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.490124 (+445838us) raft_consensus.cc:1685] finished
0709 13:01:07.490145 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.490279 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":14698,"thread_start_us":994724,"threads_started":1,"wal-append.queue_time_us":1186661}
W20260709 13:01:07.491477  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 144298us
I20260709 13:01:07.310391  1647 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:01:07.555807  1611 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:07.502628  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.514703  1536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.000s	sys 0.014s
I20260709 13:01:07.557946  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:07.481215  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:07.558377  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:07.558343  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 727201us
I20260709 13:01:07.560542  1712 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:07.558615  1720 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:01:07.561625  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:07.562537  1718 raft_consensus.cc:2368] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 16. Current term is 17.
W20260709 13:01:07.517128  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 100666us
W20260709 13:01:07.564996  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 83875.2us
I20260709 13:01:07.566036  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:07.480756  7776 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:07.526170  2406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.007s	sys 0.010s
I20260709 13:01:07.458202  7705 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:07.571378  2406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.007s	sys 0.011s
I20260709 13:01:07.511294  1715 rpcz_store.cc:276] 0709 13:01:05.883611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.883729 (+   118us) service_pool.cc:224] Handling call
0709 13:01:05.890239 (+  6510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.890423 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:01:05.896609 (+  6186us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.434229 (+1537620us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b18003c0040. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18cce404bc 00007f18ca18e48b 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1a8455 00007f18cd290060 00007f18cd2a2716 00007f18cd2b3287
0709 13:01:07.434347 (+   118us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.434396 (+    49us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:01:07.434435 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.434504 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.434640 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8403,"prepare.queue_time_us":567,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":54867,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5865,"spinlock_wait_cycles":16074624,"thread_start_us":78428,"threads_started":1}
I20260709 13:01:07.510421  1570 rpcz_store.cc:276] 0709 13:01:06.041591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.043946 (+  2355us) service_pool.cc:224] Handling call
0709 13:01:06.044210 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.044389 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:07.011836 (+967447us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.432774 (+420938us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.432848 (+    74us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:07.432912 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.434415 (+  1503us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.434537 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20686,"prepare.queue_time_us":307574,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":4246,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":7547,"thread_start_us":1345169,"threads_started":2}
W20260709 13:01:07.568043  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.533952  7739 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:07.436728  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:07.501379  7700 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:07.578588  1644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.013s	sys 0.006s
W20260709 13:01:07.578982  1644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.013s	sys 0.006s
I20260709 13:01:07.544272  7713 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.536655  7772 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:07.582363  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:07.596349  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 50154.1us
I20260709 13:01:07.564495  7797 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:07.543726  7854 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:07.481856  7808 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.579628  7804 raft_consensus.cc:3055] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:07.575501  7566 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.607194  1536 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:07.545070  7547 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:07.576789  7833 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:07.579294  6929 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:07.593652  7811 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:07.601454  7264 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:07.670949  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 103804us
W20260709 13:01:07.673712  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 66637.4us
I20260709 13:01:07.703851  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:07.604565  7854 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:07.593291  7161 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:07.679778  7847 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:07.680034  7646 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:07.728499  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:07.728845  7646 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:07.730099  7847 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.730618  7847 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.731400  1572 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:07.670903  7833 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.611436  7863 consensus_queue.cc:1048] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:01:07.598924  7713 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:07.690630  7852 log.cc:927] Time spent T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:01:07.610272  7804 raft_consensus.cc:740] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:07.612962  6929 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:01:07.720142  2437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.024s	sys 0.012s
W20260709 13:01:07.712949  2443 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.028s	sys 0.038s
I20260709 13:01:07.720868  1537 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:07.720525  7854 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:07.723260  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.726032  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:07.768777  1564 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:07.722703  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:07.580690  7776 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.737906  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:01:07.719787  7864 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:01:07.670723  7663 consensus_queue.cc:1059] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
W20260709 13:01:07.764999  2437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.024s	sys 0.013s
W20260709 13:01:07.765551  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 44795.3us
I20260709 13:01:07.722924  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:01:07.765066  2443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.028s	sys 0.038s
I20260709 13:01:07.709667  7857 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.666369  7547 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.721390  7811 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:07.743449  7558 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:07.826476  7558 raft_consensus.cc:697] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 17 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:07.827708  7558 consensus_queue.cc:237] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:07.830615  7859 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:01:07.831298  7547 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:07.831490  7811 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:07.832425  7663 raft_consensus.cc:3055] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:07.832834  7663 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:07.833657  7663 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.834336  7808 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:07.835021  7663 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:07.838524  2443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42636 (request call id 1458) took 1620 ms. Trace:
I20260709 13:01:07.838945  2443 rpcz_store.cc:276] 0709 13:01:06.218581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.695153 (+476572us) service_pool.cc:224] Handling call
0709 13:01:06.758787 (+ 63634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.758997 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:06.806821 (+ 47824us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.838198 (+1031377us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.838251 (+    53us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:07.838297 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.838358 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.838471 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22153,"prepare.queue_time_us":56743,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"thread_start_us":1014059,"threads_started":1}
W20260709 13:01:07.841717  7851 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:01:07.843510  7740 raft_consensus.cc:3055] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:07.843950  7740 raft_consensus.cc:740] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:07.844828  7740 consensus_queue.cc:260] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.846382  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 1696) took 1084 ms. Trace:
I20260709 13:01:07.846783  1719 rpcz_store.cc:276] 0709 13:01:06.762389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.769948 (+  7559us) service_pool.cc:224] Handling call
0709 13:01:06.770316 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.770786 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.770824 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.771356 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:01:07.492891 (+721535us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:07.492933 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.492997 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.846114 (+353117us) raft_consensus.cc:1685] finished
0709 13:01:07.846135 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.846319 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8775,"thread_start_us":721209,"threads_started":1,"wal-append.queue_time_us":839822}
I20260709 13:01:07.848690  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3913) took 1014 ms. Trace:
I20260709 13:01:07.849056  1563 rpcz_store.cc:276] 0709 13:01:06.833978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.834130 (+   152us) service_pool.cc:224] Handling call
0709 13:01:06.847114 (+ 12984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.014169 (+167055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.014200 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.014244 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:07.014274 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.848461 (+834187us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54003b3b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:07.848506 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.848623 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383695744}
I20260709 13:01:07.857307  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3917) took 1006 ms. Trace:
I20260709 13:01:07.868211  7804 consensus_queue.cc:260] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.869491  7804 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.767426  6929 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:07.873718  7816 raft_consensus.cc:3055] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:07.875310  7713 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:07.875358  7816 raft_consensus.cc:740] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:07.874912  7463 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:07.876313  7847 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:07.857755  1571 rpcz_store.cc:276] 0709 13:01:06.850636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.056660 (+206024us) service_pool.cc:224] Handling call
0709 13:01:07.057111 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.206333 (+149222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.857049 (+650716us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540028d054. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:07.857246 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341388544}
I20260709 13:01:07.877445  7705 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:07.876356  7816 consensus_queue.cc:260] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.881045  2406 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:07.883510  7833 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:07.886369  7312 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:07.886935  7312 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.887383  7863 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:07.889051  7312 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:07.890173  7772 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:07.890727  7772 raft_consensus.cc:697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 17 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:07.891777  7772 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.889045  2406 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:07.893996  7776 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:07.894344  7346 consensus_meta.cc:287] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.735s	user 0.003s	sys 0.008s
I20260709 13:01:07.895071  2406 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:07.897361  1564 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:01:07.901599  2406 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 13:01:07.903169  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 307193us
I20260709 13:01:07.903458  2406 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:07.906838  7850 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:07.907431  7850 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.908169  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:07.907980  7794 consensus_queue.cc:1059] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:07.908730  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 4008) took 1928 ms. Trace:
I20260709 13:01:07.909121  7853 raft_consensus.cc:3055] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:07.909646  1537 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:07.909659  7853 raft_consensus.cc:740] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:07.909209  1644 rpcz_store.cc:276] 0709 13:01:05.979916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.980260 (+   344us) service_pool.cc:224] Handling call
0709 13:01:05.980547 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.980890 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:06.473421 (+492531us) spinlock_profiling.cc:243] Waited 962 us on lock 0x7b18000fe2c0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca18de07 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1a8455 00007f18d0c903c7 00007f18cd2a29a7 00007f18cd2b20bf 00007f18cd2b2038
0709 13:01:06.950136 (+476715us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.904671 (+954535us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:07.905253 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:01:07.906651 (+  1398us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:07.906699 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.908443 (+  1744us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.908487 (+    44us) raft_consensus.cc:1685] finished
0709 13:01:07.908569 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.908682 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5839,"prepare.queue_time_us":1156406,"prepare.run_cpu_time_us":145,"prepare.run_wall_time_us":146,"raft.queue_time_us":151118,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":8856,"spinlock_wait_cycles":2212096,"thread_start_us":1430619,"threads_started":3,"wal-append.queue_time_us":819340}
I20260709 13:01:07.911729  7566 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:07.749557  7161 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:07.894004  7735 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:07.911201  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 239417us
I20260709 13:01:07.903863  1565 raft_consensus.cc:2368] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 17. Current term is 18.
I20260709 13:01:07.922791  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:07.938758  2443 raft_consensus.cc:2393] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
W20260709 13:01:07.921257  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 201400us
I20260709 13:01:07.941162  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:07.941972  1563 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
W20260709 13:01:07.941612  1685 leader_election.cc:336] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.819s (SENT)
I20260709 13:01:07.943636  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:07.944409  1714 raft_consensus.cc:2393] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 14: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 13:01:07.944214  1685 leader_election.cc:336] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.940s (SENT)
I20260709 13:01:07.945051  1685 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:07.946535  7799 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:07.925287  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:07.948105  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:07.948691  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:07.949313  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:07.949787  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:07.950433  1715 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:07.950785  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:07.952193  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:07.917420  2437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 1512) took 1956 ms. Trace:
I20260709 13:01:07.916249  2405 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:07.954869  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:07.955493  7735 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.921829  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:07.932960  7853 consensus_queue.cc:260] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:07.934907  2444 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:07.956548  7264 consensus_queue.cc:1059] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:07.937939  7566 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.957432  7566 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:07.959784  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 43610.4us
I20260709 13:01:07.960090  7566 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:07.960476  2405 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:07.956571  7853 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:07.961228  7735 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:07.961616  7735 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:07.957439  7264 raft_consensus.cc:3055] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:07.961987  7735 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:07.962460  7264 raft_consensus.cc:740] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:07.947698  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:07.964057  7264 consensus_queue.cc:260] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:07.965582  7264 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:07.963233  1685 leader_election.cc:336] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.005s (SENT)
I20260709 13:01:07.917142  7741 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:07.945806  1537 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:07.972157  1685 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:07.975597  2406 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:07.976768  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:07.978976  1715 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 18.
W20260709 13:01:07.980366  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.980607  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.980105  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:07.921710  7776 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:07.918557  7858 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:07.934255  7794 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:07.996438  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:07.989698  2406 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:08.004731  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.004953  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:07.982307  1564 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:01:07.982842  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:08.005659  1563 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:07.954101  2437 rpcz_store.cc:276] 0709 13:01:05.961219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.961400 (+   181us) service_pool.cc:224] Handling call
0709 13:01:05.961769 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.962022 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:01:07.034035 (+1072013us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.916924 (+882889us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.916986 (+    62us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:01:07.917032 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.917253 (+   221us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.917367 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33962,"prepare.queue_time_us":103171,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":5053,"raft.queue_time_us":14533,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":8200,"thread_start_us":1880774,"threads_started":2,"wal-append.queue_time_us":806142}
I20260709 13:01:07.985670  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:07.922708  7161 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:07.981758  7868 log.cc:927] Time spent T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:01:07.982749  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 50443.6us
I20260709 13:01:08.009836  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:08.012328  7881 consensus_queue.cc:1048] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:01:08.004467  7883 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.015887  7816 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:08.009828  7797 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:01:08.019384  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 3176) took 1028 ms. Trace:
I20260709 13:01:08.003290  7813 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:01:07.976436  7547 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:08.026418  7547 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:08.026947  7547 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:07.986685  7775 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:07.985342  7790 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:07.986627  7858 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:08.031330  7858 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:08.033109  7871 log.cc:927] Time spent T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:01:08.019796  1716 rpcz_store.cc:276] 0709 13:01:06.991350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.991495 (+   145us) service_pool.cc:224] Handling call
0709 13:01:06.991867 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.125154 (+133287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.125196 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.125251 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:07.125284 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.019137 (+893853us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540022ae54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:08.019187 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.019324 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306085632}
I20260709 13:01:07.984078  7741 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.036037  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3915) took 1193 ms. Trace:
I20260709 13:01:07.468937  2448 rpcz_store.cc:276] 0709 13:01:05.959401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.959603 (+   202us) service_pool.cc:224] Handling call
0709 13:01:05.959963 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.960241 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:07.039682 (+1079441us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.467713 (+428031us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.467767 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:07.467811 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.467870 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.468467 (+   597us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65522,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":766,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2186,"thread_start_us":1480861,"threads_started":2}
I20260709 13:01:08.036430  1566 rpcz_store.cc:276] 0709 13:01:06.842556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.848002 (+  5446us) service_pool.cc:224] Handling call
0709 13:01:06.848301 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.332546 (+484245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.418004 (+ 85458us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:07.418649 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 13:01:07.722868 (+304219us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:07.722907 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.722977 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.035834 (+312857us) raft_consensus.cc:1685] finished
0709 13:01:08.035854 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.035983 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":170855,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3300,"thread_start_us":716229,"threads_started":2,"wal-append.queue_time_us":502659}
W20260709 13:01:08.039894  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.984746  7776 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:08.047750  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:01:08.049090  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 59518.2us
I20260709 13:01:08.050770  1563 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 17.
I20260709 13:01:08.054141  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:08.054966  1566 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:01:07.970381  7735 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.060768  2406 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:08.064371  1718 raft_consensus.cc:1240] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:08.065936  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.056402  7881 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:08.067548  7881 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.068761  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:01:08.070749  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.071504  1686 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:08.072392  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:08.074265  7839 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:08.074371  7557 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:08.074851  7839 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:08.075498  7839 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:08.082302  7463 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:08.073779  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:08.084394  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:08.085199  7463 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:08.085705  7463 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:08.086148  7463 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.095556  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:08.096406  1716 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.097761  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.098650  1718 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:01:08.090381  7775 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:08.104581  7775 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:08.104710  7631 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:08.105013  7775 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:08.105738  7631 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:08.091615  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:08.107484  7631 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:08.108378  1686 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:08.114194  1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.014s	sys 0.023s
I20260709 13:01:08.050021  7699 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:08.114547  1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.015s	sys 0.023s
I20260709 13:01:08.052851  7776 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:08.069816  7881 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:08.117138  1718 raft_consensus.cc:1240] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:08.122092  2442 raft_consensus.cc:1240] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:08.122450  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.124090  7797 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:08.113914  7566 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:01:08.118911  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 563179us
W20260709 13:01:08.119535  1536 connection.cc:256] RPC call timeout handler was delayed by -1.1148617059999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
I20260709 13:01:08.142962  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:08.140480  1611 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:08.146989  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:08.149287  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:08.149899  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.151682  1611 leader_election.cc:400] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 16. Current term is 17.
I20260709 13:01:08.152017  1611 leader_election.cc:403] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:01:08.152208  1685 leader_election.cc:336] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.106s (SENT)
I20260709 13:01:08.152681  1685 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:08.154915  1718 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:01:08.156008  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:08.124493  7797 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:08.178779  1612 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:08.181929  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.185657  1715 raft_consensus.cc:2410] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:01:08.189644  1536 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:08.193696  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.138293  7566 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.197184  1570 raft_consensus.cc:1240] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:08.200790  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:08.207229  1569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 3908) took 2223 ms (client timeout 1748 ms). Trace:
W20260709 13:01:08.207644  1569 rpcz_store.cc:269] 0709 13:01:05.973101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.978388 (+  5287us) service_pool.cc:224] Handling call
0709 13:01:08.196356 (+2217968us) spinlock_profiling.cc:243] Waited 91.7 ms on lock 0x7b5400103454. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:01:08.196496 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210809216}
I20260709 13:01:08.208074  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:08.154352  7876 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.151836  7878 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:08.220400  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.221041  1720 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:01:08.221865  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.211899  1536 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:08.176541  7713 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:08.180936  7727 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:08.217381  1721 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:08.218802  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.229899  1712 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:01:08.230414  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.235529  7857 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.236478  7857 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:08.236936  7857 raft_consensus.cc:697] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:08.201264  7707 consensus_queue.cc:1059] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:01:08.240513  6929 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.221454  7558 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:08.185401  7885 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:08.242334  7878 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:08.242982  7885 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:08.243544  7885 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:08.244729  7878 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:08.208519  7790 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:08.246335  7790 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.246711  7790 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:08.200958  7679 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:08.254601  1712 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:08.258129  7735 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:08.191215  7847 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 16. Current term is 17.
I20260709 13:01:08.212486  7566 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:08.223532  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:08.222086  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.193087  7797 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:08.154647  7346 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:08.269420  1716 raft_consensus.cc:2468] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:01:08.214715  7161 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.213068  7794 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:01:08.279325  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 56074.9us
W20260709 13:01:08.280149  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 56731.5us
I20260709 13:01:08.284217  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:08.283725  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:08.284583  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.287024  2405 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:01:08.287438  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 148792us
I20260709 13:01:08.289827  1536 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:08.292322  2438 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:01:08.292783  2438 pending_rounds.cc:85] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 9
I20260709 13:01:08.293035  2438 pending_rounds.cc:107] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:01:08.293337  2438 raft_consensus.cc:2889] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:08.293582  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:08.294175  1569 raft_consensus.cc:3055] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:08.294442  1569 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 13:01:08.297626  1536 leader_election.cc:336] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 1.662s (SENT)
I20260709 13:01:08.298095  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:08.295576  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 201671us
I20260709 13:01:08.261996  7854 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.284150  7853 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:08.283876  7346 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:08.237852  7857 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:08.321365  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.334988  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:08.318771  7799 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:08.339486  7740 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.339288  7799 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:08.339879  1612 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:08.324944  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:08.325294  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:08.325425  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:08.297863  7772 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:08.341495  1566 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:08.326027  1611 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:08.327073  1536 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:08.288753  7735 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:01:08.341146  7346 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:08.291432  7680 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:08.286341  7881 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:08.318708  7794 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:08.288887  7890 consensus_queue.cc:1059] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:01:08.302201  7312 consensus_queue.cc:1059] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:01:08.228920  7876 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.326824  7557 raft_consensus.cc:2804] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:08.345201  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:08.355818  1713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 1700) took 1429 ms. Trace:
I20260709 13:01:08.361038  1563 raft_consensus.cc:1240] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:08.364275  7876 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:08.343022  7161 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:08.364884  7775 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:08.365423  7161 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.300539  7887 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:08.367017  1566 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:01:08.359686  1713 rpcz_store.cc:276] 0709 13:01:06.926849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.981950 (+ 55101us) service_pool.cc:224] Handling call
0709 13:01:06.989207 (+  7257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.007155 (+ 17948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.355592 (+1348437us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b540025b2d0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:01:08.355729 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15855488}
I20260709 13:01:08.365859  7161 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:08.342249  7726 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.278s	user 0.001s	sys 0.020s
I20260709 13:01:08.374890  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:08.334791  7888 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:08.333679  7833 consensus_queue.cc:1059] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
W20260709 13:01:08.341598  7663 consensus_meta.cc:287] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.005s
I20260709 13:01:08.394812  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:08.395309  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 13:01:08.377002  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 51049.9us
W20260709 13:01:08.375196  1456 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bfbaf6c33e5b45ea9c75342b1011f209 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 338d817f94ee4c1bad162e9a5860b68a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:08.380874  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:01:08.381038  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 78519.9us
W20260709 13:01:08.381337  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 86897.7us
I20260709 13:01:08.343819  7847 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:08.398789  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:08.399272  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:08.336879  6929 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:08.384004  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:01:08.422068  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.388499  7547 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.347647  7680 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:08.347297  7757 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:08.367923  7890 raft_consensus.cc:3055] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:08.369649  7700 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:08.401186  1571 raft_consensus.cc:2393] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 13: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 13:01:08.382397  7726 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.319s	user 0.001s	sys 0.020s
I20260709 13:01:08.404105  7850 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:08.407428  7833 raft_consensus.cc:3055] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:08.411772  7846 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:08.412981  7776 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.413862  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.414322  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:08.414462  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:08.462607  7680 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.416486  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:08.485178  1570 raft_consensus.cc:2393] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 19: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:08.336019  7855 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:01:08.418371  1564 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:08.370364  7882 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:08.483421  1572 raft_consensus.cc:2376] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14. Re-sending same reply.
I20260709 13:01:08.386186  7790 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.382752  7735 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.423347  1713 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:08.426782  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:08.382474  7878 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:08.489029  7878 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.488880  7735 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.489420  7878 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:08.491168  7735 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:08.352581  7463 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.392059  7794 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:08.493449  7794 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 18 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:08.494563  7463 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:08.494331  7794 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:08.382651  7887 raft_consensus.cc:697] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:08.390519  7557 raft_consensus.cc:697] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:08.500952  7557 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.350315  7839 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:08.502667  1714 raft_consensus.cc:2393] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 13: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:08.347788  7881 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.466521  7890 raft_consensus.cc:740] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:01:08.479559  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 139747us
I20260709 13:01:08.422870  7875 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.416263  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.417300  1716 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:08.486930  7799 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:08.495815  1717 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:08.497323  1570 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: [12.9-13.10]
I20260709 13:01:08.498413  1564 raft_consensus.cc:1240] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:01:08.499351  7776 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 22 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:08.499827  2448 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 22 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 21. Current term is 22. Ops: []
I20260709 13:01:08.499917  7863 raft_consensus.cc:3055] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:08.504755  1713 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:08.507108  1715 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 12: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:08.480428  7833 raft_consensus.cc:740] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:08.506335  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:08.513412  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:08.515507  1567 raft_consensus.cc:2393] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 13: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:08.518617  1612 leader_election.cc:400] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 17. Current term is 18.
I20260709 13:01:08.519018  1612 leader_election.cc:403] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:08.522846  7887 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.523406  7833 consensus_queue.cc:260] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.524820  7833 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:08.469762  7883 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:01:08.528909  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:08.529518  1644 raft_consensus.cc:2376] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 18. Re-sending same reply.
I20260709 13:01:08.397019  7888 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.532827  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:08.533602  1644 raft_consensus.cc:2393] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:08.534150  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.534269  1645 raft_consensus.cc:1240] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:08.534714  1639 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:01:08.533424  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.535362  1640 raft_consensus.cc:2468] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:01:08.515100  7863 raft_consensus.cc:740] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:01:08.538443  7898 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:01:08.541971  1715 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:08.520460  7775 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:08.542753  7890 consensus_queue.cc:260] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.520946  7876 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:08.547271  1644 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: [10.11-13.12]
I20260709 13:01:08.547883  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.561286  1640 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:01:08.562244  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.550989  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.562958  1641 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:01:08.563308  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.563735  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.564069  1640 raft_consensus.cc:2410] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:01:08.550688  1638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b968f124f3854f20bff4af609192c41a"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 13:01:08.564536  1638 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:08.564882  1638 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:08.554962  1646 raft_consensus.cc:1240] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:08.530948  7804 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:08.562110  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.547345  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:08.565789  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:08.521341  7679 consensus_queue.cc:1059] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:01:08.571303  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:08.573632  7888 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:08.574368  7863 consensus_queue.cc:260] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.569207  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.511675  7875 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.580466  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.580471  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:08.557853  7839 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:08.578783  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.594521  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.586182  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.595199  1646 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:01:08.570667  7854 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:08.531852  7858 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.579720  7876 raft_consensus.cc:697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:08.599601  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:08.601742  1645 raft_consensus.cc:2468] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:01:08.567417  7850 consensus_queue.cc:1059] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:01:08.616671  1647 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:08.598489  7890 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:08.628222  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.602520  7863 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:08.643610  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:08.620710  7547 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:08.584883  7885 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.645524  2442 raft_consensus.cc:1240] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:08.682691  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.686215  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:08.708858  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:08.725240  1638 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:08.684505  7850 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:08.757998  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.758821  1640 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
W20260709 13:01:08.759389  7907 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:01:08.759433  1638 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:08.763307  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.763710  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.764411  1720 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:01:08.754948  7881 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:08.771742  2405 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:08.642652  7346 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.785451  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.724139  7877 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:08.787894  1640 raft_consensus.cc:2393] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 14: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:08.788895  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.793080  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:08.797200  1645 raft_consensus.cc:2393] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 13: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:08.793416  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:08.802345  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.809499  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.785490  7847 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:08.789778  7916 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:08.820892  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.821781  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:08.822795  1640 raft_consensus.cc:2393] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 12: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:08.723421  7876 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.828269  7853 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:08.830746  7908 log.cc:927] Time spent T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:01:08.800791  7877 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.821261  7916 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:08.850489  7916 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:08.790773  7850 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.867204  7346 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:08.867621  7741 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:08.863772  1570 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
W20260709 13:01:08.869287  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 541513us
I20260709 13:01:08.877225  7161 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.881184  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:08.889051  7878 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.905426  1537 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:08.891993  7877 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:08.892143  7680 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.892879  7885 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:08.878165  7679 raft_consensus.cc:3055] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:01:08.901368  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.903853  1639 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:08.910691  1566 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:08.914951  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.897089  7566 consensus_meta.cc:287] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.613s	user 0.005s	sys 0.003s
I20260709 13:01:08.912528  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:08.905804  7914 log.cc:927] Time spent T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.096s	user 0.000s	sys 0.002s
I20260709 13:01:08.819839  7847 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:08.911432  1537 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:09.245689  7790 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:08.908964  7772 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.941309  2438 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:08.941962  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:08.944796  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:09.303215  1564 raft_consensus.cc:1240] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:08.986764  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:08.986805  2447 raft_consensus.cc:1240] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:01:08.990762  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:09.304204  1639 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:09.087333  7680 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:09.087683  7672 consensus_queue.cc:1059] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:09.089254  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:09.307556  2444 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:01:09.090289  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:09.091073  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 13:01:09.096254  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 101620us
I20260709 13:01:09.099412  7878 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:08.911576  7875 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:09.111281  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:08.905602  7853 consensus_queue.cc:1059] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
W20260709 13:01:09.113175  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 125167us
I20260709 13:01:08.937713  7858 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:09.116583  7797 consensus_meta.cc:287] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.832s	user 0.008s	sys 0.002s
I20260709 13:01:09.119061  7850 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:09.122517  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.338135  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.123870  7910 log.cc:927] Time spent T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.399s	user 0.002s	sys 0.000s
I20260709 13:01:08.940079  7566 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.125916  1647 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:09.130399  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:09.341997  1645 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:01:09.132405  7922 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.914464  7679 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 13:01:09.140604  7804 consensus_meta.cc:287] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.000s
W20260709 13:01:09.155275  7863 consensus_meta.cc:287] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.000s
I20260709 13:01:09.158560  7161 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:09.160880  7890 consensus_meta.cc:287] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.528s	user 0.000s	sys 0.009s
W20260709 13:01:09.172200  7833 consensus_meta.cc:287] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.647s	user 0.012s	sys 0.000s
I20260709 13:01:09.187774  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:09.362349  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:09.224454  7857 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:09.224399  1563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 3930) took 1157 ms. Trace:
I20260709 13:01:09.228997  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:09.401549  2442 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
I20260709 13:01:09.239017  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:09.402436  1571 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:09.255405  7872 raft_consensus.cc:3055] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:01:09.267797  7917 log.cc:927] Time spent T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.363s	user 0.000s	sys 0.005s
I20260709 13:01:09.272025  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 1710) took 1152 ms. Trace:
I20260709 13:01:09.275202  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:09.279799  7919 log.cc:927] Time spent T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.194s	user 0.002s	sys 0.004s
I20260709 13:01:09.281316  2448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42646 (request call id 1535) took 1243 ms. Trace:
I20260709 13:01:09.282531  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:09.284441  7727 raft_consensus.cc:3055] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:08.916415  1643 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 9.
I20260709 13:01:09.287690  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:09.290385  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:01:09.294178  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.300652  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 389253us
I20260709 13:01:08.937215  1641 raft_consensus.cc:2368] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 12. Current term is 13.
I20260709 13:01:09.312306  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:09.317905  1686 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:09.302632  7794 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:09.327113  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:09.335896  1639 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
W20260709 13:01:09.349575  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.319121  7790 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.351807  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:09.353585  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:09.341210  7797 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.354627  7672 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.397075  1718 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:01:09.487574  1565 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:09.357857  7887 consensus_queue.cc:1059] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.133s
I20260709 13:01:09.440526  2442 raft_consensus.cc:1240] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:09.396576  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:09.489464  1647 raft_consensus.cc:2376] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14. Re-sending same reply.
I20260709 13:01:09.401321  1563 rpcz_store.cc:276] 0709 13:01:08.067160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.068028 (+   868us) service_pool.cc:224] Handling call
0709 13:01:08.068312 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.361587 (+293275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.224148 (+862561us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b540035aa54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:09.224332 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672670080}
I20260709 13:01:09.397847  7646 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.496650  2448 rpcz_store.cc:276] 0709 13:01:08.038110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.038282 (+   172us) service_pool.cc:224] Handling call
0709 13:01:08.038636 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.512500 (+473864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.229969 (+717469us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b54006fead4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:09.281255 (+ 51286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1060175744}
I20260709 13:01:09.503194  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:09.503945  1647 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:01:09.504501  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:09.494953  1571 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 17.
I20260709 13:01:09.505611  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 13:01:09.409302  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 221586us
I20260709 13:01:09.341048  7909 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.345775  7875 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.511811  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:09.512614  1643 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:01:09.504839  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:09.506632  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.514009  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:09.490793  1717 rpcz_store.cc:276] 0709 13:01:08.119706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.119859 (+   153us) service_pool.cc:224] Handling call
0709 13:01:08.120209 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.507566 (+387357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.271706 (+764140us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b540025a3d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:09.271948 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863384960}
I20260709 13:01:09.398576  1714 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:09.507186  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 189330us
I20260709 13:01:09.508296  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:09.518602  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:09.519178  1647 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:01:09.461617  7566 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:09.520481  7847 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:09.432333  7857 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:09.521341  7878 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:01:09.521692  7885 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:09.522266  7885 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.522675  7857 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:09.523213  7857 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:09.523677  7857 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:09.524191  7885 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:09.527247  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:09.531927  2442 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:09.396777  7880 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:01:09.534144  1719 raft_consensus.cc:1240] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:09.508644  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:09.441498  7850 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:09.488313  7672 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.357713  7804 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 17. Current term is 18.
I20260709 13:01:09.463943  7881 raft_consensus.cc:3055] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:09.492421  7727 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:09.355326  7558 consensus_queue.cc:1059] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.178s
I20260709 13:01:09.356026  7922 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.525974  7700 raft_consensus.cc:2804] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:09.559139  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:09.550462  2405 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:09.559862  2442 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:09.555124  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:09.547530  7857 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:09.572834  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3257) took 1019 ms. Trace:
I20260709 13:01:09.561239  2405 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:09.504467  7790 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.533756  7875 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.536161  7780 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:09.575626  2405 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:09.509359  7646 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.462147  7679 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:09.571133  7558 raft_consensus.cc:3055] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:09.576958  7890 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:09.546440  7905 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:09.532840  7909 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:09.536409  7816 consensus_queue.cc:1059] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:01:09.546384  7881 raft_consensus.cc:740] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:01:09.587319  7876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.033s	sys 0.037s
I20260709 13:01:09.549103  7566 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:01:09.754711  2438 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 8.
I20260709 13:01:09.599442  7558 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
W20260709 13:01:09.623330  7876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.033s	sys 0.037s
I20260709 13:01:09.765127  7797 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:09.693497  1565 raft_consensus.cc:2468] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:01:09.770582  7672 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:09.772586  7875 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:09.772686  7679 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:09.639736  7881 consensus_queue.cc:260] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.576550  7700 raft_consensus.cc:697] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:09.715405  1642 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:09.715598  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:09.723932  1641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3253) took 1171 ms. Trace:
I20260709 13:01:09.798617  1638 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:09.798990  1641 rpcz_store.cc:276] 0709 13:01:08.552400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.563538 (+ 11138us) service_pool.cc:224] Handling call
0709 13:01:09.723361 (+1159823us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54002c42d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:01:09.723686 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855973760}
I20260709 13:01:09.799248  7700 consensus_queue.cc:237] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:09.577250  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 221916us
I20260709 13:01:09.802809  7903 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:09.803072  7881 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:09.584437  1714 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:01:09.728552  1569 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.803753  7903 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.805724  1569 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:09.808218  7790 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:09.615640  7727 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.732992  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 1712) took 1588 ms. Trace:
I20260709 13:01:09.810243  1719 rpcz_store.cc:276] 0709 13:01:08.144655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.144769 (+   114us) service_pool.cc:224] Handling call
0709 13:01:08.174726 (+ 29957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.539438 (+1364712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.732414 (+192976us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400301954. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:09.732783 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3125862272}
I20260709 13:01:09.737332  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 1715) took 1532 ms. Trace:
I20260709 13:01:09.739101  1612 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:09.753487  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:09.605751  2442 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:01:09.571561  2448 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 13:01:09.622664  7890 raft_consensus.cc:697] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:09.834998  7646 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:09.839447  7890 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.652733  7909 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:09.624394  7916 consensus_meta.cc:287] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.773s	user 0.008s	sys 0.005s
I20260709 13:01:09.842489  7903 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:09.549363  7741 consensus_queue.cc:1059] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:01:09.843146  7916 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.616180  7799 consensus_queue.cc:1059] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:01:09.648016  7922 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:09.479466  7855 raft_consensus.cc:2955] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 6 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:09.846661  1646 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 18.
I20260709 13:01:09.848182  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 4018) took 1056 ms. Trace:
I20260709 13:01:09.848510  1646 rpcz_store.cc:276] 0709 13:01:08.792040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.793160 (+  1120us) service_pool.cc:224] Handling call
0709 13:01:09.847943 (+1054783us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54002422d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:01:09.848122 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1727952768}
I20260709 13:01:09.848976  1569 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:01:09.598920  7858 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:09.850370  1568 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:01:09.648383  7933 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:09.528903  7872 raft_consensus.cc:740] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:09.574086  1644 rpcz_store.cc:276] 0709 13:01:08.553304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.597859 (+ 44555us) service_pool.cc:224] Handling call
0709 13:01:08.598172 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.598504 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:08.598535 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.603227 (+  4692us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.781420 (+178193us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:08.781480 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.781581 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.267100 (+485519us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:01:09.548182 (+281082us) raft_consensus.cc:1685] finished
0709 13:01:09.548203 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.572766 (+ 24563us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3683,"spinlock_wait_cycles":437913344,"thread_start_us":165144,"threads_started":1,"wal-append.queue_time_us":214329}
I20260709 13:01:09.714650  1645 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:09.695688  1566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 1124) took 1321 ms. Trace:
I20260709 13:01:09.883435  1566 rpcz_store.cc:276] 0709 13:01:08.374157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.374314 (+   157us) service_pool.cc:224] Handling call
0709 13:01:08.375851 (+  1537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.915233 (+539382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.694970 (+779737us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540031bfd4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:09.695411 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229553024}
W20260709 13:01:09.790567  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.884873  7933 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:09.885541  7933 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:09.811427  1718 rpcz_store.cc:276] 0709 13:01:08.205079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.205259 (+   180us) service_pool.cc:224] Handling call
0709 13:01:08.205735 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.488013 (+1282278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.736736 (+248723us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400228b54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:09.737146 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2667173248}
I20260709 13:01:09.817036  7790 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.888607  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38394 (request call id 1131) took 1471 ms. Trace:
I20260709 13:01:09.765354  7558 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.803463  1685 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:09.893699  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 90628.9us
I20260709 13:01:09.845806  7916 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:09.897580  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.851081  7858 raft_consensus.cc:3055] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:01:09.851204  1569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38394 (request call id 1122) took 1558 ms (client timeout 2035 ms). Trace:
I20260709 13:01:09.846698  7922 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.864120  1638 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:01:09.856060  7909 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:09.888638  7790 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.899641  7909 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.901158  7872 consensus_queue.cc:260] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:09.870007  7877 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:09.902438  7872 raft_consensus.cc:3060] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:09.903468  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:09.904306  1640 raft_consensus.cc:2376] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12. Re-sending same reply.
I20260709 13:01:09.898320  7858 raft_consensus.cc:740] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:01:09.898476  1569 rpcz_store.cc:269] 0709 13:01:08.293236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.293368 (+   132us) service_pool.cc:224] Handling call
0709 13:01:08.942504 (+649136us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b4c000a8a80. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cb564a20 00007f18cb575a29 00007f18cb53b644 00007f18cb562f2d 00007f18cb562b93 00007f18cd29318b 00007f18cd293cb5 00007f18cd28ef30 00007f18cd2907de 00007f18cd29c27c 00007f18d225db17
0709 13:01:09.466412 (+523908us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54003a2da0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd21606f 00007f18cd28ef60 00007f18cd2907de 00007f18cd29c27c 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2
0709 13:01:09.727273 (+260861us) spinlock_profiling.cc:243] Waited 78.9 ms on lock 0x7b54003a2da0. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd215520 00007f18cd28ef70 00007f18cd2907de 00007f18cd29c27c 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2
0709 13:01:09.851115 (+123842us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151676928}
I20260709 13:01:09.889016  1568 rpcz_store.cc:276] 0709 13:01:08.417346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.421203 (+  3857us) service_pool.cc:224] Handling call
0709 13:01:09.849714 (+1428511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.850807 (+  1093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.888346 (+ 37539us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54000eb350. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd2978ad 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:01:09.888548 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3284293376}
I20260709 13:01:09.906311  7858 consensus_queue.cc:260] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.906872  7909 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:09.908026  7909 consensus_queue.cc:1059] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:09.908515  7858 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.909442  7909 raft_consensus.cc:3055] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:09.909844  7909 raft_consensus.cc:740] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:09.897511  7916 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.911324  7916 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.859254  7903 raft_consensus.cc:3055] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:09.914234  7903 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:09.915001  7847 raft_consensus.cc:3055] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:09.915550  7847 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:09.916364  7727 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:09.915928  7903 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.916855  7847 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.919405  7672 raft_consensus.cc:3055] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:09.919482  7930 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:09.920017  7672 raft_consensus.cc:740] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:09.920425  7930 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:09.922587  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.922370  7922 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:09.898522  7566 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:09.931382  7558 raft_consensus.cc:3060] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.932049  7790 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:09.932147  7922 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:09.933266  1685 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:09.935459  1685 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:09.931666  7909 consensus_queue.cc:260] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:09.913911  7916 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:09.936868  7880 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:09.937006  7909 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.937768  7880 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:09.921495  7672 consensus_queue.cc:260] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.942838  7726 raft_consensus.cc:3055] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:09.942911  1685 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:09.943382  7672 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.944813  1685 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:09.944896  7929 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:09.946117  7929 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:09.946365  7847 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:09.949422  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.951575  7930 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:09.955648  1536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.006s	sys 0.005s
W20260709 13:01:09.956202  1536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.006s	sys 0.005s
W20260709 13:01:09.956593  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 608511us
I20260709 13:01:09.958317  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:09.959100  1569 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:01:09.959468  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 220771us
I20260709 13:01:09.962136  1644 raft_consensus.cc:1240] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:09.962867  1645 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 13:01:09.963474  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.966537  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:09.966846  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:09.958349  7566 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.967633  2440 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 17.
I20260709 13:01:09.943425  7726 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:09.968156  7566 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.969764  2438 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:09.969429  7726 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:09.971789  7726 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:09.971891  7566 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:09.975783  1569 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 22.
I20260709 13:01:09.987641  2438 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 18. Current term is 19. Ops: []
W20260709 13:01:09.996436  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 51795.9us
I20260709 13:01:09.997885  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:10.006340  1467 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58252 (request call id 332) took 18336 ms (client timeout 15000 ms). Trace:
I20260709 13:01:10.007874  7903 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:10.006340  1569 raft_consensus.cc:1240] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:10.006875  1467 rpcz_store.cc:269] 0709 13:00:51.661872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.662083 (+   211us) service_pool.cc:224] Handling call
0709 13:01:09.996064 (+18333981us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:04.550217 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:04.550874 (+   657us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:04.550927 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:01:04.550949 (+    22us) tablet.cc:662] Decoding operations
0709 13:01:04.552150 (+  1201us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:04.552268 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:04.552294 (+    26us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:01:04.553264 (+   970us) tablet.cc:701] Row locks acquired
0709 13:01:04.553343 (+    79us) write_op.cc:260] PREPARE: finished
0709 13:01:04.553517 (+   174us) write_op.cc:270] Start()
0709 13:01:04.553663 (+   146us) write_op.cc:276] Timestamp: P: 1783602064553441 usec, L: 0
0709 13:01:04.553683 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:01:04.644796 (+ 91113us) log.cc:844] Serialized 4000 byte log entry
0709 13:01:05.746962 (+1102166us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:01:05.820910 (+ 73948us) op_driver.cc:464] REPLICATION: finished
0709 13:01:05.883784 (+ 62874us) write_op.cc:301] APPLY: starting
0709 13:01:05.895620 (+ 11836us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:07.837954 (+1942334us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b180033e500. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ccfd70ec 00007f18cd023c0a 00007f18cd0234f7 00007f18cd023490 00007f18ccfdaf48 00007f18d0cef1bb 00007f18d0cef532 00007f18d0d36b93 00007f18d0be3de3
0709 13:01:07.839181 (+  1227us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:07.839208 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:08.282188 (+442980us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:08.336650 (+ 54462us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:01:08.353599 (+ 16949us) write_op.cc:312] APPLY: finished
0709 13:01:08.389393 (+ 35794us) log.cc:844] Serialized 97 byte log entry
0709 13:01:08.539403 (+150010us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:08.539545 (+   142us) write_op.cc:454] Released schema lock
0709 13:01:08.539606 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:08.542532 (+  2926us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:08.542567 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2165773,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":32137,"apply.run_cpu_time_us":55300,"apply.run_wall_time_us":2673158,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45947,"num_ops":10,"prepare.queue_time_us":305381,"prepare.run_cpu_time_us":59510,"prepare.run_wall_time_us":681215,"raft.queue_time_us":71369,"raft.run_cpu_time_us":9442,"raft.run_wall_time_us":32395,"replication_time_us":1267067,"spinlock_wait_cycles":35544320,"thread_start_us":923677,"threads_started":5,"wal-append.queue_time_us":814026,"wal-append.run_cpu_time_us":17347,"wal-append.run_wall_time_us":2818890}]]}
I20260709 13:01:10.019050  7741 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:10.020193  7940 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:10.022563  7741 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.022702  7940 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.021210  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:10.021430  1470 catalog_manager.cc:5697] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 13 to 14, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 14 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:01:10.032217  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 408524us
I20260709 13:01:10.030352  1470 catalog_manager.cc:5697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 6 to 9, term changed from 10 to 11, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to <none>, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:10.032981  7741 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:10.033838  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:10.034147  7799 consensus_queue.cc:1059] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:10.034701  1569 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:10.034940  1470 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:10.036464  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:10.037308  7566 raft_consensus.cc:3055] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:10.037827  7566 raft_consensus.cc:740] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:10.037469  1470 catalog_manager.cc:5697] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 11 to 14, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 14 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:10.038928  7566 consensus_queue.cc:260] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.039959  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:10.040601  1566 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:10.040110  1470 catalog_manager.cc:5697] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:10.040617  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:10.040114  7566 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:10.042163  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 420224us
I20260709 13:01:10.041790  1470 catalog_manager.cc:5697] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 13 to 15, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:10.043308  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.043532  1470 catalog_manager.cc:5697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:10.045203  1470 catalog_manager.cc:5697] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:10.046415  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:10.047149  1565 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:01:10.046649  1470 catalog_manager.cc:5697] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 17 to 19, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 19 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:10.048431  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:10.048202  1470 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 14 to 16, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:10.050134  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:10.049878  1470 catalog_manager.cc:5697] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 10 to 15, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:10.051118  7872 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:10.051888  7872 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:10.052039  1470 catalog_manager.cc:5697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 9 to 12, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:10.052851  1612 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:10.054097  7939 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:10.053911  1470 catalog_manager.cc:5697] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 9 to 12, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 12 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:10.054847  7939 raft_consensus.cc:697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:10.055912  7872 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:10.055888  1470 catalog_manager.cc:5697] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:10.056631  1685 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.056217  7939 consensus_queue.cc:237] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:10.062450  7794 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.065551  7794 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.065506  1470 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 10 to 12, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:10.067878  1566 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:01:10.068058  7794 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.069507  1470 catalog_manager.cc:5697] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 9 to 10, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:10.030318  7940 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:09.988387  7933 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.072227  7741 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:10.063743  1569 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 19.
I20260709 13:01:10.073118  2405 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:10.073482  7933 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:10.037540  1686 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:10.074951  7799 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:10.077636  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 56719us
I20260709 13:01:10.079303  2406 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.080229  1685 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:10.080866  2406 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:10.081236  7700 raft_consensus.cc:2804] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:10.082104  7679 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:10.082468  7808 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:10.082926  7808 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:10.083348  7808 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.071704  1470 catalog_manager.cc:5697] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:10.091686  1569 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:10.095376  7916 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:10.096520  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 59092.2us
I20260709 13:01:10.100884  7741 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:10.102101  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:10.102766  1568 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:10.081924  7700 raft_consensus.cc:697] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:10.111079  7847 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:10.111789  7847 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:10.107826  7727 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:10.115096  1565 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:10.115247  1566 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 22 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 21. Current term is 22. Ops: []
I20260709 13:01:10.087466  7933 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:10.124038  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.125114  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:10.125200  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:10.126039  1569 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:10.126556  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:10.127753  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.129420  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:10.130543  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:10.134130  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:10.133973  7700 consensus_queue.cc:237] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:10.135290  1571 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:01:10.136327  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.139330  2405 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:01:10.139858  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.140281  2405 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.141234  7890 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:10.141255  7631 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:10.141896  7631 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.142292  7631 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:10.143285  7794 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:10.114398  7847 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:10.143906  7794 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:10.145915  7794 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:10.150239  7847 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.151165  7847 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: true } }
I20260709 13:01:10.153584  7909 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:10.153724  7929 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:10.154471  7929 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:10.154381  7909 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.156775  7929 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:10.157341  7909 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.158377  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:10.160585  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.161263  2440 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 17.
I20260709 13:01:10.162422  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:10.163164  7909 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:10.163447  1719 raft_consensus.cc:2410] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:10.164176  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:10.164541  7909 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.167011  7631 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.167336  7909 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:10.168444  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.169870  7847 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:10.162786  7808 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.171559  1569 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:01:10.172745  7855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:48208 (request call id 14) took 5358 ms. Trace:
W20260709 13:01:10.173355  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 77298.6us
I20260709 13:01:10.174108  1568 raft_consensus.cc:2410] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:01:10.174762  1685 leader_election.cc:400] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 12. Current term is 13.
W20260709 13:01:10.179888  7952 log.cc:927] Time spent T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:01:10.119275  7933 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:10.116197  7858 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:10.188508  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 135783us
I20260709 13:01:10.188560  1685 leader_election.cc:403] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:10.193432  1570 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:10.193627  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.191605  7933 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.182338  7727 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:10.200313  1684 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.191898  7903 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:10.204927  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:10.208549  2406 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:10.212126  7816 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:10.203522  7700 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:10.220106  1568 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
I20260709 13:01:10.222004  1571 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:10.223011  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:10.224011  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:10.224182  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.226213  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:01:10.226481  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 128434us
I20260709 13:01:10.227032  1571 raft_consensus.cc:2393] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 13: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:10.227550  1685 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:10.228801  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:10.229465  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:10.230145  1719 raft_consensus.cc:3055] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:10.230510  1719 raft_consensus.cc:740] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:10.230459  7679 consensus_queue.cc:1059] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:10.231705  7872 raft_consensus.cc:3055] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:10.232120  7872 raft_consensus.cc:740] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:10.229594  7847 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:10.231432  1719 consensus_queue.cc:260] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:10.235356  7794 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:10.236107  7847 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.236531  7847 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:10.237277  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:10.239188  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:10.239979  1718 raft_consensus.cc:2393] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 8: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:10.240309  7679 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.241132  1717 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:10.241324  1712 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:10.233199  7872 consensus_queue.cc:260] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.242758  1570 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:10.240849  7679 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.244212  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:10.244484  7872 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.214782  7916 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.245360  7916 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.246567  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:10.247360  1717 raft_consensus.cc:2393] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:10.247488  7916 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:10.248070  7909 raft_consensus.cc:2804] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:10.248500  1718 raft_consensus.cc:1240] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:10.248886  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:10.249826  1569 raft_consensus.cc:1240] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:10.251214  1719 raft_consensus.cc:3060] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:10.251495  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:10.252091  1715 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:01:10.250970  7929 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:10.254774  7929 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:10.255168  7929 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:10.255584  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:10.256117  7929 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.257097  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:10.257768  7929 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:10.257967  7909 raft_consensus.cc:697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:10.258639  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:10.259404  1715 raft_consensus.cc:2410] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:10.259119  7909 consensus_queue.cc:237] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:10.250982  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:10.262563  1717 raft_consensus.cc:2410] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:10.256446  1686 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:10.274935  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.277360  2440 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:01:10.277590  7672 consensus_queue.cc:1059] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:10.278309  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:10.266808  7566 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:10.278399  1611 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:10.279800  7566 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.280242  7566 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:10.280279  7808 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.281181  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:10.282232  7877 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:10.278594  7672 raft_consensus.cc:3055] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:10.279386  7679 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.284637  7672 raft_consensus.cc:740] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:10.285661  7672 consensus_queue.cc:260] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.286883  7672 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:10.279632  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.289947  1612 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:10.303596  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:10.295535  1686 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:10.295960  1612 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:10.309471  1571 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:10.310474  7631 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:10.310788  7816 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:10.296113  7679 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:10.303588  7727 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.314656  1686 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 13:01:10.315138  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 91088.6us
I20260709 13:01:10.316187  7679 raft_consensus.cc:697] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:10.188796  7855 rpcz_store.cc:276] 0709 13:01:04.814178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.814363 (+   185us) service_pool.cc:224] Handling call
0709 13:01:05.751437 (+937074us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4c000a8c40. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cb564a20 00007f18cb575a29 00007f18cb53b644 00007f18cb562f2d 00007f18cb562b93 00007f18cd1f11af 00007f18cd1f0f3e 00007f18cd276888 00007f18cd29375c 00007f18cd29476a 00007f18cd29391b
0709 13:01:05.752198 (+   761us) log.cc:844] Serialized 501 byte log entry
0709 13:01:10.172516 (+4420318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1448,"raft.queue_time_us":5647,"raft.run_cpu_time_us":907,"raft.run_wall_time_us":154490,"spinlock_wait_cycles":31053184,"thread_start_us":78118,"threads_started":1,"wal-append.queue_time_us":76591,"wal-append.run_cpu_time_us":1265,"wal-append.run_wall_time_us":1001852}
I20260709 13:01:10.319099  7847 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.319568  1611 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:10.320778  1611 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:10.321307  7847 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.321587  7740 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:10.315179  7922 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:10.322535  7922 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:10.322949  7922 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.322839  7679 consensus_queue.cc:237] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.331507  1719 raft_consensus.cc:2468] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:01:10.321895  7847 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:10.336001  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:10.313088  7808 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:10.341776  7903 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:10.342257  7903 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.342648  7903 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:10.343377  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.326524  7741 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:10.346658  1536 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.347481  7855 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:10.348076  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.348807  7855 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:10.349462  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.340925  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:10.353928  7727 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:10.354444  7727 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:10.354836  7727 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.355756  7741 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.356389  7741 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.359092  7741 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:10.360700  7566 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.361963  1717 raft_consensus.cc:2368] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 17. Current term is 18.
I20260709 13:01:10.364907  7855 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:10.366689  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:10.367575  7877 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:10.367977  7877 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.368312  7877 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:10.368468  1612 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:10.369226  7740 consensus_queue.cc:1059] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:10.370326  7804 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:10.377950  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:10.378702  1714 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:10.379045  1536 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.379907  7855 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:10.380458  1611 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:10.381479  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:10.382195  1719 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 8.
I20260709 13:01:10.383808  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:10.384709  1720 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 19.
I20260709 13:01:10.385082  7566 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.386477  1571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:01:10.387259  1571 raft_consensus.cc:606] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.387689  1571 raft_consensus.cc:630] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Rejecting request to transfer leadership because tablet server a4be9cc90aca4dd4ad7db103062a7208 is not a voter in the active config
I20260709 13:01:10.388556  1536 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.389312  1611 leader_election.cc:400] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 17. Current term is 18.
I20260709 13:01:10.391501  1571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:01:10.399478  1571 raft_consensus.cc:606] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 17 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.393440  7808 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:10.390082  7631 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:10.389588  2406 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.035s (SENT) [suppressed 14 similar messages]
W20260709 13:01:10.392874  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 52024us
I20260709 13:01:10.392592  7877 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.379634  7922 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.400250  1611 leader_election.cc:403] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:10.394302  7855 raft_consensus.cc:3060] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:10.403044  7631 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.341274  7847 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.408602  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:10.410709  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:10.410840  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:10.425532  2440 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:10.412484  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:10.420636  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:10.414108  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:10.446285  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 56753.2us
I20260709 13:01:10.448627  1720 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:10.450320  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.410709  7808 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:01:10.440668  7566 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:10.434657  7847 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:10.442986  7922 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.466809  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:10.467478  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.468875  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 79721.7us
I20260709 13:01:10.473006  1714 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:01:10.475111  1536 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.441282  7961 raft_consensus.cc:2804] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:10.482815  1571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:01:10.483644  1571 raft_consensus.cc:606] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.484097  1571 raft_consensus.cc:614] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:10.464867  7872 raft_consensus.cc:3060] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:01:10.465102  7566 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:10.490484  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:10.495440  1719 raft_consensus.cc:2393] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 6: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:10.468366  7741 raft_consensus.cc:476] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Not starting pre-election -- already a leader
I20260709 13:01:10.476083  7797 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:10.508517  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.486316  7700 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463) with higher term. Message: Invalid argument: T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 12. Current term is 13.
I20260709 13:01:10.513428  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:10.491916  7922 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.497995  7566 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:10.506176  7740 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.499192  7961 raft_consensus.cc:697] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:10.511641  7794 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:10.531328  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:10.532212  2448 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 17: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:10.532982  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.530900  7699 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.531137  7741 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:10.526445  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.537030  2442 raft_consensus.cc:2410] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:01:10.537673  7877 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.538295  1570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:01:10.538846  1570 raft_consensus.cc:606] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:10.539149  1570 raft_consensus.cc:614] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:10.542771  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:10.543550  2437 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:10.543923  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:10.544827  2437 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:01:10.545147  2437 pending_rounds.cc:85] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 11
I20260709 13:01:10.545243  2448 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:10.546304  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.546259  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:10.545347  2437 pending_rounds.cc:107] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:01:10.547093  2437 raft_consensus.cc:2889] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:10.547608  7961 consensus_queue.cc:237] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:10.548156  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.548907  2437 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 22: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:10.549633  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.550284  2437 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 19: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:10.551045  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.551538  7804 raft_consensus.cc:3055] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:10.552121  7804 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:10.552865  7566 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.553164  7804 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.529394  7558 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.555058  7566 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.555769  2448 raft_consensus.cc:1240] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:10.555508  7558 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.556975  2448 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:10.560002  2444 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
W20260709 13:01:10.535442  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.566262  2440 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 18.
I20260709 13:01:10.551599  2437 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:01:10.568877  2436 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:10.570189  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.573678  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:10.571841  1686 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:10.577245  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.580646  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:10.581668  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:10.582479  1640 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 18: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:10.583858  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:10.584303   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:10.584510  1640 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:01:10.585419  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:10.586154   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:10.587836  7672 consensus_queue.cc:1059] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:10.588285  7631 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:10.589063  7672 raft_consensus.cc:3055] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:10.589447  7672 raft_consensus.cc:740] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:10.591455  7794 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:10.592011  7794 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.594130  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 13:01:10.599539  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 133486us
I20260709 13:01:10.523900  7922 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:10.590416  7672 consensus_queue.cc:260] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.573172  7558 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.608539  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:10.609479  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:10.610802  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:10.573565  7741 raft_consensus.cc:697] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:10.589984  7808 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.599882  7909 raft_consensus.cc:2804] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:10.600698  7877 raft_consensus.cc:493] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.618731  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:10.619781  2405 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:10.603232  7804 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:10.549963  7933 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:10.677788  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 58109.9us
I20260709 13:01:10.535490  7740 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.679679  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:10.618403  7797 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:10.568854  7699 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:10.690526  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.694830  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 69084.9us
I20260709 13:01:10.697885  7969 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.697964  7741 consensus_queue.cc:237] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.698531  7969 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:10.700572  7969 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:10.623301  7794 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.704105  2438 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 11: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:10.696967  2405 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:10.685365  7881 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:10.615365  7558 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:01:10.615267  7631 consensus_queue.cc:1059] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:01:10.717532  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:10.710944  2437 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:01:10.719354  1638 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
W20260709 13:01:10.743672  7966 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:10.701047  7672 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:10.708878  7958 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:01:10.701202  7816 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:10.757615  7909 raft_consensus.cc:697] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 18 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:10.680784  7727 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.679069  7877 raft_consensus.cc:515] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:10.709066  7965 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.710026  7881 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.676733  7808 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.721556  7794 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:10.693161  7903 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:10.771379  7881 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:10.766088  7816 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.773365  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:10.778421  7808 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.751246  7858 raft_consensus.cc:2804] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:10.782769  7858 raft_consensus.cc:697] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:10.783715  7858 consensus_queue.cc:237] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.773787  7971 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:10.703922  7916 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:01:10.797721  7727 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.801959  7922 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:10.803400  7877 leader_election.cc:290] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:10.805298  7903 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:10.806156  7933 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:10.809379  7699 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:10.787052  7816 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.811105  7740 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:10.813598  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.820139  1720 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:10.821303  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:10.822079  1719 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:10.789121  7971 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:10.827068  7971 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.789374  7794 raft_consensus.cc:697] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:10.830914  7794 consensus_queue.cc:237] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.777139  7965 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.847386  1712 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:01:10.850986  7965 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:10.856212  7940 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:10.864408  7855 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:10.793475  7909 consensus_queue.cc:237] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.874660  7872 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 17. Current term is 18.
I20260709 13:01:10.880719  7847 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:10.887146  7816 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.891948  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.895421  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:10.921386  7816 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:10.922510  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:10.923170  1719 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.924525  7847 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:10.926450  7971 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.928704  7971 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:10.929106  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 241602us
I20260709 13:01:10.894268  7881 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.931420  7881 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:10.932644  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:10.933084  1717 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:10.937211  1719 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:01:10.942459  7971 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:10.951023  7794 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:10.951401  7855 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:10.956126  7855 consensus_queue.cc:1059] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:10.960258  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:10.962458  7855 raft_consensus.cc:3055] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:10.963541  7816 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:10.963610  7855 raft_consensus.cc:740] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:10.964241  7816 raft_consensus.cc:697] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:10.965370  7816 consensus_queue.cc:237] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.977564  7855 consensus_queue.cc:260] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.979099  7855 raft_consensus.cc:3060] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:10.979703  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:10.980242  7941 raft_consensus.cc:3055] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:10.980774  7975 consensus_queue.cc:1059] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:01:10.987098  1717 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 20.
I20260709 13:01:10.991478  2405 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:10.992583  7983 raft_consensus.cc:2804] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:10.993141  7983 raft_consensus.cc:697] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 20 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:10.993963  7983 consensus_queue.cc:237] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:10.990533  7941 raft_consensus.cc:740] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:01:11.044850  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.052546  7941 consensus_queue.cc:260] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.053920  7941 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:11.056900  1570 raft_consensus.cc:1275] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:11.030764  7909 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:11.058693  7909 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.060895  7909 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.071272  7970 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:11.073519  7970 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.085031  7959 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.085683  7959 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:11.088091  7959 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:11.085052  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.091131  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.096101  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.105036  7959 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.105638  7959 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:11.107085  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.107753  7959 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:11.108848  7959 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:11.109351  7959 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.111140  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.111478  1570 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:11.111418  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:11.112207  1569 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:01:11.112371  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:11.113081  1717 raft_consensus.cc:2368] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 13:01:11.107781  2444 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:01:11.113977  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:11.114517  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:11.114682  1719 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 17.
I20260709 13:01:11.115247  1565 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 17: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:11.122709  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:11.122849  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:11.122817  7939 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:11.123780  1717 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 10.
I20260709 13:01:11.124080  7939 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.124850  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:11.125638  1715 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.126947  7939 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.131166  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:11.131729  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.123363  7909 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:11.134642  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:11.135406  1713 raft_consensus.cc:2393] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 14: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:11.136759  1718 raft_consensus.cc:1275] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:11.141978  7903 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:01:11.145043  7974 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:11.132927  7909 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.152289  1611 leader_election.cc:400] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 13:01:11.152740  1611 leader_election.cc:403] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:01:11.153515  1611 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:11.154367  7872 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.155918  7804 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:11.156327  7804 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.156667  7804 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:11.169516  1638 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:11.169934  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.170576  1647 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:01:11.170490  7847 consensus_queue.cc:1048] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:11.169468  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:11.171720  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:11.172120  1641 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.172472  1644 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 17: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:11.180743  1715 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:01:11.182926  1611 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:11.189568  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:11.189800  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.189198  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:11.189569  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:11.192204  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.194017  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.194682  1644 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:01:11.197180  7974 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:11.198813  7799 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.199527  7799 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:11.201699  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:11.201815  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:11.185477  7847 raft_consensus.cc:2804] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:11.177946  7970 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.205583  7700 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:11.214893  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:11.217141  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.219867  1644 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: [10.11-13.12]
I20260709 13:01:11.223572  1641 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:01:11.223750  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.211923  7700 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:11.226038  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.224386  1645 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 18.
I20260709 13:01:11.231949  7804 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:11.213704  7847 raft_consensus.cc:697] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:11.242848  1644 raft_consensus.cc:1240] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:11.221040  7939 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.224211  7872 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for earlier term 8. Current term is 9.
I20260709 13:01:11.261210  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.241417  7700 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:11.267931  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 71958.5us
I20260709 13:01:11.270531  1712 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:11.248169  7959 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.272217  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.254539  7881 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:11.278209  7847 consensus_queue.cc:237] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:11.274221  7816 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.281983  7816 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.284096  2438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42646 (request call id 1553) took 1151 ms. Trace:
I20260709 13:01:11.284354  2443 raft_consensus.cc:1240] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:11.284637  2438 rpcz_store.cc:276] 0709 13:01:10.132782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.136071 (+  3289us) service_pool.cc:224] Handling call
0709 13:01:11.283829 (+1147758us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b5400746154. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:01:11.283999 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300263296}
I20260709 13:01:11.291846  7979 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:11.293480  7881 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.268203  7804 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:11.295742  7881 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:11.296835  1687 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.299963  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:11.309247  1641 raft_consensus.cc:1275] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:11.309695  1645 raft_consensus.cc:1275] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:11.310324  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.310962  1645 raft_consensus.cc:1275] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:11.310916  1641 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:01:11.311664  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:11.276574  7855 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.284550  7816 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:11.307143  1537 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:11.312270  1718 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:01:11.324877  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:11.325656  1715 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:01:11.326905  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:11.327513  1641 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:11.323491  7855 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.332219  7855 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.332808  7855 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:11.333184  7855 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.333525  7855 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.337687  7700 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.340658  7700 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.344298  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:11.344854  1641 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:11.347810  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:11.349071  2405 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:11.352219  2437 pending_rounds.cc:85] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 9
I20260709 13:01:11.352660  2437 pending_rounds.cc:107] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:01:11.352949  2437 raft_consensus.cc:2889] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:11.353158  1638 raft_consensus.cc:2468] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 18.
I20260709 13:01:11.356335  2405 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:01:11.363571  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.358528  7804 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.366590  7804 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.368728  7804 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.371579  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.372728  2443 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 6.
I20260709 13:01:11.370189  7941 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:11.370877  2405 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:11.374305  2446 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:11.364959  7977 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:11.375308  7977 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.375658  7977 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:11.364308  7816 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:11.376870  7979 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:11.362906  8001 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.384419  7971 raft_consensus.cc:3055] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:11.385056  7971 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:11.377240  7816 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:11.378119  7979 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.399632  7816 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.381852  8001 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:11.398778  7804 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.430331  1638 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:11.409199  7979 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.408200  7959 raft_consensus.cc:493] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.411007  7970 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.414251  7974 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:11.413970  8008 consensus_queue.cc:1059] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:01:11.395709  7971 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:11.441639  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 60184.5us
I20260709 13:01:11.453725  7941 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:11.461102  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.462175  1638 raft_consensus.cc:2393] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:11.463056  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:11.463617  1647 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.440681  7970 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.439047  7959 raft_consensus.cc:515] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:11.464416  1640 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:11.437476  7804 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.464628  1641 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:11.445510  7794 consensus_queue.cc:1059] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:01:11.488457  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:11.489120  2443 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.489347  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.489984  2446 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:01:11.475189  8001 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:11.484169  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:11.491117  1570 raft_consensus.cc:3060] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.484956  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:11.487007  1569 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:11.477041  7799 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:11.489442  7804 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.468240  7970 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.505293  7975 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:11.505983  1570 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:01:11.510912  7816 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.516088  7816 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:11.516716  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.522473  1646 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:01:11.517060  7977 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.518317  7979 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.526338  7979 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:11.528492  7909 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.527704  7977 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:11.541800  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 83575.2us
I20260709 13:01:11.545473  7804 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.505841  7975 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.546002  7804 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.563925  7804 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.537762  7971 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:11.580271  7975 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.487350  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:11.596657  1647 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
W20260709 13:01:11.604569  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 89494.7us
I20260709 13:01:11.744517  7909 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:11.617219  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.619648  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.746901  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.747431  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.744351  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 257053us
I20260709 13:01:11.749428  2446 raft_consensus.cc:1240] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:11.630193  1639 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:01:11.755887  1639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38584 (request call id 1506) took 1175 ms. Trace:
I20260709 13:01:11.756253  1639 rpcz_store.cc:276] 0709 13:01:10.580155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.580286 (+   131us) service_pool.cc:224] Handling call
0709 13:01:11.755702 (+1175416us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540021a554. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:01:11.755830 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2412020480}
I20260709 13:01:11.642995  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:11.757627  1567 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:11.760221  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.653440  7558 raft_consensus.cc:3055] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:11.663532  2443 raft_consensus.cc:2468] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:01:11.763015  7558 raft_consensus.cc:740] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:11.762887  7929 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:11.679500  7959 leader_election.cc:290] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:11.688489  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 225861us
I20260709 13:01:11.764016  7558 consensus_queue.cc:260] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.764369  1685 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:11.765008  7558 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.767072  1685 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:11.694429  1536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.084s	user 0.025s	sys 0.016s
I20260709 13:01:11.767515  7959 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.767925  1536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.025s	sys 0.017s
I20260709 13:01:11.768092  7959 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:11.768535  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 1.15907e+06us
W20260709 13:01:11.669212  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 224207us
I20260709 13:01:11.770334  7959 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:11.773270  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.775151  7971 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.775712  7971 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.777732  7975 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.778438  7971 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.778255  7975 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:11.780597  7975 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:11.783200  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:11.784708  1644 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:11.785801  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:11.786441  1641 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:11.786346  7975 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:11.789637  2405 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:11.790465  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:11.790695  2405 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:11.791049  1647 raft_consensus.cc:3060] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.791530  7977 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:11.791985  7977 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.792342  7977 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:11.795184  8019 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:11.795619  8019 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:11.795511  1685 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:11.796044  8019 raft_consensus.cc:3060] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.797502  7909 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:11.798749  7909 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.800274  7977 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.801298  7909 consensus_queue.cc:1048] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:11.800117  7799 consensus_queue.cc:1048] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:11.805500  7799 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.799664  7968 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:11.806880  7968 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.807021  7977 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:11.807335  7968 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:11.801877  8013 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.421s	user 0.003s	sys 0.000s
I20260709 13:01:11.809816  7968 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.814254  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.805977  7799 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.814425  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:11.814998  2446 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 11: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:11.816151  2438 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:11.817097  1647 raft_consensus.cc:2468] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:01:11.817276  7799 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.820683  1641 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:01:11.821386  1567 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
W20260709 13:01:11.822274  1456 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bfbaf6c33e5b45ea9c75342b1011f209 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 338d817f94ee4c1bad162e9a5860b68a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:01:11.823724  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 61510.5us
I20260709 13:01:11.824961  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.519479  7855 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.838650  7855 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.826326  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:11.840066  7816 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:11.840433  7816 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:11.840801  7816 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.824759  1686 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:11.830531  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.832661  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.832957  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.842638  2442 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 11: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:11.842981  2444 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:01:11.833997  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.835600  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.843814  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.844314  2446 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:01:11.836246  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.844358  2440 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:01:11.842597  2443 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 19.
W20260709 13:01:11.836634  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.847549  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:11.848331  2436 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 11: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:11.850870  1537 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:11.852641  1686 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:11.853457  7939 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:11.853834  7939 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:11.854228  7939 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.857410  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.859797  2448 raft_consensus.cc:1240] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:11.860917  7929 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:11.861466  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.861479  2446 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:11.862274  7816 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.861706  7929 raft_consensus.cc:697] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:11.864730  7816 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:11.864500  7929 consensus_queue.cc:237] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:11.863787  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.865989  8021 consensus_queue.cc:1059] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:11.866209  7939 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.866815  8021 consensus_queue.cc:1243] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer 338d817f94ee4c1bad162e9a5860b68a log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:11.867789  7566 consensus_queue.cc:1059] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:11.868275  8021 raft_consensus.cc:3055] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:11.868614  8021 raft_consensus.cc:740] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:11.868777  7566 raft_consensus.cc:3055] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:11.868896  8017 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.869184  7566 raft_consensus.cc:740] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:11.870398  7558 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:11.869504  8017 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.870850  7558 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:11.871351  7558 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:11.872393  8017 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.869530  8021 consensus_queue.cc:260] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.874782  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.874626  7566 consensus_queue.cc:260] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.875936  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.876084  8021 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:11.876562  1640 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 19.
I20260709 13:01:11.877501  2438 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:11.876518  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.877585  1638 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:11.877985  1643 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:11.878361  1646 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 15: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:11.878922  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.879689  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.880378  1646 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 11: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:11.880249  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.881248  1643 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 11: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:11.876132  7971 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:01:11.875957  7566 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.867578  1686 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:11.884333  1641 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:01:11.887101  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 17d2c95439be4ced872760603b0ae02b with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:11.887408  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.859421  8019 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.894598  7976 raft_consensus.cc:2804] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:11.894848  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.895467  2448 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:01:11.895738  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:11.896306  1570 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:01:11.896442  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:11.896607  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.897117  1571 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 22.
I20260709 13:01:11.897228  2443 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 22.
I20260709 13:01:11.866886  7672 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:01:11.899137  1715 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:11.899601  7976 raft_consensus.cc:697] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 13:01:11.900398  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.900542  7976 consensus_queue.cc:237] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.901064  7975 consensus_queue.cc:1059] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:11.902216  7975 raft_consensus.cc:3055] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:11.902657  7975 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:11.903579  7975 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:11.904110  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.904729  1642 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:01:11.904834  7975 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.897135  7816 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:01:11.921121  1467 catalog_manager.cc:5697] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 13 to 14, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:11.922634  7939 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:11.924255  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:11.924968  1715 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:01:11.925828  1467 catalog_manager.cc:5697] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 13:01:11.929967  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:11.935778  1715 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:11.943558  1715 raft_consensus.cc:1240] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:11.928392  1467 catalog_manager.cc:5697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 9 to 13, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 13 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:11.946302  1467 catalog_manager.cc:5697] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 13 to 15, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:11.947057  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:11.947906  1467 catalog_manager.cc:5697] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 13 to 14, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:11.950729  2405 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:01:11.952775  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 155661us
I20260709 13:01:11.962893  1715 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:01:11.964010  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:11.933876  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 218) took 11064 ms. Trace:
I20260709 13:01:11.964589  1641 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.966611  1467 catalog_manager.cc:5697] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 10 to 11, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:11.960923  2405 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:11.975402  1467 catalog_manager.cc:5697] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 10 to 12, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:11.978855  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:11.981616  1467 catalog_manager.cc:5697] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:11.985641  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:11.985739  1467 catalog_manager.cc:5697] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 13 to 17, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:11.991182  1715 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:11.990871  1467 catalog_manager.cc:5697] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 15 to 18, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 13:01:11.992980   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:11.992537  1467 catalog_manager.cc:5697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:11.997409  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:11.979028  8021 raft_consensus.cc:2804] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:12.001648  1718 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:11.995011  1467 catalog_manager.cc:5697] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:11.985571  7816 raft_consensus.cc:2804] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:12.004881  1718 raft_consensus.cc:1240] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:11.989313  7977 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:12.002118  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:12.015250  1713 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 22.
I20260709 13:01:12.008387  1641 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:01:12.003685  1467 catalog_manager.cc:5697] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 7 to 9, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:11.961367  7566 consensus_queue.cc:1048] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:01:12.010459  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:12.017210  1712 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:12.013762  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:11.964874  1470 rpcz_store.cc:276] 0709 13:01:00.869638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.869874 (+   236us) service_pool.cc:224] Handling call
0709 13:01:11.933757 (+11063883us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:10.577829 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:10.578680 (+   851us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:10.578743 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:01:10.578771 (+    28us) tablet.cc:662] Decoding operations
0709 13:01:10.580505 (+  1734us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:10.580645 (+   140us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:10.580686 (+    41us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:01:10.582253 (+  1567us) tablet.cc:701] Row locks acquired
0709 13:01:10.582303 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:01:10.582457 (+   154us) write_op.cc:270] Start()
0709 13:01:10.582627 (+   170us) write_op.cc:276] Timestamp: P: 1783602070582401 usec, L: 0
0709 13:01:10.582665 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:01:10.583400 (+   735us) log.cc:844] Serialized 6694 byte log entry
0709 13:01:10.934892 (+351492us) op_driver.cc:464] REPLICATION: finished
0709 13:01:11.034907 (+100015us) write_op.cc:301] APPLY: starting
0709 13:01:11.035008 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:11.044909 (+  9901us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:11.046021 (+  1112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:11.233067 (+187046us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:11.292071 (+ 59004us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:01:11.292140 (+    69us) write_op.cc:312] APPLY: finished
0709 13:01:11.292677 (+   537us) log.cc:844] Serialized 156 byte log entry
0709 13:01:11.292878 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:11.293051 (+   173us) write_op.cc:454] Released schema lock
0709 13:01:11.293126 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:11.293586 (+   460us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:11.293612 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":920528,"reported_tablets":36,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":99705,"apply.run_cpu_time_us":27778,"apply.run_wall_time_us":258676,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75221,"num_ops":17,"prepare.queue_time_us":109498,"prepare.run_cpu_time_us":74163,"prepare.run_wall_time_us":120066,"raft.queue_time_us":118051,"raft.run_cpu_time_us":12661,"raft.run_wall_time_us":29955,"replication_time_us":352055,"spinlock_wait_cycles":31488,"thread_start_us":220449,"threads_started":4,"wal-append.queue_time_us":207596}]]}
I20260709 13:01:12.021065  1467 catalog_manager.cc:5697] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 13:01:12.032337  1714 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:12.031071  7794 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.034950  7794 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:12.036676  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.037011  7794 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:12.038138  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:12.016566  8017 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.038741  2437 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 18.
I20260709 13:01:12.038861  8017 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.039772  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:12.041163  8017 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:12.013909  8021 raft_consensus.cc:697] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:12.042409  8021 consensus_queue.cc:237] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.043709  1712 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 18.
I20260709 13:01:12.052032  1537 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:12.052284  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:11.993338  7929 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:01:12.052805  2437 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:01:12.053530  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:12.022583  7816 raft_consensus.cc:697] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:12.055030  1719 raft_consensus.cc:1240] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:12.055636  7816 consensus_queue.cc:237] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:12.056511  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.056844  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:12.057379  1715 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:12.058372  1536 connection.cc:256] RPC call timeout handler was delayed by -1.5335951800000203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
I20260709 13:01:12.063891  1712 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:01:11.996304  7726 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:01:12.073006  1537 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:12.017530  7977 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:12.077883  1715 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:01:12.078862  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:12.030836  7799 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.079500  7794 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:12.088879  7794 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.089335  7794 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:12.076706  8017 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:12.094771  8019 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:12.095348  8017 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:12.096091  7799 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.094671  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:12.060225  7847 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:01:12.108088  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:12.099647  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:12.110289  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:12.097980  8017 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:12.111500  8017 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:12.111706  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:12.111920  8017 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.112344  8017 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:12.112666  2437 raft_consensus.cc:2410] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:01:12.098801  7799 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:12.114307  8032 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.080s	user 0.002s	sys 0.001s
I20260709 13:01:12.104578  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:12.114975  1712 raft_consensus.cc:2393] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 20: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:12.102523  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:12.072345  7959 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.069759  7855 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:12.121876  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:12.130626  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:12.084200  7977 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.136190  1712 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:12.136929  1611 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:12.138769  1717 raft_consensus.cc:2393] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 14: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:12.140867  1686 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:12.119971  8019 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:12.147516  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 88487.3us
I20260709 13:01:12.150620  2405 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:12.151242  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.151808  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:12.143108  7855 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.154095  7855 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:12.145851  7970 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:01:12.155275  7558 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.155874  7970 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:12.130151  7566 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:12.160465  1713 raft_consensus.cc:2468] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:01:12.138156  7872 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.145351  7961 raft_consensus.cc:2804] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:01:12.186995  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 121596us
I20260709 13:01:12.175161  1718 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:01:12.161398  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:12.219820  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:12.180006  7816 raft_consensus.cc:2804] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:12.177721  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 105826us
I20260709 13:01:12.222409  7855 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:12.223021  7855 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:12.158010  7558 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:12.227445  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 86917.4us
I20260709 13:01:12.227990  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:12.132843  7959 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.166543  8027 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:12.222498  7816 raft_consensus.cc:697] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:01:12.231539  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 47455.1us
I20260709 13:01:12.236954  2438 raft_consensus.cc:2368] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16.
I20260709 13:01:12.170291  8020 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 13:01:12.212757  7961 raft_consensus.cc:697] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:12.239993  7855 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:12.236637  8027 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.255719  8027 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:12.178064  7566 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.185671  7872 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.258271  7566 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:12.259744  7872 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:12.260020  7959 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:12.173755  7983 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:01:12.251014  2405 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:12.252069  2437 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
W20260709 13:01:12.254382  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 93137.7us
I20260709 13:01:12.254724  7961 consensus_queue.cc:237] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:12.262670  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 118081us
I20260709 13:01:12.266498  2405 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:12.268407  2446 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:01:12.270188  1537 leader_election.cc:400] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16.
I20260709 13:01:12.270509  1537 leader_election.cc:403] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:12.175869  8019 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.271224  1686 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:12.289397  8046 raft_consensus.cc:2804] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:12.295192  8041 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.296640  8019 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:12.272378  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:12.304775  1536 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:12.301964  1537 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:12.261590  7794 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.271008  7983 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:12.269802  7975 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:12.304111  8038 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.303222  8046 raft_consensus.cc:697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:12.326340  2446 raft_consensus.cc:1275] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:12.327721  7983 raft_consensus.cc:697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:12.321312  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:12.344611  1717 raft_consensus.cc:2410] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:01:12.340919  1567 raft_consensus.cc:2393] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 19: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:12.313490  7939 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:12.303159  7881 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:01:12.343235  1612 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:12.368945  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:12.348158  8017 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.404335  8017 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:12.410581  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.370666  8043 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:12.416675  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:12.417431  2438 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:12.408226  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:12.314795  7816 consensus_queue.cc:237] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:12.450621  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.377584  8048 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:12.342726  8038 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.376780  7975 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:01:12.408234  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 95952.5us
I20260709 13:01:12.376931  7929 consensus_queue.cc:1048] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
W20260709 13:01:12.463508  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 165235us
I20260709 13:01:12.414506  8042 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.399178  7959 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:01:12.504036  1536 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:12.452137  7983 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.485939  8048 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:12.501554  7939 raft_consensus.cc:697] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:12.510071  8042 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:12.528816  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 120643us
I20260709 13:01:12.530117  1612 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:12.534444  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 45746.8us
W20260709 13:01:12.529712  8035 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:01:12.524891  8043 raft_consensus.cc:697] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 13:01:12.569831  8047 log.cc:927] Time spent T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:01:12.527634  7558 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:12.570420  8043 consensus_queue.cc:237] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:12.571743  8037 log.cc:927] Time spent T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:01:12.573029  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:12.558674  8038 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:12.529007  8042 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.530786  7794 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:12.490532  8046 consensus_queue.cc:237] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.580919  8042 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:12.535602  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:01:12.582768  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 47240.3us
I20260709 13:01:12.583457  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:12.584440  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:12.586650  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:12.584530  2406 leader_election.cc:336] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.590s (SENT)
I20260709 13:01:12.587177  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:12.588994  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:12.566633  7961 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.599965  7961 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:12.590150  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:12.602357  1646 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 17.
I20260709 13:01:12.590741  2406 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:12.603533  2438 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:01:12.591570  1647 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:01:12.592175  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:12.605595  2436 raft_consensus.cc:2410] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:12.593400  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:12.593953  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:12.606446  2448 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
I20260709 13:01:12.594516  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:12.579279  8048 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.596035  8036 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:01:12.597755  1536 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:12.607184  2444 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:01:12.597697  7975 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:12.599375  8060 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:12.608718  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:12.616199  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:12.586936  8038 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:12.619234  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:12.588377  7558 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:12.640983  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:12.617476  8060 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:12.648126  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.654330  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:12.613489  8036 consensus_queue.cc:1243] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:01:12.641810  8021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.017s	sys 0.010s
I20260709 13:01:12.621693  7975 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:12.585373  8052 consensus_queue.cc:1059] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 13:01:12.640504  7855 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:12.706008  8059 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:01:12.706902  8053 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:01:12.707252  7566 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:12.708087  8057 log.cc:927] Time spent T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:12.637948  7558 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:12.711258  8041 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16.
I20260709 13:01:12.713191  8027 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.656159  8060 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:12.714483  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:01:12.715893  8064 log.cc:927] Time spent T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:01:12.709972  7977 consensus_meta.cc:287] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.000s
I20260709 13:01:12.639736  8017 raft_consensus.cc:3060] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:12.656405  7961 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:12.724990  8059 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.742301  8059 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:12.720486  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 127872us
W20260709 13:01:12.675179  1668 debug-util.cc:398] Leaking SignalData structure 0x7b0800351ce0 after lost signal to thread 434
W20260709 13:01:12.744369  1668 debug-util.cc:398] Leaking SignalData structure 0x7b080014e860 after lost signal to thread 1504
W20260709 13:01:12.745607  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1060 after lost signal to thread 1596
I20260709 13:01:12.674785  7881 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.656306  8051 raft_consensus.cc:2764] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
W20260709 13:01:12.717437  8021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.019s	sys 0.013s
I20260709 13:01:12.729314  1571 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:12.618594  7939 consensus_queue.cc:237] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.735805  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:12.734745  8063 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:12.738987  7977 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.739835  7566 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 23 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:12.746493  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:12.757961  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:12.730829  7558 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:12.748327  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08003577a0 after lost signal to thread 1597
W20260709 13:01:12.762970  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6120 after lost signal to thread 1671
W20260709 13:01:12.763303  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08002e81e0 after lost signal to thread 1672
W20260709 13:01:12.764364  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08003aac20 after lost signal to thread 1745
W20260709 13:01:12.764614  1668 debug-util.cc:398] Leaking SignalData structure 0x7b080037c600 after lost signal to thread 1746
W20260709 13:01:12.765695  1668 debug-util.cc:398] Leaking SignalData structure 0x7b080030b600 after lost signal to thread 2477
W20260709 13:01:12.766021  1668 debug-util.cc:398] Leaking SignalData structure 0x7b0800250a20 after lost signal to thread 7699
I20260709 13:01:12.725283  7979 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:01:12.772593  2443 raft_consensus.cc:1240] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:12.778316  1564 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:12.786101  1566 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:01:12.789872  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:12.790606  1572 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:12.794215  8068 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:12.794795  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:12.795472  1563 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:01:12.798000  1572 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 17.
I20260709 13:01:12.803630  8027 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:12.805222  7558 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:12.807305  7977 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:12.754889  7881 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.818405  1565 raft_consensus.cc:2468] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:01:12.809728  8042 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.823328  1641 raft_consensus.cc:1240] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:12.823952  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:12.824579  1565 raft_consensus.cc:2376] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13. Re-sending same reply.
I20260709 13:01:12.821106  8068 raft_consensus.cc:697] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:01:12.828974  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 244445us
I20260709 13:01:12.830806  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:12.822918  7975 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.834789  7558 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:12.847147  2406 leader_election.cc:336] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.035s (SENT)
I20260709 13:01:12.841279  1537 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:12.852272  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:12.853295  1565 raft_consensus.cc:2376] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 22. Re-sending same reply.
I20260709 13:01:12.856851  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:12.858752  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:12.859527  2448 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:12.861706  7881 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:12.830094  7983 raft_consensus.cc:2955] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Committing config change with OpId 10.11: config changed from index 8 to 11, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:12.871922  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:12.872833  1572 raft_consensus.cc:2410] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:01:12.847007  7975 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.874747  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:12.875453  1572 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:12.876053  1565 raft_consensus.cc:2376] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16. Re-sending same reply.
I20260709 13:01:12.840170  8042 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:12.841029  8065 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:12.873816  2448 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 19.
I20260709 13:01:12.839289  8068 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.853159  7804 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:12.858397  7558 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:12.886999  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:12.882091  8065 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.843776  8060 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:12.911955  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:12.898592  8072 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:12.876935  8017 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:12.919413  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:12.952788  2438 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:12.919473  7855 raft_consensus.cc:3055] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:12.920979  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:12.921891  8065 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:12.925062  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:12.927714  7975 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:12.928087  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:12.928809  7558 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:12.932945  1563 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:12.954802  2442 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:12.958122  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:12.962877  1565 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:12.981741  2438 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 23.
I20260709 13:01:12.892002  8059 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.002342  1712 raft_consensus.cc:2393] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 14: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:12.998687  1569 raft_consensus.cc:2376] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 19. Re-sending same reply.
I20260709 13:01:12.999437  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:13.001250  1570 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 20.
I20260709 13:01:13.003504  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:13.004755  1568 raft_consensus.cc:1240] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 19. Ops: []
I20260709 13:01:13.007326  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:13.007889  1717 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 18.
I20260709 13:01:13.012058  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.012600  1567 raft_consensus.cc:2376] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16. Re-sending same reply.
I20260709 13:01:12.955639  7855 raft_consensus.cc:740] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:12.964046  7566 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.018201  1565 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
W20260709 13:01:13.010878  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 99314.3us
I20260709 13:01:12.964334  7909 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.020462  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:12.898984  7804 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.032881  1611 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:13.043172  8065 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:13.043744  8065 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.044188  8065 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:13.050576  1537 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:13.051637  8017 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:13.052240  8017 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:13.052356  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:13.052949  2406 leader_election.cc:336] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.947s (SENT)
I20260709 13:01:13.053174  8017 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:13.055986  2406 leader_election.cc:336] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.037s (SENT)
I20260709 13:01:13.058156  2406 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:13.004522  8027 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.002696  8048 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:13.005672  8021 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:13.068622  1566 raft_consensus.cc:1240] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:13.062911  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:01:13.069900  2406 leader_election.cc:336] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 2.063s (SENT)
I20260709 13:01:13.070762  2406 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:13.078034  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.070333  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.080577  1564 raft_consensus.cc:2410] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:13.077206  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.083269  1568 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:01:12.955147  8072 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.086678  7855 consensus_queue.cc:260] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.041754  7566 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.088696  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.095682  1566 raft_consensus.cc:2393] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 10: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:13.095276  1563 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 23.
I20260709 13:01:13.075981  8046 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:13.095815  1718 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:13.101776  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:13.041685  7909 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.063656  7971 consensus_queue.cc:1059] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:01:13.072957  8027 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.076248  8048 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:13.076207  8021 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.105732  7872 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.117385  1566 raft_consensus.cc:1275] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:13.107784  8019 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:13.127321  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.128338  1563 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:13.104317  7558 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:13.129757  8034 log.cc:927] Time spent T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.776s	user 0.005s	sys 0.000s
I20260709 13:01:13.113111  8044 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.130877  7909 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:13.130836  8044 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.126819  7872 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.133343  8044 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:13.133505  8027 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:13.136929  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38584 (request call id 1537) took 1173 ms. Trace:
I20260709 13:01:13.138412  7872 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:13.137365  1643 rpcz_store.cc:276] 0709 13:01:11.963909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.964288 (+   379us) service_pool.cc:224] Handling call
0709 13:01:11.985698 (+ 21410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.986030 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.986092 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.010013 (+ 23921us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b2c0009a708. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cbb91a11 00007f18cbba1372 00007f18cd2d3a01 00007f18cd29843a 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2
0709 13:01:12.022347 (+ 12334us) log.cc:844] Serialized 26 byte log entry
0709 13:01:12.184731 (+162384us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:12.184771 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.184837 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.962794 (+777957us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:01:13.136696 (+173902us) raft_consensus.cc:1685] finished
0709 13:01:13.136717 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.136845 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":416,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":13645,"spinlock_wait_cycles":9539712,"thread_start_us":154212,"threads_started":1,"wal-append.queue_time_us":242890}
I20260709 13:01:13.138873  7804 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:13.140405  7566 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:13.141270  8060 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:13.143174  1612 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.024s	sys 0.016s
W20260709 13:01:13.143493  1612 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.024s	sys 0.016s
W20260709 13:01:13.143740  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 547693us
I20260709 13:01:13.145856  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:13.152627  7799 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:13.154762  7959 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:13.155321  7959 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:13.161038  8065 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:13.164198  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.164841  8028 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:13.165330  8028 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 23 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:13.167626  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.169840  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:13.173022  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:13.173588  1714 raft_consensus.cc:1813] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Handling vote request from an unknown peer a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:13.174113  1714 raft_consensus.cc:2410] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:01:13.177163  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:13.181010  2442 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:13.186584  1718 raft_consensus.cc:2393] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:13.187768  1644 raft_consensus.cc:2393] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:13.190311  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.190657  1645 raft_consensus.cc:1275] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:13.192003  1645 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:13.199260  2437 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:13.209043  1568 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:01:13.217198  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:13.217434  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.217727  1564 raft_consensus.cc:1275] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:01:13.218019  1563 raft_consensus.cc:3060] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:13.217887  1639 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
W20260709 13:01:13.230901  8083 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:01:13.232482  8086 log.cc:927] Time spent T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:01:13.233564  8048 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:13.234707  8072 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:13.235073  8021 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:13.236493  8059 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 20 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:13.236683  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:13.238498  8041 raft_consensus.cc:3055] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:13.238993  8041 raft_consensus.cc:740] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:13.240269  1643 raft_consensus.cc:2393] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 19: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:13.258304  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:13.259371  1645 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:13.274147  1566 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:01:13.281993  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.282778  1566 raft_consensus.cc:2393] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 10: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:13.218818  7959 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:13.221462  8042 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:13.267588  8048 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.219455  8038 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:01:13.307785  1572 raft_consensus.cc:1275] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:13.317332  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.328517  1565 raft_consensus.cc:2376] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14. Re-sending same reply.
I20260709 13:01:13.317833  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.320047  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.325587  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.314304  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:13.316872  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.309890  1563 raft_consensus.cc:2468] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:01:13.332058  1570 raft_consensus.cc:2376] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16. Re-sending same reply.
I20260709 13:01:13.320320  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:13.321935  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.336301  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.267778  8028 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.333982  1569 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 20.
I20260709 13:01:13.306432  7975 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 13:01:13.340133  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 277328us
I20260709 13:01:13.340054  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.310309  8038 consensus_queue.cc:1243] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:01:13.341615  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.343132  8065 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:13.292838  8041 consensus_queue.cc:260] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.345125  7799 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:13.345500  8041 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.346939  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:13.347096  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:13.347669  1639 raft_consensus.cc:3060] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.348425  1644 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:13.355504  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.306489  8042 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.367309  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.357517  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.359062  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.359498  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.341284  1570 raft_consensus.cc:2376] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 17. Re-sending same reply.
I20260709 13:01:13.357662  1612 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:13.370391  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:13.370662  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:13.371809  1612 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:13.372370  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.373941  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.374578  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.349722  1644 raft_consensus.cc:2955] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 8 to 11, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:13.387820  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.388924  1565 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 15: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:13.429814  1572 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:13.432272  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.309814  8048 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.437256  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.443300  1565 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 11: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:13.444597  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.444870  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.443567  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.467399  1572 raft_consensus.cc:2410] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:13.446192  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.470572  1566 raft_consensus.cc:2468] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 20.
I20260709 13:01:13.477792  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.478907  1570 raft_consensus.cc:2376] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15. Re-sending same reply.
I20260709 13:01:13.480243  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:01:13.473058  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 45499.3us
I20260709 13:01:13.488994  1715 pending_rounds.cc:85] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Aborting all ops after (but not including) 8
I20260709 13:01:13.489432  1715 pending_rounds.cc:107] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:01:13.489727  1715 raft_consensus.cc:2889] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:13.491837  1563 raft_consensus.cc:2410] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:01:13.491285  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.495524  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.444149  8059 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:13.498332  1565 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:01:13.497704  1566 raft_consensus.cc:3060] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:13.376586  7929 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:01:13.379809  8040 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:01:13.503820  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.444685  8076 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:13.500569  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:13.508402  1716 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:13.514576  8111 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:01:13.491523  7804 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:13.516574  7804 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.517760  1645 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:13.519047  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.508133  8076 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.519479  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:13.521056  1564 raft_consensus.cc:2393] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 14: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:13.527902  1685 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:13.501065  1718 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:13.499938  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.440183  8017 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:13.522038  8076 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.522176  8038 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:13.522799  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:13.523597  8048 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:13.528142  7855 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:13.528609  1640 raft_consensus.cc:3060] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.526986  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.506203  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.505599  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.547758  1565 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 17.
I20260709 13:01:13.548425  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.539697  1716 raft_consensus.cc:2468] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 19.
I20260709 13:01:13.498804  8059 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.543004  1566 raft_consensus.cc:2468] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
W20260709 13:01:13.544744  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.544754  1612 leader_election.cc:336] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.716s (SENT)
W20260709 13:01:13.544927  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 166991us
I20260709 13:01:13.546900  1639 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:01:13.547863  1564 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 19.
I20260709 13:01:13.554936  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.552681  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:13.556759  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:13.557265  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.561472  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.561523  1647 raft_consensus.cc:1275] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:13.563498  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:13.564553  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:13.565748  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:13.565966  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:13.566612  2448 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:13.566723  2438 raft_consensus.cc:2393] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 14: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:13.564045  2436 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
I20260709 13:01:13.574654  1566 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:13.574991  1572 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 17: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:13.544986  7974 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:13.583096  2448 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 20.
I20260709 13:01:13.584633  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:13.588503  1564 raft_consensus.cc:1275] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:13.589672  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:13.588395  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.594993  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:13.595842  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c79f18b2f4247348564b91d430d6124" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:13.596822  1572 raft_consensus.cc:2393] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 14: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:13.597038  2444 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:13.599822  1564 raft_consensus.cc:1275] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:13.556922  8059 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:13.601229  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:13.605163  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.601634  1569 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:13.599213  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:13.608305  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:13.610909  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.611596  1572 raft_consensus.cc:2376] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14. Re-sending same reply.
I20260709 13:01:13.612764  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.609041  2447 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 6.
W20260709 13:01:13.620584  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 68614.6us
I20260709 13:01:13.569689  1685 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:13.621804  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 52214.7us
I20260709 13:01:13.543757  8017 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.633796  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:13.634523  2437 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:01:13.551865  8060 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:01:13.635890  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:13.599936  8072 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.638680  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:01:13.608484  8111 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:01:13.674829  8038 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:13.675575  8038 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:13.640376  2448 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:01:13.645968  8102 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:01:13.646716  8085 log.cc:927] Time spent T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.427s	user 0.007s	sys 0.000s
W20260709 13:01:13.647215  8104 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:13.658001  7804 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:13.661477  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:13.663888  8042 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:13.666887  1564 raft_consensus.cc:2376] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14. Re-sending same reply.
I20260709 13:01:13.639446  8099 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:13.609696  7974 raft_consensus.cc:697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:13.687455  7974 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.691974  7941 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:13.694809  8106 log.cc:927] Time spent T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:13.697867  8017 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:13.700927  1571 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:13.702234  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.703348  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.704308  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.704840  1571 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
I20260709 13:01:13.705590  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.706887  1564 raft_consensus.cc:1275] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:01:13.708375  8110 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.362s	user 0.002s	sys 0.000s
W20260709 13:01:13.708850  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.711862  8082 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:01:13.714869  8083 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:13.685868  2405 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:13.723861  2405 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:13.726821  7983 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:13.632833  8020 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.728302  8105 raft_consensus.cc:2804] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:13.735831  1571 raft_consensus.cc:2393] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 14: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:13.730356  1713 raft_consensus.cc:1275] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:13.737836  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.732156  1640 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:13.682304  8038 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:13.740605  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 100139us
I20260709 13:01:13.744678  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.745965  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.748378  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.768282  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.787776  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.789003  1571 raft_consensus.cc:2393] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 17: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:13.804759  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.805761  1565 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 19.
I20260709 13:01:13.744042  7961 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:13.743474  8021 consensus_queue.cc:1048] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:01:13.811025  1713 raft_consensus.cc:1275] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:13.812088  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:01:13.812364  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 52358.6us
I20260709 13:01:13.812480  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.813220  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.728084  7672 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:01:13.681849  8072 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.827059  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.828128  1563 raft_consensus.cc:2393] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 15: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:13.830899  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.831450  1563 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:13.811560  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.798480  8105 raft_consensus.cc:697] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:13.845126  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.846410  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:13.847090  1719 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:13.848129  2446 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 17.
I20260709 13:01:13.848858  1564 raft_consensus.cc:2410] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:13.743618  8020 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.849900  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:13.852746  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 284162us
I20260709 13:01:13.834700  8099 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.853706  1563 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 20.
I20260709 13:01:13.855418  1611 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:13.858134  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:13.861073  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:13.861675  1564 raft_consensus.cc:1813] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Handling vote request from an unknown peer a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:13.862296  1564 raft_consensus.cc:2410] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:01:13.864148  1571 raft_consensus.cc:3055] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:13.864559  1571 raft_consensus.cc:740] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:13.840088  8091 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:01:13.869220  1571 consensus_queue.cc:260] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:13.868332  8103 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 13:01:13.865899  8017 raft_consensus.cc:2764] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:01:13.867219  8042 raft_consensus.cc:2804] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:13.870910  7929 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:13.862192  7939 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:13.861445  7977 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:01:13.890571  1571 raft_consensus.cc:3060] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:13.916101  1537 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:13.911020  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:13.878968  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:13.897444  8108 log.cc:927] Time spent T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.257s	user 0.004s	sys 0.000s
I20260709 13:01:13.861871  8099 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.864748  7799 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:01:13.883140  8125 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:13.921847  2442 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:01:13.886883  8041 consensus_meta.cc:287] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.000s
I20260709 13:01:13.887087  8105 consensus_queue.cc:237] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.868404  8046 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:01:13.947299  1570 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 17.
I20260709 13:01:13.890285  7974 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.950654  7974 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.951988  8090 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:13.952822  8059 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.953218  7974 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:13.923098  7558 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:13.954149  7558 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.954618  7558 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.954852  8090 consensus_queue.cc:1059] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:13.955327  8119 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:01:13.956187  7816 raft_consensus.cc:3055] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:13.956615  7816 raft_consensus.cc:740] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:13.957499  7816 consensus_queue.cc:260] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.958626  7977 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:13.937115  7939 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.959288  7977 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:13.960875  7939 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:13.961966  8020 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:13.877911  8112 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.885416  8028 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:01:13.913547  7929 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.941159  2436 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:13.969380  1567 raft_consensus.cc:2468] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:01:13.972818  2406 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:13.976543  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 97632.7us
I20260709 13:01:13.977471  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:13.979103  1571 raft_consensus.cc:1275] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:01:13.979627  1571 pending_rounds.cc:85] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 10
I20260709 13:01:13.979987  1571 pending_rounds.cc:107] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:01:13.980377  1571 raft_consensus.cc:2889] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:13.932590  7881 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:01:13.974154  7929 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:13.920506  8042 raft_consensus.cc:697] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:14.000715  8042 consensus_queue.cc:237] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:13.975787  8112 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.005343  8112 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:14.007021  8076 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.009342  8076 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:14.009873  1536 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:13.978711  7855 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:14.006415  2406 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:13.961831  7977 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:14.037213  7881 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:13.983255  8046 consensus_queue.cc:1048] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
W20260709 13:01:14.104269  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 97935.7us
I20260709 13:01:14.030768  8041 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:14.026175  7855 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:14.119390  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 90854us
I20260709 13:01:14.120512  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:14.038007  7881 raft_consensus.cc:697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:14.029671  8059 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:14.125690  1538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.128621  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.148187  8041 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:14.150898  8099 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:14.061044  8048 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:01:14.120302  7983 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:14.157781  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54412 (request call id 1783) took 1687 ms. Trace:
I20260709 13:01:14.114892  2406 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:14.015879  8020 consensus_queue.cc:1048] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.097s
W20260709 13:01:14.168207  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 53183.3us
I20260709 13:01:14.139878  8021 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:14.170480  2406 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:14.158388  1721 rpcz_store.cc:276] 0709 13:01:12.470358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.470496 (+   138us) service_pool.cc:224] Handling call
0709 13:01:12.470869 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.478378 (+  7509us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:13.193653 (+715275us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b1800263740. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18cce404bc 00007f18ca18e48b 00007f18d2fe8ab9 00007f18ca1aa69b 00007f18ca1a893f 00007f18ca1a8455 00007f18d0c903c7 00007f18cd2a29a7 00007f18cd2b20bf
0709 13:01:13.193793 (+   140us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.360598 (+166805us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.361173 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.361345 (+   172us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:13.361391 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.361480 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.896781 (+535301us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:01:14.157482 (+260701us) raft_consensus.cc:1685] finished
0709 13:01:14.157512 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.157700 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5487,"prepare.queue_time_us":42506,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1660,"raft.queue_time_us":1058,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":7186,"spinlock_wait_cycles":46160896,"thread_start_us":226475,"threads_started":2,"wal-append.queue_time_us":365348}
I20260709 13:01:14.164809  7816 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.163419  8070 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:14.176870  1612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.011s	sys 0.010s
W20260709 13:01:14.178578  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 278774us
W20260709 13:01:14.179010  1612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.011s	sys 0.010s
I20260709 13:01:14.168102  7979 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:14.185657  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 13:01:14.192101  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 592889us
W20260709 13:01:14.180315  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 313195us
I20260709 13:01:14.199056  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:14.205556  8076 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:14.206262  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:14.200616  8046 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:14.212728  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:14.177932  8021 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.181087  8070 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.219003  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:01:14.210219  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 292856us
I20260709 13:01:14.220901  2446 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:01:14.222434  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:14.223287  2440 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:01:14.219828  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
W20260709 13:01:14.227419  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.228077  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.228763  2443 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:14.235713  7558 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.239089  7558 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:14.242472  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:14.243235  2443 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:14.246258  2404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.248113  8070 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:14.253875  2443 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:01:14.255719  8021 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:14.217772  7974 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:14.256706  7974 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.257130  7974 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:14.258915  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:14.259661  2443 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:14.261755  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:14.262559  1571 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:01:14.263069  1567 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
W20260709 13:01:14.264699  1612 leader_election.cc:336] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.832s (SENT)
I20260709 13:01:14.265123  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:14.266822  1644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.003s	sys 0.023s
W20260709 13:01:14.267827  1644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.003s	sys 0.023s
I20260709 13:01:14.268754  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:14.284646  2443 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 17.
W20260709 13:01:14.288786  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 168388us
I20260709 13:01:14.289646  1536 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:14.206229  8076 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.293004  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:14.292989  1569 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 23 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:01:14.294111  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:14.286551  8110 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:01:14.308375  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:14.261219  7855 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.225006  8046 raft_consensus.cc:697] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:14.313486  2405 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:14.315434  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:14.207285  7881 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.290814  7983 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:14.307880  8129 log.cc:927] Time spent T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:14.337823  8065 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:14.342514  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.343521  1716 raft_consensus.cc:2368] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16.
I20260709 13:01:14.344794  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.322999  8041 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:14.348546  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:14.299846  7558 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:14.339781  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.340978  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.379300  1721 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 19.
W20260709 13:01:14.338811  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 74145.4us
W20260709 13:01:14.380451  1612 leader_election.cc:336] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.878s (SENT)
I20260709 13:01:14.349236  8138 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:14.350704  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:14.354544  8137 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:14.343344  8020 consensus_queue.cc:1048] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:01:14.364565  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:14.341979  8048 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:14.369627  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.370353  1720 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 18. Current term is 19. Ops: [16.9-18.10]
W20260709 13:01:14.372210  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 201804us
I20260709 13:01:14.329663  7855 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.377874  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.380868  1612 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:14.326102  7977 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:14.397317   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:14.382170  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.397857  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.382567  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:14.386698  1717 raft_consensus.cc:2393] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 14: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 13:01:14.392594  1687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.059s	sys 0.087s
W20260709 13:01:14.399103  1687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.060s	sys 0.087s
I20260709 13:01:14.392627  2406 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:14.394586  1686 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:14.396185  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.434597  1720 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 11.
I20260709 13:01:14.390645  8048 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:14.430902  1716 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 19.
I20260709 13:01:14.372623  8041 consensus_queue.cc:1059] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 13:01:14.436991  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 111464us
I20260709 13:01:14.439456  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.440346  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.442652  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:14.442691  1456 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bfbaf6c33e5b45ea9c75342b1011f209 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 338d817f94ee4c1bad162e9a5860b68a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:14.444512  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.444900  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:14.445140  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:14.445493  1570 raft_consensus.cc:2468] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 18.
I20260709 13:01:14.446111  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:14.446355  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:14.446946  1563 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:14.447224  1570 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:14.447207  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:14.447824  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:14.447943  1565 raft_consensus.cc:2376] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16. Re-sending same reply.
I20260709 13:01:14.448588  1572 raft_consensus.cc:2393] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 10: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:14.395942  8142 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 13:01:14.450884  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 56377.8us
I20260709 13:01:14.437479  8021 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:14.464484  1686 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:14.466748  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:14.467875  1568 raft_consensus.cc:2393] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 11: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:14.440577  8048 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:14.478590  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:14.479441  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4759b34f9b3e4074a8a1cffa7efc8ff7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:14.395155  8137 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.473585  1563 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 17.
W20260709 13:01:14.487044  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 52209.9us
I20260709 13:01:14.489708  2443 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:14.492714  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:14.493363  2440 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:14.495930  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:14.496537  1570 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 17.
I20260709 13:01:14.437624  8070 consensus_queue.cc:1048] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:01:14.454377  7566 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:14.499167  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:14.507534  1570 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 17.
I20260709 13:01:14.466456  8021 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:14.533524  2440 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 12.
I20260709 13:01:14.453306  7977 consensus_queue.cc:1048] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:01:14.399587  8046 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:14.537985  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 87203.6us
W20260709 13:01:14.564160  8134 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:01:14.566552  8143 log.cc:927] Time spent T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:01:14.568873  8120 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.734s	user 0.003s	sys 0.000s
I20260709 13:01:14.570462  1715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60088 (request call id 3250) took 1082 ms. Trace:
I20260709 13:01:14.570887  1715 rpcz_store.cc:276] 0709 13:01:13.487875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.488047 (+   172us) service_pool.cc:224] Handling call
0709 13:01:13.488531 (+   484us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:13.503502 (+ 14971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.503531 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:13.504360 (+   829us) log.cc:844] Serialized 78 byte log entry
0709 13:01:13.634184 (+129824us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:13.634240 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.634312 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.449183 (+814871us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b4400022b4c. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18ca033db1 00007f18ca0d1c85 00007f18ca0d26a2 00007f18cce441db 00007f18cce3faaf 00007f18cce3386e 00007f18cce32bb6 00007f18cce327d8 00007f18cce3c221 00007f18cce3c1d9 00007f18cce3c169
0709 13:01:14.570138 (+120955us) raft_consensus.cc:1685] finished
0709 13:01:14.570160 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.570403 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5602,"raft.queue_time_us":6530,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":21179,"spinlock_wait_cycles":6202752,"thread_start_us":88469,"threads_started":1,"wal-append.queue_time_us":210020}
I20260709 13:01:14.572638  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:14.572901  1712 raft_consensus.cc:1217] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 12.8->[13.9-17.11]   Dedup: 15.10->[17.11-17.11]
I20260709 13:01:14.573544  1712 raft_consensus.cc:1240] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 17. Current term is 18. Ops: [13.9-17.11]
I20260709 13:01:14.573829  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:14.507599  8076 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:14.524657  8021 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:14.497491  8041 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
W20260709 13:01:14.559725  8132 log.cc:927] Time spent T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:01:14.576208  7799 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:14.613092  8139 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 13:01:14.629354  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 164990us
W20260709 13:01:14.631922  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 133554us
I20260709 13:01:14.617851  7799 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:14.582078  8138 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:01:14.679134  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:14.687374  1536 leader_election.cc:400] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16.
I20260709 13:01:14.691082  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:14.682538  7799 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.687932  7855 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:14.712422  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:14.714859  2406 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:14.716564  8165 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:14.718818  8150 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:14.706390  7941 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.723224  8137 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:14.684823  8148 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 13:01:14.735888  8161 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:01:14.736773  8133 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.358s	user 0.000s	sys 0.000s
I20260709 13:01:14.736914  8158 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:01:14.736816  8100 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 13:01:14.746768  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 58249.2us
I20260709 13:01:14.842742  1536 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:14.764813  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 50055us
I20260709 13:01:14.768018  8090 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:14.773447  8065 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:01:14.811688  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.848688  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:14.778914  8127 log.cc:927] Time spent T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.632s	user 0.002s	sys 0.000s
I20260709 13:01:14.815379  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.850689  7961 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:14.851228  1712 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 13:01:14.774152  8136 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:14.770042  1563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:01:14.852689  1563 raft_consensus.cc:606] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:14.852797  8136 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:14.853159  1563 raft_consensus.cc:614] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:14.776288  8122 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.853494  8136 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.854368  8122 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.856568  8122 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:14.775486  8141 raft_consensus.cc:3055] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:14.856853  8136 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:14.857170  8141 raft_consensus.cc:740] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:14.858172  8141 consensus_queue.cc:260] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.859686  8141 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:14.777676  8135 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:14.860714  8135 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:14.773952  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 393497us
W20260709 13:01:14.862555  1612 leader_election.cc:336] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Timed out: RequestConsensusVote RPC to 127.0.107.193:45751 timed out after 1.903s (SENT)
I20260709 13:01:14.863057  1612 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:14.863991  8136 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:14.776535  8076 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 13:01:14.770382  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 58071.1us
I20260709 13:01:14.759701  8140 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:14.762948  8150 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.779618  7941 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.851461  7961 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:14.865619  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.867501  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:14.874168  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:14.875155  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:14.879828  1565 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:14.898783  7941 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:14.899507  8154 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:14.892050  8041 consensus_queue.cc:1059] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:01:14.901489  1712 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:14.749804  7974 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:14.876329  7929 consensus_meta.cc:287] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: Time spent flushing consensus metadata: real 0.869s	user 0.013s	sys 0.001s
I20260709 13:01:14.868404  7558 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:14.922449  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 55029.4us
W20260709 13:01:14.886447  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.878573  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:14.915097  1537 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:14.891350  8150 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:14.912665  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:14.952489  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.942445  8017 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:14.979803  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:14.881012  7855 raft_consensus.cc:493] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:14.941587  8152 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:14.982435  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:14.974009  1566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eae5b8a8b4f14989a2565077fe8be235"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "66344ad7cd844754b2c81cc689a709b0"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:01:14.983994  1566 raft_consensus.cc:606] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Received request to transfer leadership to TS 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:14.984330  1566 raft_consensus.cc:614] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:14.976367  1717 raft_consensus.cc:1240] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 16. Current term is 18. Ops: []
I20260709 13:01:14.897709  8021 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:14.979620  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 64619.1us
I20260709 13:01:14.877439  8065 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.990263  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:14.881307  8046 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:01:14.881611  8076 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:14.905304  8137 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.088s
I20260709 13:01:14.989410  8145 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:14.955140  7558 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:15.005879  8126 log.cc:927] Time spent T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.958s	user 0.000s	sys 0.002s
I20260709 13:01:14.951797  7929 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.007907  7929 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:14.977367  8138 consensus_queue.cc:1059] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:01:15.009049  8138 raft_consensus.cc:3055] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:15.009408  8138 raft_consensus.cc:740] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:14.890775  8140 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:15.010769  7816 consensus_meta.cc:287] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.832s	user 0.013s	sys 0.000s
I20260709 13:01:14.996701  8072 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:15.012914  7974 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:15.013581  8140 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:14.988745  7855 raft_consensus.cc:515] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:15.019436  1718 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 18: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:15.020467  2436 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:15.015791  8165 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:14.982610  8152 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:15.022565  8152 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:15.024725  7855 leader_election.cc:290] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:15.027166  7799 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.027580  8021 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:15.029301  7799 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:15.030164  8017 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:15.030081  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 47709.7us
I20260709 13:01:15.030767  8017 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.031863  8068 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:15.031944  2406 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:15.032363  8068 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.032723  8017 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:15.033880  8167 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:14.986474  8041 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:15.034771  8041 raft_consensus.cc:697] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:15.035034  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:15.035827  1565 raft_consensus.cc:2410] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:15.035602  8041 consensus_queue.cc:237] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.032770  8068 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:15.038507  1715 raft_consensus.cc:1240] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:15.041093  1563 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:15.043740  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:15.049422  2436 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:15.015439  8076 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:15.067067  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:15.051469  8142 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.077224  2406 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:15.092303  1565 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:15.103149  8172 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.104686  8172 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:15.109876  8068 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.112323  8068 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:15.113381  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:15.114240  1712 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 18: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:15.085204  8142 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.138445  8165 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:15.139006  8165 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:15.139554  8142 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:15.084640  7855 consensus_queue.cc:1059] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:01:15.143262  7961 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:15.143877  8135 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:15.144320  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:15.151086  8065 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:15.154601  8048 consensus_meta.cc:287] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.001s
I20260709 13:01:15.154662  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:15.155596  1565 raft_consensus.cc:3060] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:15.155299  8048 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:15.156705  1568 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:15.158825  8019 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:15.157861  8048 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:15.194178  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 289254us
I20260709 13:01:15.194949  1611 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:15.195597  1565 raft_consensus.cc:2468] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 18.
I20260709 13:01:15.196689  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:15.197561  1565 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 23.
I20260709 13:01:15.207551  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:15.210040  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:15.222631  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:15.223287  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:15.244998  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 284604us
I20260709 13:01:15.212186  8135 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:15.163686  8152 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.253664  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:15.254721  2447 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 18: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:15.257421  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:15.257423  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:15.259465  2444 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:15.260039  1721 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:15.259939  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:15.261456  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:15.262778  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:15.263206  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:15.221971  8048 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:15.247751  8120 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:01:15.221199  8017 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:15.274042  2446 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:01:15.264914  1686 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:15.293715  2444 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 13:01:15.296041  2447 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:15.299222  1612 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:15.265393  8135 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:15.303784  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:15.306447  1564 raft_consensus.cc:3060] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:15.269634  8021 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.308984  1686 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:15.223614  8165 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.315094  8028 raft_consensus.cc:2804] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:15.315655  8040 consensus_queue.cc:1059] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:15.315990  8152 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:15.316529  8040 raft_consensus.cc:3055] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:15.316885  8040 raft_consensus.cc:740] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:15.264518  8141 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:01:15.251547  8098 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:01:15.326517  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:15.327746  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:15.328461  1567 raft_consensus.cc:2393] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 18: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:15.333328  1686 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:15.308226  8135 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.305730  7959 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:15.339154  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:15.277025  8048 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.307121  8112 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:15.357743  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:15.355217  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:15.362582  1720 raft_consensus.cc:2368] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 18.
W20260709 13:01:15.365694  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 53741.6us
I20260709 13:01:15.368063  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:15.297410  8017 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.376266   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:15.378319   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:15.346939  8141 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
W20260709 13:01:15.382762  8173 log.cc:927] Time spent T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:01:15.385535  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72ddc5b6631d45ffb9776db2cc41447d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:15.331043  8065 consensus_queue.cc:1048] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:01:15.345316  8028 raft_consensus.cc:697] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:15.397068  8028 consensus_queue.cc:237] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.317754  8040 consensus_queue.cc:260] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.399562  8040 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.363919  7974 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.330618  8021 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:15.392199  8180 log.cc:927] Time spent T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:01:15.334681  7566 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:01:15.394531  8048 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:15.395423  8194 consensus_queue.cc:1048] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:15.405505  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:15.409488  8150 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.411599  8150 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:15.412245  1716 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 12: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:15.374323  8183 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:15.415717  8021 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:15.415982  8048 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.417611  8157 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.375280  7959 consensus_queue.cc:1059] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:01:15.425552  8017 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:15.426707  8165 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:15.441437  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:15.471872  2446 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 15: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:15.443331  7558 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:15.418022  1564 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 18.
W20260709 13:01:15.462440  8197 log.cc:927] Time spent T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.055s	user 0.006s	sys 0.000s
I20260709 13:01:15.473467  8154 raft_consensus.cc:3055] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:15.474548  8154 raft_consensus.cc:740] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:15.475391  8154 consensus_queue.cc:260] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:15.476420  8154 raft_consensus.cc:3060] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:15.480676  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 125562us
I20260709 13:01:15.481150  7979 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.481763  7979 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.482456  8131 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:01:15.462909  8193 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.005s
W20260709 13:01:15.461448  8146 log.cc:927] Time spent T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.057s	user 0.001s	sys 0.005s
I20260709 13:01:15.454443  8157 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.487767  8157 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:15.464560  8138 consensus_queue.cc:260] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.492177  8138 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:15.492316  7855 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.494366  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:15.498597  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:15.499418  2440 raft_consensus.cc:2393] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:15.501924  8194 consensus_queue.cc:1059] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:15.503787  7959 raft_consensus.cc:3055] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:15.504186  7959 raft_consensus.cc:740] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:15.505124  7959 consensus_queue.cc:260] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.509274  1718 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:01:15.509397  8149 consensus_queue.cc:1059] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:15.510779  8158 raft_consensus.cc:3055] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:15.511173  8158 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:15.512235  7959 raft_consensus.cc:3060] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:15.512173  8158 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:15.520339  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:15.525358  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:15.526564  1686 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:15.528347  7979 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:15.531329  2405 leader_election.cc:400] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 18.
I20260709 13:01:15.536732  8158 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:15.549742  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:15.566295  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 159230us
I20260709 13:01:15.689364  1612 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:15.690874  1612 leader_election.cc:304] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
W20260709 13:01:15.466432  8177 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.167s	user 0.001s	sys 0.004s
I20260709 13:01:15.453606  8048 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.469779  2447 raft_consensus.cc:2468] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 18.
I20260709 13:01:15.466130  8135 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:15.687033  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 134783us
I20260709 13:01:15.455567  8065 raft_consensus.cc:3055] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:15.687707  2405 leader_election.cc:403] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:01:15.688736  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 162236us
I20260709 13:01:15.577682  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:15.693441  7961 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:15.694361  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:15.719204  2443 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 20.
I20260709 13:01:15.700886  8166 raft_consensus.cc:2804] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:15.704802  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:15.720831  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.720964  1612 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:15.705329  8183 raft_consensus.cc:2749] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:15.721580  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:15.706403  8122 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:15.709964  8072 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:15.727993  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 196784us
W20260709 13:01:15.734404  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 373177us
W20260709 13:01:15.740288  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.746536  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:15.742218  8072 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.753553  8072 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:15.755195  8183 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:15.730710  8194 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:15.758888  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:15.759534  1563 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 20.
I20260709 13:01:15.764285  1718 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:15.764693  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:15.766680  8165 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:15.716351  8065 raft_consensus.cc:740] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:15.768116  8065 consensus_queue.cc:260] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:15.769104  8065 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:15.772449  1712 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 18. Current term is 19. Ops: [16.9-18.10]
I20260709 13:01:15.774399  1537 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:15.774513  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:15.736248  8090 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271) with higher term. Message: Invalid argument: T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 18.
I20260709 13:01:15.777719  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:15.778659  2406 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 13:01:15.779598  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 58686.7us
W20260709 13:01:15.780194  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 74062.1us
I20260709 13:01:15.784142  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:15.784696  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:15.786623  2406 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:15.787181  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:15.787766  1566 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 10.
I20260709 13:01:15.745769  7799 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.748246  8048 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:15.746079  8166 raft_consensus.cc:697] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 18 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 13:01:15.789537  1456 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bfbaf6c33e5b45ea9c75342b1011f209 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 338d817f94ee4c1bad162e9a5860b68a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:15.796185  1565 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:15.800755  1612 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:15.802484  7961 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:15.803972  1612 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:15.790957  8068 raft_consensus.cc:2804] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:15.787052  7855 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:15.812359  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:15.813599  1717 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:15.794745  8194 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:15.814164  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:15.817837  7961 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:15.820742  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.777362  7979 consensus_queue.cc:1059] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:01:15.821795  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:15.818740  8217 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.824927  8068 raft_consensus.cc:697] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 18 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:15.828745  8068 consensus_queue.cc:237] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.830562  8166 consensus_queue.cc:237] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.809021  7855 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.833997  7855 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:15.835076  8135 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:15.827247  2406 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:15.836705  2406 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:15.836969  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:15.837522  2406 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:15.809118  8167 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:15.826951  7983 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:15.839589  7816 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:15.840832  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:15.825661  7959 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:15.847488  8019 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:15.849092  7979 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:15.849509  7979 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.842190  7816 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:15.851686  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.849861  7979 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.839547  8194 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:15.850095  8021 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.850229  7941 raft_consensus.cc:3055] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:15.861229  1612 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:15.865899  1612 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:15.860215  7959 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.860761  7816 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:15.842834  8167 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.864683  7941 raft_consensus.cc:740] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:15.872112  8217 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:15.884294  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 46834.8us
I20260709 13:01:15.861676  8135 consensus_queue.cc:1048] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:01:15.897254  8172 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:15.881119  8183 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.872098  8021 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.906852  1537 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:15.916049  2442 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:15.917862  7941 consensus_queue.cc:260] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:15.932011  8167 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:15.938727  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:15.945608  1536 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:45463 timed out after 2.096s (SENT) [suppressed 39 similar messages]
I20260709 13:01:15.930442  7941 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:15.929510  8157 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:15.915285  8163 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:01:15.943801  8165 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:01:16.001973  8222 log.cc:927] Time spent T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:01:16.007910  1719 raft_consensus.cc:2955] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 6 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:16.021665  7816 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.025774  7816 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 21 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:15.999837  8021 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:16.027614  7855 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.029776  7855 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:16.032743  7979 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.085112  8163 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:16.121383  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 172640us
I20260709 13:01:16.132226  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:16.133391  1715 raft_consensus.cc:2410] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:16.122126  8163 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:16.136967  8157 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.144071  8048 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:01:16.162391  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 296516us
I20260709 13:01:16.168093  1612 leader_election.cc:304] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:16.171172  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:16.171844  2447 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 21: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:16.175664  1612 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:16.163604  8157 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.179378  8157 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:16.182479  7979 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:16.185994  2447 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:01:16.187513  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.190276  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:16.191828  7961 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:16.206934  8235 log.cc:927] Time spent T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:16.189548  8240 raft_consensus.cc:2749] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:16.212412  8228 log.cc:927] Time spent T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.222s	user 0.002s	sys 0.000s
W20260709 13:01:16.226913  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.231585  8163 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:16.165167  8048 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.191483  1612 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:01:16.243893  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 52514.4us
I20260709 13:01:16.246383  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:16.242304  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 80421.8us
W20260709 13:01:16.247786  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.251540  1644 raft_consensus.cc:1240] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:01:16.255163  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:16.256151  1645 raft_consensus.cc:2393] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 11: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:16.256292  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:16.257580  1644 raft_consensus.cc:2393] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 14: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:16.259476  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:16.249480  8231 log.cc:927] Time spent T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:16.263708  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.269204  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.253065  7961 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:16.269876  1644 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 18.
I20260709 13:01:16.243340  8122 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:16.272485  1643 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:16.273882  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.274662  1645 raft_consensus.cc:2468] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
W20260709 13:01:16.274717  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.278277  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:16.281086  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.281446  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:16.281961  1645 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:01:16.282373  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.283880  1641 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 17.
I20260709 13:01:16.283227  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.292384  8041 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:16.293012  8041 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:16.295095  8041 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:16.293030  7983 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:16.296198  7983 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:16.273867  8163 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:16.307194  8163 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.308969  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:16.309330  8163 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:16.309826  1563 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 21: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:16.280040  8122 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:16.311232  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.312188  8122 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:16.313596  8048 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:16.313946  7855 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:16.314550  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:16.315097  1564 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.317430  1639 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 13.
I20260709 13:01:16.280515  7961 raft_consensus.cc:697] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 17 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:16.320420  7961 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.282016  1644 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:16.325152  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.326372  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.326946  1641 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:01:16.335042  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:16.339021  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:16.341133  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:16.342397  1564 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:01:16.343111  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681b2518696f44d99824827761c9c9f1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.347620  1571 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:01:16.348145  7983 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.350445  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.353319  1640 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:01:16.353468  2446 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 24 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 23. Current term is 24. Ops: []
I20260709 13:01:16.339241  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:16.354200  2436 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 17.
I20260709 13:01:16.356154  1572 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:01:16.363734  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.363850  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.368007  1644 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 18.
I20260709 13:01:16.370770  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:16.372462  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.373227  1638 raft_consensus.cc:2393] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 14: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:16.374814  1642 raft_consensus.cc:1217] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 LEADER]: Deduplicated request from leader. Original: 16.9->[18.10-18.10]   Dedup: 18.10->[]
I20260709 13:01:16.374557  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:16.379103  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.380990  1642 raft_consensus.cc:1240] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:01:16.386799  1645 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 18.
I20260709 13:01:16.375658  1640 raft_consensus.cc:2376] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15. Re-sending same reply.
I20260709 13:01:16.372972  2406 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:16.403476  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beabe4568b4d481bac560939dd7f8258" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.369323  7983 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:16.405753  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:16.411679  1719 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 17: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:16.406510  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:16.408141  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:01:16.414192  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.415419  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b719a12d310b46bf978e160558e7d6f5" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.422523  1537 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:16.424409  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.425045  1640 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:01:16.410687  7672 raft_consensus.cc:2804] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:16.428197  2442 raft_consensus.cc:2955] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 6 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:16.404388  8165 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:01:16.460412  7816 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:16.461206  7816 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.472254  8046 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.472873  8046 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.475415  8046 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:16.476398  8249 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:16.424094  8227 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:01:16.446434  8048 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:16.489379  1645 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:16.484790  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.491603  1641 raft_consensus.cc:2468] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:01:16.430719  8150 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:01:16.449757  7672 raft_consensus.cc:697] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:16.501722  1641 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:16.508523  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.509505  1643 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:16.482991  8157 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.491185  8227 consensus_queue.cc:1243] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer 338d817f94ee4c1bad162e9a5860b68a log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:01:16.524137  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 106962us
I20260709 13:01:16.522346  1645 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:16.491438  8122 raft_consensus.cc:493] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:16.497591  8048 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:16.534729  1642 raft_consensus.cc:1275] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:16.505501  7983 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.534969  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:16.546342  1647 raft_consensus.cc:1240] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:16.553562  1647 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:16.541958  7855 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.543687  8048 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:16.543754  8150 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:16.577194  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:16.577538  1641 raft_consensus.cc:2468] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 7.
I20260709 13:01:16.586464  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.603365  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:16.604027  1572 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 17.
I20260709 13:01:16.527714  8157 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:16.631695  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.542651  8122 raft_consensus.cc:515] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.632573  1643 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:01:16.558799  7983 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.636559  7983 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:16.651433  8221 log.cc:927] Time spent T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.720s	user 0.005s	sys 0.000s
I20260709 13:01:16.662493  1645 raft_consensus.cc:1275] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:01:16.665548  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.588290  7855 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:16.675402  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.605893  8150 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.601325  7672 consensus_queue.cc:237] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.686349  7816 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:16.689016  8122 leader_election.cc:290] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:16.669596  8254 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:01:16.730686  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 155063us
W20260709 13:01:16.689994  8252 log.cc:927] Time spent T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:01:16.732450  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.715730  8256 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:16.694758  7855 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:16.738935  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:16.748980  1644 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:16.731129  8254 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.752058  8254 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:16.789657  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.741393  8256 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.800837  1640 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:16.800988  8137 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:01:16.801543  8137 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:16.811664  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:16.815896  1685 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.821507  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.822656  1641 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:01:16.822203  8255 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:16.824378  8150 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:16.812605  8157 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:16.826354  8256 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:16.835300  8253 log.cc:927] Time spent T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 13:01:16.840866  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.845067  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:16.847308  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:16.848156  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.848695  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b724690541549b4be895303885a0998" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.848894  1642 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:01:16.849463  1639 raft_consensus.cc:2393] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 7: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:16.849856  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:16.850435  1638 raft_consensus.cc:3060] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.850821  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.852566  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:16.853169  2446 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:01:16.853940  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:16.855275  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:16.858757  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:16.859390  1568 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 18.
I20260709 13:01:16.860297  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:16.860965  1569 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:01:16.863092  1566 pending_rounds.cc:85] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 11
I20260709 13:01:16.863452  1566 pending_rounds.cc:107] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:01:16.863709  1566 raft_consensus.cc:2889] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:16.870265  2406 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:16.870882  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:16.870124  8137 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.871268  8148 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:16.871454  2436 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 18.
I20260709 13:01:16.871819  8148 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.873817  8148 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:16.882478  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.884038  7881 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:16.884578  7881 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.884985  7881 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:16.890614  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.893728  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.894556  1647 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 18.
I20260709 13:01:16.896689  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:16.897689  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.899030  1643 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:01:16.900022  8122 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:16.902292  1612 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:16.898382  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:16.903767  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:16.906298  7881 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.906634  8137 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:16.910959  8148 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:01:16.911115  1686 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.913106  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:16.914404  2436 raft_consensus.cc:1275] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:01:16.916421  1469 catalog_manager.cc:5697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 13:01:16.387079   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:16.923516  8048 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:16.896680  2406 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:16.953053  1647 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 15: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:16.953452  1644 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:01:16.973796  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 77208.4us
W20260709 13:01:16.958757  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 56566.4us
I20260709 13:01:16.975077  1638 raft_consensus.cc:2468] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:01:16.977885  2406 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:16.979513  1469 catalog_manager.cc:5697] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:16.979980  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:16.985698  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:16.964151  8098 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:16.966812  8122 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:17.000906  1712 raft_consensus.cc:1275] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:17.006625  1467 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58252 (request call id 333) took 6743 ms. Trace:
I20260709 13:01:16.976375  8194 raft_consensus.cc:476] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Not starting pre-election -- already a leader
I20260709 13:01:16.978608  8243 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:16.984668  8105 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:17.014348  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:17.011304  1537 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:17.018713  1686 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:17.019678  1686 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:16.998661  7961 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:17.007059  1467 rpcz_store.cc:276] 0709 13:01:10.254922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.255082 (+   160us) service_pool.cc:224] Handling call
0709 13:01:16.998134 (+6743052us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:12.365280 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:12.517868 (+152588us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:12.519206 (+  1338us) write_op.cc:435] Acquired schema lock
0709 13:01:12.522150 (+  2944us) tablet.cc:662] Decoding operations
0709 13:01:12.774730 (+252580us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:12.779435 (+  4705us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:12.782297 (+  2862us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:01:12.835162 (+ 52865us) tablet.cc:701] Row locks acquired
0709 13:01:12.835182 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:01:12.835354 (+   172us) write_op.cc:270] Start()
0709 13:01:12.835481 (+   127us) write_op.cc:276] Timestamp: P: 1783602072835302 usec, L: 0
0709 13:01:12.835502 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:01:12.836281 (+   779us) log.cc:844] Serialized 5533 byte log entry
0709 13:01:13.551689 (+715408us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b1800375700. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18d3073de1 00007f18d30805b1 00007f18ca1ab3f3 00007f18ca1ad7c1 00007f18ca1ad779 00007f18ca1ad709 00007f18ca1ad6d1 00007f18ca1ac9cd 000000000038f354 000000000038f199 00007f18ca18e83a
0709 13:01:14.175474 (+623785us) op_driver.cc:464] REPLICATION: finished
0709 13:01:14.468527 (+293053us) write_op.cc:301] APPLY: starting
0709 13:01:14.480191 (+ 11664us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:15.031368 (+551177us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:15.031392 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:15.401085 (+369693us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:15.401374 (+   289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:01:15.401419 (+    45us) write_op.cc:312] APPLY: finished
0709 13:01:15.401727 (+   308us) log.cc:844] Serialized 129 byte log entry
0709 13:01:15.792866 (+391139us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:15.805972 (+ 13106us) write_op.cc:454] Released schema lock
0709 13:01:15.810710 (+  4738us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:15.843257 (+ 32547us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:15.846610 (+  3353us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":165964,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":260939,"apply.run_cpu_time_us":57741,"apply.run_wall_time_us":1378798,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62675,"num_ops":14,"prepare.queue_time_us":160993,"prepare.run_cpu_time_us":25860,"prepare.run_wall_time_us":546269,"raft.queue_time_us":444265,"raft.run_cpu_time_us":9677,"raft.run_wall_time_us":222819,"replication_time_us":1321868,"spinlock_wait_cycles":7175936,"thread_start_us":854966,"threads_started":5,"wal-append.queue_time_us":419026,"wal-append.run_cpu_time_us":18616,"wal-append.run_wall_time_us":2336680}]]}
I20260709 13:01:16.976518  8148 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.020952  1469 catalog_manager.cc:5697] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 11 to 16, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.009307  8258 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:17.032084  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.013397  7939 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.013034  8165 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.013480  8243 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.015646  8105 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:17.028170  7799 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:17.026508  8149 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:17.004899  8098 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:17.020681  8272 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:17.041913  8243 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:17.042661  8105 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:17.063377  1469 catalog_manager.cc:5697] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 11 to 13, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
W20260709 13:01:17.073392  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 87774.3us
I20260709 13:01:17.074164  1612 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:17.076982  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:17.077116  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:17.051602  7799 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:17.078403  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:17.078429  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:17.078682  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:17.079048  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff20dea159284907b41e95b640800f50" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:17.081804  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:17.083415  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:17.084928  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:17.045671  8165 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:17.064340  8272 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.086221  8258 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:17.090086  8148 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:17.095378  7881 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:17.096293  1566 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:17.038344  8040 consensus_queue.cc:1048] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:01:17.098798  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:17.104765  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:17.100641  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:17.106125  1713 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 17: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:17.107060  1536 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:17.101671  8258 raft_consensus.cc:697] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:17.109512  8258 consensus_queue.cc:237] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.112079  8257 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.112411  8150 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:17.112603  8257 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:17.113250  8028 consensus_queue.cc:1048] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:17.110824  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:17.041421  7939 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.115716  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:17.116787  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:17.119086  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:17.122005  1647 raft_consensus.cc:2393] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 14: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:17.119160  2443 raft_consensus.cc:1240] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:17.084277  7799 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:17.125461  1536 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.120664  8255 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:17.127749  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:17.127923  8255 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:17.128331  1647 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 18.
I20260709 13:01:17.128540  8048 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:17.128291  8255 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:17.099961  8272 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:17.133324  8098 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:17.138639  8255 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.140152  1469 catalog_manager.cc:5697] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 9 to 12, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 13:01:17.123879  8041 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:01:17.151357  1469 catalog_manager.cc:5697] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 8 to 9, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.142244  8255 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:17.160315  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b968f124f3854f20bff4af609192c41a" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:17.161513  8272 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.164791  8254 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.165277  8254 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.166922  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:17.167196  8254 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:17.167451  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:17.168217  1565 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 18.
I20260709 13:01:17.139756  8165 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:17.148963  7939 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:17.169540  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:17.169831  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 44435.4us
I20260709 13:01:17.170424  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:17.179894  1712 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 24.
I20260709 13:01:17.171785  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:17.180824  1536 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.176790  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:17.177032  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:17.177500  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:17.178498  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:17.182552  1536 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.182869  1646 raft_consensus.cc:2376] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 18. Re-sending same reply.
I20260709 13:01:17.178577  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:17.173115  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:17.184894  1536 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.185739  2442 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:17.179898  2436 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
I20260709 13:01:17.187083  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:17.185832  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:17.190330  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:17.191000  1686 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:17.192857  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:17.197980  1612 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:17.199914  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:17.200754  1639 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:17.202775  7939 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:17.202981  1686 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:17.203261  7939 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.203671  7939 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:17.204149  8140 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:17.204582  8140 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.204931  8140 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.206257  7961 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:17.208510  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:17.209195  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:17.155150  8243 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.172201  8138 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:17.216965  1612 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:17.222195  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:17.189695  8255 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.191814  8048 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:17.233574  2443 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 17.
I20260709 13:01:17.224169  1612 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:17.240497  1612 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:17.226629  8041 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:01:17.263614  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.225039  7961 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:17.218485  8138 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:17.225286  8240 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:17.230149  8257 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:17.222078  8165 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:17.291584  8138 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:17.326699  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 214570us
I20260709 13:01:17.221743  8174 consensus_queue.cc:1048] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
W20260709 13:01:17.383145  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 144853us
I20260709 13:01:17.234369  8065 raft_consensus.cc:2749] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:17.238741  8122 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.395047  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:17.397058  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 213082us
I20260709 13:01:17.398972  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:17.402849  8194 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:17.402926  7961 consensus_queue.cc:1059] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:17.403661  8194 consensus_queue.cc:1059] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:17.404107  7961 raft_consensus.cc:3055] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:17.404752  7961 raft_consensus.cc:740] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:17.405068  8216 raft_consensus.cc:3055] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:17.405443  8216 raft_consensus.cc:740] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:17.405539  7961 consensus_queue.cc:260] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.406267  8216 consensus_queue.cc:260] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.407157  7961 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:17.392266  8279 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:17.407994  1536 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:17.428730  7855 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:17.429236  7855 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:17.429639  7855 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:17.433293  8280 log.cc:927] Time spent T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.235s	user 0.003s	sys 0.000s
I20260709 13:01:17.437465  8255 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:17.438467  1613 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.438225  8255 raft_consensus.cc:697] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:17.440215  8255 consensus_queue.cc:237] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:17.446086  7799 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.416991  8272 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:17.471354  1537 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:17.479282  7799 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:17.483065  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 75122.9us
I20260709 13:01:17.483990  1536 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.477569  8272 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:01:17.506188  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 104145us
I20260709 13:01:17.467578  7939 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:17.515529  7939 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:17.485690  8041 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:17.477289  8105 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.523979  8105 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:17.527943  8138 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.530247  8272 raft_consensus.cc:697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 17 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:17.531198  8272 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.507757  8243 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:17.511772  8048 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:17.505740  8269 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.541203  8138 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:17.504297  8140 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.558295  8140 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:17.550477  8271 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.566665  8271 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.569383  8271 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:17.571738  1685 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.573354  1685 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:17.575173  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 91256.7us
I20260709 13:01:17.576278  1536 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:17.579644  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 367186us
I20260709 13:01:17.584569  1536 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:17.586786  1685 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.550254  8250 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:17.592906  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:17.587853  7855 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:17.587816  8131 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:17.596201  7855 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:17.585523  8138 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:17.596976  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:17.598795  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:17.597730  1643 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 18.
I20260709 13:01:17.600786  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:17.601420  1647 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:17.604804  1685 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.608174  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:17.609066  1644 raft_consensus.cc:2410] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:01:17.609118  1646 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:17.610798  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:17.611423  1646 raft_consensus.cc:3060] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:17.585721  8282 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:17.612303  2447 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:17.611423  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:17.614653  1644 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 15: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:17.618042  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:17.621308  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:17.622330  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:17.624331  1536 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.625326  1536 leader_election.cc:304] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.632376  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:17.633440  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.596712  8294 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:17.642551  1566 raft_consensus.cc:1275] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:01:17.642957  1566 pending_rounds.cc:85] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 9
I20260709 13:01:17.643194  1566 pending_rounds.cc:107] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 18.10
W20260709 13:01:17.631806  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 160633us
I20260709 13:01:17.643453  1566 raft_consensus.cc:2889] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:17.644423  1569 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:17.645423  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:17.615689  8272 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:17.641841  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6fdab08a024ae6999ae0a520cd1cd0" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:17.647990  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:17.648382  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13ac9e112d84ff79c9ea7f4762a82ab" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:17.643455  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:17.650700  1647 raft_consensus.cc:2468] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 19.
I20260709 13:01:17.652091  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:17.649643  1569 raft_consensus.cc:1240] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Rejecting Update request from peer 66344ad7cd844754b2c81cc689a709b0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:17.650748  2442 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.648841  1685 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.657702  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:17.652694  2447 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 17.
I20260709 13:01:17.658303  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:17.658463  1563 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 19: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:17.621871  8131 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:17.661700  2442 raft_consensus.cc:2468] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:01:17.662846  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:17.663259  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:17.663441  1568 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:17.663452  1644 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:17.665400  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:17.665904  1638 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:17.666069  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:17.667146  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:17.633839  8255 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:17.632750  7855 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:17.640740  8138 raft_consensus.cc:2749] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:17.677269  1565 raft_consensus.cc:1240] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:17.671708  1646 raft_consensus.cc:2468] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 19.
I20260709 13:01:17.678248  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:17.642412  8048 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:17.701587  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:17.702513  2442 raft_consensus.cc:2393] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 19: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:17.703622  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:17.707623  1571 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:17.708997  8243 consensus_queue.cc:1059] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:17.709359  7672 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:17.710451  8243 consensus_queue.cc:1048] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:17.640138  8291 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:17.711298  8291 raft_consensus.cc:697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 18 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:17.712396  8291 consensus_queue.cc:237] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:17.632769  7961 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:01:17.650143  8272 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.710630  7881 raft_consensus.cc:3055] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:17.600344  8250 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:17.694325  1638 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 18.
I20260709 13:01:17.719594  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:17.681012  8282 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:17.737663  8299 log.cc:927] Time spent T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:17.739447  8250 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:17.740182  1565 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:17.677011  7855 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:17.730518  8272 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:17.744841  8279 raft_consensus.cc:3055] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:17.731029  7881 raft_consensus.cc:740] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:17.724833  1644 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
W20260709 13:01:17.777082  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 69361.3us
I20260709 13:01:17.781620  1565 raft_consensus.cc:1275] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:01:17.779095  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 100662us
I20260709 13:01:17.785846  1685 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:01:17.788148  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 85929.9us
I20260709 13:01:17.784415  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:17.824868  1611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.777944  7855 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:17.845005  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 60652.8us
W20260709 13:01:17.849905  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 61065.1us
I20260709 13:01:17.851951  1686 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.779271  8279 raft_consensus.cc:740] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:17.849431  8065 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:17.874979  8297 log.cc:927] Time spent T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:01:17.874782  8065 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.873224  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:17.850239  8250 raft_consensus.cc:2804] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:17.884894  1686 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.849840  8257 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:17.787585  8174 consensus_queue.cc:1059] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 13:01:17.896647  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:17.802947  7961 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.078s
W20260709 13:01:17.882165  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 87661.3us
I20260709 13:01:17.865878  8216 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:17.893275  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "289133b3cbb949f4967bbf24c6b14e19" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:17.892953  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:17.849275  8122 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:17.849539  8227 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:01:17.912236  2405 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:17.898131  8256 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:17.935904  8256 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.936316  8256 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:17.897313  8229 consensus_queue.cc:1048] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:01:17.939608  8298 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:01:17.940557  8300 log.cc:927] Time spent T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
W20260709 13:01:17.941843  8302 log.cc:927] Time spent T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:01:17.897760  8149 raft_consensus.cc:2804] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:17.915092  8046 raft_consensus.cc:3055] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:17.946818  8046 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:17.947780  8046 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.949079  8046 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:17.927774  8065 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:17.890513  8310 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:17.903384  8257 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.907594  7881 consensus_queue.cc:260] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.902683  8250 raft_consensus.cc:697] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 19 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 13:01:17.966549  1456 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bfbaf6c33e5b45ea9c75342b1011f209 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 338d817f94ee4c1bad162e9a5860b68a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:01:17.960834  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 48686.8us
I20260709 13:01:17.967568  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0
W20260709 13:01:17.968483  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 117432us
I20260709 13:01:17.969550  1612 leader_election.cc:304] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:17.973905  7961 raft_consensus.cc:2749] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:17.970301  8289 consensus_queue.cc:1059] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:01:17.976454  8019 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:17.976734  8289 raft_consensus.cc:3055] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:17.977321  8289 raft_consensus.cc:740] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:17.978416  8289 consensus_queue.cc:260] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:17.980322  8149 raft_consensus.cc:697] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
W20260709 13:01:17.983378  8307 log.cc:927] Time spent T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:01:17.989353  8312 log.cc:927] Time spent T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:17.990108  8308 consensus_queue.cc:1059] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:17.991206  8098 raft_consensus.cc:3055] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:17.991724  8098 raft_consensus.cc:740] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:17.992766  8098 consensus_queue.cc:260] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:17.993717  8250 consensus_queue.cc:237] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:17.994040  8098 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:18.000181  8257 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:18.009065  8194 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.009639  8194 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:18.011713  7816 raft_consensus.cc:2764] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:01:18.011834  8194 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:18.013495  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 46008us
W20260709 13:01:18.014307  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 44829.9us
I20260709 13:01:18.015550  1536 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:18.017016  1536 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:18.019119  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:18.021376  2447 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:18.022192  2405 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:18.022567  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:18.025602  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:18.026392  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:18.026369  1536 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:18.027989  1536 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:18.029258  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:18.031138  1716 raft_consensus.cc:1240] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:17.981441  8149 consensus_queue.cc:237] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.032487  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:18.018023  8257 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:18.041585  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:18.043191  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:18.040162  1716 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:01:18.044582  2405 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:18.044734  1713 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:18.018342  8291 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:18.020236  8065 raft_consensus.cc:493] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:18.054162  2405 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:18.027843  8138 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:18.057675  1720 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 24: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:18.031078  8269 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:18.040079  8048 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:18.082788  2405 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:18.095638  1713 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:18.056365  7983 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:18.100219  2405 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 13:01:18.103389  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 127120us
I20260709 13:01:18.106547  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbaf6c33e5b45ea9c75342b1011f209" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:18.075357  7816 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:18.109027  1638 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: [10.9-13.11]
I20260709 13:01:18.078856  8287 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:18.041607  8243 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:18.119407  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:18.124055  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:18.125042  1640 raft_consensus.cc:2393] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 15: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:18.098846  8194 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:18.099746  8269 raft_consensus.cc:697] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 18 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:18.111725  7816 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:18.100219  8319 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:18.101653  8224 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:18.101950  8048 raft_consensus.cc:697] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:18.101846  8122 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:18.112428  8105 raft_consensus.cc:2804] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:18.091236  8290 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:01:18.082247  8065 raft_consensus.cc:515] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:18.169952  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 132928us
W20260709 13:01:18.176545  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 51277us
I20260709 13:01:18.120399  8258 consensus_queue.cc:1059] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:01:18.129089  8295 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.165056  7816 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:18.113212  8311 consensus_queue.cc:1048] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:01:18.160573  8194 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:18.171617  8319 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:18.196913  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 77568.3us
I20260709 13:01:18.204833  1685 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:18.205911  2442 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:01:18.185154  8105 raft_consensus.cc:697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 19 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:18.207396  1611 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:18.206466  7855 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.210371  1564 raft_consensus.cc:1240] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:01:18.177613  8122 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.211009  1715 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 19 LEADER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:18.199379  8240 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:18.226375  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.187029  8295 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.230870  1568 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:18.235200  2443 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:18.235507  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:18.236397  2442 raft_consensus.cc:2393] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 24: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:18.218214  7799 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:18.242559  8291 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:18.243470  8324 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:18.243877  8324 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.244238  8324 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:18.247977  8272 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.248595  1537 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:18.249119  1563 raft_consensus.cc:2368] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 15. Current term is 16.
I20260709 13:01:18.250204  8291 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:18.242679  8326 consensus_queue.cc:1059] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:01:18.255970  1638 raft_consensus.cc:1240] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:01:18.270452  8320 log.cc:927] Time spent T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:01:18.271064  8122 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:18.278084  1640 raft_consensus.cc:1240] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:18.281735  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:18.283581  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:18.236267  8257 consensus_queue.cc:1059] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:01:18.294198  1612 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:18.216802  8048 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.207296  8269 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.281581  8326 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:18.268033  8258 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:01:18.256951  8105 consensus_queue.cc:237] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.312309  8257 consensus_queue.cc:1243] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:18.315263  8326 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.335374  1712 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:18.338145  8122 consensus_queue.cc:1059] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:01:18.348345  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 165409us
I20260709 13:01:18.350747  2405 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:18.368400  8279 consensus_queue.cc:260] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.394546  8326 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:18.394991  8046 consensus_queue.cc:1059] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:18.395511  8272 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:18.395867  8046 raft_consensus.cc:3055] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:18.396252  8046 raft_consensus.cc:740] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:18.397826  8046 consensus_queue.cc:260] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.398974  8046 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:18.369841  8279 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:01:18.401226  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 50594.5us
I20260709 13:01:18.369549  8256 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.407575  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:18.405537  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:18.349983  8138 raft_consensus.cc:3055] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:18.421216  2406 leader_election.cc:400] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 15. Current term is 16.
I20260709 13:01:18.421619  2406 leader_election.cc:403] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:01:18.416611  2446 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:18.428149  8339 consensus_queue.cc:1059] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:01:18.429049  8339 consensus_queue.cc:1243] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Peer 66344ad7cd844754b2c81cc689a709b0 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:18.431928  7816 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.432924  8327 raft_consensus.cc:3055] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:18.433429  8327 raft_consensus.cc:740] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:18.437425  2443 raft_consensus.cc:1240] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:18.440970  7816 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:18.420560  8224 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:01:18.449112  8333 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:18.377034  8257 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:01:18.452636  8065 leader_election.cc:290] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:18.460914  1719 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:18.463344  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:18.468150  8295 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:18.468500  8289 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:18.473356   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:18.486260  2446 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:01:18.507076  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:18.421228  8138 raft_consensus.cc:740] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:18.470526  8319 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:18.489241  8019 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 15. Current term is 16.
W20260709 13:01:18.614025  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 148018us
W20260709 13:01:18.616205  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.470942  8157 consensus_queue.cc:1059] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
W20260709 13:01:18.616139  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.616190  1537 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:18.615847  8216 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.632400  8255 raft_consensus.cc:3055] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:18.632941  8255 raft_consensus.cc:740] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:18.632462  8216 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.634332  8292 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:18.633838  8255 consensus_queue.cc:260] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.634917  8292 raft_consensus.cc:697] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:18.635767  8292 consensus_queue.cc:237] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.639814  8216 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:18.629128  8291 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:18.646835  8194 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:18.651705  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 170709us
I20260709 13:01:18.513170  8224 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 24 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
W20260709 13:01:18.660271  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.661788  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:18.662421  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:18.663561  2446 raft_consensus.cc:2393] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 18: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:18.662489  1719 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 19.
I20260709 13:01:18.670105  1611 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:18.613937  8319 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:18.687011  8319 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.689572  8319 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:18.667021  8338 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:18.520661  8295 consensus_queue.cc:1059] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.137s
I20260709 13:01:18.699473  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:18.703071  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:18.707631  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 413572us
I20260709 13:01:18.698101  8319 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:18.712121  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:18.713197  1568 raft_consensus.cc:2393] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 19: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:18.513782  8327 consensus_queue.cc:260] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.740708  1639 raft_consensus.cc:3055] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:18.715979  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28f3d3a9bc24be6b8fc4d90754cdfac" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:18.765900  1639 raft_consensus.cc:740] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:18.709270  8257 raft_consensus.cc:3055] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:18.766893  1639 consensus_queue.cc:260] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.775128  1639 raft_consensus.cc:3060] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:18.778678  1640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:18.779280  1640 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:18.781085  7881 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:18.724138  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:18.724015  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:18.719555  1571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a129c637a374138850dc8acf679f4bd"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:01:18.736629  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
W20260709 13:01:18.721045  2406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.737017  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:18.719302  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:18.741223  1638 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:01:18.720870  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:18.668571  8138 consensus_queue.cc:260] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:18.790169  1639 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:18.790799  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:18.791219  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:18.727129  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:18.791435  1638 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:18.784467  1571 raft_consensus.cc:606] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:18.712850  8319 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 13:01:18.807593  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.798671  1640 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
W20260709 13:01:18.854501  8335 log.cc:927] Time spent T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:01:18.857961  1642 raft_consensus.cc:1240] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:01:18.798961  2447 raft_consensus.cc:2393] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 16: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:18.765136  8258 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.858937  1638 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:01:18.861507  8258 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.862890  1639 raft_consensus.cc:2410] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:01:18.863674  8258 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:18.847887  8329 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
W20260709 13:01:18.866194  8295 consensus_queue.cc:1175] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a4be9cc90aca4dd4ad7db103062a7208" responder_term: 19 status { last_received { term: 17 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:18.867220  8340 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.867689  8340 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.796838  1571 raft_consensus.cc:614] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:18.873893  1612 leader_election.cc:304] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:18.773118  8257 raft_consensus.cc:740] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:18.794617  8131 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.893740  2442 raft_consensus.cc:1240] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Rejecting Update request from peer a4be9cc90aca4dd4ad7db103062a7208 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:18.897272  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:18.898046  2446 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 18.
W20260709 13:01:18.880609  8324 consensus_meta.cc:287] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.007s
I20260709 13:01:18.895430  8138 raft_consensus.cc:3060] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:18.849818  8319 raft_consensus.cc:3060] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:18.895120  8258 raft_consensus.cc:2749] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:18.922766  8345 log.cc:927] Time spent T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:01:18.928113  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:18.799549  8224 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.909282  8131 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:18.946511  7855 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:18.968441  1612 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:18.880264  8338 log.cc:927] Time spent T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:01:18.971269  1612 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:18.973344  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:18.976694  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 204555us
I20260709 13:01:18.969298  8279 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:18.959350  8324 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:18.987876  1612 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:01:18.992445  1610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.975648  8258 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:19.010177  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:19.014025  1647 raft_consensus.cc:2410] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:01:18.990289  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:18.999758  8318 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:19.046464  1643 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:19.049952  1571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61b3acddedfe43b6b7d1a8f74c050925"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:34298
I20260709 13:01:19.050998  1571 raft_consensus.cc:606] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:19.051610  1571 raft_consensus.cc:614] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:19.059674  2405 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:19.060405  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 164915us
I20260709 13:01:19.019042  8216 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:19.020602  8293 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.039306  8255 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:19.069337  8046 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:19.036854  8131 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.065375  8216 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.088655  1646 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:19.096153  2447 raft_consensus.cc:1275] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:19.099108   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:19.101104   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:19.110698  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:19.090874  8216 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:19.088393  8357 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:19.112025  1571 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 17.
I20260709 13:01:19.075322  8293 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.121435  1713 raft_consensus.cc:1240] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:01:19.094362  8194 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:19.122377  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:19.102900  8321 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.124254  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.129088  1571 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 24.
I20260709 13:01:19.106400  8131 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:19.125128  1536 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:19.141297  8148 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:19.138934  8131 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.153831  8131 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.159379  8257 consensus_queue.cc:260] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.160480  8257 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:19.166458  8350 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:01:19.170693  8041 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:19.171489  8041 raft_consensus.cc:697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:19.172784  8041 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.173974  8327 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.174994  8272 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:19.175781  8272 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:19.170573  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 45518.2us
I20260709 13:01:19.180263  1536 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:19.182078  8157 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:19.127580  8357 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:19.198704  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.126937  8308 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:01:19.223098  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 137099us
I20260709 13:01:19.249296  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:19.250133  1647 raft_consensus.cc:2393] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 10: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
W20260709 13:01:19.253261  8354 log.cc:927] Time spent T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
I20260709 13:01:19.138332  8321 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.278437  8324 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:19.271301  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 135905us
I20260709 13:01:19.259557  8272 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.253774  8308 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.298982  8308 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.301087  1570 raft_consensus.cc:1275] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:01:19.301486  1570 pending_rounds.cc:85] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 11
I20260709 13:01:19.301719  1570 pending_rounds.cc:107] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:01:19.301959  1570 raft_consensus.cc:2889] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:19.308117  8255 raft_consensus.cc:493] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:19.308679  8255 raft_consensus.cc:515] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.246022  8048 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:01:19.252202  8310 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:01:19.269309  8356 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:19.334369  8356 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.337615  8356 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.253713  8040 consensus_queue.cc:1048] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:01:19.338327  8040 consensus_queue.cc:1243] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Peer a4be9cc90aca4dd4ad7db103062a7208 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:19.339687  8293 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.351461  8321 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:19.353220  8357 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:19.359927  8289 consensus_meta.cc:287] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Time spent flushing consensus metadata: real 0.891s	user 0.010s	sys 0.000s
I20260709 13:01:19.288276  8269 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:19.362564  8269 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.364965  8269 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.368818  8224 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.369506  8224 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.378855  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 4085) took 1126 ms. Trace:
I20260709 13:01:19.379427  1643 rpcz_store.cc:276] 0709 13:01:18.251973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.252378 (+   405us) service_pool.cc:224] Handling call
0709 13:01:18.257954 (+  5576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.052652 (+794698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.378513 (+325861us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b540021aa54. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:19.378773 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812622720}
I20260709 13:01:19.392647  8325 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.393260  8325 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.395407  8325 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:19.399189  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.399224  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.400513  2442 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:01:19.408610  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:19.423825  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.426120  2447 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 21.
I20260709 13:01:19.427634  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:19.445828  2446 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:19.452292  2442 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:01:19.420652  8329 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:19.531840  2442 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:19.421111  8157 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:19.539114  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.406276  8216 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.547336  2442 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:19.550114  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.550493  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:19.562171  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.563588  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 282446us
I20260709 13:01:19.566252  1537 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:19.531845  8327 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.537106  8329 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:19.586486  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 296251us
I20260709 13:01:19.591425  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:19.592398  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:19.594398  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:19.599206  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:19.598069  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:19.604475  1647 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:19.583513  8279 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.585346  8295 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:19.590896  8329 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:19.615338  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95165be2dd8c456fb98e088711372ce3" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.601055  8255 leader_election.cc:290] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.612315  8279 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.610486  8295 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.620846  8295 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:19.620958  7799 raft_consensus.cc:493] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:19.621613  7799 raft_consensus.cc:515] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.623816  7799 leader_election.cc:290] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.612084  8138 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:01:19.624258  7799 raft_consensus.cc:493] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:19.601862  8048 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:19.624178  1564 raft_consensus.cc:2410] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
W20260709 13:01:19.630445  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 65673.2us
I20260709 13:01:19.632863  1568 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:19.590443  8327 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.640626  1647 pending_rounds.cc:85] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 10
I20260709 13:01:19.641047  1647 pending_rounds.cc:107] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:01:19.641358  1647 raft_consensus.cc:2889] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:19.637511  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:19.610793  8318 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:19.609068  8157 consensus_queue.cc:1059] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:01:19.617893  8324 raft_consensus.cc:493] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:19.613039  8357 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 13:01:19.645824  8368 log.cc:927] Time spent T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:01:19.656764  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:19.645938  8352 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:19.646021  8341 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.635637  8048 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.635555  7799 raft_consensus.cc:515] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.657711  7881 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:19.666299  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:19.670015  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:19.670184  8296 raft_consensus.cc:493] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:19.683802  8296 raft_consensus.cc:515] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.689900  8340 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.646227  8342 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:01:19.699954  7799 leader_election.cc:290] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.656821  8324 raft_consensus.cc:515] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:19.674290  8319 consensus_meta.cc:287] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: Time spent flushing consensus metadata: real 0.701s	user 0.007s	sys 0.003s
I20260709 13:01:19.712699  8319 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:19.715502  8319 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:19.704157  8224 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:19.704937  8216 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.707511  8358 raft_consensus.cc:3055] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:19.676177  7881 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.716708  8358 raft_consensus.cc:740] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:19.717641  8358 consensus_queue.cc:260] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:19.719174  8358 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:19.668639  8341 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.720431  1563 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:01:19.668398  8352 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.721436  8341 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.723657  8352 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:19.711997  8279 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.718211  7881 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:19.727607  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.728585  8351 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:19.730983  8327 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.649256  8318 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.734226  1645 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:19.733678  8318 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.737408  8324 leader_election.cc:290] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:19.737862  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:19.738508  1720 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 9.
I20260709 13:01:19.695420  8296 leader_election.cc:290] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.747303  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.747994  2442 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:01:19.756341  1720 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 24 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:01:19.756798  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:19.767318  1537 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:19.769702  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:19.771472  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:19.771659  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:01:19.774539  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 480478us
I20260709 13:01:19.774866  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:19.776059  1717 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 9.
I20260709 13:01:19.778479  1716 raft_consensus.cc:2468] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 19.
I20260709 13:01:19.781894  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:19.781388  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:19.779161  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:19.785823  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 112834us
I20260709 13:01:19.787732  1612 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:19.715860  8048 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.798250  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:19.798887  1571 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:19.802907  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.762729  8333 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:19.774358  8357 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:19.804806  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:19.808465  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b97ee9bb5742b6a7bfc576360314c5" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.693917  8295 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.778242  7672 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:19.813783  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.815727  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.808775  1611 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:19.819705  1611 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:19.823758  2436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.824988  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:19.810539  8048 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.806736  8158 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:19.828239  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.830376  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.843189  2437 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 21.
I20260709 13:01:19.839439  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:19.840463  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:19.844388  2438 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:19.811233  8357 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.827184  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41d3057239d54d6183db91d2b176c2dd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:19.851078  7816 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:19.854653  8342 raft_consensus.cc:493] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.855581  8348 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:19.862200  8358 raft_consensus.cc:493] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.812323  8256 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:19.817435  7672 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.820736  8240 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:19.879119  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:19.880390  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:19.926388  1644 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:01:19.882488  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:19.887508  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:19.930070  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016c9143ad3147438e814f92f2090928" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:19.888547  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:19.889758  1641 raft_consensus.cc:1275] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:19.896268  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dad2e408414d2fa4f055c6eccf5b92" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:19.900274  2438 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 19.
I20260709 13:01:19.904199  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:19.908052  1612 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:19.919950  1686 leader_election.cc:304] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:19.869060  8158 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.876951  8357 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:19.947618  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:01:19.967083  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.969439  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:19.812940  8333 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.971756  1686 leader_election.cc:304] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:19.948947  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:19.979638  1612 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:19.905674  8348 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.876711  8216 raft_consensus.cc:493] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
W20260709 13:01:19.992040  8380 log.cc:927] Time spent T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:19.997298  8331 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:19.926748  7672 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:19.997910  8383 raft_consensus.cc:2804] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:01:20.000664  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 53171.9us
I20260709 13:01:20.007336  2440 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:19.973312  8256 raft_consensus.cc:2749] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:19.975132  8158 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:19.876497  8048 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:19.974552  8293 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:19.906641  8342 raft_consensus.cc:515] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:20.004652  8348 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:19.922235  8358 raft_consensus.cc:515] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.013281  8319 raft_consensus.cc:2804] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:20.045783  2405 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:20.046466  8330 consensus_queue.cc:1048] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:20.015664  8331 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.060672  8371 raft_consensus.cc:2749] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.048308  8383 raft_consensus.cc:697] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:20.015090  8216 raft_consensus.cc:515] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:20.106176  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 60471.3us
I20260709 13:01:20.115175  2405 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:20.106992  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 107753us
W20260709 13:01:20.108150  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 101242us
I20260709 13:01:19.995620  8329 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.117939  1686 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:20.107577  8331 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:20.082224  8323 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:20.080132  8194 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.042187  8340 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:01:20.070007  8295 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 22 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.106976  8105 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:20.105672  8319 raft_consensus.cc:697] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 19 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:20.126309  7881 raft_consensus.cc:2749] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:20.134845  8371 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:20.132956  8323 raft_consensus.cc:493] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:01:20.150599  8381 log.cc:927] Time spent T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 13:01:20.151239  8386 log.cc:927] Time spent T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:01:20.154955  8358 leader_election.cc:290] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.155167  8048 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.157052  8342 leader_election.cc:290] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:20.148630  8371 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:20.158521  8371 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.164201  8323 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:20.166319  8385 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:01:20.177471  8319 consensus_queue.cc:237] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.179275  8329 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.173408  8383 consensus_queue.cc:237] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:20.191241  8323 raft_consensus.cc:515] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.239497  1713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:20.241258  1686 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:20.162232  8194 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.273373  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:20.274351  2438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:20.277141  8359 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:20.278611  8359 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.280299  8362 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:20.282801  8216 leader_election.cc:290] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.283882  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:20.284366  8323 leader_election.cc:290] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:20.284812  2437 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:01:20.289575  8194 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.281944  8359 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:20.302946  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 62037us
I20260709 13:01:20.304701  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:20.325932  1714 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:01:20.274405  2440 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:20.332433  1611 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
W20260709 13:01:20.318569  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.340668  8319 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:20.340813  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:20.341177  8319 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.341605  8319 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.341774  1568 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:01:20.340668  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:20.223774   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:20.377614  8357 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.400146  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46640 (request call id 4101) took 1416 ms. Trace:
I20260709 13:01:20.400667  1570 rpcz_store.cc:276] 0709 13:01:18.983482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.983653 (+   171us) service_pool.cc:224] Handling call
0709 13:01:18.983926 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.302422 (+318496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.399586 (+1097164us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b540028c154. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd298e01 00007f18cd29783e 00007f18d225c419 00007f18cb7d3bd4 00007f18cb7d3b62 00007f18cb7d3a91 00007f18cb7d3a0c 00007f18cb7d2cc2 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:20.399919 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":728495360}
I20260709 13:01:20.396214  2440 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 22.
I20260709 13:01:20.404461  7672 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.411532  8357 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.414198  8158 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.417052  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:20.422293  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:20.424779  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:20.439843  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:20.443384  1537 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:01:20.444463  8396 log.cc:927] Time spent T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.279s	user 0.004s	sys 0.000s
I20260709 13:01:20.452431  8383 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.455035  1564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46640 (request call id 4102) took 1466 ms. Trace:
I20260709 13:01:20.457319  8318 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.457345  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93b49f668f7487dad07043590a5616f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:20.415834  8371 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.504369  1564 rpcz_store.cc:276] 0709 13:01:18.988337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.989997 (+  1660us) service_pool.cc:224] Handling call
0709 13:01:20.454578 (+1464581us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54002684d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd201571 00007f18cd29c2fa 00007f18d225db17 00007f18cb7d86d4 00007f18cb7d8662 00007f18cb7d8591 00007f18cb7d850c 00007f18cb7d77c2 00007f18cb5d348c 00007f18cb5d28c6 00007f18cb5d226f
0709 13:01:20.454823 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384349952}
I20260709 13:01:20.461840  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:20.463181  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:20.463632  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e1751f20084c868e4ad6251ca38954" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:20.466483  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:20.447945  8319 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.513965  8319 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.514407  8318 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.516268  2443 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 13.
I20260709 13:01:20.517148  2446 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:20.518199  1563 raft_consensus.cc:3060] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:20.523463  7672 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:20.524441  8371 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.480346  8333 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.524827  1717 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:20.525790  1720 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 25 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:01:20.525499  8383 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.526527  8318 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.527940  8383 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.528417  8333 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:20.529042  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:20.488965  2448 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:20.529241  8333 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.530552  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:20.531435  1567 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 16: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:20.532020  8333 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.532689  1570 raft_consensus.cc:2393] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 19: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:20.475659  8348 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.534722  1571 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 14.
I20260709 13:01:20.535092  1643 raft_consensus.cc:2393] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:20.536087  1568 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 22: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:20.484326  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
W20260709 13:01:20.536888  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 52685.4us
I20260709 13:01:20.538072  8131 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:20.513814  8158 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 25 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.524371  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:20.473621  8331 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.529120  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:20.524528  2444 raft_consensus.cc:2368] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11.
I20260709 13:01:20.540517  2446 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:01:20.549063  1712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:20.550913  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:20.551721  1715 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:01:20.565534  1535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.568701  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 125489us
I20260709 13:01:20.541857  8131 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:20.600543  8131 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:20.570079  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:20.606365  1721 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.608783  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:20.611356  8296 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:20.571743  8348 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.571817  8158 consensus_queue.cc:1048] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:20.574457  8272 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:20.627466  8272 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.628002  8272 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:20.575738  2437 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 16: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:20.630435  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:20.578167  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:20.631698  1721 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:01:20.577042  1715 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
I20260709 13:01:20.583822  8331 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 22 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.590009  1537 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:20.591938  8318 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:20.633080  8318 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.635314  8318 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.596705  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:20.635917  2443 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.636075  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:20.636740  1564 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:20.598587  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:20.638558  1643 raft_consensus.cc:2393] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 11: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:20.639334  8294 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:20.640031  8294 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.599573  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:20.616633  1563 raft_consensus.cc:2468] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 19.
I20260709 13:01:20.623651  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:20.645051  1647 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.646958  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:20.647570  1569 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.651237  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11fdc1931874b5389be76ef648b6ae1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:20.655001  1536 leader_election.cc:304] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:20.656075  8157 raft_consensus.cc:2749] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.656466  1536 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:20.667513  8138 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:20.668949  1611 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:20.651389  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:20.657527  8341 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:20.657295  8294 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.671902  8341 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 22 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:20.673081  8341 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.673552  7983 consensus_queue.cc:1059] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:20.669772  8331 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:20.674465  8331 raft_consensus.cc:697] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:20.674731  8105 raft_consensus.cc:3055] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:01:20.675248  8105 raft_consensus.cc:740] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:20.675431  8331 consensus_queue.cc:237] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.676246  8105 consensus_queue.cc:260] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:20.657864  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 68021.4us
I20260709 13:01:20.678828  1537 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:20.681483  8048 consensus_queue.cc:1059] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:20.682367  8291 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:20.684191  8291 raft_consensus.cc:697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:20.665257  7816 consensus_queue.cc:1059] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:20.683359  8342 raft_consensus.cc:493] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:20.662452  2443 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:01:20.685536  8048 raft_consensus.cc:3055] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:20.702224  2443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:20.703553  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:20.704293  2446 raft_consensus.cc:2393] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 11: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:20.707373  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:20.704960  1569 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:01:20.691946  8359 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:20.691573  8048 raft_consensus.cc:740] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:20.712564  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:20.713908  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:20.727052  2437 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 22: Already voted for candidate 338d817f94ee4c1bad162e9a5860b68a in this term.
I20260709 13:01:20.729467  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:20.708930  8157 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:20.685362  8291 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:20.731376  1469 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58260 (request call id 330) took 20116 ms (client timeout 15000 ms). Trace:
I20260709 13:01:20.749271  1564 raft_consensus.cc:2468] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 25.
I20260709 13:01:20.753458  8358 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.754115  8358 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.754499  1466 catalog_manager.cc:5697] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.756323  8358 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.756222  1466 catalog_manager.cc:5697] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.762148  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:01:20.762822  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 73445.2us
I20260709 13:01:20.762918  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:20.766299  8048 consensus_queue.cc:260] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.767621  8048 raft_consensus.cc:3060] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.772529  1686 leader_election.cc:400] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11.
I20260709 13:01:20.772891  1686 leader_election.cc:403] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:20.734944  8359 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.722766  8342 raft_consensus.cc:515] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.779258  8294 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) with higher term. Message: Invalid argument: T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 for earlier term 10. Current term is 11.
I20260709 13:01:20.811565  8359 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.814082  8342 leader_election.cc:290] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.815371  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:20.742900  1469 rpcz_store.cc:269] 0709 13:01:00.485507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.489224 (+  3717us) service_pool.cc:224] Handling call
0709 13:01:20.601661 (+20112437us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:17.539072 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:17.539634 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:17.539667 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:01:17.539685 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:17.562724 (+ 23039us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:17.562806 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:17.562842 (+    36us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:01:17.563391 (+   549us) tablet.cc:701] Row locks acquired
0709 13:01:17.563411 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:01:17.563567 (+   156us) write_op.cc:270] Start()
0709 13:01:17.563693 (+   126us) write_op.cc:276] Timestamp: P: 1783602077563516 usec, L: 0
0709 13:01:17.563717 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:01:17.564679 (+   962us) log.cc:844] Serialized 2467 byte log entry
0709 13:01:17.748313 (+183634us) op_driver.cc:464] REPLICATION: finished
0709 13:01:18.174922 (+426609us) write_op.cc:301] APPLY: starting
0709 13:01:18.178469 (+  3547us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:18.273632 (+ 95163us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:18.273728 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:19.088227 (+814499us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:19.117528 (+ 29301us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:01:19.127472 (+  9944us) write_op.cc:312] APPLY: finished
0709 13:01:19.202697 (+ 75225us) log.cc:844] Serialized 65 byte log entry
0709 13:01:19.274574 (+ 71877us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:19.274685 (+   111us) write_op.cc:454] Released schema lock
0709 13:01:19.274731 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:19.276593 (+  1862us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:19.276623 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1893828,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":413677,"apply.run_cpu_time_us":22694,"apply.run_wall_time_us":1108136,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29219,"num_ops":6,"prepare.queue_time_us":226340,"prepare.run_cpu_time_us":35728,"prepare.run_wall_time_us":155945,"raft.queue_time_us":91967,"raft.run_cpu_time_us":115240,"raft.run_wall_time_us":306820,"replication_time_us":184443,"thread_start_us":668903,"threads_started":5,"wal-append.queue_time_us":278596,"wal-append.run_cpu_time_us":52759,"wal-append.run_wall_time_us":2362943}]]}
W20260709 13:01:20.820537  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 102464us
I20260709 13:01:20.819048  8272 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.830875  8287 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:20.831471  8287 raft_consensus.cc:697] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:20.832051  8272 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.832437  8287 consensus_queue.cc:237] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.825591  1647 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:01:20.834245  1466 catalog_manager.cc:5697] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 12 to 13, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:20.835700  1466 catalog_manager.cc:5697] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 8 to 11, term changed from 10 to 14, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to <none>, 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:20.838210  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a057e47a0fca4295957540c192996970" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:20.837858  1647 raft_consensus.cc:1240] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:01:20.843472  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:20.844321  1643 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 16: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:20.845115  8323 raft_consensus.cc:3055] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:20.845480  8323 raft_consensus.cc:740] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:20.846454  8323 consensus_queue.cc:260] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.847052  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:20.848434  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2033b178bcb643fd84ac0d1ae7e6a64b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:20.849063  1647 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:20.798652  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:20.854997  1643 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 22: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:20.837867  1466 catalog_manager.cc:5697] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 10 to 15, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 15 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.859005  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f8a3d26bbd4c18a7d64b7584debff6" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:20.867230  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 141894us
W20260709 13:01:20.882200  2407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.882494  1466 catalog_manager.cc:5697] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.884182  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:20.884951  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:20.884768  1466 catalog_manager.cc:5697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 16 to 17, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 17 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.888033  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:20.885540  1642 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:01:20.894729  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:20.881897  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:20.892179  1466 catalog_manager.cc:5697] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 9 to 11, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 13:01:20.898520  1686 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:20.899511  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:20.902341  1645 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 16: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:20.898133  8158 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:20.909749  8105 raft_consensus.cc:3060] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:20.912431  8393 raft_consensus.cc:2804] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:01:20.913127  8393 raft_consensus.cc:697] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 25 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:20.915879  8333 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:20.918139  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:20.918762  2442 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:20.919283  1537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.908399  1466 catalog_manager.cc:5697] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.930331  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
W20260709 13:01:20.929450  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 196742us
I20260709 13:01:20.944281  1612 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:20.899583  8371 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:20.951396  8376 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:20.954418  1715 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:20.954216  8376 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.955364  8371 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.956432  1612 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:20.959523  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:20.946635  8333 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.973084  1536 leader_election.cc:304] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:20.951889  8359 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.972713  1466 catalog_manager.cc:5697] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 6 to 9, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 10 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.976416  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:20.964017  8331 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.982666  8333 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:20.983544  2444 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:01:20.984829  8333 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:20.990913  8293 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:01:20.992482  8279 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.994086  8384 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:20.998436  8409 log.cc:927] Time spent T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:01:21.000278  8272 raft_consensus.cc:2749] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:21.001452  2405 leader_election.cc:304] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:21.002345  1536 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:21.006664  8272 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:21.008229  1536 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:20.960827  8393 consensus_queue.cc:237] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:21.010263  8138 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:21.012868  8323 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:21.018920  2442 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:01:21.031340  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:21.029672  8376 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:21.035669  1568 raft_consensus.cc:1240] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:21.035815  8371 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:21.036860  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:21.048455  1537 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:21.053977  1564 raft_consensus.cc:1240] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 25 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 24. Current term is 25. Ops: []
I20260709 13:01:21.055274  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:21.030400  8019 raft_consensus.cc:2804] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:21.063038  1721 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 18: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:21.058502  8272 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:21.010035  8131 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:21.111904  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:21.086548  8019 raft_consensus.cc:697] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:21.119405  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:21.122009  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:21.101627  8272 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:21.106630  8384 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:21.136371  8384 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:21.130391  1718 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:21.132547  8019 consensus_queue.cc:237] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:21.112991  8279 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
W20260709 13:01:21.148515  8413 log.cc:927] Time spent T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.057s	user 0.001s	sys 0.001s
I20260709 13:01:21.149986  8131 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:21.160326  8272 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:21.162597  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 105742us
I20260709 13:01:21.167160  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5316a1e4f014102b1770c3f8b08410b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:21.169046  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:21.169727  1566 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 18.
I20260709 13:01:21.180292  8340 raft_consensus.cc:493] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:21.180917  8340 raft_consensus.cc:515] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:21.181281  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:21.183194  8340 leader_election.cc:290] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:21.183774  8340 raft_consensus.cc:493] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:21.184299  8340 raft_consensus.cc:515] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:21.188863  1685 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:21.190078  7799 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:21.191643  8410 raft_consensus.cc:493] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:21.192282  8410 raft_consensus.cc:515] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:21.196076  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
W20260709 13:01:21.207125  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 83766.3us
I20260709 13:01:21.221850  1686 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:21.175843  1569 raft_consensus.cc:2468] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:01:21.233736  8028 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:21.236536  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.237195  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:21.237876  1721 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 18.
W20260709 13:01:21.240787  1536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.240988  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca192f35fd14bb58ebd0766d7a202f8" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:21.244127  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:21.244848  8048 raft_consensus.cc:493] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:21.245131  1638 raft_consensus.cc:1240] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 14. Current term is 15. Ops: [10.9-14.12]
I20260709 13:01:21.245499  8048 raft_consensus.cc:515] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:21.245911  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:21.247213  1641 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:21.262737  1644 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:21.262290  8138 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.263675  8048 leader_election.cc:290] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:21.264058  8138 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:21.265893  8384 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:21.252686  8279 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:21.268484  8340 leader_election.cc:290] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:21.268757  2406 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:21.270073  7816 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:21.278563  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:21.279039  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:21.284973  1612 leader_election.cc:304] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:21.285787  8279 raft_consensus.cc:2749] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:21.286428  1612 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:21.286723  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:21.287443  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:21.287814  8384 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:21.288749  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:21.290858  1571 raft_consensus.cc:1275] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:21.291977  1571 raft_consensus.cc:1275] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:01:21.292460  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:21.297035  8224 consensus_queue.cc:1059] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:21.298497  8287 raft_consensus.cc:3055] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:21.298557  1565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:21.298940  8287 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:21.299880  8287 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:21.300791  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:21.301297  8287 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:21.302250  8393 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:21.283282  1536 leader_election.cc:304] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:21.306363  8048 raft_consensus.cc:2749] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:21.311359  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:21.311805  8341 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:21.312497  1536 leader_election.cc:304] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:21.312963  2444 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:21.313264  8341 raft_consensus.cc:2749] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:21.315506  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:21.320762  8341 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:21.320757  8138 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:21.313653  1536 leader_election.cc:304] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:21.332729  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:21.340941  1641 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:01:21.346961  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:21.360651  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 47061.8us
I20260709 13:01:21.338917  8138 raft_consensus.cc:2749] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:21.349375  8410 leader_election.cc:290] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:21.368211  1718 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:21.374646  8310 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:21.375418  8310 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:21.377621  8310 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:21.382119  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:21.383519  1569 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:01:21.397416  8138 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:21.398630  2448 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:21.407840  2406 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:21.408669  7672 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:21.409055  7672 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:21.409257  1686 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:21.409457  7672 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:21.410473  8028 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:21.410851  8028 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:21.411211  8028 raft_consensus.cc:3060] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:21.406548  8279 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:01:21.417330  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b24c881516c4da087ee25ab3682886b" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:21.420075  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c2c21bc6aa4835b68933c89735091f" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:21.423238  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7133ad6a0a3449ad9f1b93e65653432d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:21.431109  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:21.434612  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:21.437837  1536 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:21.438608  8357 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:21.438969  8357 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.439316  8357 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:21.425704  8279 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:01:21.449005  7672 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:21.452479  1536 leader_election.cc:304] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:21.455583  8028 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:21.458957  8028 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:21.468417  8331 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:01:21.451359  7672 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:21.463553  2444 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 22 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:01:21.454452  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:21.470206  1718 raft_consensus.cc:2393] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 18: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:21.464871  1564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:21.470593  8341 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:01:21.475456  1536 leader_election.cc:304] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:21.484925  1564 raft_consensus.cc:2468] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:01:21.479483  1536 leader_election.cc:304] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:21.485968  1686 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:21.474294  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:21.478382  8138 raft_consensus.cc:2749] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:21.495712  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:21.478359  8341 raft_consensus.cc:2749] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:21.502322  1536 leader_election.cc:304] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:21.493394  8272 raft_consensus.cc:2749] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:21.496951  8294 raft_consensus.cc:2804] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:21.499851  8331 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:21.529235  1564 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 25 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:01:21.507647  8293 consensus_queue.cc:1048] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:01:21.494359  8357 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:21.532485  1563 raft_consensus.cc:2368] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 18. Current term is 19.
I20260709 13:01:21.533535  1715 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:21.508985  8340 raft_consensus.cc:2749] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:21.539503  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:21.542001  1715 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:21.538375  8294 raft_consensus.cc:697] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:21.551935  2448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:21.552606  2448 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:21.551970  8294 consensus_queue.cc:237] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:21.541597  8393 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:01:21.510833  8318 consensus_queue.cc:1048] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:01:21.571934  2448 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 19.
I20260709 13:01:21.544004  8019 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:01:21.583990  1568 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:21.582857  1715 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 19.
I20260709 13:01:21.567600  8357 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:21.586472  1537 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:21.613799  8341 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:21.616325  8341 raft_consensus.cc:697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 19 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:21.617264  8341 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:21.626510  7816 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:01:21.655752  2406 leader_election.cc:400] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 election: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 18. Current term is 19.
I20260709 13:01:21.662590  2406 leader_election.cc:403] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:01:21.666697  2444 raft_consensus.cc:1275] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 25 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 16. (term mismatch)
I20260709 13:01:21.667270  2444 pending_rounds.cc:85] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Aborting all ops after (but not including) 15
I20260709 13:01:21.671744  8105 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) with higher term. Message: Invalid argument: T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 for earlier term 18. Current term is 19.
I20260709 13:01:21.667573  2444 pending_rounds.cc:107] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: Aborting uncommitted NO_OP operation due to leader change: 24.16
I20260709 13:01:21.679776  2444 raft_consensus.cc:2889] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:21.701840  8393 consensus_queue.cc:1048] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.009s
W20260709 13:01:21.714262  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 202805us
I20260709 13:01:21.726514  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:21.727380  8279 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:21.727753  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:21.729058  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:21.750238  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519a89ee28c45f98d4fe9c4bfea4baf" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:21.728546  8279 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:21.758128  1647 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:21.757211  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:21.760852  8440 log.cc:927] Time spent T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:01:21.762223  1642 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 22 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:01:21.762611  1642 pending_rounds.cc:85] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Aborting all ops after (but not including) 15
I20260709 13:01:21.762843  1642 pending_rounds.cc:107] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:01:21.763070  1642 raft_consensus.cc:2889] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:21.762355  1641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:21.737860  8333 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:21.764531  1641 raft_consensus.cc:2393] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 16: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:21.759889  2447 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:21.781447  1470 catalog_manager.cc:5697] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 15 to 16, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.784195  8291 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:21.783979  1470 catalog_manager.cc:5697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 11 to 14, leader changed from <none> to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:21.795637  1638 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:01:21.782382  8438 log.cc:927] Time spent T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
I20260709 13:01:21.809749  1470 catalog_manager.cc:5697] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 15 to 16, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.814110  1536 leader_election.cc:304] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:21.829473  1642 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:21.835451  1470 catalog_manager.cc:5697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.839814  1645 raft_consensus.cc:1275] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:21.840593  1470 catalog_manager.cc:5697] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 12 to 15, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.842134  1470 catalog_manager.cc:5697] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 16 to 20, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 20 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.844461  1536 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:21.865962  8410 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:21.866804  8272 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:01:21.868382  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:21.869190  1639 raft_consensus.cc:2393] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 16: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:21.852072  8341 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:01:21.843657  8340 raft_consensus.cc:2749] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.895010  1470 catalog_manager.cc:5697] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 14 to 15, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.897977  1636 tablet_service.cc:1558] Processing DeleteTablet for tablet 17d2c95439be4ced872760603b0ae02b with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:50864
I20260709 13:01:21.898926  1470 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 12 to 13, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.910881  8376 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:21.901885  1470 catalog_manager.cc:5697] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 9 to 11, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.910471  1466 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58250 (request call id 292) took 9917 ms. Trace:
I20260709 13:01:21.958650  8454 tablet_replica.cc:333] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:21.960162  8454 raft_consensus.cc:2243] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:21.961001  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 99304.3us
W20260709 13:01:21.941100  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 93384.2us
I20260709 13:01:21.978708  1470 catalog_manager.cc:5697] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:21.982606  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 134794us
I20260709 13:01:21.941429  1466 rpcz_store.cc:276] 0709 13:01:11.993067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.001422 (+  8355us) service_pool.cc:224] Handling call
0709 13:01:21.910378 (+9908956us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:21.148977 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:21.149665 (+   688us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:21.149719 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:01:21.149740 (+    21us) tablet.cc:662] Decoding operations
0709 13:01:21.170951 (+ 21211us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:21.171044 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:21.171072 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:01:21.171956 (+   884us) tablet.cc:701] Row locks acquired
0709 13:01:21.172002 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:01:21.172169 (+   167us) write_op.cc:270] Start()
0709 13:01:21.172348 (+   179us) write_op.cc:276] Timestamp: P: 1783602081172107 usec, L: 0
0709 13:01:21.172383 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:01:21.173015 (+   632us) log.cc:844] Serialized 4028 byte log entry
0709 13:01:21.439696 (+266681us) op_driver.cc:464] REPLICATION: finished
0709 13:01:21.576512 (+136816us) write_op.cc:301] APPLY: starting
0709 13:01:21.576618 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:21.619085 (+ 42467us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:21.619211 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:21.677112 (+ 57901us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:21.677466 (+   354us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:01:21.677535 (+    69us) write_op.cc:312] APPLY: finished
0709 13:01:21.677902 (+   367us) log.cc:844] Serialized 97 byte log entry
0709 13:01:21.684215 (+  6313us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:21.684342 (+   127us) write_op.cc:454] Released schema lock
0709 13:01:21.684406 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:21.684821 (+   415us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:21.684854 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":136491,"apply.run_cpu_time_us":15445,"apply.run_wall_time_us":108306,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45947,"num_ops":10,"prepare.queue_time_us":142452,"prepare.run_cpu_time_us":22178,"prepare.run_wall_time_us":117308,"raft.queue_time_us":40977,"raft.run_cpu_time_us":23499,"raft.run_wall_time_us":78613,"replication_time_us":255506,"spinlock_wait_cycles":1408,"thread_start_us":267109,"threads_started":4,"wal-append.queue_time_us":172729}]]}
I20260709 13:01:21.980705  8279 raft_consensus.cc:493] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.993981  1470 catalog_manager.cc:5697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 13 to 14, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.972944  7672 consensus_queue.cc:1048] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 13:01:22.005657  8445 log.cc:927] Time spent T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:01:21.995388  8048 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:22.046422   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:21.997948  8454 raft_consensus.cc:2272] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.001017  1470 catalog_manager.cc:5697] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: leader changed from <none> to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:22.060664  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 67422.7us
I20260709 13:01:22.061517  1470 catalog_manager.cc:5697] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.003965  8279 raft_consensus.cc:515] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:22.076612  1470 catalog_manager.cc:5697] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:22.104552  8279 leader_election.cc:290] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:22.106717  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:22.107898  1563 raft_consensus.cc:2410] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:01:22.111470  8454 ts_tablet_manager.cc:1916] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:22.097203  1470 catalog_manager.cc:5697] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 7 to 10, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.118911  1470 catalog_manager.cc:5697] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 9 to 10, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.121869  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f283aa8c9b4a40729ec5fde1481234a1"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:01:22.122845  1718 raft_consensus.cc:606] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:22.123251  1718 raft_consensus.cc:614] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:22.123358  1456 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bfbaf6c33e5b45ea9c75342b1011f209 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 338d817f94ee4c1bad162e9a5860b68a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:22.125180   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:01:22.121451  1470 catalog_manager.cc:5697] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:22.128321   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:01:22.159900  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 163870us
I20260709 13:01:22.156965  1470 catalog_manager.cc:5697] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 12 to 19, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 19 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:22.172725  1470 catalog_manager.cc:5697] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 11 to 12, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.175253  1470 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 12 to 14, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 14 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:01:22.179546  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 180633us
I20260709 13:01:22.182367  1718 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:22.181720  1470 catalog_manager.cc:5697] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 13 to 14, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 14 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:22.195850  8357 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:01:22.198156  8424 log.cc:927] Time spent T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:22.200562  1571 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:22.165853  8456 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:22.206423  8456 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:22.192205  1470 catalog_manager.cc:5697] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 12 to 13, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.222628  8028 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:01:22.228574  8456 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:22.238433  1566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:22.239617  1566 raft_consensus.cc:2393] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 15: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:22.254384  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:22.255195  2440 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
W20260709 13:01:22.261672  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 84880.7us
W20260709 13:01:22.261858  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 47595.1us
I20260709 13:01:22.298640  1470 catalog_manager.cc:5697] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 9 to 13, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:22.326992  8449 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.327674  8449 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:22.339174  8449 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:22.340297  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:22.340930  1642 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:01:22.342250  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:22.345211  2447 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 15.
I20260709 13:01:22.346400  1537 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:22.348204  8449 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:22.348601  8449 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.348964  8449 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:22.359483  8454 ts_tablet_manager.cc:1929] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.8
I20260709 13:01:22.360078  8454 log.cc:1199] T 17d2c95439be4ced872760603b0ae02b P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/17d2c95439be4ced872760603b0ae02b
I20260709 13:01:22.357301  8449 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:22.362197  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet 17d2c95439be4ced872760603b0ae02b (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:01:22.365782  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:22.366456  1642 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:22.373580  8449 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:22.377725  1642 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:01:22.385705  2444 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:22.386695  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:22.387310  2440 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:22.394886  8449 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:01:22.345045  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 138869us
W20260709 13:01:22.401775  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 194053us
I20260709 13:01:22.404875  2440 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:01:22.408095  1537 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:22.415989  8449 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:22.418406  8449 raft_consensus.cc:697] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:22.419319  8449 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:22.444422  1642 raft_consensus.cc:1275] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:22.477774  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681214f01c5b4fc6a0aa493b2382c01f" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:22.482590  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:22.483489  1718 raft_consensus.cc:2393] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4be9cc90aca4dd4ad7db103062a7208 in current term 15: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:22.493273  1611 leader_election.cc:304] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:22.495482  8456 raft_consensus.cc:2749] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:22.495579  1611 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:22.497143  8458 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:22.501433  8459 consensus_queue.cc:1048] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:22.550832  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:22.551429  1715 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:22.555510  8449 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:22.556057  8449 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:22.559188  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:22.564865  8449 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:22.566730  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:22.567622  2444 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:01:22.569886  1537 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:22.570205  1715 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:01:22.571777  8410 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:22.572161  8410 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:22.572511  8410 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:22.580443  8410 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:22.599443  8410 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:22.600392  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:22.602926  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:22.605826  1720 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 14: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:22.603669  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:22.606884  1715 raft_consensus.cc:2393] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 338d817f94ee4c1bad162e9a5860b68a in current term 14: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:22.608131  2444 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 14.
I20260709 13:01:22.609207  1537 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:22.610160  8340 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:22.610630  8340 raft_consensus.cc:697] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:22.611466  8340 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:22.769649  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 219) took 6301 ms. Trace:
I20260709 13:01:22.760186  1468 catalog_manager.cc:5697] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 18 to 19, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.781478  1468 catalog_manager.cc:5697] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.792557  1468 catalog_manager.cc:5697] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 13 to 14, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 13:01:22.775190  1470 rpcz_store.cc:276] 0709 13:01:16.467909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.468091 (+   182us) service_pool.cc:224] Handling call
0709 13:01:22.769559 (+6301468us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:22.476730 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:22.477481 (+   751us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:22.477514 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:01:22.477531 (+    17us) tablet.cc:662] Decoding operations
0709 13:01:22.479184 (+  1653us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:22.479289 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:22.479314 (+    25us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:01:22.480936 (+  1622us) tablet.cc:701] Row locks acquired
0709 13:01:22.480954 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:01:22.481095 (+   141us) write_op.cc:270] Start()
0709 13:01:22.481207 (+   112us) write_op.cc:276] Timestamp: P: 1783602082481043 usec, L: 0
0709 13:01:22.481234 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:01:22.514353 (+ 33119us) log.cc:844] Serialized 9085 byte log entry
0709 13:01:22.592026 (+ 77673us) op_driver.cc:464] REPLICATION: finished
0709 13:01:22.616147 (+ 24121us) write_op.cc:301] APPLY: starting
0709 13:01:22.616234 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:22.638533 (+ 22299us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:22.638629 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:22.683227 (+ 44598us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:22.683540 (+   313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:01:22.683584 (+    44us) write_op.cc:312] APPLY: finished
0709 13:01:22.684001 (+   417us) log.cc:844] Serialized 204 byte log entry
0709 13:01:22.684189 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.684380 (+   191us) write_op.cc:454] Released schema lock
0709 13:01:22.684438 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:22.687604 (+  3166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.687636 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":19045,"mutex_wait_us":27513,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":23865,"apply.run_cpu_time_us":28297,"apply.run_wall_time_us":71382,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100313,"num_ops":23,"prepare.queue_time_us":67152,"prepare.run_cpu_time_us":5711,"prepare.run_wall_time_us":44388,"replication_time_us":110605,"thread_start_us":68456,"threads_started":2}]]}
I20260709 13:01:22.803916  1468 catalog_manager.cc:5697] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 11 to 13, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.808445  1468 catalog_manager.cc:5697] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 17 to 18, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.812068  1468 catalog_manager.cc:5697] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 11 to 12, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 13:01:22.813470  1468 catalog_manager.cc:5697] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 8 to 11, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:22.816025  1468 catalog_manager.cc:5697] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 13 to 14, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.818162  1468 catalog_manager.cc:5697] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 12 to 13, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 13:01:22.819682  1468 catalog_manager.cc:5697] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 5 to 7, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:22.820910  1468 catalog_manager.cc:5697] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 16 to 19, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 19 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 13:01:22.823036  1468 catalog_manager.cc:5697] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 8 to 14, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 13:01:22.841285  1639 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:22.849833  8410 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:22.916419  8459 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.917379  8459 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:22.930027  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:22.930722  2444 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:22.920734  8459 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:22.929369  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a" is_pre_election: true
I20260709 13:01:22.943512  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:22.943853  1717 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:22.944278  8459 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:22.944671  8459 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.945001  8459 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:22.948375  8291 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:22.952880  8459 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:22.959900  8459 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:22.962850  1563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:22.964583  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:22.967142  2444 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:22.976540  2444 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
I20260709 13:01:22.984403  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:22.988065  8470 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:22.993693  8470 raft_consensus.cc:697] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:22.999102  8470 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:23.009613  2444 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:23.037047  8410 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:23.077044  1466 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.080402  2440 raft_consensus.cc:1240] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Rejecting Update request from peer 338d817f94ee4c1bad162e9a5860b68a for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:23.082104  8341 consensus_queue.cc:1059] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:23.082986  8341 raft_consensus.cc:3055] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:23.083393  8341 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:23.084895  8341 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:23.086330  8341 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:23.083827  1468 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58252 (request call id 334) took 2413 ms. Trace:
I20260709 13:01:23.092525  1468 rpcz_store.cc:276] 0709 13:01:20.670570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.670784 (+   214us) service_pool.cc:224] Handling call
0709 13:01:23.083744 (+2412960us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:22.850178 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:22.850698 (+   520us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:22.850731 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:01:22.850748 (+    17us) tablet.cc:662] Decoding operations
0709 13:01:22.851750 (+  1002us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:22.851802 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:22.851833 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:01:22.852889 (+  1056us) tablet.cc:701] Row locks acquired
0709 13:01:22.852909 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:01:22.853048 (+   139us) write_op.cc:270] Start()
0709 13:01:22.853163 (+   115us) write_op.cc:276] Timestamp: P: 1783602082853000 usec, L: 0
0709 13:01:22.853186 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:01:22.856868 (+  3682us) log.cc:844] Serialized 4858 byte log entry
0709 13:01:22.859045 (+  2177us) op_driver.cc:464] REPLICATION: finished
0709 13:01:22.859595 (+   550us) write_op.cc:301] APPLY: starting
0709 13:01:22.859672 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:22.882777 (+ 23105us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:22.882869 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:22.963597 (+ 80728us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:22.989322 (+ 25725us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:01:22.993318 (+  3996us) write_op.cc:312] APPLY: finished
0709 13:01:23.024396 (+ 31078us) log.cc:844] Serialized 113 byte log entry
0709 13:01:23.029628 (+  5232us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:23.035875 (+  6247us) write_op.cc:454] Released schema lock
0709 13:01:23.035947 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:23.036358 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:23.036398 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13455,"reported_tablets":31,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":257,"apply.run_cpu_time_us":16352,"apply.run_wall_time_us":176707,"cfile_cache_hit":48,"cfile_cache_hit_bytes":50184,"num_ops":12,"prepare.queue_time_us":372,"prepare.run_cpu_time_us":4137,"prepare.run_wall_time_us":8797,"replication_time_us":5720}]]}
I20260709 13:01:23.083297  1466 catalog_manager.cc:5697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 16 to 19, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 19 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.101763  1466 catalog_manager.cc:5697] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 17 to 18, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 18 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:23.102851  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 79307.8us
I20260709 13:01:23.105762  1466 catalog_manager.cc:5697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 14 to 15, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 15 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.108564  1466 catalog_manager.cc:5697] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 17 to 19, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:23.109911  1466 catalog_manager.cc:5697] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 19 to 25. New cstate: current_term: 25 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:23.111513  1466 catalog_manager.cc:5697] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 16 to 18, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:23.112854  1466 catalog_manager.cc:5697] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:23.114252  1466 catalog_manager.cc:5697] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.116374  1466 catalog_manager.cc:5697] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 13 to 18, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 18 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:23.117921  1466 catalog_manager.cc:5697] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 18 to 19, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 13:01:23.119228  1466 catalog_manager.cc:5697] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.120631  1466 catalog_manager.cc:5697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 14 to 16, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 16 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.122188  1466 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 18 to 22, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 22 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.123694  1466 catalog_manager.cc:5697] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:01:23.132166  8490 log.cc:927] Time spent T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:01:23.159924   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:23.209044  1456 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet cbe76ebe20be4546bed4f95e2ee090bd with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER failed with leader 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6f381117554e49bb816791ab0a10f2b8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:23.424340  1563 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 14. (term mismatch)
I20260709 13:01:23.425149  1563 pending_rounds.cc:85] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Aborting all ops after (but not including) 13
I20260709 13:01:23.425415  1563 pending_rounds.cc:107] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Aborting uncommitted NO_OP operation due to leader change: 14.14
I20260709 13:01:23.425683  1563 raft_consensus.cc:2889] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:23.427806  8470 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:23.480141  2440 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:01:23.481477  8310 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:23.606010  1466 catalog_manager.cc:5697] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 14 to 16, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 16 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.727025  1466 catalog_manager.cc:5697] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 14 to 16, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } }
I20260709 13:01:23.755800  1467 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58260 (request call id 331) took 5831 ms. Trace:
I20260709 13:01:23.758195  1467 rpcz_store.cc:276] 0709 13:01:17.924302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.924529 (+   227us) service_pool.cc:224] Handling call
0709 13:01:18.207281 (+282752us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54004254d4. stack: 00007f18ca179343 00007f18ca179240 00007f18c9b081d4 00007f18d3846304 00007f18d3846299 00007f18cd202090 00007f18cd2a0f3a 00007f18d30571cc 00007f18d315537e 00007f18d16162a4 00007f18d1616232 00007f18d1616161 00007f18d16160dc 00007f18d1615392 00007f18cb5d348c 00007f18cb5d28c6
0709 13:01:23.755622 (+5548341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7004,"reported_tablets":45,"spinlock_wait_cycles":282036224}
I20260709 13:01:23.933370  1470 catalog_manager.cc:5697] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:23.937870  1470 catalog_manager.cc:5697] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.943470  1470 catalog_manager.cc:5697] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
W20260709 13:01:23.951277  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 51444.9us
I20260709 13:01:24.020313  1466 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 13 to 15, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:24.064448  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60766 (request call id 220) took 1069 ms. Trace:
I20260709 13:01:24.064893  1470 rpcz_store.cc:276] 0709 13:01:22.994905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.995043 (+   138us) service_pool.cc:224] Handling call
0709 13:01:24.064362 (+1069319us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:23.949798 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:23.950357 (+   559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:23.950396 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:01:23.950414 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:23.950943 (+   529us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:23.951004 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:23.951033 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:01:23.951464 (+   431us) tablet.cc:701] Row locks acquired
0709 13:01:23.951483 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:23.951618 (+   135us) write_op.cc:270] Start()
0709 13:01:23.951712 (+    94us) write_op.cc:276] Timestamp: P: 1783602083951569 usec, L: 0
0709 13:01:23.951731 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:01:23.952322 (+   591us) log.cc:844] Serialized 1302 byte log entry
0709 13:01:23.954606 (+  2284us) op_driver.cc:464] REPLICATION: finished
0709 13:01:23.959494 (+  4888us) write_op.cc:301] APPLY: starting
0709 13:01:23.959580 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:23.963249 (+  3669us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:23.963345 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:23.965202 (+  1857us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:23.965377 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:01:23.965420 (+    43us) write_op.cc:312] APPLY: finished
0709 13:01:23.965638 (+   218us) log.cc:844] Serialized 41 byte log entry
0709 13:01:23.966663 (+  1025us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:23.966751 (+    88us) write_op.cc:454] Released schema lock
0709 13:01:23.966801 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:23.967141 (+   340us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:23.967169 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8915,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":4670,"apply.run_cpu_time_us":5179,"apply.run_wall_time_us":7608,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12546,"num_ops":3,"prepare.queue_time_us":610,"prepare.run_cpu_time_us":2741,"prepare.run_wall_time_us":2806,"replication_time_us":2748}]]}
I20260709 13:01:24.193197  1715 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:24.218688  1647 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:24.226791  8310 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:24.229692  2440 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:24.259639  8470 raft_consensus.cc:2955] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 9 to 12, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:24.268688  1639 raft_consensus.cc:2955] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 9 to 12, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:24.277061  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cc8f7aca67ac4df5b6f0b4f41d538dfd with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:24.277299  8489 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:24.279279  1563 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:24.293980  1467 catalog_manager.cc:5697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: config changed from index 9 to 12, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New cstate: current_term: 14 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.304402  2440 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:01:24.306726  8497 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:24.317047  1557 tablet_service.cc:1558] Processing DeleteTablet for tablet cc8f7aca67ac4df5b6f0b4f41d538dfd with delete_type TABLET_DATA_TOMBSTONED (TS 338d817f94ee4c1bad162e9a5860b68a not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:48208
I20260709 13:01:24.328447  8340 raft_consensus.cc:2955] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Committing config change with OpId 16.15: config changed from index 11 to 15, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:24.334074   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:24.334586  8507 tablet_replica.cc:333] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:24.335736  8507 raft_consensus.cc:2243] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.344378  8507 raft_consensus.cc:2272] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.347596  8507 ts_tablet_manager.cc:1916] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:24.334313  2440 raft_consensus.cc:2955] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 11 to 15, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:24.363988  1456 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cbe76ebe20be4546bed4f95e2ee090bd with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 13:01:24.375754  1467 catalog_manager.cc:5697] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 11 to 15, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 16 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:24.377671  8507 ts_tablet_manager.cc:1929] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:01:24.386799  1717 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:01:24.381786  8507 log.cc:1199] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 338d817f94ee4c1bad162e9a5860b68a: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-0-root/wals/cc8f7aca67ac4df5b6f0b4f41d538dfd
I20260709 13:01:24.399628  8340 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:24.400008  1456 catalog_manager.cc:5028] TS 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): tablet cc8f7aca67ac4df5b6f0b4f41d538dfd (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:01:24.400866  1636 tablet_service.cc:1558] Processing DeleteTablet for tablet cbe76ebe20be4546bed4f95e2ee090bd with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:50864
I20260709 13:01:24.439917  2447 raft_consensus.cc:2955] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 9 to 12, VOTER 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:24.452018  1717 raft_consensus.cc:2955] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Committing config change with OpId 16.15: config changed from index 11 to 15, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:24.478648  8509 tablet_replica.cc:333] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:24.479808  8509 raft_consensus.cc:2243] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:24.495777  8509 raft_consensus.cc:2272] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:24.501986  1715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:01:24.502779  1715 raft_consensus.cc:606] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:24.505887  1715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:01:24.506543  1715 raft_consensus.cc:606] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Received request to transfer leadership to TS 338d817f94ee4c1bad162e9a5860b68a
W20260709 13:01:24.508594  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 65899.2us
I20260709 13:01:24.510509  1715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:01:24.511230  1715 raft_consensus.cc:606] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:24.512030  8509 ts_tablet_manager.cc:1916] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:01:24.535190  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 109797us
I20260709 13:01:24.565531  8495 raft_consensus.cc:993] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 13:01:24.566077  8495 raft_consensus.cc:1081] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Signalling peer 338d817f94ee4c1bad162e9a5860b68a to start an election
W20260709 13:01:24.574385  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 149787us
I20260709 13:01:24.580258  1564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:46640
I20260709 13:01:24.580884  1564 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:24.581213  1564 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:24.591461  8509 ts_tablet_manager.cc:1929] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.14
I20260709 13:01:24.596187  8509 log.cc:1199] T cbe76ebe20be4546bed4f95e2ee090bd P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/cbe76ebe20be4546bed4f95e2ee090bd
I20260709 13:01:24.607234  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet cbe76ebe20be4546bed4f95e2ee090bd (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
I20260709 13:01:24.596433  1564 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:24.616180  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:24.616739  1715 raft_consensus.cc:3055] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:24.617023  1715 raft_consensus.cc:740] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:24.617656  1715 consensus_queue.cc:260] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:24.618764  1715 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:24.622625  1564 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:24.634228  1715 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:01:24.639659  1536 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:24.641628  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:24.642234  2440 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:24.646236  8512 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:24.646788  8512 raft_consensus.cc:697] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:24.647581  8512 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:24.675709  2440 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 16.
I20260709 13:01:24.690349  1467 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 15 to 16, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 16 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.719342  2440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54"
dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:52126
I20260709 13:01:24.721570  2440 raft_consensus.cc:606] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:24.719651  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 46081.8us
I20260709 13:01:24.731961  1715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b"
dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:42630
I20260709 13:01:24.732705  1715 raft_consensus.cc:606] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:24.734016   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:24.735747   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:24.848119  8515 raft_consensus.cc:993] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:01:24.848727  8515 raft_consensus.cc:1081] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:01:24.850675  1639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 13:01:24.851225  1639 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:24.851563  1639 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:24.883498  1639 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:24.892216  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:24.892858  1715 raft_consensus.cc:3055] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:24.892935  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:24.893282  1715 raft_consensus.cc:740] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:24.893616  2440 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:24.892370  1639 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:24.894155  1715 consensus_queue.cc:260] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:24.895272  1715 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:24.901039  2440 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:01:24.902346  1612 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:24.903093  8458 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:24.903630  8458 raft_consensus.cc:697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:24.904528  8458 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:24.918043  1467 catalog_manager.cc:5697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 14 to 15, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:24.923693  8520 raft_consensus.cc:993] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:01:24.924206  8520 raft_consensus.cc:1081] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:01:24.925964  1639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:38584
I20260709 13:01:24.926501  1639 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:24.926832  1639 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:24.915488  1715 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:01:24.978528  8515 raft_consensus.cc:993] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 13:01:24.979004  8515 raft_consensus.cc:1081] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Signalling peer 338d817f94ee4c1bad162e9a5860b68a to start an election
I20260709 13:01:24.982220  1568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef"
dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
 from {username='slave'} at 127.0.0.1:46640
I20260709 13:01:24.982815  1568 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:24.983189  1568 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.993827  1568 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:24.996600  1639 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:25.012014  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:25.012593  1715 raft_consensus.cc:3055] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:25.012900  1715 raft_consensus.cc:740] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:25.016815  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:25.013579  1715 consensus_queue.cc:260] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:25.017446  1720 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:25.018069  1715 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:25.016017  1639 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:25.029258  2440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:25.029928  2440 raft_consensus.cc:3055] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:25.030257  2440 raft_consensus.cc:740] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:25.030603  8515 raft_consensus.cc:993] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:01:25.031255  8470 raft_consensus.cc:1081] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:01:25.031075  2440 consensus_queue.cc:260] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:25.033967  2440 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:25.039354  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "338d817f94ee4c1bad162e9a5860b68a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:25.039981  2447 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:25.042487  2440 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 17.
I20260709 13:01:25.044888  1715 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:01:25.048286  2447 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338d817f94ee4c1bad162e9a5860b68a in term 10.
I20260709 13:01:25.062178  1536 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0; no voters: 
I20260709 13:01:25.063225  8497 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:25.063745  8497 raft_consensus.cc:697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Becoming Leader. State: Replica: 338d817f94ee4c1bad162e9a5860b68a, State: Running, Role: LEADER
I20260709 13:01:25.064615  8497 consensus_queue.cc:237] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:25.050158  1568 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [CANDIDATE]: Term 10 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:25.053016  1647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:36708
I20260709 13:01:25.068634  1647 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:25.069010  1647 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:25.054818  2444 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:01:25.072811  8340 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:25.082680  1647 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:25.084899  1647 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:25.086573  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:25.087230  1715 raft_consensus.cc:3055] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:25.087523  1715 raft_consensus.cc:740] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:25.088228  1715 consensus_queue.cc:260] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:25.089236  1715 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:25.054739  1720 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 17.
I20260709 13:01:25.095844  1612 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:25.096131  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a2b0ee304d42d18cbe5fa6ca66804b" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "338d817f94ee4c1bad162e9a5860b68a"
I20260709 13:01:25.111493  1717 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:01:25.129594  1568 raft_consensus.cc:3060] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:25.131476  8458 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:25.132087  8458 raft_consensus.cc:697] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:25.133119  8458 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:25.123768  1715 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:01:25.138798  1568 raft_consensus.cc:2468] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 15.
I20260709 13:01:25.140081  1611 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:25.180238  8340 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:01:25.176939  8516 raft_consensus.cc:2804] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:25.235673  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 95707.6us
W20260709 13:01:25.232702  8519 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:25.236011  8516 raft_consensus.cc:697] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
W20260709 13:01:25.294524  8528 log.cc:927] Time spent T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:01:25.327867  8516 consensus_queue.cc:237] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:25.376688  1467 catalog_manager.cc:5697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: term changed from 9 to 10, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193). New cstate: current_term: 10 leader_uuid: "338d817f94ee4c1bad162e9a5860b68a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.387681  1718 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:25.397899  2447 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:25.405718  8458 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:25.385200  1468 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 16 to 17, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.463366  8529 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:25.492343  2440 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:25.497327  8526 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:25.512573  8539 log.cc:927] Time spent T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:01:25.563843  1467 catalog_manager.cc:5697] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 14 to 15, leader changed from 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.598453  1715 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Refusing update from remote peer 338d817f94ee4c1bad162e9a5860b68a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:25.630365  8533 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:01:25.668195  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 128055us
I20260709 13:01:25.677524  2440 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:01:25.681277  8516 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:25.684432  1720 raft_consensus.cc:1275] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:01:25.685958  8548 consensus_queue.cc:1048] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:25.738090   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:25.764618  1568 raft_consensus.cc:1275] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:25.771793  8516 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:25.819993  1717 raft_consensus.cc:1275] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:25.822933  8498 consensus_queue.cc:1048] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:26.884953   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:27.272069  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 102160us
W20260709 13:01:27.289745  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 117179us
W20260709 13:01:27.308862  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 127667us
W20260709 13:01:27.398228  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 80943.4us
W20260709 13:01:27.416095  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 109461us
I20260709 13:01:27.505697  2442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7"
dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:52126
I20260709 13:01:27.506348  2442 raft_consensus.cc:606] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:27.529495  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 111033us
I20260709 13:01:27.593287  2444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627"
dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:52126
I20260709 13:01:27.593920  2444 raft_consensus.cc:606] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:27.597777  2444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c55d053b55024621933828292867f0e6"
dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
mode: GRACEFUL
new_leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:52126
I20260709 13:01:27.598344  2444 raft_consensus.cc:606] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Received request to transfer leadership to TS a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:27.599617   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:01:27.601320   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:27.627362  8530 raft_consensus.cc:993] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:01:27.628039  8530 raft_consensus.cc:1081] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:01:27.642437  8573 raft_consensus.cc:993] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:01:27.642930  8573 raft_consensus.cc:1081] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
W20260709 13:01:27.725630  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 71326.6us
I20260709 13:01:27.810411  1647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:38584
I20260709 13:01:27.811060  1647 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:27.811426  1647 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:27.821833  1642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:38584
I20260709 13:01:27.823335  1642 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:27.823731  1642 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:27.831128  1642 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:27.833055  1642 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:27.832892  1647 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:27.846513  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
W20260709 13:01:28.098975  1536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 246260us
I20260709 13:01:28.104283  1638 raft_consensus.cc:1240] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:28.105723  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:28.126317  2444 raft_consensus.cc:3055] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:28.126670  2444 raft_consensus.cc:740] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:28.127408  2444 consensus_queue.cc:260] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:28.128484  2444 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:27.870558  1715 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:28.155249  2444 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
W20260709 13:01:28.177295  2474 debug-util.cc:398] Leaking SignalData structure 0x7b080033e600 after lost signal to thread 434
I20260709 13:01:28.146502  1647 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:28.178871  2474 debug-util.cc:398] Leaking SignalData structure 0x7b08001a0d00 after lost signal to thread 1504
W20260709 13:01:28.180169  2474 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4d80 after lost signal to thread 1596
W20260709 13:01:28.181416  2474 debug-util.cc:398] Leaking SignalData structure 0x7b0800325960 after lost signal to thread 1671
W20260709 13:01:28.182670  2474 debug-util.cc:398] Leaking SignalData structure 0x7b08003ae8a0 after lost signal to thread 1745
W20260709 13:01:28.183879  2474 debug-util.cc:398] Leaking SignalData structure 0x7b08002a91e0 after lost signal to thread 2477
I20260709 13:01:28.189332  1715 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 11.
W20260709 13:01:28.278023  2405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.295281  1611 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:28.300417  8603 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:28.309754  8603 raft_consensus.cc:697] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:28.311368  8603 consensus_queue.cc:237] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:28.328647  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:28.352937  2444 raft_consensus.cc:3055] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:28.353287  2444 raft_consensus.cc:740] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:28.354003  2444 consensus_queue.cc:260] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:28.355171  2444 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.340490  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:28.362046  2444 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:01:28.363400  1715 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.368007  1612 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:28.369262  8587 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:28.369796  8587 raft_consensus.cc:697] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:28.370677  8587 consensus_queue.cc:237] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:28.375186  8573 raft_consensus.cc:993] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: : Instructing follower a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:01:28.375761  8573 raft_consensus.cc:1081] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Signalling peer a4be9cc90aca4dd4ad7db103062a7208 to start an election
I20260709 13:01:28.413409  1715 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 12.
I20260709 13:01:28.421311  1639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c55d053b55024621933828292867f0e6"
dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
 from {username='slave'} at 127.0.0.1:38584
I20260709 13:01:28.421895  1639 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.422298  1639 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:28.436760  1717 raft_consensus.cc:1240] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Rejecting Update request from peer 6f381117554e49bb816791ab0a10f2b8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:28.438761  1639 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:28.442463  1639 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:28.510833  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:28.511505  2444 raft_consensus.cc:3055] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:28.511792  2444 raft_consensus.cc:740] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:28.512559  2444 consensus_queue.cc:260] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:28.513497  2444 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:28.522096  1685 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 80359.4us
I20260709 13:01:28.520656  1470 catalog_manager.cc:5697] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 10 to 11, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.523927  1470 catalog_manager.cc:5697] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 11 to 12, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.529966  2444 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 18.
I20260709 13:01:28.535359  1612 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:28.536207  8603 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:28.536733  8603 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:28.537576  8603 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:28.559095  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:28.559731  1717 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:28.567883  1717 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 18.
I20260709 13:01:28.602527   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:28.671439  1470 catalog_manager.cc:5697] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 17 to 18, leader changed from 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.848552  1717 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:28.850149  8579 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:28.871059  2442 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:28.885721  8603 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:28.910511  2444 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:28.913434  8579 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:28.978345  1718 raft_consensus.cc:1275] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:28.979833  8579 consensus_queue.cc:1048] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:28.998348  1537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 82197.6us
I20260709 13:01:29.027493  2444 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:01:29.032169  8595 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:01:29.089184  1718 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:01:29.090893  8603 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:01:29.768608   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:29.872730   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:01:29.874459   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:30.488368  1715 consensus_queue.cc:237] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:30.554477  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 123534us
I20260709 13:01:30.635663  1566 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:30.641042  2444 raft_consensus.cc:1275] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:30.644891  8636 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:30.649339  8633 consensus_queue.cc:1048] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:30.695874  8631 raft_consensus.cc:2955] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 8 to 11, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:30.697942  2444 raft_consensus.cc:2955] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 8 to 11, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:30.729259  1566 raft_consensus.cc:2955] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 8 to 11, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:30.793427  1468 catalog_manager.cc:5697] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a reported cstate change: config changed from index 8 to 11, VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) evicted. New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } }
I20260709 13:01:30.810792  1455 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bfbaf6c33e5b45ea9c75342b1011f209 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 13:01:30.911931   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:30.975020  1636 tablet_service.cc:1558] Processing DeleteTablet for tablet bfbaf6c33e5b45ea9c75342b1011f209 with delete_type TABLET_DATA_TOMBSTONED (TS a4be9cc90aca4dd4ad7db103062a7208 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:50864
I20260709 13:01:31.020046  8645 tablet_replica.cc:333] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:31.026469  8645 raft_consensus.cc:2243] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.035112  8645 raft_consensus.cc:2272] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.044695  8645 ts_tablet_manager.cc:1916] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:31.063696   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:01:31.087598  2406 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
I20260709 13:01:31.102741  8645 ts_tablet_manager.cc:1929] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 13:01:31.103389  8645 log.cc:1199] T bfbaf6c33e5b45ea9c75342b1011f209 P a4be9cc90aca4dd4ad7db103062a7208: Deleting WAL directory at /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601840662384-431-0/minicluster-data/ts-1-root/wals/bfbaf6c33e5b45ea9c75342b1011f209
I20260709 13:01:31.105559  1455 catalog_manager.cc:5028] TS a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): tablet bfbaf6c33e5b45ea9c75342b1011f209 (table test-workload [id=459c0b6405d34fddb511baae1d126fe5]) successfully deleted
W20260709 13:01:31.128791  2406 consensus_peers.cc:597] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.142953  1612 consensus_peers.cc:597] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.162674  1686 consensus_peers.cc:597] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.165228  1686 consensus_peers.cc:597] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.189538  2406 consensus_peers.cc:597] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.190583  1686 consensus_peers.cc:597] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.219494  2406 consensus_peers.cc:597] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.230177  2406 consensus_peers.cc:597] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.231245  1686 consensus_peers.cc:597] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.257829   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:01:31.266409  1686 consensus_peers.cc:597] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.270335   431 tablet_replica.cc:333] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.271719   431 raft_consensus.cc:2243] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:31.271988  2406 consensus_peers.cc:597] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.274686  1612 consensus_peers.cc:597] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.275048   431 raft_consensus.cc:2272] T 681214f01c5b4fc6a0aa493b2382c01f P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:31.277005  2406 consensus_peers.cc:597] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.280529  2406 consensus_peers.cc:597] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.288245   431 tablet_replica.cc:333] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.289407   431 raft_consensus.cc:2243] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:31.297648  1612 consensus_peers.cc:597] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.296525   431 raft_consensus.cc:2272] T 72ddc5b6631d45ffb9776db2cc41447d P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.310258   431 tablet_replica.cc:333] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.313758   431 raft_consensus.cc:2243] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.318116   431 raft_consensus.cc:2272] T 59f8a3d26bbd4c18a7d64b7584debff6 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.325351   431 tablet_replica.cc:333] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.330358   431 raft_consensus.cc:2243] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:31.327633  1612 consensus_peers.cc:597] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.331403   431 raft_consensus.cc:2272] T a057e47a0fca4295957540c192996970 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.334571   431 tablet_replica.cc:333] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.343722   431 raft_consensus.cc:2243] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.344743   431 raft_consensus.cc:2272] T 289133b3cbb949f4967bbf24c6b14e19 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.348083   431 tablet_replica.cc:333] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
W20260709 13:01:31.352942  2406 consensus_peers.cc:597] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.359153   431 raft_consensus.cc:2243] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:31.360510   431 raft_consensus.cc:2272] T 02b66b7be226499cbd9e020d381c72b2 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.363626   431 tablet_replica.cc:333] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
W20260709 13:01:31.376425  2406 consensus_peers.cc:597] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.377789  1686 consensus_peers.cc:597] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.378137   431 raft_consensus.cc:2243] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:31.379411   431 raft_consensus.cc:2272] T ac93f5a09723490eaf799683a1582480 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.384747   431 tablet_replica.cc:333] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.385663   431 raft_consensus.cc:2243] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.386397   431 raft_consensus.cc:2272] T e519a89ee28c45f98d4fe9c4bfea4baf P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.389393   431 tablet_replica.cc:333] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
W20260709 13:01:31.399119  1612 consensus_peers.cc:597] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.401320  1686 consensus_peers.cc:597] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.412371  2406 consensus_peers.cc:597] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.412662  1612 consensus_peers.cc:597] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.416217   431 raft_consensus.cc:2243] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:31.417747   431 raft_consensus.cc:2272] T a6e5957876f24a868f3f2c49fcf5e759 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.430342   431 tablet_replica.cc:333] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.434134   431 raft_consensus.cc:2243] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.435137   431 raft_consensus.cc:2272] T e28f3d3a9bc24be6b8fc4d90754cdfac P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.439195   431 tablet_replica.cc:333] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
W20260709 13:01:31.451640  1686 consensus_peers.cc:597] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.454794   431 raft_consensus.cc:2243] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.455832   431 raft_consensus.cc:2272] T e5316a1e4f014102b1770c3f8b08410b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.459151   431 tablet_replica.cc:333] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.460096   431 raft_consensus.cc:2243] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.461809   431 raft_consensus.cc:2272] T 31e1751f20084c868e4ad6251ca38954 P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:31.462229  2406 consensus_peers.cc:597] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.468513   431 tablet_replica.cc:333] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.475150   431 raft_consensus.cc:2243] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:31.475800  1612 consensus_peers.cc:597] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.476619   431 raft_consensus.cc:2272] T eae5b8a8b4f14989a2565077fe8be235 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.482337   431 tablet_replica.cc:333] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.483325   431 raft_consensus.cc:2243] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.484120   431 raft_consensus.cc:2272] T 41d3057239d54d6183db91d2b176c2dd P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.497932   431 tablet_replica.cc:333] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.499117   431 raft_consensus.cc:2243] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:31.500756   431 raft_consensus.cc:2272] T cbe76ebe20be4546bed4f95e2ee090bd P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.503659   431 tablet_replica.cc:333] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.504590   431 raft_consensus.cc:2243] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:31.505810   431 raft_consensus.cc:2272] T a186179c799f4e53a8adf725dfd98a58 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:31.506428  1686 consensus_peers.cc:597] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.508978   431 tablet_replica.cc:333] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.510001   431 raft_consensus.cc:2243] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.510927   431 raft_consensus.cc:2272] T f283aa8c9b4a40729ec5fde1481234a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.518009   431 tablet_replica.cc:333] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.518946   431 raft_consensus.cc:2243] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.519914   431 raft_consensus.cc:2272] T 8ca192f35fd14bb58ebd0766d7a202f8 P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.522915   431 tablet_replica.cc:333] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.533905   431 raft_consensus.cc:2243] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.534768   431 raft_consensus.cc:2272] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.537935   431 tablet_replica.cc:333] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.539125   431 raft_consensus.cc:2243] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.539904   431 raft_consensus.cc:2272] T b8c2c21bc6aa4835b68933c89735091f P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.549212   431 tablet_replica.cc:333] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.550155   431 raft_consensus.cc:2243] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.551192   431 raft_consensus.cc:2272] T e0a2b0ee304d42d18cbe5fa6ca66804b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.554092   431 tablet_replica.cc:333] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.555092   431 raft_consensus.cc:2243] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:31.556460   431 raft_consensus.cc:2272] T a2e78d031c384616a01064318cb24f28 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.560951   431 tablet_replica.cc:333] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.562014   431 raft_consensus.cc:2243] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.562713   431 raft_consensus.cc:2272] T 7133ad6a0a3449ad9f1b93e65653432d P 338d817f94ee4c1bad162e9a5860b68a [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:31.563880  2406 consensus_peers.cc:597] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.567507   431 tablet_replica.cc:333] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.568445   431 raft_consensus.cc:2243] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.569226   431 raft_consensus.cc:2272] T b968f124f3854f20bff4af609192c41a P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.592293   431 tablet_replica.cc:333] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
W20260709 13:01:31.597080  1686 consensus_peers.cc:597] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.604192  1612 consensus_peers.cc:597] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.614208   431 raft_consensus.cc:2243] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.615098   431 raft_consensus.cc:2272] T 8b24c881516c4da087ee25ab3682886b P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.618098   431 tablet_replica.cc:333] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.622484   431 raft_consensus.cc:2243] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:31.623742   431 raft_consensus.cc:2272] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 338d817f94ee4c1bad162e9a5860b68a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.626669   431 tablet_replica.cc:333] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.627970   431 raft_consensus.cc:2243] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.628705   431 raft_consensus.cc:2272] T beabe4568b4d481bac560939dd7f8258 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.631826   431 tablet_replica.cc:333] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.632638   431 raft_consensus.cc:2243] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.633327   431 raft_consensus.cc:2272] T 8dd7e524e66b45d5a5c823f1a5224351 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.636168   431 tablet_replica.cc:333] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.637127   431 raft_consensus.cc:2243] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:31.638682   431 raft_consensus.cc:2272] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.641582   431 tablet_replica.cc:333] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.642450   431 raft_consensus.cc:2243] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.643158   431 raft_consensus.cc:2272] T 5a129c637a374138850dc8acf679f4bd P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.646171   431 tablet_replica.cc:333] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.647308   431 raft_consensus.cc:2243] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.647948   431 raft_consensus.cc:2272] T 681b2518696f44d99824827761c9c9f1 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.651039   431 tablet_replica.cc:333] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.651844   431 raft_consensus.cc:2243] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.652513   431 raft_consensus.cc:2272] T 61b3acddedfe43b6b7d1a8f74c050925 P 338d817f94ee4c1bad162e9a5860b68a [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:31.658068  1612 consensus_peers.cc:597] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.655427   431 tablet_replica.cc:333] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.659888   431 raft_consensus.cc:2243] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.660624   431 raft_consensus.cc:2272] T b11fdc1931874b5389be76ef648b6ae1 P 338d817f94ee4c1bad162e9a5860b68a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.663446   431 tablet_replica.cc:333] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.664269   431 raft_consensus.cc:2243] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:31.665462   431 raft_consensus.cc:2272] T 17d2c95439be4ced872760603b0ae02b P 338d817f94ee4c1bad162e9a5860b68a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.668666   431 tablet_replica.cc:333] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.669457   431 raft_consensus.cc:2243] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:31.670615   431 raft_consensus.cc:2272] T 1f9c43e38d20461f85176d58e01fc7a1 P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.673887   431 tablet_replica.cc:333] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.675956   431 raft_consensus.cc:2243] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.676651   431 raft_consensus.cc:2272] T 95165be2dd8c456fb98e088711372ce3 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.680032   431 tablet_replica.cc:333] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.681155   431 raft_consensus.cc:2243] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.681970   431 raft_consensus.cc:2272] T e93b49f668f7487dad07043590a5616f P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.688741   431 tablet_replica.cc:333] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.692103   431 raft_consensus.cc:2243] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:31.693343   431 raft_consensus.cc:2272] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.696838   431 tablet_replica.cc:333] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.697593   431 raft_consensus.cc:2243] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.698378   431 raft_consensus.cc:2272] T 2033b178bcb643fd84ac0d1ae7e6a64b P 338d817f94ee4c1bad162e9a5860b68a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.704339   431 tablet_replica.cc:333] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.705144   431 raft_consensus.cc:2243] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:31.706343   431 raft_consensus.cc:2272] T 36627e4c13c74e8a9fd501f26c7aff53 P 338d817f94ee4c1bad162e9a5860b68a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.714740   431 tablet_replica.cc:333] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.715741   431 raft_consensus.cc:2243] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:01:31.717028   431 raft_consensus.cc:2272] T 2d6b5add0ec94eccb0981a9bb10c79ef P 338d817f94ee4c1bad162e9a5860b68a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.720037   431 tablet_replica.cc:333] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.720917   431 raft_consensus.cc:2243] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.721625   431 raft_consensus.cc:2272] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 338d817f94ee4c1bad162e9a5860b68a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.724651   431 tablet_replica.cc:333] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.725792   431 raft_consensus.cc:2243] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.726585   431 raft_consensus.cc:2272] T b719a12d310b46bf978e160558e7d6f5 P 338d817f94ee4c1bad162e9a5860b68a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.729382   431 tablet_replica.cc:333] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.736521   431 raft_consensus.cc:2243] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:31.737710   431 raft_consensus.cc:2272] T 25bf4151e41a48f3b21b94c95a02dcd4 P 338d817f94ee4c1bad162e9a5860b68a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:31.750942   431 tablet_replica.cc:333] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a: stopping tablet replica
I20260709 13:01:31.755187   431 raft_consensus.cc:2243] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:31.755993   431 raft_consensus.cc:2272] T bfbaf6c33e5b45ea9c75342b1011f209 P 338d817f94ee4c1bad162e9a5860b68a [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:32.016476  2406 connection.cc:573] client connection to 127.0.107.193:45751 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:01:32.333868  1518 auto_rebalancer.cc:629] Failed to schedule move for tablet cbe76ebe20be4546bed4f95e2ee090bd: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.469286  8627 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.470002  8627 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:32.478327  2406 leader_election.cc:336] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.481081  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:32.485244  2405 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:32.486316  8604 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:32.490621  8627 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:32.524221  8631 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.524837  8631 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.526916  8631 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:32.529259  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:32.537809  1686 leader_election.cc:336] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.538414  1686 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:32.554360  8631 raft_consensus.cc:2749] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:32.589540  8631 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.590173  8631 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.592372  8631 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:32.609067  8627 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.613181  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:32.617694  1686 leader_election.cc:336] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.609726  8627 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.618171  1686 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:32.618885  8631 raft_consensus.cc:2749] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:32.619969  8627 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:32.636185  8631 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.636770  8631 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.638569  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:32.640398  2406 leader_election.cc:336] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.641366  8631 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:32.640880  8632 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.642814  2405 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:32.644774  8604 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:32.644955  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:32.651460  8639 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.652011  8639 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:32.653537  1686 leader_election.cc:336] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.654026  1686 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:32.657785  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:32.659945  1721 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
I20260709 13:01:32.661037  8631 raft_consensus.cc:2749] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:32.656268  8639 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:32.646530  8632 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.664247  8632 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:32.664904  8627 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.669275  8627 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.671250  8627 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:32.665364  2405 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:32.672163  8627 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:32.672511  8627 raft_consensus.cc:493] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.667685  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:32.672840  8627 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:32.674312  1612 leader_election.cc:336] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.675263  1612 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:32.676561  8603 raft_consensus.cc:2749] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:32.677464  2406 leader_election.cc:336] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.679416  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:32.679980  1721 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:01:32.681581  2405 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:32.682395  8639 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:32.682775  8639 raft_consensus.cc:493] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.683136  8639 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:32.692169  8639 raft_consensus.cc:515] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.693410  8631 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
W20260709 13:01:32.693858  2406 leader_election.cc:336] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.695423  8627 raft_consensus.cc:515] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.698946  8631 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.700307  8627 leader_election.cc:290] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:32.701069  8631 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:32.702708  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:32.705102  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac93f5a09723490eaf799683a1582480" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:32.705662  1721 raft_consensus.cc:3060] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:32.709759  2406 leader_election.cc:336] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.710217  8627 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.710745  8627 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:32.711843  1686 leader_election.cc:336] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.712293  1686 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:32.712898  8627 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:32.713485  8636 raft_consensus.cc:2749] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:32.717468  8627 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.718096  8627 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.720391  8627 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:32.727057  8603 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.727605  8603 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.729424  8603 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:32.731417  1721 raft_consensus.cc:2468] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:01:32.732234  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:32.732771  2405 leader_election.cc:304] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:32.732877  1715 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 14.
W20260709 13:01:32.733532  2406 leader_election.cc:336] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:32.734067  2406 leader_election.cc:336] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.734143  8627 raft_consensus.cc:2804] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:32.734776  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:32.746486  8627 raft_consensus.cc:697] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:32.735209  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:32.732973  8631 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.747478  8627 consensus_queue.cc:237] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.748157  8631 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.749358  8604 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.749914  8604 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.750408  8631 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:32.737946  1612 leader_election.cc:336] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.752077  8604 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:32.753280  1612 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:32.754078  8603 raft_consensus.cc:2749] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:32.756500  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:32.757097  2446 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
I20260709 13:01:32.759323  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:32.762097  8636 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:32.762490  8636 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.762883  8636 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:32.766201  2406 leader_election.cc:336] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:32.766739  2406 leader_election.cc:336] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:32.772918  1686 leader_election.cc:336] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.776861  8603 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.777433  8603 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.739066  8639 leader_election.cc:290] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:32.735950  2405 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:32.779279  8603 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:32.779251  8639 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:32.782012  8639 raft_consensus.cc:493] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.782415  8639 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:32.784058  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:32.784432  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe76ebe20be4546bed4f95e2ee090bd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:32.784715  2446 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
I20260709 13:01:32.784981  1721 raft_consensus.cc:3060] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:32.787302  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:32.791399  8603 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.791888  8603 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.793668  8603 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:32.794529  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:32.795287  8603 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:32.795684  8603 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.797596  8603 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:32.802484  1612 leader_election.cc:336] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.803965  1470 catalog_manager.cc:5697] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 14 to 15, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.804988  8604 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.807826  8604 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.809789  8604 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:32.813086  8636 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.828356  8636 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:32.815018  8603 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.817184  8639 raft_consensus.cc:515] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.846446  8603 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:32.846694  8639 leader_election.cc:290] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:32.850230  1612 leader_election.cc:336] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.856456  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b66b7be226499cbd9e020d381c72b2" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:32.857100  2442 raft_consensus.cc:3060] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:32.866761  2442 raft_consensus.cc:2468] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 17.
I20260709 13:01:32.870725  1612 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:32.822372  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:32.871578  2446 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 18.
I20260709 13:01:32.805717  2405 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:32.872994  8639 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:32.873145  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 67497.8us
I20260709 13:01:32.831664  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a186179c799f4e53a8adf725dfd98a58" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 13:01:32.834805  2406 leader_election.cc:336] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.875689  2444 raft_consensus.cc:3060] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:32.836282  1686 leader_election.cc:336] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.878400  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6e5957876f24a868f3f2c49fcf5e759" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:32.878993  1715 raft_consensus.cc:3060] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:32.883050  2406 leader_election.cc:336] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.886731  8658 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.887320  8658 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.889690  8658 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:32.890738  8639 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.891153  2405 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:32.891302  8639 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.891934  8604 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:32.893411  8639 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:32.895037  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:32.895744  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:32.901597  2406 leader_election.cc:336] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:32.902248  2406 leader_election.cc:336] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.904570  8636 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.905160  8636 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.907330  8636 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:32.908272  1715 raft_consensus.cc:2468] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:01:32.910554  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:32.911146  2446 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 19.
I20260709 13:01:32.911751  2444 raft_consensus.cc:2468] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 17.
I20260709 13:01:32.912691  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:32.913511  1686 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:32.914872  8651 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:32.915102  8631 raft_consensus.cc:2804] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:32.915247  8651 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.915738  8651 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:32.919068  1686 leader_election.cc:336] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.921125  8631 raft_consensus.cc:697] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 17 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:32.922151  8631 consensus_queue.cc:237] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.922703  2405 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:32.923447  8604 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:32.924517  2405 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:32.926208  8664 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.928742  8658 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:32.929144  2405 leader_election.cc:304] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:32.928761  8664 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.927590  8651 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.818605  1721 raft_consensus.cc:2468] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 17.
I20260709 13:01:32.932313  8651 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:32.931749  8664 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:32.933557  1612 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 62906us
I20260709 13:01:32.934201  8661 raft_consensus.cc:2804] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:32.934795  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:32.935655  2446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691bccf09f2f475a98a7ab9cbbd1dd8d" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:32.939671  2446 raft_consensus.cc:3060] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:32.941001  1686 leader_election.cc:336] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:32.941615  1686 leader_election.cc:336] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.946444  2444 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 10.
I20260709 13:01:32.947887  1686 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:32.949041  8661 raft_consensus.cc:697] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:32.949244  8664 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:32.949690  8664 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:32.950129  8664 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:32.958297  8664 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.960671  8664 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:32.962340  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6b5add0ec94eccb0981a9bb10c79ef" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:32.972968  2444 raft_consensus.cc:3060] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:32.962256  8661 consensus_queue.cc:237] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.964825  2446 raft_consensus.cc:2468] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 20.
I20260709 13:01:32.965353  8658 raft_consensus.cc:2804] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:32.981820  8658 raft_consensus.cc:697] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:32.982807  8658 consensus_queue.cc:237] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.966552  2405 leader_election.cc:304] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 13:01:32.972007  1686 leader_election.cc:336] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:32.987272  1686 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:32.988058  8664 raft_consensus.cc:2804] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:32.988517  8664 raft_consensus.cc:697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 20 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:32.989342  8664 consensus_queue.cc:237] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:32.997097  8639 raft_consensus.cc:2804] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:32.997710  8639 raft_consensus.cc:697] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:32.998543  8639 consensus_queue.cc:237] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.008244  2444 raft_consensus.cc:2468] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 11.
I20260709 13:01:33.008944  1470 catalog_manager.cc:5697] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 14 to 15, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:33.014751  1686 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:33.016162  8651 raft_consensus.cc:2804] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:33.016758  8651 raft_consensus.cc:697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:33.017645  8651 consensus_queue.cc:237] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.024700  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:33.025414  1639 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
I20260709 13:01:33.030375  8658 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:33.031242  8658 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.034359  8658 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:33.030419  8604 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:33.035638  8604 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.037789  8604 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:33.038087  1470 catalog_manager.cc:5697] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 16 to 17, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:33.040057  2406 leader_election.cc:336] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:33.046413  2406 leader_election.cc:336] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:33.049288  1467 catalog_manager.cc:5697] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 16 to 17, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.053951  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:33.056494  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:33.058761  1715 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:01:33.059340  8603 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:33.059700  8603 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:33.060038  8603 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:33.067891  8603 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.069808  8603 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:33.084712  1612 leader_election.cc:336] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:33.092355  1470 catalog_manager.cc:5697] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 19 to 20, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 20 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.097191  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e78d031c384616a01064318cb24f28" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:33.097821  2444 raft_consensus.cc:3060] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:33.094887  1470 catalog_manager.cc:5697] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 10 to 11, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.114743  1467 catalog_manager.cc:5697] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 16 to 17, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:33.120059  2444 raft_consensus.cc:2468] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 19.
I20260709 13:01:33.120509  8658 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:33.130963  2405 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:33.164705  8658 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.144716  8604 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:33.166926  8604 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.187350  8604 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:33.188272  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:33.188921  1647 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
I20260709 13:01:33.171561  8627 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:33.170550  8636 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:33.194456  8627 raft_consensus.cc:493] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:33.207574  8627 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.215756  8658 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:33.216377  8673 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:33.217104  8673 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.209134  8632 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:33.225063  8673 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:33.225243  8632 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:33.235373  2406 leader_election.cc:336] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:33.236001  2406 leader_election.cc:336] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:33.238512  8632 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:33.245131  8627 raft_consensus.cc:515] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.206851  8636 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.252475  8636 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:33.255311  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:33.256289  2442 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 19.
I20260709 13:01:33.263151  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:33.265528  8675 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:33.266088  8675 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:33.266700  8675 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:33.270994  8627 leader_election.cc:290] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:33.272761  2406 leader_election.cc:336] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:33.277070  1686 leader_election.cc:336] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:33.283218  1611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 76877.3us
I20260709 13:01:33.293514  8675 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.304023  8675 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:33.288048  2405 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:33.306275  8627 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:33.306687  8627 raft_consensus.cc:493] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:33.307049  8627 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:33.307803  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9c43e38d20461f85176d58e01fc7a1" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:33.308398  2442 raft_consensus.cc:3060] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:33.311630  1612 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:33.313345  8676 raft_consensus.cc:2804] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:33.313823  8676 raft_consensus.cc:697] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:33.314667  8676 consensus_queue.cc:237] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.317397  2442 raft_consensus.cc:2468] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 20.
I20260709 13:01:33.326491  1686 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:33.327355  8675 raft_consensus.cc:2804] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:33.328366  8675 raft_consensus.cc:697] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 20 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:33.329322  8675 consensus_queue.cc:237] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:33.331624  1612 leader_election.cc:336] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:33.332221  1686 leader_election.cc:336] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:33.333129  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:33.333767  2444 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 16.
I20260709 13:01:33.335330  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:33.336114  2444 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 22.
I20260709 13:01:33.340517  1715 raft_consensus.cc:1275] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:33.358235  1467 catalog_manager.cc:5697] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 19 to 20, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 20 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.363309  8627 raft_consensus.cc:515] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:33.366371  2406 consensus_peers.cc:597] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:33.371109  1612 leader_election.cc:336] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:33.375185  1715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d2c95439be4ced872760603b0ae02b" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:33.378398  1715 raft_consensus.cc:3060] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.384179  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:33.385020  8676 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:33.385352  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:33.385399  8676 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:33.386209  8676 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:33.387758  8603 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:33.388137  8603 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:33.388479  8603 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:33.389410  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
I20260709 13:01:33.391001  1639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208" is_pre_election: true
W20260709 13:01:33.392371  2406 leader_election.cc:336] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:33.403191  8603 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.404328  1639 raft_consensus.cc:2393] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 23: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:33.403046  8676 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.407470  1642 raft_consensus.cc:2393] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 17: Already voted for candidate a4be9cc90aca4dd4ad7db103062a7208 in this term.
I20260709 13:01:33.408635  8676 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:33.409385  8603 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 23 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:33.409754  1686 consensus_peers.cc:597] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:33.414623  1612 leader_election.cc:336] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:33.419796  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc72a09ffebe49218d3a2f9d4e0bcc45" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:33.420408  2442 raft_consensus.cc:3060] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:33.424628  2444 raft_consensus.cc:1275] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:01:33.426366  8664 consensus_queue.cc:1048] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:01:33.427312  2442 raft_consensus.cc:2468] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 17.
W20260709 13:01:33.431910  2406 consensus_peers.cc:597] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:33.431995  2444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf4151e41a48f3b21b94c95a02dcd4" candidate_uuid: "a4be9cc90aca4dd4ad7db103062a7208" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:33.432786  2444 raft_consensus.cc:3060] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:33.436451  8658 consensus_queue.cc:1048] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:33.439332  2444 raft_consensus.cc:2468] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4be9cc90aca4dd4ad7db103062a7208 in term 23.
W20260709 13:01:33.443176  2406 consensus_peers.cc:597] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:33.443989  2446 raft_consensus.cc:1275] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:01:33.445482  8664 consensus_queue.cc:1048] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:33.445150  1467 catalog_manager.cc:5697] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 18 to 19, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.452806  1612 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:33.453680  8603 raft_consensus.cc:2804] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:33.454227  8603 raft_consensus.cc:697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:33.455021  8603 consensus_queue.cc:237] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.455345  1715 raft_consensus.cc:2468] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 13.
I20260709 13:01:33.458865  1612 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 
I20260709 13:01:33.459599  8676 raft_consensus.cc:2804] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:33.460096  8676 raft_consensus.cc:697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 23 LEADER]: Becoming Leader. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Running, Role: LEADER
I20260709 13:01:33.460952  8676 consensus_queue.cc:237] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.461962  8627 leader_election.cc:290] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:33.486311  1612 leader_election.cc:336] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:33.487471  1612 leader_election.cc:336] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:33.496599  1686 consensus_peers.cc:597] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:33.560359  2444 raft_consensus.cc:1275] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:33.567806  8676 consensus_queue.cc:1048] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:33.467814  2405 leader_election.cc:304] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:33.578387  8674 raft_consensus.cc:2804] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:33.579082  8674 raft_consensus.cc:697] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:33.580196  8674 consensus_queue.cc:237] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:33.596446  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43271, user_credentials={real_user=slave}} blocked reactor thread for 128688us
I20260709 13:01:33.597543  2405 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
W20260709 13:01:33.629074  2406 consensus_peers.cc:597] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:33.636375  2406 consensus_peers.cc:597] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:33.621830  8677 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:33.639217  8677 raft_consensus.cc:493] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 338d817f94ee4c1bad162e9a5860b68a)
I20260709 13:01:33.639606  8677 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:33.640168  2405 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:33.641347  2405 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:33.642490  8604 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:33.642637  8674 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:33.652052  1467 catalog_manager.cc:5697] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 16 to 17, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.654250  1467 catalog_manager.cc:5697] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 reported cstate change: term changed from 22 to 23, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194). New cstate: current_term: 23 leader_uuid: "a4be9cc90aca4dd4ad7db103062a7208" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:33.662360  8692 log.cc:927] Time spent T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.057s	user 0.003s	sys 0.003s
W20260709 13:01:33.662914  8683 log.cc:927] Time spent T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8: Append to log took a long time: real 0.183s	user 0.007s	sys 0.016s
W20260709 13:01:33.670110  1612 consensus_peers.cc:597] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:33.673142  2447 raft_consensus.cc:1275] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:01:33.677253  8684 log.cc:927] Time spent T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.192s	user 0.005s	sys 0.017s
W20260709 13:01:33.677215  8685 log.cc:927] Time spent T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: Append to log took a long time: real 0.126s	user 0.005s	sys 0.000s
I20260709 13:01:33.689682  1721 raft_consensus.cc:1275] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:01:33.693153  1721 raft_consensus.cc:1275] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:33.702003  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36627e4c13c74e8a9fd501f26c7aff53" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:33.708330  1642 raft_consensus.cc:3060] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:33.713004  1686 consensus_peers.cc:597] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:33.713622  1686 consensus_peers.cc:597] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:33.722153  8677 raft_consensus.cc:515] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:33.724428  8677 leader_election.cc:290] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Requested vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:33.739917  1642 raft_consensus.cc:2468] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 17.
I20260709 13:01:33.752223  1638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a0e244d11c4ffe96ee4a663e2c69c8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a4be9cc90aca4dd4ad7db103062a7208"
I20260709 13:01:33.753008  1638 raft_consensus.cc:3060] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:33.758322  8651 consensus_queue.cc:1048] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
W20260709 13:01:33.783654  2406 consensus_peers.cc:597] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:33.784180  2406 leader_election.cc:336] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:33.795149  1686 consensus_peers.cc:597] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:33.795892  1686 consensus_peers.cc:597] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:33.796283  1686 consensus_peers.cc:597] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:33.798857  1612 consensus_peers.cc:597] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:33.802428  1612 consensus_peers.cc:597] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:33.808631  1638 raft_consensus.cc:2468] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
W20260709 13:01:33.813418  1686 consensus_peers.cc:597] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:33.813920  1686 consensus_peers.cc:597] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:33.832341  1686 consensus_peers.cc:597] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:33.847127  2444 raft_consensus.cc:1275] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:01:33.847607  1612 consensus_peers.cc:597] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:33.848790  8676 consensus_queue.cc:1048] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:01:33.856251  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 102402us
W20260709 13:01:33.856552  1686 consensus_peers.cc:597] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:33.859426  8604 consensus_queue.cc:1048] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:01:33.860910  8604 consensus_queue.cc:1048] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:01:33.863708  2406 consensus_peers.cc:597] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:33.874239  1612 consensus_peers.cc:597] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:33.877452  2447 raft_consensus.cc:1275] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:33.885203  8603 consensus_queue.cc:1048] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:01:33.885921  2406 consensus_peers.cc:597] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:33.892753  1467 catalog_manager.cc:5697] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 12 to 13, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:33.885886  1612 consensus_peers.cc:597] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:33.894541  1612 consensus_peers.cc:597] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:33.894541  2437 consensus_queue.cc:237] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: NON_VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { promote: true } }
W20260709 13:01:33.922178  2406 consensus_peers.cc:597] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:33.922266  2442 raft_consensus.cc:1275] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:01:33.938417  8675 consensus_queue.cc:1048] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:01:33.941883  1612 consensus_peers.cc:597] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:33.965709  2406 consensus_peers.cc:597] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:33.973369  2405 leader_election.cc:304] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:33.974203  8604 raft_consensus.cc:2804] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:33.974675  8604 raft_consensus.cc:697] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:33.975528  8604 consensus_queue.cc:237] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:33.982589  2406 consensus_peers.cc:597] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:33.985397  1612 consensus_peers.cc:597] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:33.999312  2405 leader_election.cc:304] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208; no voters: 338d817f94ee4c1bad162e9a5860b68a
I20260709 13:01:34.000200  8639 raft_consensus.cc:2804] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:34.000710  8639 raft_consensus.cc:697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:34.001606  8639 consensus_queue.cc:237] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:34.044740  1612 consensus_peers.cc:597] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:34.055186  1686 consensus_peers.cc:597] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:34.069931  2442 raft_consensus.cc:1275] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Refusing update from remote peer a4be9cc90aca4dd4ad7db103062a7208: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:01:34.072533  8676 consensus_queue.cc:1048] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:01:34.090528  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 85108.9us
I20260709 13:01:34.092764  1721 raft_consensus.cc:1275] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:01:34.103138  2406 consensus_peers.cc:597] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.110605  1612 consensus_peers.cc:597] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.116768  2406 consensus_peers.cc:597] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.123881  1686 consensus_peers.cc:597] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.137004  1612 consensus_peers.cc:597] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:34.150782  8627 consensus_queue.cc:1048] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:34.160804  1721 raft_consensus.cc:1275] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:01:34.172827  2405 consensus_peers.cc:597] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:34.179932  2406 consensus_peers.cc:597] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.180330  1612 consensus_peers.cc:597] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:34.187621  8604 consensus_queue.cc:1048] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:34.203117  1721 raft_consensus.cc:2955] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 4 to 13, NON_VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: NON_VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { promote: true } } }
I20260709 13:01:34.201418  8604 raft_consensus.cc:2955] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 4 to 13, NON_VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: NON_VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { promote: true } } }
W20260709 13:01:34.233795  2406 consensus_peers.cc:597] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:34.367470  2406 consensus_peers.cc:597] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.384688  1686 consensus_peers.cc:597] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:34.663393  1467 catalog_manager.cc:5697] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 16 to 17, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:34.665349  1467 catalog_manager.cc:5697] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 15 to 16, leader changed from 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:34.856850  8735 ts_tablet_manager.cc:933] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Initiating tablet copy from peer 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:34.871420  1647 raft_consensus.cc:1275] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:34.872200  1642 raft_consensus.cc:1275] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:01:34.873893  8735 tablet_copy_client.cc:323] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.196:39297
I20260709 13:01:34.875929  2460 tablet_copy_service.cc:140] P 6f381117554e49bb816791ab0a10f2b8: Received BeginTabletCopySession request for tablet 8b24c881516c4da087ee25ab3682886b from peer a4be9cc90aca4dd4ad7db103062a7208 ({username='slave'} at 127.0.0.1:45120)
I20260709 13:01:34.876505  2460 tablet_copy_service.cc:161] P 6f381117554e49bb816791ab0a10f2b8: Beginning new tablet copy session on tablet 8b24c881516c4da087ee25ab3682886b from peer a4be9cc90aca4dd4ad7db103062a7208 at {username='slave'} at 127.0.0.1:45120: session id = a4be9cc90aca4dd4ad7db103062a7208-8b24c881516c4da087ee25ab3682886b
I20260709 13:01:34.889712  2460 tablet_copy_source_session.cc:215] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:34.905952  8735 ts_tablet_manager.cc:1916] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260709 13:01:34.909471  8658 consensus_queue.cc:1048] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:34.910775  8627 consensus_queue.cc:1048] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:01:34.925206  2406 consensus_peers.cc:597] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.929474  2406 consensus_peers.cc:597] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:34.931715  2406 consensus_peers.cc:597] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:34.942251  1467 catalog_manager.cc:5697] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: config changed from index 4 to 13, NON_VOTER a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) added. New cstate: current_term: 15 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: NON_VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:34.968348  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 48667us
I20260709 13:01:34.986521  8735 ts_tablet_manager.cc:1929] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.3
I20260709 13:01:34.989097  8735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b24c881516c4da087ee25ab3682886b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.006628  8735 tablet_copy_client.cc:806] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:35.007315  8735 tablet_copy_client.cc:670] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:35.012111  8735 tablet_copy_client.cc:538] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:35.029953  8735 tablet_bootstrap.cc:492] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap starting.
I20260709 13:01:35.058444   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:01:35.153338  8735 tablet_bootstrap.cc:492] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:35.154843  8735 tablet_bootstrap.cc:492] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Bootstrap complete.
I20260709 13:01:35.155829  8735 ts_tablet_manager.cc:1403] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Time spent bootstrapping tablet: real 0.126s	user 0.048s	sys 0.008s
I20260709 13:01:35.158965  8735 raft_consensus.cc:359] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: NON_VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { promote: true } }
I20260709 13:01:35.159904  8735 raft_consensus.cc:740] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: a4be9cc90aca4dd4ad7db103062a7208, State: Initialized, Role: LEARNER
I20260709 13:01:35.160647  8735 consensus_queue.cc:260] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } attrs { replace: true } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: NON_VOTER last_known_addr { host: "127.0.107.194" port: 45463 } attrs { promote: true } }
I20260709 13:01:35.163833  8735 ts_tablet_manager.cc:1434] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:01:35.170202  2460 tablet_copy_service.cc:342] P 6f381117554e49bb816791ab0a10f2b8: Request end of tablet copy session a4be9cc90aca4dd4ad7db103062a7208-8b24c881516c4da087ee25ab3682886b received from {username='slave'} at 127.0.0.1:45120
I20260709 13:01:35.170730  2460 tablet_copy_service.cc:434] P 6f381117554e49bb816791ab0a10f2b8: ending tablet copy session a4be9cc90aca4dd4ad7db103062a7208-8b24c881516c4da087ee25ab3682886b on tablet 8b24c881516c4da087ee25ab3682886b with peer a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:35.280789  1642 raft_consensus.cc:1217] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.12->[15.13-15.13]   Dedup: 15.13->[]
I20260709 13:01:35.370401   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:01:35.438874  2405 consensus_peers.cc:597] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:35.439836  2405 consensus_peers.cc:597] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:35.449379  2405 consensus_peers.cc:597] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:35.449632  1685 consensus_peers.cc:597] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:35.450240  2405 consensus_peers.cc:597] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:35.457947  1685 consensus_peers.cc:597] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:35.461335  2405 consensus_peers.cc:597] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.502391   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:01:35.503103  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc780 after lost signal to thread 434
I20260709 13:01:35.504204   431 tablet_replica.cc:333] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.505340   431 raft_consensus.cc:2243] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEARNER]: Raft consensus shutting down.
I20260709 13:01:35.505898   431 raft_consensus.cc:2272] T 8b24c881516c4da087ee25ab3682886b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEARNER]: Raft consensus is shut down!
W20260709 13:01:35.504314  1668 debug-util.cc:398] Leaking SignalData structure 0x7b0800229340 after lost signal to thread 1504
W20260709 13:01:35.507828  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08003472e0 after lost signal to thread 1671
W20260709 13:01:35.508884  1668 debug-util.cc:398] Leaking SignalData structure 0x7b0800357160 after lost signal to thread 1745
I20260709 13:01:35.509083   431 tablet_replica.cc:333] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
W20260709 13:01:35.510099  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08002c5c20 after lost signal to thread 2477
I20260709 13:01:35.510114   431 raft_consensus.cc:2243] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:35.510787  1668 debug-util.cc:398] Leaking SignalData structure 0x7b08002ffb20 after lost signal to thread 8659
I20260709 13:01:35.511075   431 raft_consensus.cc:2272] T 681214f01c5b4fc6a0aa493b2382c01f P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.513756   431 tablet_replica.cc:333] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.514599   431 raft_consensus.cc:2243] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.515847   431 raft_consensus.cc:2272] T b47cff236bac4d2fae5f94a61502aec7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:35.521025  2405 consensus_peers.cc:597] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.523847   431 tablet_replica.cc:333] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.524773   431 raft_consensus.cc:2243] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.525424   431 raft_consensus.cc:2272] T a057e47a0fca4295957540c192996970 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.527957   431 tablet_replica.cc:333] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.528767   431 raft_consensus.cc:2243] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.529354   431 raft_consensus.cc:2272] T 59f8a3d26bbd4c18a7d64b7584debff6 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.532222   431 tablet_replica.cc:333] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.533066   431 raft_consensus.cc:2243] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.534312   431 raft_consensus.cc:2272] T 02b66b7be226499cbd9e020d381c72b2 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.536834   431 tablet_replica.cc:333] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.537699   431 raft_consensus.cc:2243] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.538435   431 raft_consensus.cc:2272] T e519a89ee28c45f98d4fe9c4bfea4baf P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.540812   431 tablet_replica.cc:333] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.541673   431 raft_consensus.cc:2243] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.542712   431 raft_consensus.cc:2272] T 289133b3cbb949f4967bbf24c6b14e19 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.545181   431 tablet_replica.cc:333] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.545984   431 raft_consensus.cc:2243] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.546695   431 raft_consensus.cc:2272] T 478c3696a6364c18a8ebef13ff075bfa P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.549399   431 tablet_replica.cc:333] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.550189   431 raft_consensus.cc:2243] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.550760   431 raft_consensus.cc:2272] T e28f3d3a9bc24be6b8fc4d90754cdfac P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.553577   431 tablet_replica.cc:333] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.554419   431 raft_consensus.cc:2243] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.555501   431 raft_consensus.cc:2272] T f283aa8c9b4a40729ec5fde1481234a1 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.558085   431 tablet_replica.cc:333] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.558873   431 raft_consensus.cc:2243] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.561981   431 raft_consensus.cc:2272] T e5316a1e4f014102b1770c3f8b08410b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.564615   431 tablet_replica.cc:333] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.565456   431 raft_consensus.cc:2243] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.566196   431 raft_consensus.cc:2272] T 31e1751f20084c868e4ad6251ca38954 P a4be9cc90aca4dd4ad7db103062a7208 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.568790   431 tablet_replica.cc:333] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
W20260709 13:01:35.569109  1685 consensus_peers.cc:597] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.569548   431 raft_consensus.cc:2243] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.570254   431 raft_consensus.cc:2272] T eae5b8a8b4f14989a2565077fe8be235 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.572700   431 tablet_replica.cc:333] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.573489   431 raft_consensus.cc:2243] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.574635   431 raft_consensus.cc:2272] T c55d053b55024621933828292867f0e6 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.577178   431 tablet_replica.cc:333] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.578039   431 raft_consensus.cc:2243] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.578647   431 raft_consensus.cc:2272] T e13ac9e112d84ff79c9ea7f4762a82ab P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.581291   431 tablet_replica.cc:333] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.582149   431 raft_consensus.cc:2243] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.582753   431 raft_consensus.cc:2272] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.585224   431 tablet_replica.cc:333] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.585988   431 raft_consensus.cc:2243] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.586740   431 raft_consensus.cc:2272] T b8c2c21bc6aa4835b68933c89735091f P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.589347   431 tablet_replica.cc:333] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.590426   431 raft_consensus.cc:2243] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.591531   431 raft_consensus.cc:2272] T e0a2b0ee304d42d18cbe5fa6ca66804b P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.593988   431 tablet_replica.cc:333] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.594802   431 raft_consensus.cc:2243] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:01:35.594934  1685 consensus_peers.cc:597] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.595949   431 raft_consensus.cc:2272] T a2e78d031c384616a01064318cb24f28 P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.598483   431 tablet_replica.cc:333] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.599268   431 raft_consensus.cc:2243] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.600327   431 raft_consensus.cc:2272] T b968f124f3854f20bff4af609192c41a P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.604589   431 tablet_replica.cc:333] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.605482   431 raft_consensus.cc:2243] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.606155   431 raft_consensus.cc:2272] T ff20dea159284907b41e95b640800f50 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.608937   431 tablet_replica.cc:333] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.609696   431 raft_consensus.cc:2243] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.610311   431 raft_consensus.cc:2272] T 5a129c637a374138850dc8acf679f4bd P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.619120   431 tablet_replica.cc:333] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.619956   431 raft_consensus.cc:2243] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.620570   431 raft_consensus.cc:2272] T 36a0e244d11c4ffe96ee4a663e2c69c8 P a4be9cc90aca4dd4ad7db103062a7208 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.625933   431 tablet_replica.cc:333] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.626889   431 raft_consensus.cc:2243] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.627533   431 raft_consensus.cc:2272] T 71dad2e408414d2fa4f055c6eccf5b92 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.630227   431 tablet_replica.cc:333] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.630987   431 raft_consensus.cc:2243] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.632334   431 raft_consensus.cc:2272] T beabe4568b4d481bac560939dd7f8258 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.635317   431 tablet_replica.cc:333] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.636080   431 raft_consensus.cc:2243] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.637105   431 raft_consensus.cc:2272] T daf4ad4ac54a4a228481863e56e53d54 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.639827   431 tablet_replica.cc:333] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.640571   431 raft_consensus.cc:2243] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.643018   431 raft_consensus.cc:2272] T 681b2518696f44d99824827761c9c9f1 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.648687   431 tablet_replica.cc:333] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.649515   431 raft_consensus.cc:2243] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.650545   431 raft_consensus.cc:2272] T 61b3acddedfe43b6b7d1a8f74c050925 P a4be9cc90aca4dd4ad7db103062a7208 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:35.655166  1685 consensus_peers.cc:597] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.655982   431 tablet_replica.cc:333] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.656826   431 raft_consensus.cc:2243] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.658032   431 raft_consensus.cc:2272] T f4986d58f61a45638a1088287c2004d8 P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:35.663852  2405 consensus_peers.cc:597] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:35.714496  1685 consensus_peers.cc:597] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:35.715397  1685 consensus_peers.cc:597] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.720194   431 tablet_replica.cc:333] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
W20260709 13:01:35.721639  2405 consensus_peers.cc:597] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.723943   431 raft_consensus.cc:2243] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.726192   431 raft_consensus.cc:2272] T 016c9143ad3147438e814f92f2090928 P a4be9cc90aca4dd4ad7db103062a7208 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.728981   431 tablet_replica.cc:333] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.748915   431 raft_consensus.cc:2243] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.749989   431 raft_consensus.cc:2272] T 25bf4151e41a48f3b21b94c95a02dcd4 P a4be9cc90aca4dd4ad7db103062a7208 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.752712   431 tablet_replica.cc:333] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.753780   431 raft_consensus.cc:2243] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.754699   431 raft_consensus.cc:2272] T 4b724690541549b4be895303885a0998 P a4be9cc90aca4dd4ad7db103062a7208 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.757594   431 tablet_replica.cc:333] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.758388   431 raft_consensus.cc:2243] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.765136   431 raft_consensus.cc:2272] T b719a12d310b46bf978e160558e7d6f5 P a4be9cc90aca4dd4ad7db103062a7208 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.768163   431 tablet_replica.cc:333] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.769193   431 raft_consensus.cc:2243] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.770553   431 raft_consensus.cc:2272] T bc72a09ffebe49218d3a2f9d4e0bcc45 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:35.782124  2405 consensus_peers.cc:597] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:35.783170  1685 consensus_peers.cc:597] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.791157   431 tablet_replica.cc:333] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
W20260709 13:01:35.791705  1685 consensus_peers.cc:597] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.791970   431 raft_consensus.cc:2243] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.792675   431 raft_consensus.cc:2272] T 5c79f18b2f4247348564b91d430d6124 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.795267   431 tablet_replica.cc:333] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.802009   431 raft_consensus.cc:2243] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.802678   431 raft_consensus.cc:2272] T 95165be2dd8c456fb98e088711372ce3 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.806705   431 tablet_replica.cc:333] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.816658   431 raft_consensus.cc:2243] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.817981   431 raft_consensus.cc:2272] T e93b49f668f7487dad07043590a5616f P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.821177   431 tablet_replica.cc:333] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.830302   431 raft_consensus.cc:2243] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.831523   431 raft_consensus.cc:2272] T b7404e443f1f4264bb8ea4e04b8e8627 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:35.833033  2405 consensus_peers.cc:597] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:35.825188  1685 consensus_peers.cc:597] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.840754   431 tablet_replica.cc:333] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.841516   431 raft_consensus.cc:2243] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.842033   431 raft_consensus.cc:2272] T 4a6fdab08a024ae6999ae0a520cd1cd0 P a4be9cc90aca4dd4ad7db103062a7208 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.844445   431 tablet_replica.cc:333] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
W20260709 13:01:35.844746  1685 consensus_peers.cc:597] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:35.845443  2405 consensus_peers.cc:597] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:35.855015  2405 consensus_peers.cc:597] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.857501   431 raft_consensus.cc:2243] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.858203   431 raft_consensus.cc:2272] T 36627e4c13c74e8a9fd501f26c7aff53 P a4be9cc90aca4dd4ad7db103062a7208 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.861336   431 tablet_replica.cc:333] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.862035   431 raft_consensus.cc:2243] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.862732   431 raft_consensus.cc:2272] T a4b97ee9bb5742b6a7bfc576360314c5 P a4be9cc90aca4dd4ad7db103062a7208 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.865303   431 tablet_replica.cc:333] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
I20260709 13:01:35.866178   431 raft_consensus.cc:2243] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:35.867347   431 raft_consensus.cc:2272] T cc8f7aca67ac4df5b6f0b4f41d538dfd P a4be9cc90aca4dd4ad7db103062a7208 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:35.871860   431 tablet_replica.cc:333] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208: stopping tablet replica
W20260709 13:01:35.879315  1685 consensus_peers.cc:597] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:35.880823   431 raft_consensus.cc:2243] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:35.881655   431 raft_consensus.cc:2272] T 2033b178bcb643fd84ac0d1ae7e6a64b P a4be9cc90aca4dd4ad7db103062a7208 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:35.890446  2405 consensus_peers.cc:597] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:36.221884  2406 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111) [suppressed 412 similar messages]
I20260709 13:01:36.623060  8627 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.623723  8627 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:36.628675  8631 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.629235  8631 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:36.636438  8627 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:36.645656  2405 leader_election.cc:336] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:36.685794  8759 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.686641  8759 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:36.690400  8631 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:36.751215  1686 consensus_peers.cc:597] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:36.751945  1686 consensus_peers.cc:597] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:36.752449  1686 consensus_peers.cc:597] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:36.753050  1686 consensus_peers.cc:597] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:36.757720  1686 consensus_peers.cc:597] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:36.758210  1686 consensus_peers.cc:597] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:36.750119  8753 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.772145  8627 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.778522  8627 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:36.789633  8627 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:36.794097  8696 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.794701  8696 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:36.795336  2406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45751, user_credentials={real_user=slave}} blocked reactor thread for 572056us
I20260709 13:01:36.796720  8696 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:36.781479  8753 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:36.802744  8761 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.803319  8761 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:36.805750  8761 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:36.806898  8759 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:36.807802  8631 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.808347  8631 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:36.789331  8757 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.810571  8757 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:36.813244  8757 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:36.813315  8631 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:36.797020  8756 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.817216  8756 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:36.823848  8756 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:36.828581  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 62126.8us
W20260709 13:01:36.846477  2405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45463, user_credentials={real_user=slave}} blocked reactor thread for 52906.2us
I20260709 13:01:36.801939  8753 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:36.894956  8759 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.900890  8759 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:36.903095  8759 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:36.908453  8751 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.909161  8751 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:36.911739  8751 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:36.915413  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:36.916524  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:36.922258  2442 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 15.
W20260709 13:01:36.922672  1686 leader_election.cc:336] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:36.922420  2447 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 12.
W20260709 13:01:36.933099  1686 consensus_peers.cc:597] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:36.935452  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:36.936262  2447 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 17.
I20260709 13:01:36.940587  1686 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:36.943548  1686 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:36.950543  8763 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:36.951062  8763 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.951406  8763 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:36.976707  8753 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.977494  8753 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:36.978410  8758 raft_consensus.cc:493] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:36.978541  8751 raft_consensus.cc:493] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f381117554e49bb816791ab0a10f2b8)
I20260709 13:01:36.979228  8751 raft_consensus.cc:515] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:36.978406  2406 consensus_peers.cc:597] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:36.980278  8753 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:36.992795  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
W20260709 13:01:36.993468  1612 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3818) could send its response
I20260709 13:01:36.981491  8751 leader_election.cc:290] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:36.979171  8758 raft_consensus.cc:515] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:36.994741  1612 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3819) could send its response
I20260709 13:01:36.995564  8758 leader_election.cc:290] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:36.996919  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:36.996748  8763 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:36.997535  1717 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 17.
I20260709 13:01:36.982839  8748 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:36.998543  8748 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:36.980849  2406 consensus_peers.cc:597] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:36.999693  2406 leader_election.cc:336] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:36.992452  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:36.992828  8759 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.000591  8748 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:37.000381  8759 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:36.993585  1718 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:01:36.993726  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:36.980939  8764 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.002355  1719 raft_consensus.cc:2393] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 16: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:36.968586  8762 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.002393  8764 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:37.003388  8748 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:37.003805  8748 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.003902  1714 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 18.
I20260709 13:01:37.004197  8748 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:37.004799  8764 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:37.005791  8762 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:37.006372  8696 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.006886  8696 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:37.007313  2405 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:37.008244  8750 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:37.008476  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:37.008950  8696 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:37.008630  8750 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.009438  8696 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:37.009641  2405 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:37.009658  8750 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:37.010568  8627 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:37.009874  8696 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.010893  8627 raft_consensus.cc:493] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.011170  8696 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:37.011307  8627 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:37.018340  1686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39297, user_credentials={real_user=slave}} blocked reactor thread for 74885.4us
I20260709 13:01:37.018280  8627 raft_consensus.cc:515] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:37.019253  1686 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:37.019723  8750 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:37.000051  2406 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.020550  8762 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:37.021991  8658 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:37.025799  8750 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:37.027367  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:37.020371  8627 leader_election.cc:290] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:36.995592  1612 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3820) could send its response
I20260709 13:01:37.028119  8748 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:37.028903  8764 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:37.024309  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:37.042505  8764 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 13:01:37.042799  1612 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3821) could send its response
I20260709 13:01:37.042979  8764 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:37.043722  1612 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3822) could send its response
W20260709 13:01:37.044515  1612 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3823) could send its response
W20260709 13:01:37.045241  1612 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3824) could send its response
W20260709 13:01:37.046342  1612 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3825) could send its response
W20260709 13:01:37.047190  1612 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3826) could send its response
W20260709 13:01:37.047979  1612 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3827) could send its response
W20260709 13:01:37.048776  1612 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3828) could send its response
I20260709 13:01:37.032943  8763 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:37.033685  8696 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:37.038228  2442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "478c3696a6364c18a8ebef13ff075bfa" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:37.039727  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd7e524e66b45d5a5c823f1a5224351" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:37.040542  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c55d053b55024621933828292867f0e6" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
W20260709 13:01:37.051571  1685 leader_election.cc:336] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: recv got EOF from 127.0.107.194:45463 (error 108)
I20260709 13:01:37.051821  2437 raft_consensus.cc:2393] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 19: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:37.051999  1685 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:37.022223  2406 consensus_peers.cc:597] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:37.042622  1714 raft_consensus.cc:3060] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:37.054620  2406 consensus_peers.cc:597] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.055146  2406 consensus_peers.cc:597] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:37.056648  8763 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:37.002888  8759 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:37.059926  8764 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:37.063024  1714 raft_consensus.cc:2468] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 19.
I20260709 13:01:37.064903  8759 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.071537  1719 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 18: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
I20260709 13:01:37.071424  8759 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:37.072474  8764 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:37.073496  8759 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:37.065418  1685 leader_election.cc:336] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:37.065917  2405 connection.cc:573] client connection to 127.0.107.194:45463 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:01:37.066489  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:37.076062  1718 raft_consensus.cc:2393] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f381117554e49bb816791ab0a10f2b8 in current term 13: Already voted for candidate 66344ad7cd844754b2c81cc689a709b0 in this term.
W20260709 13:01:37.067395   431 connection.cc:466] server connection from 127.0.0.1:38584 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38584 (request call id 2035) could send its response
W20260709 13:01:37.076865  2406 consensus_peers.cc:597] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:37.076956   431 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3804) could send its response
W20260709 13:01:37.077530  2406 leader_election.cc:336] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:37.068938  8696 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:37.070668  1686 consensus_peers.cc:597] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.077574   431 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3805) could send its response
W20260709 13:01:37.078619   431 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3806) could send its response
W20260709 13:01:37.079067  2405 leader_election.cc:336] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:01:37.079141   431 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3807) could send its response
W20260709 13:01:37.079878   431 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3808) could send its response
W20260709 13:01:37.080235  2405 leader_election.cc:336] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:01:37.080358   431 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3809) could send its response
W20260709 13:01:37.080891   431 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3810) could send its response
W20260709 13:01:37.080955  2405 leader_election.cc:336] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:01:37.081424   431 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3811) could send its response
W20260709 13:01:37.081936   431 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3812) could send its response
W20260709 13:01:37.084297   431 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3813) could send its response
I20260709 13:01:37.084713  2405 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
W20260709 13:01:37.084822   431 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3814) could send its response
I20260709 13:01:37.068527  8748 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:37.085554   431 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3815) could send its response
W20260709 13:01:37.085980  1685 leader_election.cc:336] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:37.086165   431 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36708 (request call id 3816) could send its response
W20260709 13:01:37.086545  1685 leader_election.cc:336] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:37.086798   431 connection.cc:466] server connection from 127.0.0.1:36708 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36708 (request call id 3817) could send its response
W20260709 13:01:37.087276  1685 leader_election.cc:336] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:37.087869  1685 leader_election.cc:336] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:37.088153  2406 leader_election.cc:336] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:37.088909  1686 consensus_peers.cc:597] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.088630  2405 leader_election.cc:336] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:37.089534  1686 leader_election.cc:336] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:37.090838  8696 raft_consensus.cc:2804] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:37.091310  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.092370  8696 raft_consensus.cc:697] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 19 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:37.092765  8627 raft_consensus.cc:3060] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:37.093350  8696 consensus_queue.cc:237] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:37.098114  1686 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:37.098672  2406 leader_election.cc:336] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:37.098934  1686 leader_election.cc:336] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:37.099212  2406 consensus_peers.cc:597] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:37.099339  1686 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:37.089470  1685 leader_election.cc:336] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:37.100447  1685 leader_election.cc:336] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:37.100912  1685 leader_election.cc:336] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:37.101361  1685 leader_election.cc:336] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:37.100032  8764 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:37.102136  8748 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:37.105374  1685 leader_election.cc:336] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:37.106020  1685 leader_election.cc:336] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:37.106525  1685 leader_election.cc:336] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:37.102388  1686 leader_election.cc:336] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:37.102922  8627 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:37.103404  2405 leader_election.cc:336] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:37.112046  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.112382  2405 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.113019  8764 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:01:37.113263  2405 leader_election.cc:336] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:37.113721  2405 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:37.114547  2405 leader_election.cc:336] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:37.115105  8759 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:37.115291  8627 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:37.115144  2405 leader_election.cc:336] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:37.116269  2405 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:37.117199  2405 leader_election.cc:336] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:37.117677  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.118577  8759 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:37.119189  8759 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:37.121850  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4986d58f61a45638a1088287c2004d8" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
W20260709 13:01:37.122416  1685 leader_election.cc:336] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:37.122908  1685 leader_election.cc:336] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:37.133617  1468 catalog_manager.cc:5697] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 18 to 19, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:37.136773  2437 raft_consensus.cc:2468] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 16.
W20260709 13:01:37.139801  2405 leader_election.cc:336] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:37.140362  2405 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.141125  8750 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:37.143476  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:37.144533  2437 raft_consensus.cc:2393] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 13: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
I20260709 13:01:37.148067  1686 leader_election.cc:304] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.148834  8764 raft_consensus.cc:2749] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:37.149582  1686 leader_election.cc:304] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.149700  8750 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.150418  8750 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:37.151549  8766 raft_consensus.cc:2749] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:37.152858  8750 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:37.150811  1686 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.154870  8766 raft_consensus.cc:2804] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:37.155609  8748 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.156072  8748 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:37.155359  8766 raft_consensus.cc:697] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:37.162386  8748 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:37.161449  8766 consensus_queue.cc:237] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:37.163558  2406 consensus_peers.cc:597] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:37.166033  2406 consensus_peers.cc:597] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.169935  1685 leader_election.cc:336] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:37.172782  1686 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:37.172976  2406 leader_election.cc:336] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:37.174362  8748 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:01:37.175410  2405 leader_election.cc:336] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:37.175951  2405 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.176688  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:37.176780  8750 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:37.177445  2437 raft_consensus.cc:2393] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 18: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
W20260709 13:01:37.186786  1686 consensus_peers.cc:597] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.187701  1686 leader_election.cc:336] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:37.188208  1686 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.192020  8766 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:37.192751  8750 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.192839  1467 catalog_manager.cc:5697] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 15 to 16, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:37.193500  8750 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:37.195689  8750 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:37.197422  1686 leader_election.cc:336] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:37.197949  1686 leader_election.cc:304] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, 6f381117554e49bb816791ab0a10f2b8
I20260709 13:01:37.198747  8766 raft_consensus.cc:2749] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:37.199785  1686 leader_election.cc:336] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:37.200223  1686 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.200350  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:37.201015  8766 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:37.201054  1718 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 15.
W20260709 13:01:37.205417  1686 leader_election.cc:336] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:37.207906  2405 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:37.211478  8627 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:37.211838  8627 raft_consensus.cc:493] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.212162  8627 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:37.214965  2405 leader_election.cc:336] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:37.210988  1686 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.221029  8766 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:37.223286  8764 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.223803  8764 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:37.224653  8627 raft_consensus.cc:515] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:37.226992  1686 consensus_peers.cc:597] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.227831  1686 consensus_peers.cc:597] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.228305  1686 consensus_peers.cc:597] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:37.228869  1686 consensus_peers.cc:597] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.232447  1685 leader_election.cc:336] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:37.225930  8764 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
W20260709 13:01:37.253388  2406 consensus_peers.cc:597] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:37.257122  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8f7aca67ac4df5b6f0b4f41d538dfd" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:37.226419  8627 leader_election.cc:290] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:37.257754  1718 raft_consensus.cc:3060] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:37.267253  1718 raft_consensus.cc:2468] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 16.
W20260709 13:01:37.271464  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08002f1920 after lost signal to thread 434
W20260709 13:01:37.272899  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08002f5e40 after lost signal to thread 1504
W20260709 13:01:37.273663  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08000bce40 after lost signal to thread 1671
I20260709 13:01:37.274606  8750 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
W20260709 13:01:37.274925  1742 debug-util.cc:398] Leaking SignalData structure 0x7b0800115fa0 after lost signal to thread 1745
I20260709 13:01:37.275152  8750 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:37.276325  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd520 after lost signal to thread 2477
W20260709 13:01:37.276803  1742 debug-util.cc:398] Leaking SignalData structure 0x7b08003c0980 after lost signal to thread 8653
I20260709 13:01:37.277225  8750 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:37.279289  2405 leader_election.cc:304] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:37.279976  8750 raft_consensus.cc:2804] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:37.280479  8750 raft_consensus.cc:697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:37.281387  8750 consensus_queue.cc:237] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:37.294273  2405 leader_election.cc:336] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:37.270982  2406 consensus_peers.cc:597] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:37.296167  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:37.298391  1718 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 11.
W20260709 13:01:37.304968  2405 leader_election.cc:336] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:37.306078  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.308305  8627 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:37.308678  8627 raft_consensus.cc:493] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:37.309031  8627 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.310590  1686 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:37.316316  2406 consensus_peers.cc:597] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:37.317220  8764 raft_consensus.cc:2749] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:37.317344  1467 catalog_manager.cc:5697] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 15 to 16, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:37.319602  8627 raft_consensus.cc:515] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:37.321672  8627 leader_election.cc:290] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Requested vote from peers 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:37.322975  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:37.323761  1718 raft_consensus.cc:3060] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.325618  2437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7404e443f1f4264bb8ea4e04b8e8627" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:37.326390  2437 raft_consensus.cc:2393] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66344ad7cd844754b2c81cc689a709b0 in current term 12: Already voted for candidate 6f381117554e49bb816791ab0a10f2b8 in this term.
W20260709 13:01:37.332216  2405 leader_election.cc:336] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:37.333271  1718 raft_consensus.cc:2468] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 12.
I20260709 13:01:37.341991  2405 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.343835  8627 raft_consensus.cc:2804] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:37.344578  8627 raft_consensus.cc:697] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:37.345417  8627 consensus_queue.cc:237] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:37.332331  1686 leader_election.cc:304] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 6f381117554e49bb816791ab0a10f2b8, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.352319  8762 raft_consensus.cc:2749] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:37.354743  1686 leader_election.cc:336] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:37.355255  1686 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:37.357013  8758 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:37.372898  1467 catalog_manager.cc:5697] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 11 to 12, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:37.447454  2406 consensus_peers.cc:597] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.464347  2406 consensus_peers.cc:597] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:37.506345  1718 raft_consensus.cc:1275] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:01:37.508082  8627 consensus_queue.cc:1048] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:01:37.535122  2405 consensus_peers.cc:597] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:37.669162  1685 consensus_peers.cc:597] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:37.707404  2406 consensus_peers.cc:597] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:37.740206  2405 consensus_peers.cc:597] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:37.761772  2406 consensus_peers.cc:597] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.772855  2406 consensus_peers.cc:597] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:37.780100  2437 raft_consensus.cc:1275] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Refusing update from remote peer 66344ad7cd844754b2c81cc689a709b0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:37.782857  8764 consensus_queue.cc:1048] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:01:37.813416  2406 consensus_peers.cc:597] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:37.822238  1718 raft_consensus.cc:1275] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:37.823824  8696 consensus_queue.cc:1048] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:37.842612  1718 raft_consensus.cc:1275] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Refusing update from remote peer 6f381117554e49bb816791ab0a10f2b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:37.844973  8759 consensus_queue.cc:1048] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:01:37.952426  2405 consensus_peers.cc:597] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:38.111748   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1668)
W20260709 13:01:38.167428  2405 consensus_peers.cc:597] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.240101  2405 consensus_peers.cc:597] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.283896  2405 consensus_peers.cc:597] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.332370  1685 consensus_peers.cc:597] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.346695  2405 consensus_peers.cc:597] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.352092  2405 consensus_peers.cc:597] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.367955  2405 consensus_peers.cc:597] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.396644  2405 consensus_peers.cc:597] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.437016  1685 consensus_peers.cc:597] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.503863  1685 consensus_peers.cc:597] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.517047  2405 consensus_peers.cc:597] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.573792  1685 consensus_peers.cc:597] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.646728  1685 consensus_peers.cc:597] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.656936  2405 consensus_peers.cc:597] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.708308  8764 raft_consensus.cc:493] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:38.708891  8764 raft_consensus.cc:515] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:38.716302  1685 leader_election.cc:336] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:38.717298  8764 leader_election.cc:290] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:38.726285  1686 leader_election.cc:336] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:38.726886  1686 leader_election.cc:304] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:38.727712  8764 raft_consensus.cc:2749] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:38.776845  8764 raft_consensus.cc:493] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:38.777386  8764 raft_consensus.cc:515] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:38.786382  1685 leader_election.cc:336] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:38.786934  1685 consensus_peers.cc:597] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.787618  8764 leader_election.cc:290] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:38.802481  1686 leader_election.cc:336] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:38.804854  1686 leader_election.cc:304] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:38.805711  8785 raft_consensus.cc:2749] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:38.836822  1686 consensus_peers.cc:597] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:38.854805  2405 consensus_peers.cc:597] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.867400  8785 raft_consensus.cc:493] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:38.868007  8785 raft_consensus.cc:515] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
W20260709 13:01:38.879640  1685 leader_election.cc:336] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:38.880548  1686 leader_election.cc:336] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:38.880998  1686 leader_election.cc:304] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:38.881709  8785 leader_election.cc:290] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:38.882229  8764 raft_consensus.cc:2749] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:01:38.888443  2406 consensus_peers.cc:597] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:38.897161  1685 consensus_peers.cc:597] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.903708  8788 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:38.908191  1685 consensus_peers.cc:597] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:38.909840  8788 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:38.916818  1685 leader_election.cc:336] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:38.918170  8788 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:38.919174  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8" is_pre_election: true
I20260709 13:01:38.919883  2447 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 13.
I20260709 13:01:38.922974  1686 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:38.923786  8788 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:38.926103  8785 raft_consensus.cc:493] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:38.926604  8785 raft_consensus.cc:515] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:38.928581  8785 leader_election.cc:290] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:38.924144  8788 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.929397  8788 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:38.934715  8764 raft_consensus.cc:493] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:38.935264  8764 raft_consensus.cc:515] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:38.937172  8764 leader_election.cc:290] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:38.944378  2406 consensus_peers.cc:597] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:38.946923  1686 leader_election.cc:336] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:38.945417  1685 consensus_peers.cc:597] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.947868  1685 consensus_peers.cc:597] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:38.948333  1685 leader_election.cc:336] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:38.948751  1685 leader_election.cc:304] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:38.949628  1686 leader_election.cc:336] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:38.949748  8785 raft_consensus.cc:2749] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:38.951035  8785 raft_consensus.cc:493] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:38.951507  8785 raft_consensus.cc:515] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:38.953446  8785 leader_election.cc:290] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:38.954908  1685 leader_election.cc:336] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:38.955614  1685 leader_election.cc:304] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:38.957772  8785 raft_consensus.cc:2749] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:38.962270  8788 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:38.964156  1686 leader_election.cc:336] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:38.965628  1685 leader_election.cc:336] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:38.966082  1685 leader_election.cc:304] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:38.967718  8789 raft_consensus.cc:2749] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:38.971083  2447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b47cff236bac4d2fae5f94a61502aec7" candidate_uuid: "66344ad7cd844754b2c81cc689a709b0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f381117554e49bb816791ab0a10f2b8"
I20260709 13:01:38.971709  2447 raft_consensus.cc:3060] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:38.977921  1685 leader_election.cc:336] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:38.978556  1685 consensus_peers.cc:597] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:39.002954  2447 raft_consensus.cc:2468] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66344ad7cd844754b2c81cc689a709b0 in term 14.
I20260709 13:01:39.004878  1686 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:39.008033  8785 raft_consensus.cc:2804] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:39.008580  8785 raft_consensus.cc:697] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Becoming Leader. State: Replica: 66344ad7cd844754b2c81cc689a709b0, State: Running, Role: LEADER
I20260709 13:01:39.009719  8785 consensus_queue.cc:237] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:39.016482  8750 raft_consensus.cc:493] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:39.017077  8750 raft_consensus.cc:515] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:39.019311  8750 leader_election.cc:290] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:39.024086  8789 raft_consensus.cc:493] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:39.024658  8789 raft_consensus.cc:515] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:39.026928  8789 leader_election.cc:290] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:39.031308  1685 leader_election.cc:336] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:39.033397  1686 consensus_peers.cc:597] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.033887  2406 leader_election.cc:336] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:39.038585  8788 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 14 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196:39297)
I20260709 13:01:39.041523  8787 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.042037  8787 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:39.039459  2405 consensus_peers.cc:597] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:39.045226  8787 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:39.063373  1685 consensus_peers.cc:597] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:39.063939   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:01:39.065864  2405 leader_election.cc:336] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:39.070742  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0" is_pre_election: true
I20260709 13:01:39.071982  1714 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 18.
I20260709 13:01:39.073570  2405 leader_election.cc:304] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:39.075295  8750 raft_consensus.cc:2749] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:39.074677  1467 catalog_manager.cc:5697] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 reported cstate change: term changed from 12 to 14, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "66344ad7cd844754b2c81cc689a709b0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.076857  2405 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:39.077641  8787 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:39.078030  8787 raft_consensus.cc:493] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.078414  8787 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:39.079794  2405 leader_election.cc:336] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:39.087028  8787 raft_consensus.cc:515] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:39.092583  1714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf4ad4ac54a4a228481863e56e53d54" candidate_uuid: "6f381117554e49bb816791ab0a10f2b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66344ad7cd844754b2c81cc689a709b0"
I20260709 13:01:39.093160  1714 raft_consensus.cc:3060] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:39.093040  1686 leader_election.cc:336] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:39.093677  8750 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:39.093835  1686 leader_election.cc:304] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:39.094228  8750 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:39.096305  8750 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:39.094578  8789 raft_consensus.cc:2749] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:01:39.098841  1686 consensus_peers.cc:597] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.099581  1686 consensus_peers.cc:597] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:39.102723  2406 leader_election.cc:336] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:39.105544  1714 raft_consensus.cc:2468] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f381117554e49bb816791ab0a10f2b8 in term 19.
I20260709 13:01:39.089727  8787 leader_election.cc:290] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 election: Requested vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:39.113528  1686 consensus_peers.cc:597] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:39.129820  1686 consensus_peers.cc:597] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:39.132130  2405 leader_election.cc:304] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0, 6f381117554e49bb816791ab0a10f2b8; no voters: 
I20260709 13:01:39.134387  8750 raft_consensus.cc:2804] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:39.138509  8750 raft_consensus.cc:697] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 19 LEADER]: Becoming Leader. State: Replica: 6f381117554e49bb816791ab0a10f2b8, State: Running, Role: LEADER
I20260709 13:01:39.139567  8750 consensus_queue.cc:237] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:39.146570  1686 consensus_peers.cc:597] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:39.155859  8788 raft_consensus.cc:493] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:39.156515  8788 raft_consensus.cc:515] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } }
I20260709 13:01:39.162727  8788 leader_election.cc:290] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:39.164251  1686 leader_election.cc:336] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:39.165668  2405 leader_election.cc:336] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:39.165946  1685 leader_election.cc:336] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:39.169243  1685 leader_election.cc:304] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66344ad7cd844754b2c81cc689a709b0; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:39.170378  8788 raft_consensus.cc:2749] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:39.177556  8792 raft_consensus.cc:493] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:39.178126  8792 raft_consensus.cc:515] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:39.180868  8792 leader_election.cc:290] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:39.184301  2405 leader_election.cc:336] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:39.184782  2405 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:39.185547  8787 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:39.186769  2405 consensus_peers.cc:597] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:39.197862  2405 leader_election.cc:336] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:39.199806  1468 catalog_manager.cc:5697] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 reported cstate change: term changed from 17 to 19, leader changed from a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194) to 6f381117554e49bb816791ab0a10f2b8 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "6f381117554e49bb816791ab0a10f2b8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:39.211081  2406 consensus_peers.cc:597] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:39.212913  8792 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:39.213418  8792 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:39.215646  8792 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:39.222126  2406 leader_election.cc:336] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:39.223438  2405 leader_election.cc:336] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:39.224020  2406 leader_election.cc:304] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:39.225200  8792 raft_consensus.cc:2749] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:39.251482  8793 raft_consensus.cc:493] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:39.252115  8793 raft_consensus.cc:515] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:39.254619  8793 leader_election.cc:290] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
I20260709 13:01:39.262756   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:01:39.265920  2406 leader_election.cc:336] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:39.266578  2406 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:39.269340  8792 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:01:39.272163  1686 consensus_peers.cc:597] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.272449  2405 leader_election.cc:336] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:39.287107  2405 consensus_peers.cc:597] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:39.295224  2405 consensus_peers.cc:597] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:39.297247  2406 leader_election.cc:336] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:39.297750  2406 leader_election.cc:304] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:39.298391  8793 raft_consensus.cc:2749] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:01:39.350529  1686 consensus_peers.cc:597] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.356158  2405 consensus_peers.cc:597] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:39.357111   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:01:39.358980  1686 consensus_peers.cc:597] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:39.360177   431 tablet_replica.cc:333] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.361122   431 raft_consensus.cc:2243] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.362207   431 raft_consensus.cc:2272] T 681214f01c5b4fc6a0aa493b2382c01f P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.364841   431 tablet_replica.cc:333] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.365584   431 raft_consensus.cc:2243] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.367261   431 raft_consensus.cc:2272] T 72ddc5b6631d45ffb9776db2cc41447d P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.369730   431 tablet_replica.cc:333] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.370554   431 raft_consensus.cc:2243] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.371332   431 pending_rounds.cc:70] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0: Trying to abort 1 pending ops.
I20260709 13:01:39.371551   431 pending_rounds.cc:77] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0: Aborting op as it isn't in flight: id { term: 14 index: 12 } timestamp: 7305634197689786368 op_type: NO_OP noop_request { }
I20260709 13:01:39.372027   431 raft_consensus.cc:2889] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:39.372362   431 raft_consensus.cc:2272] T b47cff236bac4d2fae5f94a61502aec7 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.375305   431 tablet_replica.cc:333] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.376109   431 raft_consensus.cc:2243] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.377404   431 raft_consensus.cc:2272] T 59f8a3d26bbd4c18a7d64b7584debff6 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.381608   431 tablet_replica.cc:333] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.382591   431 raft_consensus.cc:2243] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.383836   431 raft_consensus.cc:2272] T ac93f5a09723490eaf799683a1582480 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.386427   431 tablet_replica.cc:333] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.387290   431 raft_consensus.cc:2243] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.387948   431 raft_consensus.cc:2272] T 289133b3cbb949f4967bbf24c6b14e19 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:39.388029  2406 consensus_peers.cc:597] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:39.390551   431 tablet_replica.cc:333] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.391469   431 raft_consensus.cc:2243] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.392822   431 raft_consensus.cc:2272] T a6e5957876f24a868f3f2c49fcf5e759 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.395394   431 tablet_replica.cc:333] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.396226   431 raft_consensus.cc:2243] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.397509   431 raft_consensus.cc:2272] T 41d3057239d54d6183db91d2b176c2dd P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.400733   431 tablet_replica.cc:333] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.401520   431 raft_consensus.cc:2243] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.402587   431 raft_consensus.cc:2272] T eae5b8a8b4f14989a2565077fe8be235 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.405057   431 tablet_replica.cc:333] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.405869   431 raft_consensus.cc:2243] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.406941   431 raft_consensus.cc:2272] T 31e1751f20084c868e4ad6251ca38954 P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.409652   431 tablet_replica.cc:333] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.410462   431 raft_consensus.cc:2243] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.411582   431 raft_consensus.cc:2272] T a186179c799f4e53a8adf725dfd98a58 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.414103   431 tablet_replica.cc:333] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.414903   431 raft_consensus.cc:2243] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.415915   431 raft_consensus.cc:2272] T e28f3d3a9bc24be6b8fc4d90754cdfac P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.418346   431 tablet_replica.cc:333] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.419096   431 raft_consensus.cc:2243] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.419611   431 raft_consensus.cc:2272] T c55d053b55024621933828292867f0e6 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.421939   431 tablet_replica.cc:333] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.422710   431 raft_consensus.cc:2243] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.423699   431 raft_consensus.cc:2272] T e13ac9e112d84ff79c9ea7f4762a82ab P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.426087   431 tablet_replica.cc:333] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.426815   431 raft_consensus.cc:2243] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.427901   431 raft_consensus.cc:2272] T f4986d58f61a45638a1088287c2004d8 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.430332   431 tablet_replica.cc:333] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.431089   431 raft_consensus.cc:2243] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.431972   431 raft_consensus.cc:2272] T 17d2c95439be4ced872760603b0ae02b P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.434906   431 tablet_replica.cc:333] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.435647   431 raft_consensus.cc:2243] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.436223   431 raft_consensus.cc:2272] T 478c3696a6364c18a8ebef13ff075bfa P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.441953   431 tablet_replica.cc:333] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.442787   431 raft_consensus.cc:2243] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.443382   431 raft_consensus.cc:2272] T cbe76ebe20be4546bed4f95e2ee090bd P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:39.444128  2406 consensus_peers.cc:597] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:39.445586  2405 consensus_peers.cc:597] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:39.445820   431 tablet_replica.cc:333] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.446646   431 raft_consensus.cc:2243] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.447295   431 raft_consensus.cc:2272] T f283aa8c9b4a40729ec5fde1481234a1 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.449790   431 tablet_replica.cc:333] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.450624   431 raft_consensus.cc:2243] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.451257   431 raft_consensus.cc:2272] T 8ca192f35fd14bb58ebd0766d7a202f8 P 66344ad7cd844754b2c81cc689a709b0 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.454356   431 tablet_replica.cc:333] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.455149   431 raft_consensus.cc:2243] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.456177   431 raft_consensus.cc:2272] T 4759b34f9b3e4074a8a1cffa7efc8ff7 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.459231   431 tablet_replica.cc:333] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.460065   431 raft_consensus.cc:2243] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.460680   431 raft_consensus.cc:2272] T e0a2b0ee304d42d18cbe5fa6ca66804b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:39.461792  2406 consensus_peers.cc:597] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.465302  2405 consensus_peers.cc:597] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:39.463158   431 tablet_replica.cc:333] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.467128   431 raft_consensus.cc:2243] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.467826   431 raft_consensus.cc:2272] T 7133ad6a0a3449ad9f1b93e65653432d P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.474140   431 tablet_replica.cc:333] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.475005   431 raft_consensus.cc:2243] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.475587   431 raft_consensus.cc:2272] T b968f124f3854f20bff4af609192c41a P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.478240   431 tablet_replica.cc:333] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.479043   431 raft_consensus.cc:2243] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.479648   431 raft_consensus.cc:2272] T 8b24c881516c4da087ee25ab3682886b P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.482070   431 tablet_replica.cc:333] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.482873   431 raft_consensus.cc:2243] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.484053   431 raft_consensus.cc:2272] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.486745   431 tablet_replica.cc:333] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.487624   431 raft_consensus.cc:2243] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.488732   431 raft_consensus.cc:2272] T ff20dea159284907b41e95b640800f50 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.491454   431 tablet_replica.cc:333] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.492255   431 raft_consensus.cc:2243] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.492851   431 raft_consensus.cc:2272] T 8dd7e524e66b45d5a5c823f1a5224351 P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.495465   431 tablet_replica.cc:333] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.496220   431 raft_consensus.cc:2243] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.497296   431 raft_consensus.cc:2272] T 5a129c637a374138850dc8acf679f4bd P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.499991   431 tablet_replica.cc:333] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.500747   431 raft_consensus.cc:2243] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.501469   431 raft_consensus.cc:2272] T daf4ad4ac54a4a228481863e56e53d54 P 66344ad7cd844754b2c81cc689a709b0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.504053   431 tablet_replica.cc:333] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.504853   431 raft_consensus.cc:2243] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.505422   431 raft_consensus.cc:2272] T 681b2518696f44d99824827761c9c9f1 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.508093   431 tablet_replica.cc:333] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.508922   431 raft_consensus.cc:2243] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.509529   431 raft_consensus.cc:2272] T 61b3acddedfe43b6b7d1a8f74c050925 P 66344ad7cd844754b2c81cc689a709b0 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.512044   431 tablet_replica.cc:333] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.512807   431 raft_consensus.cc:2243] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.513921   431 raft_consensus.cc:2272] T b11fdc1931874b5389be76ef648b6ae1 P 66344ad7cd844754b2c81cc689a709b0 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.516567   431 tablet_replica.cc:333] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.517412   431 raft_consensus.cc:2243] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.518282   431 raft_consensus.cc:2272] T 71dad2e408414d2fa4f055c6eccf5b92 P 66344ad7cd844754b2c81cc689a709b0 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:39.519284  2405 consensus_peers.cc:597] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:39.520810   431 tablet_replica.cc:333] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.521709   431 raft_consensus.cc:2243] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.522317   431 raft_consensus.cc:2272] T beabe4568b4d481bac560939dd7f8258 P 66344ad7cd844754b2c81cc689a709b0 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.524953   431 tablet_replica.cc:333] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.525785   431 raft_consensus.cc:2243] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.526352   431 raft_consensus.cc:2272] T 016c9143ad3147438e814f92f2090928 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.529001   431 tablet_replica.cc:333] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.529946   431 raft_consensus.cc:2243] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.531083   431 raft_consensus.cc:2272] T 1f9c43e38d20461f85176d58e01fc7a1 P 66344ad7cd844754b2c81cc689a709b0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.534391   431 tablet_replica.cc:333] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.535158   431 raft_consensus.cc:2243] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.536223   431 raft_consensus.cc:2272] T 5c79f18b2f4247348564b91d430d6124 P 66344ad7cd844754b2c81cc689a709b0 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:39.528935  2405 consensus_peers.cc:597] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:39.538885   431 tablet_replica.cc:333] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.539736   431 raft_consensus.cc:2243] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.540843   431 raft_consensus.cc:2272] T 2d6b5add0ec94eccb0981a9bb10c79ef P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.544682   431 tablet_replica.cc:333] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.545485   431 raft_consensus.cc:2243] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.546561   431 raft_consensus.cc:2272] T 4b724690541549b4be895303885a0998 P 66344ad7cd844754b2c81cc689a709b0 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.549283   431 tablet_replica.cc:333] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.550072   431 raft_consensus.cc:2243] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.550738   431 raft_consensus.cc:2272] T a4b97ee9bb5742b6a7bfc576360314c5 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:39.551194  2405 consensus_peers.cc:597] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:39.553388   431 tablet_replica.cc:333] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.554265   431 raft_consensus.cc:2243] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.554872   431 raft_consensus.cc:2272] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 66344ad7cd844754b2c81cc689a709b0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.557548   431 tablet_replica.cc:333] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
W20260709 13:01:39.558261  2406 consensus_peers.cc:597] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:39.558353   431 raft_consensus.cc:2243] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:39.559387  2405 consensus_peers.cc:597] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:39.560336  2405 consensus_peers.cc:597] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:39.560426   431 raft_consensus.cc:2272] T b7404e443f1f4264bb8ea4e04b8e8627 P 66344ad7cd844754b2c81cc689a709b0 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:39.560950  2405 consensus_peers.cc:597] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:39.563469   431 tablet_replica.cc:333] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.564291   431 raft_consensus.cc:2243] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:39.565534   431 raft_consensus.cc:2272] T bfbaf6c33e5b45ea9c75342b1011f209 P 66344ad7cd844754b2c81cc689a709b0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:39.568392   431 tablet_replica.cc:333] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0: stopping tablet replica
I20260709 13:01:39.569108   431 raft_consensus.cc:2243] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:39.569748   431 raft_consensus.cc:2272] T b719a12d310b46bf978e160558e7d6f5 P 66344ad7cd844754b2c81cc689a709b0 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:39.607371  2406 consensus_peers.cc:597] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.612715  2405 consensus_peers.cc:597] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:39.672008  2405 consensus_peers.cc:597] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:39.674468  2405 connection.cc:769] client connection to 127.0.107.195:43271 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:01:39.679885  2405 consensus_peers.cc:597] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:39.686801  2406 consensus_peers.cc:597] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.695138  2405 consensus_peers.cc:597] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:39.709363  2405 consensus_peers.cc:597] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:39.717581  2405 consensus_peers.cc:597] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:39.730902  2406 consensus_peers.cc:597] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.731550  2406 consensus_peers.cc:597] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.736084  2405 consensus_peers.cc:597] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Couldn't send request to peer 66344ad7cd844754b2c81cc689a709b0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:39.828006  2406 consensus_peers.cc:597] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:40.063189  2406 consensus_peers.cc:597] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:40.069828  2406 consensus_peers.cc:597] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:40.177314  2405 consensus_peers.cc:597] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:40.188180  2405 consensus_peers.cc:597] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:40.225728  2406 consensus_peers.cc:597] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:40.280339  2406 consensus_peers.cc:597] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:40.305572  2406 consensus_peers.cc:597] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:40.335587  8793 raft_consensus.cc:493] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:40.336184  8793 raft_consensus.cc:515] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:40.340803  8793 leader_election.cc:290] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:40.346179  2405 leader_election.cc:336] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:40.350248  2405 leader_election.cc:336] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111)
I20260709 13:01:40.350732  2405 leader_election.cc:304] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:40.351573  8750 raft_consensus.cc:2749] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:40.421790  2405 consensus_peers.cc:597] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:40.447324  8750 raft_consensus.cc:493] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:40.447793  8750 raft_consensus.cc:515] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:40.449543  8750 leader_election.cc:290] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:40.453274  2406 leader_election.cc:336] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:40.454340  2405 leader_election.cc:336] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111)
I20260709 13:01:40.454978  2405 leader_election.cc:304] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:40.456045  8750 raft_consensus.cc:2749] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:40.509903  8793 raft_consensus.cc:493] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:40.512589  8793 raft_consensus.cc:515] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:40.516642  8793 leader_election.cc:290] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:40.524664  2405 leader_election.cc:336] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111)
W20260709 13:01:40.525439  2405 leader_election.cc:336] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:40.525863  2405 leader_election.cc:304] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:40.526587  8793 raft_consensus.cc:2749] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:40.594165  8793 raft_consensus.cc:493] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:40.594905  8793 raft_consensus.cc:515] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:40.600164  8750 raft_consensus.cc:493] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:40.601478  8750 raft_consensus.cc:515] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
W20260709 13:01:40.602480  2405 leader_election.cc:336] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111)
I20260709 13:01:40.599329  8793 leader_election.cc:290] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:40.604024  8750 leader_election.cc:290] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:40.608788  2406 leader_election.cc:336] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:40.614423  2406 leader_election.cc:304] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:40.615377  8750 raft_consensus.cc:2749] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:40.621910  2405 leader_election.cc:336] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
W20260709 13:01:40.622618  2405 leader_election.cc:336] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111)
I20260709 13:01:40.623075  2405 leader_election.cc:304] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:40.624106  8750 raft_consensus.cc:2749] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:40.648954  2405 consensus_peers.cc:597] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:40.659072  2406 consensus_peers.cc:597] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 -> Peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Couldn't send request to peer 338d817f94ee4c1bad162e9a5860b68a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:40.663954  8750 raft_consensus.cc:493] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:40.665012  8750 raft_consensus.cc:515] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:40.668064  8750 leader_election.cc:290] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:40.676819  2405 consensus_peers.cc:597] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:40.677475  2405 leader_election.cc:336] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:40.677608  8750 raft_consensus.cc:493] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 13:01:40.678663  2405 leader_election.cc:336] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111)
I20260709 13:01:40.679031  2405 leader_election.cc:304] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:40.679201  8750 raft_consensus.cc:515] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:40.681694  8750 leader_election.cc:290] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
I20260709 13:01:40.683470  8793 raft_consensus.cc:2749] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:40.686115  2406 leader_election.cc:336] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:40.690960  2405 leader_election.cc:336] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111)
I20260709 13:01:40.691497  2405 leader_election.cc:304] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:40.692420  8801 raft_consensus.cc:2749] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:40.694401  8801 raft_consensus.cc:493] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:40.695223  8801 raft_consensus.cc:515] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:40.698992  8801 leader_election.cc:290] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:40.702858  2405 leader_election.cc:336] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:40.704208  8750 raft_consensus.cc:493] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:40.704985  8750 raft_consensus.cc:515] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:40.707340  8750 leader_election.cc:290] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:40.709921  2405 leader_election.cc:336] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111)
I20260709 13:01:40.710377  2405 leader_election.cc:304] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
W20260709 13:01:40.711344  2406 leader_election.cc:336] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:40.712249  8750 raft_consensus.cc:2749] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:40.713352  2405 leader_election.cc:336] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111)
I20260709 13:01:40.713730  2405 leader_election.cc:304] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:40.714419  8750 raft_consensus.cc:2749] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:40.722707  8750 raft_consensus.cc:493] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:40.723452  8750 raft_consensus.cc:515] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:40.725992  8750 leader_election.cc:290] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:40.732105  2405 leader_election.cc:336] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111)
W20260709 13:01:40.735597  2406 leader_election.cc:336] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
I20260709 13:01:40.736073  8750 raft_consensus.cc:493] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:40.736156  2406 leader_election.cc:304] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:40.737313  8801 raft_consensus.cc:2749] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:40.737255  8750 raft_consensus.cc:515] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:40.740123  8750 leader_election.cc:290] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:40.746199  2406 leader_election.cc:336] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:40.756768  2405 leader_election.cc:336] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111)
I20260709 13:01:40.757310  2405 leader_election.cc:304] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:40.758359  8750 raft_consensus.cc:2749] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:40.800102  8750 raft_consensus.cc:493] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:40.800870  8750 raft_consensus.cc:515] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:40.802901  8750 leader_election.cc:290] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:40.807840  2406 leader_election.cc:336] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:40.808780  2405 leader_election.cc:336] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:40.809224  2405 leader_election.cc:304] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:40.810361  8750 raft_consensus.cc:2749] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:40.819269  2405 consensus_peers.cc:597] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:40.820027  8750 raft_consensus.cc:493] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.820612  8750 raft_consensus.cc:515] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:40.822667  8750 leader_election.cc:290] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:40.827656  2405 leader_election.cc:336] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:40.828564  8750 raft_consensus.cc:493] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
W20260709 13:01:40.828734  2405 leader_election.cc:336] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111)
I20260709 13:01:40.829896  2405 leader_election.cc:304] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:40.829991  8750 raft_consensus.cc:515] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:40.830679  8793 raft_consensus.cc:2749] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:40.832026  8750 leader_election.cc:290] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:40.835851  2406 leader_election.cc:336] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:40.837577  2405 leader_election.cc:336] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111)
I20260709 13:01:40.838097  2405 leader_election.cc:304] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, 66344ad7cd844754b2c81cc689a709b0
I20260709 13:01:40.838788  8750 raft_consensus.cc:2749] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:40.857964   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:01:40.858773  2405 consensus_peers.cc:597] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:40.860980  2405 consensus_peers.cc:597] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:40.864571  2405 consensus_peers.cc:597] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:40.887485  8793 raft_consensus.cc:493] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a4be9cc90aca4dd4ad7db103062a7208)
I20260709 13:01:40.888381  8793 raft_consensus.cc:515] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "338d817f94ee4c1bad162e9a5860b68a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45751 } } peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:40.891278  8793 leader_election.cc:290] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751), a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463)
W20260709 13:01:40.900065  2406 leader_election.cc:336] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 338d817f94ee4c1bad162e9a5860b68a (127.0.107.193:45751): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45751: connect: Connection refused (error 111)
W20260709 13:01:40.900709  2405 leader_election.cc:336] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:40.901271  2405 leader_election.cc:304] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 338d817f94ee4c1bad162e9a5860b68a, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:40.903347  8793 raft_consensus.cc:2749] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:01:41.030701  2405 consensus_peers.cc:597] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 -> Peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Couldn't send request to peer a4be9cc90aca4dd4ad7db103062a7208. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:41.031800   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:01:41.035180  8750 raft_consensus.cc:493] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66344ad7cd844754b2c81cc689a709b0)
I20260709 13:01:41.035983  8750 raft_consensus.cc:515] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a4be9cc90aca4dd4ad7db103062a7208" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45463 } } peers { permanent_uuid: "66344ad7cd844754b2c81cc689a709b0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43271 } } peers { permanent_uuid: "6f381117554e49bb816791ab0a10f2b8" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39297 } attrs { promote: false } }
I20260709 13:01:41.037988  8750 leader_election.cc:290] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463), 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271)
W20260709 13:01:41.043799  2405 leader_election.cc:336] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 66344ad7cd844754b2c81cc689a709b0 (127.0.107.195:43271): Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111)
W20260709 13:01:41.047037  2405 leader_election.cc:336] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a4be9cc90aca4dd4ad7db103062a7208 (127.0.107.194:45463): Network error: Client connection negotiation failed: client connection to 127.0.107.194:45463: connect: Connection refused (error 111)
I20260709 13:01:41.047822  2405 leader_election.cc:304] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f381117554e49bb816791ab0a10f2b8; no voters: 66344ad7cd844754b2c81cc689a709b0, a4be9cc90aca4dd4ad7db103062a7208
I20260709 13:01:41.049022  8750 raft_consensus.cc:2749] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:41.088073   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:41.089030   431 tablet_replica.cc:333] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.090174   431 raft_consensus.cc:2243] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.091562   431 raft_consensus.cc:2272] T 8ca192f35fd14bb58ebd0766d7a202f8 P 6f381117554e49bb816791ab0a10f2b8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.094686   431 tablet_replica.cc:333] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.095577   431 raft_consensus.cc:2243] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.096827   431 raft_consensus.cc:2272] T b8c2c21bc6aa4835b68933c89735091f P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.099752   431 tablet_replica.cc:333] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.100463   431 raft_consensus.cc:2243] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.101648   431 raft_consensus.cc:2272] T bfbaf6c33e5b45ea9c75342b1011f209 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.104604   431 tablet_replica.cc:333] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.105789   431 raft_consensus.cc:2243] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.107395   431 raft_consensus.cc:2272] T 2d6b5add0ec94eccb0981a9bb10c79ef P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.110723   431 tablet_replica.cc:333] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.111451   431 raft_consensus.cc:2243] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.113071   431 raft_consensus.cc:2272] T 25bf4151e41a48f3b21b94c95a02dcd4 P 6f381117554e49bb816791ab0a10f2b8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.115724   431 tablet_replica.cc:333] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.116421   431 raft_consensus.cc:2243] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.117668   431 raft_consensus.cc:2272] T 4a6fdab08a024ae6999ae0a520cd1cd0 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.120508   431 tablet_replica.cc:333] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.121229   431 raft_consensus.cc:2243] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.122686   431 raft_consensus.cc:2272] T cbe76ebe20be4546bed4f95e2ee090bd P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.125370   431 tablet_replica.cc:333] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.126017   431 raft_consensus.cc:2243] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.127156   431 raft_consensus.cc:2272] T 478c3696a6364c18a8ebef13ff075bfa P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.129710   431 tablet_replica.cc:333] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.130424   431 raft_consensus.cc:2243] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.132586   431 raft_consensus.cc:2272] T ac93f5a09723490eaf799683a1582480 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.136384   431 tablet_replica.cc:333] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.137358   431 raft_consensus.cc:2243] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.138960   431 raft_consensus.cc:2272] T e519a89ee28c45f98d4fe9c4bfea4baf P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.142529   431 tablet_replica.cc:333] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.143415   431 raft_consensus.cc:2243] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.144882   431 raft_consensus.cc:2272] T a6e5957876f24a868f3f2c49fcf5e759 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.147552   431 tablet_replica.cc:333] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.148216   431 raft_consensus.cc:2243] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.149101   431 pending_rounds.cc:70] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: Trying to abort 1 pending ops.
I20260709 13:01:41.149410   431 pending_rounds.cc:77] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8: Aborting op as it isn't in flight: id { term: 19 index: 16 } timestamp: 7305634198094979072 op_type: NO_OP noop_request { }
I20260709 13:01:41.149853   431 raft_consensus.cc:2889] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 19 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:41.150278   431 raft_consensus.cc:2272] T daf4ad4ac54a4a228481863e56e53d54 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.152936   431 tablet_replica.cc:333] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.153656   431 raft_consensus.cc:2243] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.154400   431 raft_consensus.cc:2272] T a2e78d031c384616a01064318cb24f28 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.157514   431 tablet_replica.cc:333] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.158344   431 raft_consensus.cc:2243] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.159524   431 raft_consensus.cc:2272] T 95165be2dd8c456fb98e088711372ce3 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.167840   431 tablet_replica.cc:333] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.168469   431 raft_consensus.cc:2243] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.170027   431 raft_consensus.cc:2272] T 17d2c95439be4ced872760603b0ae02b P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.172521   431 tablet_replica.cc:333] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.173056   431 raft_consensus.cc:2243] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.173623   431 raft_consensus.cc:2272] T 4b724690541549b4be895303885a0998 P 6f381117554e49bb816791ab0a10f2b8 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.176002   431 tablet_replica.cc:333] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.176602   431 raft_consensus.cc:2243] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.178480   431 raft_consensus.cc:2272] T 36627e4c13c74e8a9fd501f26c7aff53 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.180933   431 tablet_replica.cc:333] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.181646   431 raft_consensus.cc:2243] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.182313   431 raft_consensus.cc:2272] T 5c79f18b2f4247348564b91d430d6124 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.184809   431 tablet_replica.cc:333] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.185387   431 raft_consensus.cc:2243] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.186322   431 raft_consensus.cc:2272] T e93b49f668f7487dad07043590a5616f P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.188686   431 tablet_replica.cc:333] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.189388   431 raft_consensus.cc:2243] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.190706   431 raft_consensus.cc:2272] T 2033b178bcb643fd84ac0d1ae7e6a64b P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.193600   431 tablet_replica.cc:333] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.194413   431 raft_consensus.cc:2243] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.194999   431 raft_consensus.cc:2272] T b47cff236bac4d2fae5f94a61502aec7 P 6f381117554e49bb816791ab0a10f2b8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.197211   431 tablet_replica.cc:333] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.197793   431 raft_consensus.cc:2243] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.198889   431 raft_consensus.cc:2272] T 36a0e244d11c4ffe96ee4a663e2c69c8 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.201052   431 tablet_replica.cc:333] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.201623   431 raft_consensus.cc:2243] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.202406   431 raft_consensus.cc:2272] T f4986d58f61a45638a1088287c2004d8 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.204566   431 tablet_replica.cc:333] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.205169   431 raft_consensus.cc:2243] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.205796   431 raft_consensus.cc:2272] T 02b66b7be226499cbd9e020d381c72b2 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.207911   431 tablet_replica.cc:333] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.208462   431 raft_consensus.cc:2243] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.209049   431 raft_consensus.cc:2272] T bc72a09ffebe49218d3a2f9d4e0bcc45 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.211437   431 tablet_replica.cc:333] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.212155   431 raft_consensus.cc:2243] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.212739   431 raft_consensus.cc:2272] T ff20dea159284907b41e95b640800f50 P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.215184   431 tablet_replica.cc:333] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.215878   431 raft_consensus.cc:2243] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.216717   431 raft_consensus.cc:2272] T b11fdc1931874b5389be76ef648b6ae1 P 6f381117554e49bb816791ab0a10f2b8 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.219558   431 tablet_replica.cc:333] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.220302   431 raft_consensus.cc:2243] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.221375   431 raft_consensus.cc:2272] T a057e47a0fca4295957540c192996970 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:41.222560  2405 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.195:43271: connect: Connection refused (error 111) [suppressed 636 similar messages]
I20260709 13:01:41.224457   431 tablet_replica.cc:333] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.225276   431 raft_consensus.cc:2243] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.225864   431 raft_consensus.cc:2272] T a186179c799f4e53a8adf725dfd98a58 P 6f381117554e49bb816791ab0a10f2b8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.228595   431 tablet_replica.cc:333] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.229337   431 raft_consensus.cc:2243] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.230023   431 raft_consensus.cc:2272] T 72ddc5b6631d45ffb9776db2cc41447d P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.232537   431 tablet_replica.cc:333] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.233057   431 raft_consensus.cc:2243] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.234021   431 raft_consensus.cc:2272] T e5316a1e4f014102b1770c3f8b08410b P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.236092   431 tablet_replica.cc:333] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.236654   431 raft_consensus.cc:2243] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.237268   431 raft_consensus.cc:2272] T 691bccf09f2f475a98a7ab9cbbd1dd8d P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.239367   431 tablet_replica.cc:333] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.239938   431 raft_consensus.cc:2243] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.240989   431 raft_consensus.cc:2272] T 8dd7e524e66b45d5a5c823f1a5224351 P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.243640   431 tablet_replica.cc:333] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.244391   431 raft_consensus.cc:2243] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.245030   431 raft_consensus.cc:2272] T 71dad2e408414d2fa4f055c6eccf5b92 P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.247642   431 tablet_replica.cc:333] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.248175   431 raft_consensus.cc:2243] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.249146   431 raft_consensus.cc:2272] T 7133ad6a0a3449ad9f1b93e65653432d P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.251274   431 tablet_replica.cc:333] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.251818   431 raft_consensus.cc:2243] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.252828   431 raft_consensus.cc:2272] T b7404e443f1f4264bb8ea4e04b8e8627 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.255189   431 tablet_replica.cc:333] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.255733   431 raft_consensus.cc:2243] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.256891   431 raft_consensus.cc:2272] T cc8f7aca67ac4df5b6f0b4f41d538dfd P 6f381117554e49bb816791ab0a10f2b8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.260043   431 tablet_replica.cc:333] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.260794   431 raft_consensus.cc:2243] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.261834   431 raft_consensus.cc:2272] T a4b97ee9bb5742b6a7bfc576360314c5 P 6f381117554e49bb816791ab0a10f2b8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.264051   431 tablet_replica.cc:333] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.264572   431 raft_consensus.cc:2243] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.265575   431 raft_consensus.cc:2272] T c55d053b55024621933828292867f0e6 P 6f381117554e49bb816791ab0a10f2b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.267899   431 tablet_replica.cc:333] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.268411   431 raft_consensus.cc:2243] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.268887   431 raft_consensus.cc:2272] T e13ac9e112d84ff79c9ea7f4762a82ab P 6f381117554e49bb816791ab0a10f2b8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.270900   431 tablet_replica.cc:333] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.271445   431 raft_consensus.cc:2243] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.272631   431 raft_consensus.cc:2272] T 8b24c881516c4da087ee25ab3682886b P 6f381117554e49bb816791ab0a10f2b8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.275756   431 tablet_replica.cc:333] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.276435   431 raft_consensus.cc:2243] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:41.277026   431 raft_consensus.cc:2272] T 1f9c43e38d20461f85176d58e01fc7a1 P 6f381117554e49bb816791ab0a10f2b8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.279454   431 tablet_replica.cc:333] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.279966   431 raft_consensus.cc:2243] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.280941   431 raft_consensus.cc:2272] T 016c9143ad3147438e814f92f2090928 P 6f381117554e49bb816791ab0a10f2b8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.283138   431 tablet_replica.cc:333] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8: stopping tablet replica
I20260709 13:01:41.283602   431 raft_consensus.cc:2243] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.284641   431 raft_consensus.cc:2272] T 41d3057239d54d6183db91d2b176c2dd P 6f381117554e49bb816791ab0a10f2b8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.774039   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:01:41.859038   431 master.cc:562] Master@127.0.107.254:33273 shutting down...
W20260709 13:01:41.903558  1518 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:01:41.903915  1518 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:01:41.904223  1518 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:01:41.908145   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:41.908833   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:41.909178   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P b4fca1e1e7ea4cb985a4c9e3efed5179: stopping tablet replica
I20260709 13:01:42.108702   431 master.cc:584] Master@127.0.107.254:33273 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (232836 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:01:42.218554   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:46493
I20260709 13:01:42.219659   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:42.225457  8803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:42.225459  8804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:42.226965  8806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:42.228333   431 server_base.cc:1061] running on GCE node
I20260709 13:01:42.231530   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:42.231726   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:42.231837   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602102231821 us; error 0 us; skew 500 ppm
I20260709 13:01:42.232324   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:42.234898   431 webserver.cc:533] Webserver started at http://127.0.107.254:44027/ using document root <none> and password file <none>
I20260709 13:01:42.235337   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:42.235491   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:42.235702   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:42.236881   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/master-0-root/instance:
uuid: "2c664e65dd5a4381a6bca47ce9e9316f"
format_stamp: "Formatted at 2026-07-09 13:01:42 on dist-test-slave-zhdc"
I20260709 13:01:42.241194   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:01:42.244527  8811 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:42.245322   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:01:42.245626   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/master-0-root
uuid: "2c664e65dd5a4381a6bca47ce9e9316f"
format_stamp: "Formatted at 2026-07-09 13:01:42 on dist-test-slave-zhdc"
I20260709 13:01:42.245908   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:42.261771   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:42.263054   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:42.300873   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:46493
I20260709 13:01:42.300990  8862 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:46493 every 8 connection(s)
I20260709 13:01:42.304955  8863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:42.315237  8863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f: Bootstrap starting.
I20260709 13:01:42.320006  8863 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.324857  8863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f: No bootstrap required, opened a new log
I20260709 13:01:42.327206  8863 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c664e65dd5a4381a6bca47ce9e9316f" member_type: VOTER }
I20260709 13:01:42.327607  8863 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.327869  8863 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c664e65dd5a4381a6bca47ce9e9316f, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.328478  8863 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c664e65dd5a4381a6bca47ce9e9316f" member_type: VOTER }
I20260709 13:01:42.328935  8863 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:42.329133  8863 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:42.329401  8863 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.333878  8863 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c664e65dd5a4381a6bca47ce9e9316f" member_type: VOTER }
I20260709 13:01:42.334446  8863 leader_election.cc:304] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c664e65dd5a4381a6bca47ce9e9316f; no voters: 
I20260709 13:01:42.335631  8863 leader_election.cc:290] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:42.336097  8866 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.337623  8866 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [term 1 LEADER]: Becoming Leader. State: Replica: 2c664e65dd5a4381a6bca47ce9e9316f, State: Running, Role: LEADER
I20260709 13:01:42.338410  8866 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c664e65dd5a4381a6bca47ce9e9316f" member_type: VOTER }
I20260709 13:01:42.338624  8863 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:42.344360  8868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c664e65dd5a4381a6bca47ce9e9316f. Latest consensus state: current_term: 1 leader_uuid: "2c664e65dd5a4381a6bca47ce9e9316f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c664e65dd5a4381a6bca47ce9e9316f" member_type: VOTER } }
I20260709 13:01:42.345175  8868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:42.344327  8867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c664e65dd5a4381a6bca47ce9e9316f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c664e65dd5a4381a6bca47ce9e9316f" member_type: VOTER } }
I20260709 13:01:42.346331  8867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:42.352794  8875 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:42.358237  8875 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:42.359426   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:42.367854  8875 catalog_manager.cc:1383] Generated new cluster ID: 16c302a775f7432fabff5054bf1a7bab
I20260709 13:01:42.368191  8875 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:42.388973  8875 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:42.390514  8875 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:42.402814  8875 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f: Generated new TSK 0
I20260709 13:01:42.403453  8875 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:42.426846   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:42.433082  8884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:42.434432  8885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:42.436241  8887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:42.437314   431 server_base.cc:1061] running on GCE node
I20260709 13:01:42.439733   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:42.440081   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:42.440251   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602102440231 us; error 0 us; skew 500 ppm
I20260709 13:01:42.440824   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:42.443401   431 webserver.cc:533] Webserver started at http://127.0.107.193:36563/ using document root <none> and password file <none>
I20260709 13:01:42.443928   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:42.444160   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:42.444456   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:42.445649   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-0-root/instance:
uuid: "4667e9699c4d413889fc866e0e560d1f"
format_stamp: "Formatted at 2026-07-09 13:01:42 on dist-test-slave-zhdc"
I20260709 13:01:42.451079   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:01:42.455008  8892 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:42.455790   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.004s
I20260709 13:01:42.456141   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-0-root
uuid: "4667e9699c4d413889fc866e0e560d1f"
format_stamp: "Formatted at 2026-07-09 13:01:42 on dist-test-slave-zhdc"
I20260709 13:01:42.456460   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:42.474759   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:42.476013   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:42.477541   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:42.479888   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:42.480101   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:42.480347   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:42.480547   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:42.520828   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:41567
I20260709 13:01:42.520963  8954 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:41567 every 8 connection(s)
I20260709 13:01:42.526230   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:42.534227  8959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:42.535789  8960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:42.538403  8962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:42.539278   431 server_base.cc:1061] running on GCE node
I20260709 13:01:42.541724   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:42.541916   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:42.542178   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602102542157 us; error 0 us; skew 500 ppm
I20260709 13:01:42.542799   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:42.545718   431 webserver.cc:533] Webserver started at http://127.0.107.194:42667/ using document root <none> and password file <none>
I20260709 13:01:42.546363   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:42.546422  8955 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46493
I20260709 13:01:42.546676   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:42.546943  8955 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:42.547093   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:42.547881  8955 heartbeater.cc:507] Master 127.0.107.254:46493 requested a full tablet report, sending...
I20260709 13:01:42.548591   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-1-root/instance:
uuid: "f3ac81bf7b994af084e9929fac14de34"
format_stamp: "Formatted at 2026-07-09 13:01:42 on dist-test-slave-zhdc"
I20260709 13:01:42.550203  8828 ts_manager.cc:194] Registered new tserver with Master: 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:42.552085  8828 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60206
I20260709 13:01:42.553751   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:01:42.557355  8967 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:42.558244   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:01:42.558563   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-1-root
uuid: "f3ac81bf7b994af084e9929fac14de34"
format_stamp: "Formatted at 2026-07-09 13:01:42 on dist-test-slave-zhdc"
I20260709 13:01:42.558888   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:42.572058   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:42.573261   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:42.574784   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:42.577016   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:42.577242   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:42.577495   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:42.577672   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:42.618374   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:45405
I20260709 13:01:42.618563  9029 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:45405 every 8 connection(s)
I20260709 13:01:42.623325   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:42.630959  9033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:42.632647  9034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:42.634208   431 server_base.cc:1061] running on GCE node
W20260709 13:01:42.635453  9036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:42.636327  9030 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46493
I20260709 13:01:42.636545   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:01:42.636755  9030 heartbeater.cc:461] Registering TS with master...
W20260709 13:01:42.636827   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:42.637140   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602102637120 us; error 0 us; skew 500 ppm
I20260709 13:01:42.637717  9030 heartbeater.cc:507] Master 127.0.107.254:46493 requested a full tablet report, sending...
I20260709 13:01:42.637961   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:42.640300  8828 ts_manager.cc:194] Registered new tserver with Master: f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:42.640828   431 webserver.cc:533] Webserver started at http://127.0.107.195:38625/ using document root <none> and password file <none>
I20260709 13:01:42.641363   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:42.641580   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:42.641860   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:42.641976  8828 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60212
I20260709 13:01:42.643322   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-2-root/instance:
uuid: "0717530c054a42c5aa7aca788ba070a5"
format_stamp: "Formatted at 2026-07-09 13:01:42 on dist-test-slave-zhdc"
I20260709 13:01:42.648387   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:01:42.651891  9041 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:42.652691   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:01:42.652964   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-2-root
uuid: "0717530c054a42c5aa7aca788ba070a5"
format_stamp: "Formatted at 2026-07-09 13:01:42 on dist-test-slave-zhdc"
I20260709 13:01:42.653209   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:42.664242   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:42.665422   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:42.666929   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:42.669354   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:42.669538   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:42.669857   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:42.669999   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:42.710659   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:46841
I20260709 13:01:42.710776  9103 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:46841 every 8 connection(s)
I20260709 13:01:42.715598   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:42.722980  9107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:42.724443  9108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:42.727206   431 server_base.cc:1061] running on GCE node
W20260709 13:01:42.727315  9110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:42.728068  9104 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46493
I20260709 13:01:42.728506  9104 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:42.728595   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:42.728915   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:42.729086   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602102729071 us; error 0 us; skew 500 ppm
I20260709 13:01:42.729346  9104 heartbeater.cc:507] Master 127.0.107.254:46493 requested a full tablet report, sending...
I20260709 13:01:42.729741   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:42.731804  8828 ts_manager.cc:194] Registered new tserver with Master: 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:42.732771   431 webserver.cc:533] Webserver started at http://127.0.107.196:43857/ using document root <none> and password file <none>
I20260709 13:01:42.733438   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:42.733662   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:42.733705  8828 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60216
I20260709 13:01:42.734153   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:42.735451   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-3-root/instance:
uuid: "069063a72de443729cdfb3fcbfa6a123"
format_stamp: "Formatted at 2026-07-09 13:01:42 on dist-test-slave-zhdc"
I20260709 13:01:42.739899   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:01:42.743373  9115 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:42.744235   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:01:42.744549   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-3-root
uuid: "069063a72de443729cdfb3fcbfa6a123"
format_stamp: "Formatted at 2026-07-09 13:01:42 on dist-test-slave-zhdc"
I20260709 13:01:42.744832   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:42.767841   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:42.769140   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:42.770639   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:42.772940   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:42.773176   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:42.773478   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:42.773694   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:42.814872   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:38603
I20260709 13:01:42.814990  9177 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:38603 every 8 connection(s)
I20260709 13:01:42.829623  9178 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46493
I20260709 13:01:42.830094  9178 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:42.830942  9178 heartbeater.cc:507] Master 127.0.107.254:46493 requested a full tablet report, sending...
I20260709 13:01:42.833027  8828 ts_manager.cc:194] Registered new tserver with Master: 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:42.833182   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015193663s
I20260709 13:01:42.834555  8828 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60222
I20260709 13:01:42.861912  8828 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60232:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:01:43.098738  9143 tablet_service.cc:1511] Processing CreateTablet for tablet 37e725e7a33445fb9c78550251c3db98 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:43.100615  9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37e725e7a33445fb9c78550251c3db98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.118538  9069 tablet_service.cc:1511] Processing CreateTablet for tablet 37e725e7a33445fb9c78550251c3db98 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:43.118434  9142 tablet_service.cc:1511] Processing CreateTablet for tablet 3364bac8978243bcb6d068941312d443 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:43.120437  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3364bac8978243bcb6d068941312d443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.120707  9068 tablet_service.cc:1511] Processing CreateTablet for tablet eb6a98baac484a1c96cdafe7f0ba43f4 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:43.122488  8920 tablet_service.cc:1511] Processing CreateTablet for tablet 37e725e7a33445fb9c78550251c3db98 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:43.122748  9067 tablet_service.cc:1511] Processing CreateTablet for tablet fcf32f9353564e799c94067d0f6b4c5b (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:43.123983  8920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37e725e7a33445fb9c78550251c3db98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.124187  9141 tablet_service.cc:1511] Processing CreateTablet for tablet fcf32f9353564e799c94067d0f6b4c5b (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:43.124612  8915 tablet_service.cc:1511] Processing CreateTablet for tablet fe53d907711b42008ace8e547dc6f7fc (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:43.124910  9066 tablet_service.cc:1511] Processing CreateTablet for tablet 393fbe653f874c5fb76f1464a9641a6c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:43.125646  9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf32f9353564e799c94067d0f6b4c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.126005  8915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe53d907711b42008ace8e547dc6f7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.127511  9140 tablet_service.cc:1511] Processing CreateTablet for tablet 457e71b9614d4212a6d10378b169fe21 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:43.128427  9065 tablet_service.cc:1511] Processing CreateTablet for tablet fe53d907711b42008ace8e547dc6f7fc (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:43.128878  9140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457e71b9614d4212a6d10378b169fe21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.130283  9069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37e725e7a33445fb9c78550251c3db98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.130898  9064 tablet_service.cc:1511] Processing CreateTablet for tablet 317ccde7219b44848d0dd04ca340a83f (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:43.131273  9139 tablet_service.cc:1511] Processing CreateTablet for tablet fe53d907711b42008ace8e547dc6f7fc (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:43.132504  8917 tablet_service.cc:1511] Processing CreateTablet for tablet 393fbe653f874c5fb76f1464a9641a6c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:43.131333  8916 tablet_service.cc:1511] Processing CreateTablet for tablet 457e71b9614d4212a6d10378b169fe21 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:43.133960  8917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393fbe653f874c5fb76f1464a9641a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.134690  8916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457e71b9614d4212a6d10378b169fe21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.134950  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317ccde7219b44848d0dd04ca340a83f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.136205  8918 tablet_service.cc:1511] Processing CreateTablet for tablet 3364bac8978243bcb6d068941312d443 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:43.137560  8918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3364bac8978243bcb6d068941312d443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.138734  9068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb6a98baac484a1c96cdafe7f0ba43f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.139334  9139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe53d907711b42008ace8e547dc6f7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.139688  9067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf32f9353564e799c94067d0f6b4c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.139430  8919 tablet_service.cc:1511] Processing CreateTablet for tablet eb6a98baac484a1c96cdafe7f0ba43f4 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:43.140915  8919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb6a98baac484a1c96cdafe7f0ba43f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.148379  9066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393fbe653f874c5fb76f1464a9641a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.154575  9065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe53d907711b42008ace8e547dc6f7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.171060  9138 tablet_service.cc:1511] Processing CreateTablet for tablet 317ccde7219b44848d0dd04ca340a83f (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:43.172717  9138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317ccde7219b44848d0dd04ca340a83f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.186018  8914 tablet_service.cc:1511] Processing CreateTablet for tablet 7dffac6d3a0342be9474526316a71a85 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:43.187299  9197 tablet_bootstrap.cc:492] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:43.187614  8914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dffac6d3a0342be9474526316a71a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.193447  9063 tablet_service.cc:1511] Processing CreateTablet for tablet 7dffac6d3a0342be9474526316a71a85 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:43.194962  9063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dffac6d3a0342be9474526316a71a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.196403  8995 tablet_service.cc:1511] Processing CreateTablet for tablet eb6a98baac484a1c96cdafe7f0ba43f4 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:43.196501  8994 tablet_service.cc:1511] Processing CreateTablet for tablet 3364bac8978243bcb6d068941312d443 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:43.199134  8993 tablet_service.cc:1511] Processing CreateTablet for tablet fcf32f9353564e799c94067d0f6b4c5b (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:43.203004  9198 tablet_bootstrap.cc:492] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:43.204560  8991 tablet_service.cc:1511] Processing CreateTablet for tablet 457e71b9614d4212a6d10378b169fe21 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:43.207048  8990 tablet_service.cc:1511] Processing CreateTablet for tablet 317ccde7219b44848d0dd04ca340a83f (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:43.209650  9198 tablet_bootstrap.cc:654] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:43.209491  8989 tablet_service.cc:1511] Processing CreateTablet for tablet 7dffac6d3a0342be9474526316a71a85 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:43.198031  8995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb6a98baac484a1c96cdafe7f0ba43f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.211640  8993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf32f9353564e799c94067d0f6b4c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.214228  8990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317ccde7219b44848d0dd04ca340a83f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.203099  8992 tablet_service.cc:1511] Processing CreateTablet for tablet 393fbe653f874c5fb76f1464a9641a6c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:43.215597  8992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393fbe653f874c5fb76f1464a9641a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.218518  8994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3364bac8978243bcb6d068941312d443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.219296  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dffac6d3a0342be9474526316a71a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.222478  8991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457e71b9614d4212a6d10378b169fe21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.260831  9197 tablet_bootstrap.cc:654] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:43.287168  9196 tablet_bootstrap.cc:492] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:43.300541  9142 tablet_service.cc:1511] Processing CreateTablet for tablet 1b6fcb3fac4347a1bd0de44956d459d8 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:43.302250  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6fcb3fac4347a1bd0de44956d459d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.303928  8988 tablet_service.cc:1511] Processing CreateTablet for tablet 1b6fcb3fac4347a1bd0de44956d459d8 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:43.305289  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6fcb3fac4347a1bd0de44956d459d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.315088  8919 tablet_service.cc:1511] Processing CreateTablet for tablet 1b6fcb3fac4347a1bd0de44956d459d8 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:43.316638  8919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6fcb3fac4347a1bd0de44956d459d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.321560  9196 tablet_bootstrap.cc:654] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:43.340049  9064 tablet_service.cc:1511] Processing CreateTablet for tablet 5ae45916fe794471981c2ddff2693264 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:43.344485  9201 tablet_bootstrap.cc:492] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:43.347523  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae45916fe794471981c2ddff2693264. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:43.349022  8874 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:43.345227  9198 tablet_bootstrap.cc:492] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:43.355615  9198 ts_tablet_manager.cc:1403] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.153s	user 0.040s	sys 0.074s
I20260709 13:01:43.354997  8914 tablet_service.cc:1511] Processing CreateTablet for tablet 5ae45916fe794471981c2ddff2693264 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:43.356791  8914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae45916fe794471981c2ddff2693264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.357331  9197 tablet_bootstrap.cc:492] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:43.359741  9197 ts_tablet_manager.cc:1403] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.173s	user 0.029s	sys 0.034s
I20260709 13:01:43.354997  9142 tablet_service.cc:1511] Processing CreateTablet for tablet 5ae45916fe794471981c2ddff2693264 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:43.361488  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae45916fe794471981c2ddff2693264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.364420  9201 tablet_bootstrap.cc:654] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:43.371783  9197 raft_consensus.cc:359] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:43.372843  9197 raft_consensus.cc:385] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.372476  9198 raft_consensus.cc:359] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:43.373476  9198 raft_consensus.cc:385] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.373272  8995 tablet_service.cc:1511] Processing CreateTablet for tablet b9a11453401345558e4c1e70b91f288c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:43.375190  8995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a11453401345558e4c1e70b91f288c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.379776  9138 tablet_service.cc:1511] Processing CreateTablet for tablet b9a11453401345558e4c1e70b91f288c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:43.381286  9138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a11453401345558e4c1e70b91f288c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.380827  8915 tablet_service.cc:1511] Processing CreateTablet for tablet e3121fd08469404b9608676838f187ba (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:43.382643  8915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3121fd08469404b9608676838f187ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.383157  9063 tablet_service.cc:1511] Processing CreateTablet for tablet b9a11453401345558e4c1e70b91f288c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:43.384619  9063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a11453401345558e4c1e70b91f288c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.373276  9197 raft_consensus.cc:740] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:43.398757  9197 consensus_queue.cc:260] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:43.405556  9197 ts_tablet_manager.cc:1434] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 13:01:43.406294  9064 tablet_service.cc:1511] Processing CreateTablet for tablet e3121fd08469404b9608676838f187ba (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:43.407671  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3121fd08469404b9608676838f187ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.410413  9178 heartbeater.cc:499] Master 127.0.107.254:46493 was elected leader, sending a full tablet report...
I20260709 13:01:43.414077  9197 tablet_bootstrap.cc:492] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:43.414968  8988 tablet_service.cc:1511] Processing CreateTablet for tablet e3121fd08469404b9608676838f187ba (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:43.416469  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3121fd08469404b9608676838f187ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.420758  9197 tablet_bootstrap.cc:654] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:43.401259  9198 raft_consensus.cc:740] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:43.423199  9196 tablet_bootstrap.cc:492] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:43.423745  9196 ts_tablet_manager.cc:1403] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.137s	user 0.017s	sys 0.014s
I20260709 13:01:43.422623  9198 consensus_queue.cc:260] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:43.425861  9201 tablet_bootstrap.cc:492] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:43.437275  8914 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7047cf3dbc4806aad2882c18cea1f4 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:43.430744  9139 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7047cf3dbc4806aad2882c18cea1f4 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:43.427390  9196 raft_consensus.cc:359] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:43.439575  9196 raft_consensus.cc:385] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.439903  9196 raft_consensus.cc:740] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:43.440716  9196 consensus_queue.cc:260] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:43.441200  9068 tablet_service.cc:1511] Processing CreateTablet for tablet b72207701f3449e696f990856f3d7a94 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:43.438254  9201 ts_tablet_manager.cc:1403] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.094s	user 0.009s	sys 0.036s
I20260709 13:01:43.439230  8914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7047cf3dbc4806aad2882c18cea1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.447655  8995 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7047cf3dbc4806aad2882c18cea1f4 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:43.449059  8995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7047cf3dbc4806aad2882c18cea1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.442704  9068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72207701f3449e696f990856f3d7a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.443635  9139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7047cf3dbc4806aad2882c18cea1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.456426  9196 ts_tablet_manager.cc:1434] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.032s	user 0.011s	sys 0.003s
I20260709 13:01:43.456935  9142 tablet_service.cc:1511] Processing CreateTablet for tablet b72207701f3449e696f990856f3d7a94 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:43.476468  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72207701f3449e696f990856f3d7a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.483081  8955 heartbeater.cc:499] Master 127.0.107.254:46493 was elected leader, sending a full tablet report...
I20260709 13:01:43.485055  9198 ts_tablet_manager.cc:1434] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.129s	user 0.014s	sys 0.013s
I20260709 13:01:43.485884  9104 heartbeater.cc:499] Master 127.0.107.254:46493 was elected leader, sending a full tablet report...
I20260709 13:01:43.488063  9196 tablet_bootstrap.cc:492] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:43.492053  9138 tablet_service.cc:1511] Processing CreateTablet for tablet d605f782fc8f426190d3419e627d88be (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:43.470775  9064 tablet_service.cc:1511] Processing CreateTablet for tablet d605f782fc8f426190d3419e627d88be (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:43.461663  8991 tablet_service.cc:1511] Processing CreateTablet for tablet d605f782fc8f426190d3419e627d88be (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:43.500550  8917 tablet_service.cc:1511] Processing CreateTablet for tablet 992ee582def743e2952b747ca4d9e99f (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:43.508605  8991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d605f782fc8f426190d3419e627d88be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.509570  8917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992ee582def743e2952b747ca4d9e99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.514499  9138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d605f782fc8f426190d3419e627d88be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.507421  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d605f782fc8f426190d3419e627d88be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.507134  9197 tablet_bootstrap.cc:492] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:43.515972  9197 ts_tablet_manager.cc:1403] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.102s	user 0.026s	sys 0.013s
I20260709 13:01:43.516461  8919 tablet_service.cc:1511] Processing CreateTablet for tablet b72207701f3449e696f990856f3d7a94 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:43.517920  8919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72207701f3449e696f990856f3d7a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.461617  9201 raft_consensus.cc:359] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:43.519902  9201 raft_consensus.cc:385] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.519481  9197 raft_consensus.cc:359] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:43.520272  9201 raft_consensus.cc:740] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:43.520354  9197 raft_consensus.cc:385] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.520843  9197 raft_consensus.cc:740] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:43.521270  9201 consensus_queue.cc:260] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:43.521872  9197 consensus_queue.cc:260] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:43.504174  8988 tablet_service.cc:1511] Processing CreateTablet for tablet 992ee582def743e2952b747ca4d9e99f (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:43.524377  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992ee582def743e2952b747ca4d9e99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.523360  9196 tablet_bootstrap.cc:654] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:43.526027  8956 tablet.cc:2406] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:01:43.527781  9197 ts_tablet_manager.cc:1434] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:01:43.546468  9141 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7ec3e8adfe4ef8b9c4a50b85122b90 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:43.547989  9197 tablet_bootstrap.cc:492] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:43.537636  8995 tablet_service.cc:1511] Processing CreateTablet for tablet 51e05e226d044b2eacc27e329f7c96aa (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:43.538033  8914 tablet_service.cc:1511] Processing CreateTablet for tablet 51e05e226d044b2eacc27e329f7c96aa (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:43.539287  9204 raft_consensus.cc:493] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.549829  8914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e05e226d044b2eacc27e329f7c96aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.556829  8919 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7ec3e8adfe4ef8b9c4a50b85122b90 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:43.538033  9139 tablet_service.cc:1511] Processing CreateTablet for tablet 51e05e226d044b2eacc27e329f7c96aa (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:43.558425  8995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e05e226d044b2eacc27e329f7c96aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.550128  9204 raft_consensus.cc:515] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:43.563496  9065 tablet_service.cc:1511] Processing CreateTablet for tablet a7ab829c10554275ae1d80198e91fa05 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:43.563858  8991 tablet_service.cc:1511] Processing CreateTablet for tablet a7ab829c10554275ae1d80198e91fa05 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:43.564966  9065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ab829c10554275ae1d80198e91fa05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.565275  8991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ab829c10554275ae1d80198e91fa05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.567893  9204 leader_election.cc:290] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:43.499748  9198 tablet_bootstrap.cc:492] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:43.545156  9063 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7ec3e8adfe4ef8b9c4a50b85122b90 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:43.577076  8919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7ec3e8adfe4ef8b9c4a50b85122b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.577771  9063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7ec3e8adfe4ef8b9c4a50b85122b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.548019  9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7ec3e8adfe4ef8b9c4a50b85122b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.581456  8994 tablet_service.cc:1511] Processing CreateTablet for tablet d928cb8bbc1d4ab980a52299b33396b2 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:43.582852  8994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d928cb8bbc1d4ab980a52299b33396b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.542394  9068 tablet_service.cc:1511] Processing CreateTablet for tablet 992ee582def743e2952b747ca4d9e99f (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:43.586416  9139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e05e226d044b2eacc27e329f7c96aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.589504  8915 tablet_service.cc:1511] Processing CreateTablet for tablet d928cb8bbc1d4ab980a52299b33396b2 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:43.611084  9067 tablet_service.cc:1511] Processing CreateTablet for tablet d928cb8bbc1d4ab980a52299b33396b2 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:43.612375  8920 tablet_service.cc:1511] Processing CreateTablet for tablet b6b16540e04e406b8089acc5a6819d14 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:43.614451  8920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b16540e04e406b8089acc5a6819d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.623147  8992 tablet_service.cc:1511] Processing CreateTablet for tablet b6b16540e04e406b8089acc5a6819d14 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:43.625411  8992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b16540e04e406b8089acc5a6819d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.630353  9068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992ee582def743e2952b747ca4d9e99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.649467  9067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d928cb8bbc1d4ab980a52299b33396b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.649309  9030 heartbeater.cc:499] Master 127.0.107.254:46493 was elected leader, sending a full tablet report...
I20260709 13:01:43.659219  8915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d928cb8bbc1d4ab980a52299b33396b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.670925  9201 ts_tablet_manager.cc:1434] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.226s	user 0.020s	sys 0.000s
I20260709 13:01:43.672154  9201 tablet_bootstrap.cc:492] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:43.673576  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e725e7a33445fb9c78550251c3db98" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:43.681038  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e725e7a33445fb9c78550251c3db98" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:43.691674  9118 leader_election.cc:343] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.683154  9197 tablet_bootstrap.cc:654] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:43.684303  9196 tablet_bootstrap.cc:492] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:43.689714  9198 tablet_bootstrap.cc:654] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:43.673774  9138 tablet_service.cc:1511] Processing CreateTablet for tablet b6b16540e04e406b8089acc5a6819d14 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:43.699725  9140 tablet_service.cc:1511] Processing CreateTablet for tablet 1401c096fd97413881197bb35d4a55af (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:43.700249  9138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b16540e04e406b8089acc5a6819d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.701103  9140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1401c096fd97413881197bb35d4a55af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.696602  9196 ts_tablet_manager.cc:1403] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.209s	user 0.009s	sys 0.018s
I20260709 13:01:43.702325  9207 raft_consensus.cc:493] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.702829  9207 raft_consensus.cc:515] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:43.704735  9196 raft_consensus.cc:359] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:43.705483  9196 raft_consensus.cc:385] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.705786  9196 raft_consensus.cc:740] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
W20260709 13:01:43.707154  9116 leader_election.cc:343] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.699971  9063 tablet_service.cc:1511] Processing CreateTablet for tablet 1401c096fd97413881197bb35d4a55af (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:43.714627  9207 leader_election.cc:290] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:43.689843  9141 tablet_service.cc:1511] Processing CreateTablet for tablet a7ab829c10554275ae1d80198e91fa05 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:43.735960  9208 raft_consensus.cc:493] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.735838  9116 leader_election.cc:304] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:43.702829  9201 tablet_bootstrap.cc:654] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:43.737493  9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ab829c10554275ae1d80198e91fa05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.743021  8914 tablet_service.cc:1511] Processing CreateTablet for tablet 1401c096fd97413881197bb35d4a55af (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:43.744220  9206 raft_consensus.cc:493] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.744371  8914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1401c096fd97413881197bb35d4a55af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.744732  9206 raft_consensus.cc:515] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:43.736936  9208 raft_consensus.cc:515] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:43.750674  9206 leader_election.cc:290] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:43.740228  9204 raft_consensus.cc:2749] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:43.763880  9208 leader_election.cc:290] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:43.740630  9196 consensus_queue.cc:260] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:43.759229  9063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1401c096fd97413881197bb35d4a55af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.804580  9196 ts_tablet_manager.cc:1434] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.000s
I20260709 13:01:43.837591  9204 raft_consensus.cc:493] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.840077  9196 tablet_bootstrap.cc:492] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:43.847301  8991 tablet_service.cc:1511] Processing CreateTablet for tablet 5916411ff15d473591594797dfb09193 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:43.861377  9204 raft_consensus.cc:515] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:43.881305  9204 leader_election.cc:290] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:43.895689  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:43.898102  9044 leader_election.cc:343] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.900946  9197 tablet_bootstrap.cc:492] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:43.901691  9197 ts_tablet_manager.cc:1403] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.354s	user 0.032s	sys 0.011s
I20260709 13:01:43.903501  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:43.905019  9196 tablet_bootstrap.cc:654] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:43.905766  8895 leader_election.cc:343] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.903016  9068 tablet_service.cc:1511] Processing CreateTablet for tablet 5916411ff15d473591594797dfb09193 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:43.906942  8991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5916411ff15d473591594797dfb09193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.907475  9068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5916411ff15d473591594797dfb09193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.886101  9138 tablet_service.cc:1511] Processing CreateTablet for tablet 5916411ff15d473591594797dfb09193 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:43.911717  9138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5916411ff15d473591594797dfb09193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.916610  8920 tablet_service.cc:1511] Processing CreateTablet for tablet a1348d8ae8e8444fac9cc8f6bebfc852 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:43.919533  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:43.922333  8920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1348d8ae8e8444fac9cc8f6bebfc852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.922516  9139 tablet_service.cc:1511] Processing CreateTablet for tablet 5073cf5195c44a18922f4eb358531263 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:43.927068  9139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5073cf5195c44a18922f4eb358531263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.934996  8919 tablet_service.cc:1511] Processing CreateTablet for tablet 5073cf5195c44a18922f4eb358531263 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:43.937351  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:43.935602  9197 raft_consensus.cc:359] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:43.941201  8919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5073cf5195c44a18922f4eb358531263. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:43.942343  9043 leader_election.cc:343] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.937243  9198 tablet_bootstrap.cc:492] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:43.942876  9043 leader_election.cc:304] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:43.943181  9198 ts_tablet_manager.cc:1403] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.444s	user 0.010s	sys 0.015s
I20260709 13:01:43.944103  9206 raft_consensus.cc:2749] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:43.949332  9067 tablet_service.cc:1511] Processing CreateTablet for tablet a1348d8ae8e8444fac9cc8f6bebfc852 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:43.952314  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e71b9614d4212a6d10378b169fe21" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:43.952615  9198 raft_consensus.cc:359] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:43.953575  9198 raft_consensus.cc:385] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.953934  9198 raft_consensus.cc:740] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
W20260709 13:01:43.954210  8970 leader_election.cc:343] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.955125  9198 consensus_queue.cc:260] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:43.955878  9064 tablet_service.cc:1511] Processing CreateTablet for tablet 0aa3bccd3d02438e863f3fce74229335 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:43.957271  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aa3bccd3d02438e863f3fce74229335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.950275  9197 raft_consensus.cc:385] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.958626  9197 raft_consensus.cc:740] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:43.960633  8992 tablet_service.cc:1511] Processing CreateTablet for tablet a1348d8ae8e8444fac9cc8f6bebfc852 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:43.960784  9140 tablet_service.cc:1511] Processing CreateTablet for tablet 0aa3bccd3d02438e863f3fce74229335 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:43.959538  9197 consensus_queue.cc:260] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
W20260709 13:01:43.960631  9118 leader_election.cc:343] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.963231  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:43.967522  8915 tablet_service.cc:1511] Processing CreateTablet for tablet 0aa3bccd3d02438e863f3fce74229335 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:43.968195  9005 raft_consensus.cc:2468] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 0.
I20260709 13:01:43.962033  8992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1348d8ae8e8444fac9cc8f6bebfc852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.971378  9201 tablet_bootstrap.cc:492] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:43.966709  8994 tablet_service.cc:1511] Processing CreateTablet for tablet a5df48aa0fec43379ee059d845b123b4 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:43.968870  8915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aa3bccd3d02438e863f3fce74229335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.972445  8994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5df48aa0fec43379ee059d845b123b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.962177  9140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aa3bccd3d02438e863f3fce74229335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.974300  8988 tablet_service.cc:1511] Processing CreateTablet for tablet 5073cf5195c44a18922f4eb358531263 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:43.975646  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5073cf5195c44a18922f4eb358531263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.978684  8894 leader_election.cc:304] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123
I20260709 13:01:43.991706  9197 ts_tablet_manager.cc:1434] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.006s
I20260709 13:01:43.991734  9065 tablet_service.cc:1511] Processing CreateTablet for tablet a5df48aa0fec43379ee059d845b123b4 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:43.992987  9197 tablet_bootstrap.cc:492] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:43.991742  9142 tablet_service.cc:1511] Processing CreateTablet for tablet a5df48aa0fec43379ee059d845b123b4 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:43.994580  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5df48aa0fec43379ee059d845b123b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.988281  9207 raft_consensus.cc:2804] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:43.998420  9207 raft_consensus.cc:493] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.998819  9207 raft_consensus.cc:3060] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.992359  9067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1348d8ae8e8444fac9cc8f6bebfc852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:43.988489  9198 ts_tablet_manager.cc:1434] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:01:44.003276  9198 tablet_bootstrap.cc:492] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:44.006469  8917 tablet_service.cc:1511] Processing CreateTablet for tablet ef292f6bccd14fe2a930cd9e26f10d3b (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:44.007822  8917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef292f6bccd14fe2a930cd9e26f10d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.011466  8995 tablet_service.cc:1511] Processing CreateTablet for tablet ef292f6bccd14fe2a930cd9e26f10d3b (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:44.012800  8995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef292f6bccd14fe2a930cd9e26f10d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.013525  8989 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5dadd1a4f24668bef129668013d3da (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:43.988674  9201 ts_tablet_manager.cc:1403] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.316s	user 0.014s	sys 0.011s
I20260709 13:01:44.020587  8918 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5dadd1a4f24668bef129668013d3da (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:44.034984  8918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5dadd1a4f24668bef129668013d3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.022365  9069 tablet_service.cc:1511] Processing CreateTablet for tablet ee1fc193b3ad439ab1c05519323d3302 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:44.037794  9143 tablet_service.cc:1511] Processing CreateTablet for tablet 30dc6dd2b3764d889a6840a0eb8bcb46 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:44.024037  9141 tablet_service.cc:1511] Processing CreateTablet for tablet ee1fc193b3ad439ab1c05519323d3302 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:44.039422  9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30dc6dd2b3764d889a6840a0eb8bcb46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.040202  9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1fc193b3ad439ab1c05519323d3302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.027020  9138 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5dadd1a4f24668bef129668013d3da (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:44.028584  9064 tablet_service.cc:1511] Processing CreateTablet for tablet ef292f6bccd14fe2a930cd9e26f10d3b (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:44.015720  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5dadd1a4f24668bef129668013d3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.042354  9065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5df48aa0fec43379ee059d845b123b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.042929  9138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5dadd1a4f24668bef129668013d3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.031693  8993 tablet_service.cc:1511] Processing CreateTablet for tablet 30dc6dd2b3764d889a6840a0eb8bcb46 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:44.046173  8993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30dc6dd2b3764d889a6840a0eb8bcb46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.046387  9069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1fc193b3ad439ab1c05519323d3302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.027976  8915 tablet_service.cc:1511] Processing CreateTablet for tablet ee1fc193b3ad439ab1c05519323d3302 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:44.047744  8915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1fc193b3ad439ab1c05519323d3302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.038195  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:44.051602  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e71b9614d4212a6d10378b169fe21" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
W20260709 13:01:44.053309  9117 leader_election.cc:343] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.053817  9117 leader_election.cc:304] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:44.054957  9204 raft_consensus.cc:2749] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.061096  9204 raft_consensus.cc:493] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.061610  9204 raft_consensus.cc:515] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:44.063823  9204 leader_election.cc:290] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:44.064883  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef292f6bccd14fe2a930cd9e26f10d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.065515  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf32f9353564e799c94067d0f6b4c5b" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
W20260709 13:01:44.067040  9116 leader_election.cc:343] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.075526  9068 tablet_service.cc:1511] Processing CreateTablet for tablet 30dc6dd2b3764d889a6840a0eb8bcb46 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:44.076937  9068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30dc6dd2b3764d889a6840a0eb8bcb46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.077436  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf32f9353564e799c94067d0f6b4c5b" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:44.078043  8990 tablet_service.cc:1511] Processing CreateTablet for tablet a8e1e49fe15e4d22be2c7582c6803d8c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 13:01:44.078776  9117 leader_election.cc:343] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.079360  8990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e1e49fe15e4d22be2c7582c6803d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.079267  9117 leader_election.cc:304] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:44.080565  9204 raft_consensus.cc:2749] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.037074  9201 raft_consensus.cc:359] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:44.082383  9201 raft_consensus.cc:385] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.082719  9201 raft_consensus.cc:740] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.083534  9066 tablet_service.cc:1511] Processing CreateTablet for tablet a8e1e49fe15e4d22be2c7582c6803d8c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:44.084844  9066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e1e49fe15e4d22be2c7582c6803d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.086021  9137 tablet_service.cc:1511] Processing CreateTablet for tablet 0a44fd9d19a243248566560af21b992e (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:44.087356  9137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a44fd9d19a243248566560af21b992e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.090938  9207 raft_consensus.cc:515] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.092272  8930 raft_consensus.cc:2393] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3ac81bf7b994af084e9929fac14de34 in current term 1: Already voted for candidate 4667e9699c4d413889fc866e0e560d1f in this term.
I20260709 13:01:44.093248  9207 leader_election.cc:290] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:44.094568  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:44.094853  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:44.095414  9005 raft_consensus.cc:3060] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:44.096088  8895 leader_election.cc:343] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.098030  8970 leader_election.cc:304] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:44.098519  9201 consensus_queue.cc:260] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:44.095646  9196 tablet_bootstrap.cc:492] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:44.105839  9196 ts_tablet_manager.cc:1403] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.275s	user 0.014s	sys 0.004s
I20260709 13:01:44.109860  9196 raft_consensus.cc:359] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:44.121598  9196 raft_consensus.cc:385] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.126188  9196 raft_consensus.cc:740] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.127239  9196 consensus_queue.cc:260] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:44.129551  9196 ts_tablet_manager.cc:1434] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 13:01:44.093904  9207 raft_consensus.cc:493] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.132079  9207 raft_consensus.cc:515] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:44.135406  9004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
W20260709 13:01:44.136871  8894 leader_election.cc:343] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.146934  8994 tablet_service.cc:1511] Processing CreateTablet for tablet 0a44fd9d19a243248566560af21b992e (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:44.148499  8994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a44fd9d19a243248566560af21b992e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.139482  9197 tablet_bootstrap.cc:654] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.161769  9137 tablet_service.cc:1511] Processing CreateTablet for tablet 173098da7c34450aa6f93bcafd377922 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:44.163234  9137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 173098da7c34450aa6f93bcafd377922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.168947  9196 tablet_bootstrap.cc:492] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:44.140311  9207 leader_election.cc:290] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:44.185981  9198 tablet_bootstrap.cc:654] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.189797  9197 tablet_bootstrap.cc:492] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:44.196995  9005 raft_consensus.cc:2468] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 1.
I20260709 13:01:44.197702  9208 raft_consensus.cc:2749] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.198387  9206 raft_consensus.cc:493] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.198957  9206 raft_consensus.cc:515] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.200443  9139 tablet_service.cc:1511] Processing CreateTablet for tablet 5c744829b78b4069a658ca2a4d2dbb5e (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:44.201431  9206 leader_election.cc:290] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:44.201892  9139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c744829b78b4069a658ca2a4d2dbb5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.201723  8894 leader_election.cc:304] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123
I20260709 13:01:44.204564  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e725e7a33445fb9c78550251c3db98" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:44.206020  8987 tablet_service.cc:1511] Processing CreateTablet for tablet b69e9a34c48e4dbd8f8d3c71a475a7c3 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:44.208261  9201 ts_tablet_manager.cc:1434] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.174s	user 0.011s	sys 0.004s
W20260709 13:01:44.208135  9044 leader_election.cc:343] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.209537  8990 tablet_service.cc:1511] Processing CreateTablet for tablet 5c744829b78b4069a658ca2a4d2dbb5e (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:44.214123  8915 tablet_service.cc:1511] Processing CreateTablet for tablet 0a44fd9d19a243248566560af21b992e (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:44.215521  8915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a44fd9d19a243248566560af21b992e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.219761  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e725e7a33445fb9c78550251c3db98" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:44.220460  9153 raft_consensus.cc:2468] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:44.221807  9044 leader_election.cc:304] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:44.222724  9206 raft_consensus.cc:2804] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:44.223093  9206 raft_consensus.cc:493] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.223392  9206 raft_consensus.cc:3060] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.225108  9196 tablet_bootstrap.cc:654] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.233273  9207 raft_consensus.cc:2804] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:44.233901  9207 raft_consensus.cc:697] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 1 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:01:44.237074  9068 tablet_service.cc:1511] Processing CreateTablet for tablet 173098da7c34450aa6f93bcafd377922 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:44.238509  9069 tablet_service.cc:1511] Processing CreateTablet for tablet 5c744829b78b4069a658ca2a4d2dbb5e (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:44.240135  9069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c744829b78b4069a658ca2a4d2dbb5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.241753  8920 tablet_service.cc:1511] Processing CreateTablet for tablet a8e1e49fe15e4d22be2c7582c6803d8c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:44.243352  8920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e1e49fe15e4d22be2c7582c6803d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.244834  8987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69e9a34c48e4dbd8f8d3c71a475a7c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.246878  9068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 173098da7c34450aa6f93bcafd377922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.242378  9207 consensus_queue.cc:237] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.218140  9197 ts_tablet_manager.cc:1403] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.225s	user 0.009s	sys 0.012s
I20260709 13:01:44.259457  8917 tablet_service.cc:1511] Processing CreateTablet for tablet 173098da7c34450aa6f93bcafd377922 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:44.260923  8917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 173098da7c34450aa6f93bcafd377922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.255575  9201 tablet_bootstrap.cc:492] T fcf32f9353564e799c94067d0f6b4c5b P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:44.271898  8914 tablet_service.cc:1511] Processing CreateTablet for tablet b69e9a34c48e4dbd8f8d3c71a475a7c3 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:44.265810  9197 raft_consensus.cc:359] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.281140  9064 tablet_service.cc:1511] Processing CreateTablet for tablet b69e9a34c48e4dbd8f8d3c71a475a7c3 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:44.281674  9197 raft_consensus.cc:385] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.282235  9197 raft_consensus.cc:740] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.282553  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69e9a34c48e4dbd8f8d3c71a475a7c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.283283  9197 consensus_queue.cc:260] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.289569  9197 ts_tablet_manager.cc:1434] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.004s
I20260709 13:01:44.294683  8990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c744829b78b4069a658ca2a4d2dbb5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.313851  8827 catalog_manager.cc:5697] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:44.315363  8993 tablet_service.cc:1511] Processing CreateTablet for tablet 80e007e79ba94ae88d703e10d65910a9 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:44.316859  8993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e007e79ba94ae88d703e10d65910a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.294418  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:44.296548  9198 tablet_bootstrap.cc:492] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:44.318974  9198 ts_tablet_manager.cc:1403] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.316s	user 0.020s	sys 0.011s
I20260709 13:01:44.320652  9068 tablet_service.cc:1511] Processing CreateTablet for tablet d89a074d6cac458d9de6a79b3bcceade (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:44.302022  8920 tablet_service.cc:1511] Processing CreateTablet for tablet 80e007e79ba94ae88d703e10d65910a9 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:44.302510  8914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69e9a34c48e4dbd8f8d3c71a475a7c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.328799  9064 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9762d913154929be832b5508ebad68 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:44.329568  9068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89a074d6cac458d9de6a79b3bcceade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.232245  9206 raft_consensus.cc:515] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.330340  9197 tablet_bootstrap.cc:492] T fe53d907711b42008ace8e547dc6f7fc P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:44.332830  9206 leader_election.cc:290] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:44.305619  9208 raft_consensus.cc:493] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.334511  8918 tablet_service.cc:1511] Processing CreateTablet for tablet b3a7ca8dc8c64156ba3dd859eb2fdf1c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:44.335058  9137 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9762d913154929be832b5508ebad68 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:44.335536  8995 tablet_service.cc:1511] Processing CreateTablet for tablet b3a7ca8dc8c64156ba3dd859eb2fdf1c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:44.335944  8918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a7ca8dc8c64156ba3dd859eb2fdf1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.336354  9137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9762d913154929be832b5508ebad68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.336841  8995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a7ca8dc8c64156ba3dd859eb2fdf1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.337829  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9762d913154929be832b5508ebad68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.338951  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e725e7a33445fb9c78550251c3db98" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:44.339275  8920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e007e79ba94ae88d703e10d65910a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.333575  9208 raft_consensus.cc:515] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
W20260709 13:01:44.340490  9044 leader_election.cc:343] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.307753  9196 tablet_bootstrap.cc:492] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:44.342855  9196 ts_tablet_manager.cc:1403] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.174s	user 0.021s	sys 0.019s
I20260709 13:01:44.322129  9198 raft_consensus.cc:359] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:44.346247  9198 raft_consensus.cc:385] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.346607  9198 raft_consensus.cc:740] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.346771  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e725e7a33445fb9c78550251c3db98" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:44.300869  9139 tablet_service.cc:1511] Processing CreateTablet for tablet 80e007e79ba94ae88d703e10d65910a9 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:44.347456  9153 raft_consensus.cc:3060] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.348321  9139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e007e79ba94ae88d703e10d65910a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:44.323734  8893 leader_election.cc:343] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.302040  9201 tablet_bootstrap.cc:654] T fcf32f9353564e799c94067d0f6b4c5b P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.325191  9142 tablet_service.cc:1511] Processing CreateTablet for tablet d89a074d6cac458d9de6a79b3bcceade (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:44.350586  8893 leader_election.cc:304] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:44.351390  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89a074d6cac458d9de6a79b3bcceade. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:44.351750  8874 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:44.355151  9207 raft_consensus.cc:2749] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.327955  8915 tablet_service.cc:1511] Processing CreateTablet for tablet d89a074d6cac458d9de6a79b3bcceade (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:44.356841  8915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89a074d6cac458d9de6a79b3bcceade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.347465  9198 consensus_queue.cc:260] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:44.373842  8990 tablet_service.cc:1511] Processing CreateTablet for tablet e576ab3b143d4485a1c98595bfb66af5 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:44.375244  8990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e576ab3b143d4485a1c98595bfb66af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.375702  9198 ts_tablet_manager.cc:1434] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.001s
I20260709 13:01:44.376739  9198 tablet_bootstrap.cc:492] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:44.378159  9196 raft_consensus.cc:359] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.378916  9196 raft_consensus.cc:385] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.379194  9196 raft_consensus.cc:740] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.380055  9196 consensus_queue.cc:260] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.358798  9208 leader_election.cc:290] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:44.361928  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317ccde7219b44848d0dd04ca340a83f" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:44.367012  9153 raft_consensus.cc:2468] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:44.380940  8917 tablet_service.cc:1511] Processing CreateTablet for tablet e576ab3b143d4485a1c98595bfb66af5 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:44.382153  9044 leader_election.cc:304] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:44.382560  9196 ts_tablet_manager.cc:1434] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:01:44.383637  9196 tablet_bootstrap.cc:492] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:44.383735  9069 tablet_service.cc:1511] Processing CreateTablet for tablet 5e69234154ae46418e61ba3eb8a89c2a (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:44.384567  9140 tablet_service.cc:1511] Processing CreateTablet for tablet 5e69234154ae46418e61ba3eb8a89c2a (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:44.385068  9069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e69234154ae46418e61ba3eb8a89c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.385836  9140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e69234154ae46418e61ba3eb8a89c2a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:44.382236  8970 leader_election.cc:343] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.388214  9206 raft_consensus.cc:2804] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:44.371277  9141 tablet_service.cc:1511] Processing CreateTablet for tablet e576ab3b143d4485a1c98595bfb66af5 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:44.391942  9064 tablet_service.cc:1511] Processing CreateTablet for tablet b3a7ca8dc8c64156ba3dd859eb2fdf1c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:44.393419  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a7ca8dc8c64156ba3dd859eb2fdf1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.393951  9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e576ab3b143d4485a1c98595bfb66af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.394959  8917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e576ab3b143d4485a1c98595bfb66af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.328596  8987 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9762d913154929be832b5508ebad68 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:44.412653  8987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9762d913154929be832b5508ebad68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.412293  8919 tablet_service.cc:1511] Processing CreateTablet for tablet 5e69234154ae46418e61ba3eb8a89c2a (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:44.413684  8919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e69234154ae46418e61ba3eb8a89c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.435827  8991 tablet_service.cc:1511] Processing CreateTablet for tablet e8ed7e446fa14e71894176ab3ceb8318 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:44.432410  9207 raft_consensus.cc:493] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.446434  9198 tablet_bootstrap.cc:654] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.457048  9238 raft_consensus.cc:493] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.446342  9228 raft_consensus.cc:493] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.472333  9143 tablet_service.cc:1511] Processing CreateTablet for tablet e8ed7e446fa14e71894176ab3ceb8318 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:44.475189  8916 tablet_service.cc:1511] Processing CreateTablet for tablet 68d45c07c5d6485eb2f08f154a9df317 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:44.457669  9238 raft_consensus.cc:515] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:44.452020  9206 raft_consensus.cc:697] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:44.477293  9064 tablet_service.cc:1511] Processing CreateTablet for tablet e8ed7e446fa14e71894176ab3ceb8318 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:44.484381  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ed7e446fa14e71894176ab3ceb8318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.476085  8991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ed7e446fa14e71894176ab3ceb8318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.452673  9207 raft_consensus.cc:515] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:44.473711  9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ed7e446fa14e71894176ab3ceb8318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.488730  8916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d45c07c5d6485eb2f08f154a9df317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.492043  9065 tablet_service.cc:1511] Processing CreateTablet for tablet 68d45c07c5d6485eb2f08f154a9df317 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:44.494199  9138 tablet_service.cc:1511] Processing CreateTablet for tablet 713d7f8692bf457fb28973349764534b (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:44.495304  8913 tablet_service.cc:1511] Processing CreateTablet for tablet 713d7f8692bf457fb28973349764534b (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:44.502084  8989 tablet_service.cc:1511] Processing CreateTablet for tablet 713d7f8692bf457fb28973349764534b (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:44.503427  9207 leader_election.cc:290] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:44.508757  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e71b9614d4212a6d10378b169fe21" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:44.509533  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e71b9614d4212a6d10378b169fe21" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:44.510867  9065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d45c07c5d6485eb2f08f154a9df317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.518915  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713d7f8692bf457fb28973349764534b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.519522  9238 leader_election.cc:290] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:44.464308  9228 raft_consensus.cc:515] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.473708  8988 tablet_service.cc:1511] Processing CreateTablet for tablet 68d45c07c5d6485eb2f08f154a9df317 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:44.518455  9153 raft_consensus.cc:2468] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 0.
I20260709 13:01:44.510514  9206 consensus_queue.cc:237] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.522301  8913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713d7f8692bf457fb28973349764534b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:44.539189  8894 leader_election.cc:343] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.539664  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf32f9353564e799c94067d0f6b4c5b" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:44.540616  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317ccde7219b44848d0dd04ca340a83f" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:44.541103  9067 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec71963326742b199b954dc1c0bbacb (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 13:01:44.561645  8968 leader_election.cc:343] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.562026  9067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec71963326742b199b954dc1c0bbacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.562157  8968 leader_election.cc:304] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:44.562773  8895 leader_election.cc:304] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f; no voters: f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:44.563844  9208 raft_consensus.cc:2749] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.566179  9136 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec71963326742b199b954dc1c0bbacb (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:44.568007  9207 raft_consensus.cc:2804] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:44.568521  9207 raft_consensus.cc:493] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.568921  9207 raft_consensus.cc:3060] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.542938  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d45c07c5d6485eb2f08f154a9df317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.544055  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf32f9353564e799c94067d0f6b4c5b" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:44.546589  9138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713d7f8692bf457fb28973349764534b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.577035  9207 raft_consensus.cc:515] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:44.554462  9152 raft_consensus.cc:2468] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:44.580128  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e71b9614d4212a6d10378b169fe21" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:44.580710  9153 raft_consensus.cc:3060] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.580639  9044 leader_election.cc:304] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:44.586714  9238 raft_consensus.cc:2804] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:44.587100  9238 raft_consensus.cc:493] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.587433  9238 raft_consensus.cc:3060] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.591383  9228 leader_election.cc:290] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
W20260709 13:01:44.594274  9043 leader_election.cc:343] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.598016  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe53d907711b42008ace8e547dc6f7fc" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
W20260709 13:01:44.599951  8895 leader_election.cc:343] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.600880  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe53d907711b42008ace8e547dc6f7fc" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:44.604017  9201 tablet_bootstrap.cc:492] T fcf32f9353564e799c94067d0f6b4c5b P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:44.604547  9201 ts_tablet_manager.cc:1403] T fcf32f9353564e799c94067d0f6b4c5b P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.349s	user 0.010s	sys 0.046s
W20260709 13:01:44.606369  8893 leader_election.cc:343] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.606882  8893 leader_election.cc:304] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:44.605968  9153 raft_consensus.cc:2468] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 1.
I20260709 13:01:44.609951  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e71b9614d4212a6d10378b169fe21" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
W20260709 13:01:44.614086  8894 leader_election.cc:343] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.610206  9228 raft_consensus.cc:2749] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.609602  9201 raft_consensus.cc:359] T fcf32f9353564e799c94067d0f6b4c5b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:44.616099  9201 raft_consensus.cc:385] T fcf32f9353564e799c94067d0f6b4c5b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.616439  9201 raft_consensus.cc:740] T fcf32f9353564e799c94067d0f6b4c5b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.616477  8895 leader_election.cc:304] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f; no voters: f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:44.617343  9201 consensus_queue.cc:260] T fcf32f9353564e799c94067d0f6b4c5b P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:44.617720  9228 raft_consensus.cc:2804] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:44.623878  9207 leader_election.cc:290] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:44.619670  9201 ts_tablet_manager.cc:1434] T fcf32f9353564e799c94067d0f6b4c5b P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:01:44.626559  9201 tablet_bootstrap.cc:492] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:44.634692  9197 tablet_bootstrap.cc:654] T fe53d907711b42008ace8e547dc6f7fc P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.611652  9238 raft_consensus.cc:515] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:44.641386  9201 tablet_bootstrap.cc:654] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.641911  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf32f9353564e799c94067d0f6b4c5b" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:44.642894  9238 leader_election.cc:290] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:44.643028  9005 raft_consensus.cc:3060] T fcf32f9353564e799c94067d0f6b4c5b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.646919  9196 tablet_bootstrap.cc:654] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.647658  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf32f9353564e799c94067d0f6b4c5b" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:44.648336  9153 raft_consensus.cc:3060] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.655861  9005 raft_consensus.cc:2468] T fcf32f9353564e799c94067d0f6b4c5b P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:44.656244  8917 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec71963326742b199b954dc1c0bbacb (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:44.671512  8917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec71963326742b199b954dc1c0bbacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.659179  8990 tablet_service.cc:1511] Processing CreateTablet for tablet 673fe46efdf148bc9fd1720f67d50193 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:44.661825  9136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec71963326742b199b954dc1c0bbacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.677047  8828 catalog_manager.cc:5697] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.678728  8990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 673fe46efdf148bc9fd1720f67d50193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.687086  9065 tablet_service.cc:1511] Processing CreateTablet for tablet 673fe46efdf148bc9fd1720f67d50193 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:44.691804  9065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 673fe46efdf148bc9fd1720f67d50193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.694810  8989 tablet_service.cc:1511] Processing CreateTablet for tablet a8bc830d85cb40fda2ac909a09c75e07 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:44.698611  9068 tablet_service.cc:1511] Processing CreateTablet for tablet a8bc830d85cb40fda2ac909a09c75e07 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:44.702616  9228 raft_consensus.cc:697] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 1 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:01:44.703125  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8bc830d85cb40fda2ac909a09c75e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.703586  9228 consensus_queue.cc:237] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:44.704862  9068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8bc830d85cb40fda2ac909a09c75e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.707003  9043 leader_election.cc:304] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:44.707929  9206 raft_consensus.cc:2804] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:44.708096  9198 tablet_bootstrap.cc:492] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:44.708662  9206 raft_consensus.cc:697] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:44.670099  9153 raft_consensus.cc:2468] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:44.708685  9198 ts_tablet_manager.cc:1403] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.332s	user 0.021s	sys 0.040s
I20260709 13:01:44.713549  9198 raft_consensus.cc:359] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.724116  9198 raft_consensus.cc:385] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.724473  9198 raft_consensus.cc:740] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.709578  9206 consensus_queue.cc:237] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:44.726096  8916 tablet_service.cc:1511] Processing CreateTablet for tablet 1b42ffd5f054411aba877e8c374e5c15 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:44.727551  8916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b42ffd5f054411aba877e8c374e5c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.728881  9198 consensus_queue.cc:260] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.702020  8920 tablet_service.cc:1511] Processing CreateTablet for tablet a8bc830d85cb40fda2ac909a09c75e07 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:44.730253  9142 tablet_service.cc:1511] Processing CreateTablet for tablet 673fe46efdf148bc9fd1720f67d50193 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:44.747732  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 673fe46efdf148bc9fd1720f67d50193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.748157  9143 tablet_service.cc:1511] Processing CreateTablet for tablet 1b42ffd5f054411aba877e8c374e5c15 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:44.749483  9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b42ffd5f054411aba877e8c374e5c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.759195  9204 raft_consensus.cc:493] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.759755  9204 raft_consensus.cc:515] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.767437  8920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8bc830d85cb40fda2ac909a09c75e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.767730  9196 tablet_bootstrap.cc:492] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:44.768445  9196 ts_tablet_manager.cc:1403] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.385s	user 0.011s	sys 0.003s
I20260709 13:01:44.772728  9238 raft_consensus.cc:493] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.773263  9238 raft_consensus.cc:515] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.773957  9228 consensus_queue.cc:1048] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:44.774189  8988 tablet_service.cc:1511] Processing CreateTablet for tablet 1b42ffd5f054411aba877e8c374e5c15 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:44.775537  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b42ffd5f054411aba877e8c374e5c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.776171  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe53d907711b42008ace8e547dc6f7fc" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:44.775537  9238 leader_election.cc:290] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:44.778653  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe53d907711b42008ace8e547dc6f7fc" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:44.783852  9044 leader_election.cc:343] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.779803  8930 raft_consensus.cc:2468] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:44.785149  9204 leader_election.cc:290] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:44.786454  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:44.791996  9044 leader_election.cc:304] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123
I20260709 13:01:44.793412  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:44.803519  9238 raft_consensus.cc:2804] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:44.803637  9118 leader_election.cc:304] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:44.804072  9238 raft_consensus.cc:493] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.804447  9238 raft_consensus.cc:3060] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.810683  9204 raft_consensus.cc:2749] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.818845  8827 catalog_manager.cc:5697] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.826195  9141 tablet_service.cc:1511] Processing CreateTablet for tablet 69981197f2a5423a8758576940d1bf76 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:44.827597  9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69981197f2a5423a8758576940d1bf76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.819917  9196 raft_consensus.cc:359] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:44.828141  9196 raft_consensus.cc:385] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.832067  9196 raft_consensus.cc:740] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.835955  8915 tablet_service.cc:1511] Processing CreateTablet for tablet 69981197f2a5423a8758576940d1bf76 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:44.837415  8915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69981197f2a5423a8758576940d1bf76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.840472  9197 tablet_bootstrap.cc:492] T fe53d907711b42008ace8e547dc6f7fc P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:44.843623  9153 raft_consensus.cc:3060] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.798856  9198 ts_tablet_manager.cc:1434] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.004s
I20260709 13:01:44.848356  9198 tablet_bootstrap.cc:492] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:44.837350  9196 consensus_queue.cc:260] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:44.863765  9196 ts_tablet_manager.cc:1434] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.095s	user 0.011s	sys 0.000s
W20260709 13:01:44.866621  9239 log.cc:927] Time spent T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:44.867127  9198 tablet_bootstrap.cc:654] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.868222  9228 consensus_queue.cc:1048] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:44.873740  9068 tablet_service.cc:1511] Processing CreateTablet for tablet 69981197f2a5423a8758576940d1bf76 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:44.875046  9068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69981197f2a5423a8758576940d1bf76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.878326  9196 tablet_bootstrap.cc:492] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:44.890998  9228 raft_consensus.cc:493] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.878965  9197 ts_tablet_manager.cc:1403] T fe53d907711b42008ace8e547dc6f7fc P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.549s	user 0.023s	sys 0.034s
I20260709 13:01:44.902709  9228 raft_consensus.cc:515] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:44.905606  9228 leader_election.cc:290] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:44.908136  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:44.909183  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:44.910095  9079 raft_consensus.cc:2468] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 0.
I20260709 13:01:44.905211  8990 tablet_service.cc:1511] Processing CreateTablet for tablet 36c7c3cea0934ff59d24774835ed3e79 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:44.913699  8893 leader_election.cc:304] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
W20260709 13:01:44.914850  8894 leader_election.cc:343] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.915180  8990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c7c3cea0934ff59d24774835ed3e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.920740  9197 raft_consensus.cc:359] T fe53d907711b42008ace8e547dc6f7fc P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.921532  9197 raft_consensus.cc:385] T fe53d907711b42008ace8e547dc6f7fc P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.921814  9197 raft_consensus.cc:740] T fe53d907711b42008ace8e547dc6f7fc P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.926877  9201 tablet_bootstrap.cc:492] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:44.927469  9201 ts_tablet_manager.cc:1403] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.301s	user 0.021s	sys 0.005s
I20260709 13:01:44.927738  8916 tablet_service.cc:1511] Processing CreateTablet for tablet 55c00dbf47fd4608bc730f65286bd4a2 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:44.929157  8916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55c00dbf47fd4608bc730f65286bd4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.887480  9238 raft_consensus.cc:515] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.931874  9238 leader_election.cc:290] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:44.932564  9201 raft_consensus.cc:359] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:44.933326  9201 raft_consensus.cc:385] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.922850  9228 raft_consensus.cc:2804] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:44.933629  9201 raft_consensus.cc:740] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.934031  9228 raft_consensus.cc:493] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.934357  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe53d907711b42008ace8e547dc6f7fc" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:44.934517  9228 raft_consensus.cc:3060] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.934864  9196 tablet_bootstrap.cc:654] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.934607  9201 consensus_queue.cc:260] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:44.937028  9201 ts_tablet_manager.cc:1434] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:01:44.938438  9198 tablet_bootstrap.cc:492] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:44.938941  9198 ts_tablet_manager.cc:1403] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.091s	user 0.029s	sys 0.022s
I20260709 13:01:44.939424  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe53d907711b42008ace8e547dc6f7fc" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:44.940048  8929 raft_consensus.cc:3060] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.942081  9198 raft_consensus.cc:359] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:44.942513  9197 consensus_queue.cc:260] T fe53d907711b42008ace8e547dc6f7fc P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.943143  9198 raft_consensus.cc:385] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.943501  9198 raft_consensus.cc:740] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.943661  9153 raft_consensus.cc:3060] T fe53d907711b42008ace8e547dc6f7fc P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.944470  9198 consensus_queue.cc:260] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
W20260709 13:01:44.943219  9044 consensus_peers.cc:597] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:44.946866  9068 tablet_service.cc:1511] Processing CreateTablet for tablet 36c7c3cea0934ff59d24774835ed3e79 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:44.948199  9068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c7c3cea0934ff59d24774835ed3e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.948760  9198 ts_tablet_manager.cc:1434] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:01:44.949761  9198 tablet_bootstrap.cc:492] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:44.950428  9197 ts_tablet_manager.cc:1434] T fe53d907711b42008ace8e547dc6f7fc P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.047s	user 0.003s	sys 0.004s
I20260709 13:01:44.951472  9197 tablet_bootstrap.cc:492] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:44.953433  8929 raft_consensus.cc:2468] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:44.937652  8828 catalog_manager.cc:5697] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.945668  9143 tablet_service.cc:1511] Processing CreateTablet for tablet 36c7c3cea0934ff59d24774835ed3e79 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:44.960186  9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c7c3cea0934ff59d24774835ed3e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.966003  9198 tablet_bootstrap.cc:654] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.967934  9044 leader_election.cc:304] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:44.968135  8989 tablet_service.cc:1511] Processing CreateTablet for tablet 55c00dbf47fd4608bc730f65286bd4a2 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:44.968817  9238 raft_consensus.cc:2804] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:44.969295  9238 raft_consensus.cc:697] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:44.969583  8989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55c00dbf47fd4608bc730f65286bd4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:44.970161  9238 consensus_queue.cc:237] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:44.976078  9201 tablet_bootstrap.cc:492] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:44.976646  9206 raft_consensus.cc:493] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.978178  9206 raft_consensus.cc:515] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:44.989702  9206 leader_election.cc:290] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:44.991143  9228 raft_consensus.cc:515] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:44.993516  9153 raft_consensus.cc:2468] T fe53d907711b42008ace8e547dc6f7fc P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:45.014750  9196 tablet_bootstrap.cc:492] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:45.015302  9196 ts_tablet_manager.cc:1403] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.150s	user 0.021s	sys 0.020s
I20260709 13:01:45.018334  9196 raft_consensus.cc:359] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.019119  9196 raft_consensus.cc:385] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.022703  9196 raft_consensus.cc:740] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.017925  9201 tablet_bootstrap.cc:654] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.011169  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:45.012939  9004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:45.030618  9228 leader_election.cc:290] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:45.031553  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:45.031880  9142 tablet_service.cc:1511] Processing CreateTablet for tablet 9a12c81f118b4261bdad649a5d121e25 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:01:45.033236  8894 leader_election.cc:343] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.034791  8988 tablet_service.cc:1511] Processing CreateTablet for tablet 9a12c81f118b4261bdad649a5d121e25 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:45.036070  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a12c81f118b4261bdad649a5d121e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.037369  9206 consensus_queue.cc:1048] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:45.037634  8929 raft_consensus.cc:2468] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:45.038516  8920 tablet_service.cc:1511] Processing CreateTablet for tablet 9a12c81f118b4261bdad649a5d121e25 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:45.039812  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:45.039813  8920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a12c81f118b4261bdad649a5d121e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.040452  9079 raft_consensus.cc:3060] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.040535  9196 consensus_queue.cc:260] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.042711  9044 leader_election.cc:304] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:45.033263  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a12c81f118b4261bdad649a5d121e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.044816  9065 tablet_service.cc:1511] Processing CreateTablet for tablet 7a907eff584544e28628c20d7addb69c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:45.046134  9065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a907eff584544e28628c20d7addb69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.046478  9141 tablet_service.cc:1511] Processing CreateTablet for tablet 7a907eff584544e28628c20d7addb69c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:45.048125  9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a907eff584544e28628c20d7addb69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.056879  9206 raft_consensus.cc:2804] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.057430  9206 raft_consensus.cc:493] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.057803  9206 raft_consensus.cc:3060] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:45.063129  9043 leader_election.cc:343] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.063733  8915 tablet_service.cc:1511] Processing CreateTablet for tablet 7a907eff584544e28628c20d7addb69c (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:45.064942  9196 ts_tablet_manager.cc:1434] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:01:45.065100  8915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a907eff584544e28628c20d7addb69c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.066134  9208 raft_consensus.cc:493] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.066651  9208 raft_consensus.cc:515] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.066962  8991 tablet_service.cc:1511] Processing CreateTablet for tablet ad5b06a466054767b5daa1085aca6ea5 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:45.068362  8991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5b06a466054767b5daa1085aca6ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.068718  9208 leader_election.cc:290] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:45.070093  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dffac6d3a0342be9474526316a71a85" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:45.071492  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dffac6d3a0342be9474526316a71a85" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:45.076418  8968 leader_election.cc:343] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:45.077437  8970 leader_election.cc:343] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.077875  8970 leader_election.cc:304] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:45.040149  9068 tablet_service.cc:1511] Processing CreateTablet for tablet 55c00dbf47fd4608bc730f65286bd4a2 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:45.079032  9208 raft_consensus.cc:2749] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.079586  9068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55c00dbf47fd4608bc730f65286bd4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.082927  9196 tablet_bootstrap.cc:492] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:45.083657  9197 tablet_bootstrap.cc:654] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.089749  9067 tablet_service.cc:1511] Processing CreateTablet for tablet ad5b06a466054767b5daa1085aca6ea5 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:45.109710  9136 tablet_service.cc:1511] Processing CreateTablet for tablet ad5b06a466054767b5daa1085aca6ea5 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:45.119449  9136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5b06a466054767b5daa1085aca6ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.120324  9201 tablet_bootstrap.cc:492] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:45.120870  9201 ts_tablet_manager.cc:1403] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.183s	user 0.016s	sys 0.012s
I20260709 13:01:45.122625  9067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad5b06a466054767b5daa1085aca6ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.132316  8916 tablet_service.cc:1511] Processing CreateTablet for tablet a8af72e77c964acd910c3ec90fe52078 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:45.133672  8916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8af72e77c964acd910c3ec90fe52078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.132104  9206 raft_consensus.cc:515] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.135959  9196 tablet_bootstrap.cc:654] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.138352  9004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:45.141505  9198 tablet_bootstrap.cc:492] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:45.142097  9198 ts_tablet_manager.cc:1403] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.193s	user 0.029s	sys 0.008s
I20260709 13:01:45.142143  8993 tablet_service.cc:1511] Processing CreateTablet for tablet a8af72e77c964acd910c3ec90fe52078 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:45.143682  8993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8af72e77c964acd910c3ec90fe52078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.147315  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:45.147940  8929 raft_consensus.cc:3060] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:45.144596  9043 leader_election.cc:343] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.155553  9201 raft_consensus.cc:359] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.156307  9201 raft_consensus.cc:385] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.156605  9201 raft_consensus.cc:740] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.157811  9198 raft_consensus.cc:359] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.158552  9198 raft_consensus.cc:385] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.158846  9198 raft_consensus.cc:740] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.144708  9206 leader_election.cc:290] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:45.159554  8828 catalog_manager.cc:5697] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.162397  9201 consensus_queue.cc:260] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.164413  9068 tablet_service.cc:1511] Processing CreateTablet for tablet a8af72e77c964acd910c3ec90fe52078 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:45.168681  9068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8af72e77c964acd910c3ec90fe52078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.176820  8929 raft_consensus.cc:2468] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:45.160945  9079 raft_consensus.cc:2468] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 1.
I20260709 13:01:45.178944  9142 tablet_service.cc:1511] Processing CreateTablet for tablet a489378335c74a0fb5932be1e308fc64 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:45.180573  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a489378335c74a0fb5932be1e308fc64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.183511  9044 leader_election.cc:304] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:45.159579  9198 consensus_queue.cc:260] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.187891  9238 raft_consensus.cc:2804] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.198510  8893 leader_election.cc:304] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:45.200253  9242 raft_consensus.cc:2804] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.200778  9242 raft_consensus.cc:697] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 1 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:01:45.211707  9242 consensus_queue.cc:237] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.213522  8993 tablet_service.cc:1511] Processing CreateTablet for tablet a489378335c74a0fb5932be1e308fc64 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:45.215169  8993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a489378335c74a0fb5932be1e308fc64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.223059  8915 tablet_service.cc:1511] Processing CreateTablet for tablet a489378335c74a0fb5932be1e308fc64 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:45.226763  8915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a489378335c74a0fb5932be1e308fc64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.229007  9228 raft_consensus.cc:493] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.229557  9228 raft_consensus.cc:515] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.231666  9228 leader_election.cc:290] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:45.236966  9142 tablet_service.cc:1511] Processing CreateTablet for tablet 03db717c8e2a41c09a753240a6dbbb02 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:45.238231  9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03db717c8e2a41c09a753240a6dbbb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.239156  9064 tablet_service.cc:1511] Processing CreateTablet for tablet 03db717c8e2a41c09a753240a6dbbb02 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:45.240223  9064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03db717c8e2a41c09a753240a6dbbb02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:45.240515  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e725e7a33445fb9c78550251c3db98" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:45.237965  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37e725e7a33445fb9c78550251c3db98" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:45.242101  9263 raft_consensus.cc:493] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.242749  9263 raft_consensus.cc:515] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.243295  8893 leader_election.cc:304] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:45.244582  9228 raft_consensus.cc:2749] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.245441  9263 leader_election.cc:290] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:45.246946  9004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317ccde7219b44848d0dd04ca340a83f" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:45.243211  8920 tablet_service.cc:1511] Processing CreateTablet for tablet 03db717c8e2a41c09a753240a6dbbb02 (DEFAULT_TABLE table=test-workload [id=569ba9a14b4846cfbc362060a12651cd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:45.247601  9004 raft_consensus.cc:2468] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:45.247818  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317ccde7219b44848d0dd04ca340a83f" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:45.248736  9043 leader_election.cc:304] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:45.248404  8920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03db717c8e2a41c09a753240a6dbbb02. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:45.249333  9044 leader_election.cc:343] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.252038  9201 ts_tablet_manager.cc:1434] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.131s	user 0.007s	sys 0.005s
I20260709 13:01:45.253432  9201 tablet_bootstrap.cc:492] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:45.261972  9197 tablet_bootstrap.cc:492] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:45.262526  9197 ts_tablet_manager.cc:1403] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.311s	user 0.014s	sys 0.002s
I20260709 13:01:45.265743  9197 raft_consensus.cc:359] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.266562  9197 raft_consensus.cc:385] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.266865  9197 raft_consensus.cc:740] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.267728  9197 consensus_queue.cc:260] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
W20260709 13:01:45.269170  8894 consensus_peers.cc:597] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:45.270515  9197 ts_tablet_manager.cc:1434] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:45.271675  9197 tablet_bootstrap.cc:492] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:45.273628  9263 raft_consensus.cc:2804] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.274183  9263 raft_consensus.cc:493] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.281020  9263 raft_consensus.cc:3060] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.290840  9201 tablet_bootstrap.cc:654] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.292953  9242 consensus_queue.cc:1048] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:45.300915  9197 tablet_bootstrap.cc:654] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.300093  8827 catalog_manager.cc:5697] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.302197  9198 ts_tablet_manager.cc:1434] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.160s	user 0.014s	sys 0.046s
I20260709 13:01:45.302663  9264 consensus_queue.cc:1048] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:45.312207  9198 tablet_bootstrap.cc:492] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:45.278983  9238 raft_consensus.cc:697] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:45.310710  8929 raft_consensus.cc:3060] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.313850  9238 consensus_queue.cc:237] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.329274  9198 tablet_bootstrap.cc:654] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.330545  9196 tablet_bootstrap.cc:492] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:45.331774  9196 ts_tablet_manager.cc:1403] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.249s	user 0.017s	sys 0.011s
I20260709 13:01:45.332391  9264 consensus_queue.cc:1048] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:45.342949  9204 raft_consensus.cc:493] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.343513  9204 raft_consensus.cc:515] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.345584  9204 leader_election.cc:290] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:45.347273  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317ccde7219b44848d0dd04ca340a83f" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:45.348028  9005 raft_consensus.cc:2468] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:45.377869  9196 raft_consensus.cc:359] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.378919  9196 raft_consensus.cc:385] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.379277  9196 raft_consensus.cc:740] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.380324  9196 consensus_queue.cc:260] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
W20260709 13:01:45.380894  8874 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:45.383821  9201 tablet_bootstrap.cc:492] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:45.384404  9201 ts_tablet_manager.cc:1403] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.131s	user 0.014s	sys 0.016s
I20260709 13:01:45.387580  9201 raft_consensus.cc:359] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.388365  9201 raft_consensus.cc:385] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.388728  9201 raft_consensus.cc:740] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.370501  9117 leader_election.cc:304] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:45.389858  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317ccde7219b44848d0dd04ca340a83f" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:45.385558  9263 raft_consensus.cc:515] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.391201  9269 raft_consensus.cc:2804] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.391765  9269 raft_consensus.cc:493] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.392205  9269 raft_consensus.cc:3060] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.393639  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317ccde7219b44848d0dd04ca340a83f" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:45.394328  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317ccde7219b44848d0dd04ca340a83f" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:45.394708  9005 raft_consensus.cc:3060] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.395051  9263 leader_election.cc:290] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:45.396763  9263 consensus_queue.cc:1048] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:45.397972  9197 tablet_bootstrap.cc:492] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:45.398512  9197 ts_tablet_manager.cc:1403] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.020s
I20260709 13:01:45.401752  9079 raft_consensus.cc:2393] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 069063a72de443729cdfb3fcbfa6a123 in current term 1: Already voted for candidate 0717530c054a42c5aa7aca788ba070a5 in this term.
I20260709 13:01:45.405071  9197 raft_consensus.cc:359] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.405828  9197 raft_consensus.cc:385] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.406157  9197 raft_consensus.cc:740] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.407156  9197 consensus_queue.cc:260] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.409338  9005 raft_consensus.cc:2468] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:45.411664  9196 ts_tablet_manager.cc:1434] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.001s
I20260709 13:01:45.409361  9197 ts_tablet_manager.cc:1434] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:01:45.412606  8827 catalog_manager.cc:5697] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.416611  9196 tablet_bootstrap.cc:492] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:45.416828  9043 leader_election.cc:304] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:45.418022  9238 raft_consensus.cc:2804] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.418080  9269 raft_consensus.cc:515] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.418850  9238 raft_consensus.cc:697] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:45.419342  9152 raft_consensus.cc:2393] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0717530c054a42c5aa7aca788ba070a5 in current term 1: Already voted for candidate 069063a72de443729cdfb3fcbfa6a123 in this term.
I20260709 13:01:45.419727  9238 consensus_queue.cc:237] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.422403  9197 tablet_bootstrap.cc:492] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:45.423928  9201 consensus_queue.cc:260] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.431453  9201 ts_tablet_manager.cc:1434] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:01:45.432467  9197 tablet_bootstrap.cc:654] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.432514  9201 tablet_bootstrap.cc:492] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:45.443792  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317ccde7219b44848d0dd04ca340a83f" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:45.444624  9005 raft_consensus.cc:2393] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 069063a72de443729cdfb3fcbfa6a123 in current term 1: Already voted for candidate 0717530c054a42c5aa7aca788ba070a5 in this term.
I20260709 13:01:45.444399  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317ccde7219b44848d0dd04ca340a83f" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:45.452044  9116 leader_election.cc:304] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:45.453105  9204 raft_consensus.cc:2749] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.450505  9269 leader_election.cc:290] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:45.463275  9196 tablet_bootstrap.cc:654] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.471894  9198 tablet_bootstrap.cc:492] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:45.472677  9198 ts_tablet_manager.cc:1403] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.161s	user 0.013s	sys 0.009s
I20260709 13:01:45.473702  8827 catalog_manager.cc:5697] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.479183  9198 raft_consensus.cc:359] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.479983  9198 raft_consensus.cc:385] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.480285  9198 raft_consensus.cc:740] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.481182  9198 consensus_queue.cc:260] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.485458  9197 tablet_bootstrap.cc:492] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:45.485931  9197 ts_tablet_manager.cc:1403] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.064s	user 0.020s	sys 0.016s
I20260709 13:01:45.486025  9196 tablet_bootstrap.cc:492] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:45.486865  9268 consensus_queue.cc:1048] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:45.490259  9196 ts_tablet_manager.cc:1403] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.005s
I20260709 13:01:45.487811  9198 ts_tablet_manager.cc:1434] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:01:45.492271  9197 raft_consensus.cc:359] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.492863  9197 raft_consensus.cc:385] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.493119  9197 raft_consensus.cc:740] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.493714  9197 consensus_queue.cc:260] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.489589  9201 tablet_bootstrap.cc:654] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.495956  9197 ts_tablet_manager.cc:1434] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:45.492530  9198 tablet_bootstrap.cc:492] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:45.496907  9197 tablet_bootstrap.cc:492] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:45.503000  9197 tablet_bootstrap.cc:654] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.504964  9198 tablet_bootstrap.cc:654] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.511663  9201 tablet_bootstrap.cc:492] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:45.512398  9201 ts_tablet_manager.cc:1403] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.005s
I20260709 13:01:45.515540  9201 raft_consensus.cc:359] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.516274  9201 raft_consensus.cc:385] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.516587  9201 raft_consensus.cc:740] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.517329  9201 consensus_queue.cc:260] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.518680  9196 raft_consensus.cc:359] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.519354  9196 raft_consensus.cc:385] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.519630  9196 raft_consensus.cc:740] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.520820  9196 consensus_queue.cc:260] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.523146  9201 ts_tablet_manager.cc:1434] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:01:45.524238  9201 tablet_bootstrap.cc:492] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:45.527910  9208 raft_consensus.cc:493] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.528450  9208 raft_consensus.cc:515] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.530555  9208 leader_election.cc:290] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:45.532296  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:45.534471  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:45.535359  9079 raft_consensus.cc:2393] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3ac81bf7b994af084e9929fac14de34 in current term 1: Already voted for candidate 4667e9699c4d413889fc866e0e560d1f in this term.
I20260709 13:01:45.537201  8968 leader_election.cc:304] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:45.537659  9196 ts_tablet_manager.cc:1434] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:01:45.538458  9208 raft_consensus.cc:3060] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.538633  9196 tablet_bootstrap.cc:492] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:45.541882  9197 tablet_bootstrap.cc:492] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:45.542623  9197 ts_tablet_manager.cc:1403] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.015s
I20260709 13:01:45.546316  9197 raft_consensus.cc:359] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.547420  9197 raft_consensus.cc:385] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.547699  9197 raft_consensus.cc:740] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.548220  9197 consensus_queue.cc:260] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.550076  9197 ts_tablet_manager.cc:1434] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:45.551131  9197 tablet_bootstrap.cc:492] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:45.552933  9201 tablet_bootstrap.cc:654] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.556064  9198 tablet_bootstrap.cc:492] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:45.556885  9197 tablet_bootstrap.cc:654] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.558262  9198 ts_tablet_manager.cc:1403] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.031s
I20260709 13:01:45.561291  9198 raft_consensus.cc:359] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.562266  9198 raft_consensus.cc:385] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.562667  9198 raft_consensus.cc:740] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.564072  9208 raft_consensus.cc:2749] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.563768  9198 consensus_queue.cc:260] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.557651  9196 tablet_bootstrap.cc:654] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.566125  9198 ts_tablet_manager.cc:1434] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:01:45.568813  9201 tablet_bootstrap.cc:492] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:45.569268  9201 ts_tablet_manager.cc:1403] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.003s
I20260709 13:01:45.570374  9198 tablet_bootstrap.cc:492] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:45.571962  9201 raft_consensus.cc:359] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.572607  9201 raft_consensus.cc:385] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.572875  9201 raft_consensus.cc:740] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.573541  9201 consensus_queue.cc:260] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.575517  9201 ts_tablet_manager.cc:1434] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:45.576340  9201 tablet_bootstrap.cc:492] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:45.576912  9198 tablet_bootstrap.cc:654] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.583524  9197 tablet_bootstrap.cc:492] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:45.583983  9197 ts_tablet_manager.cc:1403] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.003s
I20260709 13:01:45.586858  9201 tablet_bootstrap.cc:654] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.590255  9268 raft_consensus.cc:493] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.590934  9268 raft_consensus.cc:515] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.591936  9197 raft_consensus.cc:359] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.592679  9197 raft_consensus.cc:385] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.592969  9197 raft_consensus.cc:740] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.593657  9197 consensus_queue.cc:260] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.595765  9197 ts_tablet_manager.cc:1434] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:01:45.596412  9268 leader_election.cc:290] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:45.597172  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dffac6d3a0342be9474526316a71a85" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:45.598040  9005 raft_consensus.cc:2468] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:45.601024  9197 tablet_bootstrap.cc:492] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:45.600666  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dffac6d3a0342be9474526316a71a85" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:45.602106  9043 leader_election.cc:304] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:45.602524  8929 raft_consensus.cc:2468] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:45.603341  9268 raft_consensus.cc:2804] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.603966  9268 raft_consensus.cc:493] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.604432  9268 raft_consensus.cc:3060] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.607760  9197 tablet_bootstrap.cc:654] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.615496  9197 tablet_bootstrap.cc:492] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:45.615556  9196 tablet_bootstrap.cc:492] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:45.616070  9197 ts_tablet_manager.cc:1403] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:01:45.616139  9196 ts_tablet_manager.cc:1403] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.006s
I20260709 13:01:45.615496  9201 tablet_bootstrap.cc:492] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:45.617293  9201 ts_tablet_manager.cc:1403] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.005s
I20260709 13:01:45.616775  9268 raft_consensus.cc:515] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.618816  9197 raft_consensus.cc:359] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.619503  9197 raft_consensus.cc:385] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.619088  9196 raft_consensus.cc:359] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.619781  9197 raft_consensus.cc:740] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.619951  9196 raft_consensus.cc:385] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.619889  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dffac6d3a0342be9474526316a71a85" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:45.620611  9196 raft_consensus.cc:740] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.620774  8929 raft_consensus.cc:3060] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.621307  9197 consensus_queue.cc:260] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.622484  9198 tablet_bootstrap.cc:492] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:45.623667  9197 ts_tablet_manager.cc:1434] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:45.624001  9198 ts_tablet_manager.cc:1403] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.013s
I20260709 13:01:45.624642  9197 tablet_bootstrap.cc:492] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:45.626941  9198 raft_consensus.cc:359] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.619853  9201 raft_consensus.cc:359] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.628001  9196 consensus_queue.cc:260] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.628965  9201 raft_consensus.cc:385] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.629405  9201 raft_consensus.cc:740] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.630172  9201 consensus_queue.cc:260] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.630978  9197 tablet_bootstrap.cc:654] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.632421  9201 ts_tablet_manager.cc:1434] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:01:45.628964  9198 raft_consensus.cc:385] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.633193  9198 raft_consensus.cc:740] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.634018  9198 consensus_queue.cc:260] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.635849  9201 tablet_bootstrap.cc:492] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:45.638459  9196 ts_tablet_manager.cc:1434] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:01:45.639211  9198 ts_tablet_manager.cc:1434] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:01:45.640208  9198 tablet_bootstrap.cc:492] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:45.640406  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dffac6d3a0342be9474526316a71a85" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:45.641010  9005 raft_consensus.cc:3060] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.646579  9198 tablet_bootstrap.cc:654] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.656502  9196 tablet_bootstrap.cc:492] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:45.657701  9005 raft_consensus.cc:2468] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:45.662269  9004 raft_consensus.cc:3060] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.671728  9196 tablet_bootstrap.cc:654] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.671788  9043 leader_election.cc:304] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:45.672847  9263 raft_consensus.cc:2804] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.673379  9263 raft_consensus.cc:697] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:45.674243  9263 consensus_queue.cc:237] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.677074  9269 raft_consensus.cc:493] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.677563  9269 raft_consensus.cc:515] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.665051  9198 tablet_bootstrap.cc:492] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:45.678593  9198 ts_tablet_manager.cc:1403] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.002s
I20260709 13:01:45.679626  9269 leader_election.cc:290] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:45.681362  9198 raft_consensus.cc:359] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.681669  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6fcb3fac4347a1bd0de44956d459d8" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:45.682081  9198 raft_consensus.cc:385] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.681842  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6fcb3fac4347a1bd0de44956d459d8" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:45.682292  8930 raft_consensus.cc:2468] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:45.682410  9198 raft_consensus.cc:740] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.682838  9005 raft_consensus.cc:2468] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:45.683194  9198 consensus_queue.cc:260] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.683770  9118 leader_election.cc:304] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:45.684657  9269 raft_consensus.cc:2804] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.685074  9269 raft_consensus.cc:493] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.685392  9198 ts_tablet_manager.cc:1434] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:01:45.685451  9269 raft_consensus.cc:3060] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.662599  9268 leader_election.cc:290] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:45.628029  8929 raft_consensus.cc:2468] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:45.689059  9198 tablet_bootstrap.cc:492] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:45.670086  9201 tablet_bootstrap.cc:654] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.695333  9197 tablet_bootstrap.cc:492] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:45.695930  9197 ts_tablet_manager.cc:1403] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.024s
I20260709 13:01:45.698855  9197 raft_consensus.cc:359] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.699762  9197 raft_consensus.cc:385] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.700181  9197 raft_consensus.cc:740] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.693614  9269 raft_consensus.cc:515] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.701597  8827 catalog_manager.cc:5697] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.703759  9198 tablet_bootstrap.cc:654] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.705466  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6fcb3fac4347a1bd0de44956d459d8" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:45.706184  8929 raft_consensus.cc:3060] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.707690  9207 consensus_queue.cc:1048] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:45.713701  9263 raft_consensus.cc:493] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.714502  9263 raft_consensus.cc:515] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.716289  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6fcb3fac4347a1bd0de44956d459d8" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:45.717108  9003 raft_consensus.cc:3060] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.719062  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a11453401345558e4c1e70b91f288c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:45.720057  9002 raft_consensus.cc:2468] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:45.724171  9043 leader_election.cc:304] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:45.725342  9268 raft_consensus.cc:2804] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.725829  9268 raft_consensus.cc:493] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.726316  9268 raft_consensus.cc:3060] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.726204  9206 consensus_queue.cc:1048] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:45.728547  9207 raft_consensus.cc:493] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.729048  9207 raft_consensus.cc:515] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.731218  9207 leader_election.cc:290] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:45.725898  9238 raft_consensus.cc:493] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.732334  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae45916fe794471981c2ddff2693264" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:45.733265  9079 raft_consensus.cc:2468] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 0.
I20260709 13:01:45.734107  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae45916fe794471981c2ddff2693264" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:45.734937  8893 leader_election.cc:304] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:45.732409  9238 raft_consensus.cc:515] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.738895  9238 leader_election.cc:290] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:45.734926  9153 raft_consensus.cc:2468] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 0.
I20260709 13:01:45.739945  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3121fd08469404b9608676838f187ba" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:45.742537  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3121fd08469404b9608676838f187ba" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
W20260709 13:01:45.742875  9044 leader_election.cc:343] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:45.744551  9043 leader_election.cc:343] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.745291  9043 leader_election.cc:304] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:45.746409  9207 raft_consensus.cc:2804] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.747000  9238 raft_consensus.cc:2749] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.747068  9207 raft_consensus.cc:493] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.748129  9207 raft_consensus.cc:3060] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.744535  9269 leader_election.cc:290] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:45.751058  9002 raft_consensus.cc:3060] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.752187  9197 consensus_queue.cc:260] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.758674  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a11453401345558e4c1e70b91f288c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:45.759452  9153 raft_consensus.cc:2468] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:45.762042  9003 raft_consensus.cc:2468] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:45.767791  9197 ts_tablet_manager.cc:1434] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.001s
I20260709 13:01:45.758766  9201 tablet_bootstrap.cc:492] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:45.769260  9201 ts_tablet_manager.cc:1403] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.134s	user 0.033s	sys 0.009s
I20260709 13:01:45.769744  9197 tablet_bootstrap.cc:492] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:45.771931  9201 raft_consensus.cc:359] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.772615  9201 raft_consensus.cc:385] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.772872  9201 raft_consensus.cc:740] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.774741  9117 leader_election.cc:304] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:45.777004  9201 consensus_queue.cc:260] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.780496  9201 ts_tablet_manager.cc:1434] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:01:45.781380  9201 tablet_bootstrap.cc:492] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:45.787022  8929 raft_consensus.cc:2468] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:45.790239  9198 tablet_bootstrap.cc:492] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:45.790762  9198 ts_tablet_manager.cc:1403] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.014s
I20260709 13:01:45.793566  9198 raft_consensus.cc:359] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.793987  9197 tablet_bootstrap.cc:654] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.794271  9198 raft_consensus.cc:385] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.794694  9198 raft_consensus.cc:740] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.798708  9269 raft_consensus.cc:2804] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.799683  9269 raft_consensus.cc:697] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:45.801225  9269 consensus_queue.cc:237] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.795540  9198 consensus_queue.cc:260] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.806799  9201 tablet_bootstrap.cc:654] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.809983  9198 ts_tablet_manager.cc:1434] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:01:45.810993  9198 tablet_bootstrap.cc:492] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:45.810719  9242 consensus_queue.cc:1048] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:45.812649  9263 leader_election.cc:290] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
W20260709 13:01:45.814742  9295 log.cc:927] Time spent T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:01:45.816463  9196 tablet_bootstrap.cc:492] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:45.816965  9196 ts_tablet_manager.cc:1403] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.161s	user 0.049s	sys 0.089s
I20260709 13:01:45.819857  9196 raft_consensus.cc:359] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.820521  9196 raft_consensus.cc:385] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.820799  9196 raft_consensus.cc:740] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.821492  9196 consensus_queue.cc:260] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.823623  9196 ts_tablet_manager.cc:1434] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:01:45.824990  9196 tablet_bootstrap.cc:492] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:45.827451  9201 tablet_bootstrap.cc:492] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:45.830843  9196 tablet_bootstrap.cc:654] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.831089  9201 ts_tablet_manager.cc:1403] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 13:01:45.834188  9201 raft_consensus.cc:359] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.834865  9201 raft_consensus.cc:385] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.835129  9201 raft_consensus.cc:740] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.836537  9198 tablet_bootstrap.cc:654] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.838115  9201 consensus_queue.cc:260] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.839039  9204 raft_consensus.cc:493] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.839236  9197 tablet_bootstrap.cc:492] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:45.839852  9197 ts_tablet_manager.cc:1403] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.071s	user 0.024s	sys 0.001s
I20260709 13:01:45.839547  9204 raft_consensus.cc:515] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.841737  9204 leader_election.cc:290] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:45.843230  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d605f782fc8f426190d3419e627d88be" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
W20260709 13:01:45.844785  9117 leader_election.cc:343] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.845857  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d605f782fc8f426190d3419e627d88be" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:45.846490  9201 ts_tablet_manager.cc:1434] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
W20260709 13:01:45.847370  9116 leader_election.cc:343] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.847447  9201 tablet_bootstrap.cc:492] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:45.847873  9116 leader_election.cc:304] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:45.848909  9204 raft_consensus.cc:2749] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.850240  9197 raft_consensus.cc:359] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.851109  9197 raft_consensus.cc:385] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.851512  9197 raft_consensus.cc:740] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.852326  9197 consensus_queue.cc:260] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.855321  9197 ts_tablet_manager.cc:1434] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:01:45.856331  9197 tablet_bootstrap.cc:492] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:45.857978  9201 tablet_bootstrap.cc:654] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.862394  9197 tablet_bootstrap.cc:654] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.862763  9198 tablet_bootstrap.cc:492] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:45.863238  9198 ts_tablet_manager.cc:1403] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.004s
I20260709 13:01:45.866544  9198 raft_consensus.cc:359] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.867422  9198 raft_consensus.cc:385] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.867774  9198 raft_consensus.cc:740] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.868907  9268 raft_consensus.cc:515] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.869123  9198 consensus_queue.cc:260] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.873198  9198 ts_tablet_manager.cc:1434] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:01:45.874477  9198 tablet_bootstrap.cc:492] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:45.880636  9208 raft_consensus.cc:493] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.880833  9197 tablet_bootstrap.cc:492] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:45.881549  9197 ts_tablet_manager.cc:1403] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.010s
I20260709 13:01:45.881199  9208 raft_consensus.cc:515] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:45.884315  9198 tablet_bootstrap.cc:654] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.886843  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:45.888212  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:45.888695  9201 tablet_bootstrap.cc:492] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:45.889149  9201 ts_tablet_manager.cc:1403] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 13:01:45.891342  8970 leader_election.cc:304] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:45.892413  8825 catalog_manager.cc:5697] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.897141  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a11453401345558e4c1e70b91f288c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:45.897686  9208 leader_election.cc:290] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:45.898041  9003 raft_consensus.cc:3060] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.898983  9208 raft_consensus.cc:2749] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:45.906294  9197 raft_consensus.cc:359] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.910477  9197 raft_consensus.cc:385] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.911237  9197 raft_consensus.cc:740] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.912428  9197 consensus_queue.cc:260] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.908869  9003 raft_consensus.cc:2468] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:45.916358  9204 raft_consensus.cc:493] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.916895  9204 raft_consensus.cc:515] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.918732  9197 ts_tablet_manager.cc:1434] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:01:45.920627  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e05e226d044b2eacc27e329f7c96aa" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:45.920831  9043 leader_election.cc:304] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:45.920889  9197 tablet_bootstrap.cc:492] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
W20260709 13:01:45.922322  9118 leader_election.cc:343] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.922688  9263 raft_consensus.cc:2804] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.923383  9263 raft_consensus.cc:697] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:45.923964  9004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e05e226d044b2eacc27e329f7c96aa" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:45.924505  9263 consensus_queue.cc:237] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
W20260709 13:01:45.925452  9117 leader_election.cc:343] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.919226  9265 consensus_queue.cc:1048] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:45.925997  9117 leader_election.cc:304] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:45.915349  9201 raft_consensus.cc:359] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.927278  9201 raft_consensus.cc:385] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.927657  9201 raft_consensus.cc:740] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.928499  9197 tablet_bootstrap.cc:654] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.928342  9201 consensus_queue.cc:260] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.919231  9204 leader_election.cc:290] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:45.930474  9312 raft_consensus.cc:2749] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.931156  9201 ts_tablet_manager.cc:1434] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:01:45.932161  9201 tablet_bootstrap.cc:492] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:45.934811  9198 tablet_bootstrap.cc:492] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:45.935539  9198 ts_tablet_manager.cc:1403] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.000s
I20260709 13:01:45.938993  9198 raft_consensus.cc:359] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.939713  9198 raft_consensus.cc:385] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.940012  9198 raft_consensus.cc:740] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.940157  9201 tablet_bootstrap.cc:654] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.940963  9197 tablet_bootstrap.cc:492] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:45.940914  9198 consensus_queue.cc:260] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.941825  9197 ts_tablet_manager.cc:1403] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:01:45.943528  9198 ts_tablet_manager.cc:1434] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:01:45.944487  9198 tablet_bootstrap.cc:492] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:45.944739  9197 raft_consensus.cc:359] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.945407  9197 raft_consensus.cc:385] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.945667  9197 raft_consensus.cc:740] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.951102  9263 consensus_queue.cc:1048] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:45.952149  9197 consensus_queue.cc:260] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.954593  9268 leader_election.cc:290] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:45.954873  9197 ts_tablet_manager.cc:1434] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:01:45.955850  9197 tablet_bootstrap.cc:492] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:45.958039  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a11453401345558e4c1e70b91f288c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:45.958904  9151 raft_consensus.cc:3060] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.962327  9197 tablet_bootstrap.cc:654] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.964385  9198 tablet_bootstrap.cc:654] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.965716  9201 tablet_bootstrap.cc:492] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:45.966251  9201 ts_tablet_manager.cc:1403] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.003s
I20260709 13:01:45.968914  9201 raft_consensus.cc:359] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.969626  9201 raft_consensus.cc:385] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.969898  9201 raft_consensus.cc:740] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.970556  9201 consensus_queue.cc:260] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:45.971565  9151 raft_consensus.cc:2468] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:45.973973  9265 raft_consensus.cc:493] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.975009  9197 tablet_bootstrap.cc:492] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:45.974674  9265 raft_consensus.cc:515] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:45.975687  9197 ts_tablet_manager.cc:1403] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.002s
I20260709 13:01:45.977591  9265 leader_election.cc:290] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:45.979856  9201 ts_tablet_manager.cc:1434] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:01:45.979566  9197 raft_consensus.cc:359] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.979916  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d605f782fc8f426190d3419e627d88be" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:45.981060  9201 tablet_bootstrap.cc:492] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:45.980840  9153 raft_consensus.cc:2468] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:45.981634  9004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d605f782fc8f426190d3419e627d88be" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:45.982190  9197 raft_consensus.cc:385] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.982659  9197 raft_consensus.cc:740] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.983810  9198 tablet_bootstrap.cc:492] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:45.983584  9197 consensus_queue.cc:260] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.983884  9044 leader_election.cc:304] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:45.984285  9198 ts_tablet_manager.cc:1403] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.008s
I20260709 13:01:45.982538  9004 raft_consensus.cc:2468] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:45.985997  9197 ts_tablet_manager.cc:1434] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:01:45.986093  9265 raft_consensus.cc:2804] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.986531  9265 raft_consensus.cc:493] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.986873  9265 raft_consensus.cc:3060] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.987178  9197 tablet_bootstrap.cc:492] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:45.987082  9198 raft_consensus.cc:359] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.987811  9198 raft_consensus.cc:385] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.988099  9198 raft_consensus.cc:740] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.988881  9198 consensus_queue.cc:260] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.991096  9201 tablet_bootstrap.cc:654] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.991057  9264 raft_consensus.cc:493] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.991755  9264 raft_consensus.cc:515] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:45.993980  9197 tablet_bootstrap.cc:654] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.995661  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72207701f3449e696f990856f3d7a94" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:45.996451  9238 consensus_queue.cc:1048] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:45.997920  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72207701f3449e696f990856f3d7a94" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:45.998802  9153 raft_consensus.cc:2468] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:45.993876  9264 leader_election.cc:290] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:46.000743  9044 leader_election.cc:304] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
W20260709 13:01:46.001974  9044 leader_election.cc:343] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.003122  9264 raft_consensus.cc:2804] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.003657  9264 raft_consensus.cc:493] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.004112  9264 raft_consensus.cc:3060] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.014495  9198 ts_tablet_manager.cc:1434] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:01:46.015928  9198 tablet_bootstrap.cc:492] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:45.883549  9207 raft_consensus.cc:515] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.025446  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae45916fe794471981c2ddff2693264" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:46.026286  9079 raft_consensus.cc:3060] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.029953  9198 tablet_bootstrap.cc:654] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.027697  9238 raft_consensus.cc:493] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.031677  9238 raft_consensus.cc:515] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.035945  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7ec3e8adfe4ef8b9c4a50b85122b90" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:46.036816  9153 raft_consensus.cc:2468] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:46.038479  9044 leader_election.cc:304] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:46.039197  9264 raft_consensus.cc:515] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.040632  9238 leader_election.cc:290] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:46.042471  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7ec3e8adfe4ef8b9c4a50b85122b90" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:46.044173  9264 leader_election.cc:290] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
W20260709 13:01:46.045192  9044 leader_election.cc:343] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.047546  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72207701f3449e696f990856f3d7a94" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:46.053751  9153 raft_consensus.cc:3060] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.061187  9208 raft_consensus.cc:493] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.054293  9079 raft_consensus.cc:2468] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 1.
I20260709 13:01:46.080950  9208 raft_consensus.cc:515] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.055847  9263 raft_consensus.cc:2804] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.084940  9208 leader_election.cc:290] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:46.084954  9312 raft_consensus.cc:493] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.086912  9263 raft_consensus.cc:493] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.096724  9196 tablet_bootstrap.cc:492] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:46.088493  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72207701f3449e696f990856f3d7a94" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:46.099797  9196 ts_tablet_manager.cc:1403] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.275s	user 0.056s	sys 0.105s
I20260709 13:01:46.099009  8893 leader_election.cc:304] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:46.104219  9242 raft_consensus.cc:2804] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.099742  9312 raft_consensus.cc:515] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.100337  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:46.105402  8930 raft_consensus.cc:2468] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:46.106467  9207 leader_election.cc:290] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:46.106631  9312 leader_election.cc:290] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:46.108345  8970 leader_election.cc:304] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:46.104697  9242 raft_consensus.cc:697] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 1 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:01:46.098687  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:46.112077  9242 consensus_queue.cc:237] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.112969  9151 raft_consensus.cc:2468] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:46.099653  9263 raft_consensus.cc:3060] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.111085  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae45916fe794471981c2ddff2693264" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
W20260709 13:01:46.111135  9044 leader_election.cc:343] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.111462  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:46.112380  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:46.118316  9152 raft_consensus.cc:3060] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.119269  8930 raft_consensus.cc:2468] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:46.127677  9118 leader_election.cc:304] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:46.128855  9312 raft_consensus.cc:2804] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.130399  9312 raft_consensus.cc:493] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.130896  9312 raft_consensus.cc:3060] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.131722  9197 tablet_bootstrap.cc:492] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:46.129987  9201 tablet_bootstrap.cc:492] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:46.132222  9197 ts_tablet_manager.cc:1403] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.145s	user 0.039s	sys 0.056s
I20260709 13:01:46.132256  9201 ts_tablet_manager.cc:1403] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.151s	user 0.031s	sys 0.038s
I20260709 13:01:46.133034  9263 raft_consensus.cc:515] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.135042  9201 raft_consensus.cc:359] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.135649  9197 raft_consensus.cc:359] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.136026  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7ec3e8adfe4ef8b9c4a50b85122b90" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:46.136307  9197 raft_consensus.cc:385] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.136647  9197 raft_consensus.cc:740] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.136675  9150 raft_consensus.cc:3060] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.138042  9268 consensus_queue.cc:1048] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.138244  9197 consensus_queue.cc:260] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.136680  9198 tablet_bootstrap.cc:492] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:46.140161  9198 ts_tablet_manager.cc:1403] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.013s
I20260709 13:01:46.140357  9197 ts_tablet_manager.cc:1434] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:01:46.140661  9201 raft_consensus.cc:385] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.146032  9201 raft_consensus.cc:740] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.142458  9153 raft_consensus.cc:2468] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:46.147133  9310 raft_consensus.cc:2804] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.143618  9198 raft_consensus.cc:359] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.147792  9005 raft_consensus.cc:2468] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:46.148249  9198 raft_consensus.cc:385] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.148576  9198 raft_consensus.cc:740] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.145792  9196 raft_consensus.cc:359] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.149428  9196 raft_consensus.cc:385] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.149255  9198 consensus_queue.cc:260] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.149708  9196 raft_consensus.cc:740] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.151046  9310 raft_consensus.cc:493] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.151494  9310 raft_consensus.cc:3060] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.151571  9196 consensus_queue.cc:260] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.152473  9150 raft_consensus.cc:2468] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:46.147738  9044 leader_election.cc:304] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:46.154063  9264 raft_consensus.cc:2804] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.147264  9201 consensus_queue.cc:260] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.154750  9044 leader_election.cc:304] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:46.155267  9264 raft_consensus.cc:697] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:46.156747  9196 ts_tablet_manager.cc:1434] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:01:46.157194  9265 raft_consensus.cc:515] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.157608  9201 ts_tablet_manager.cc:1434] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.004s
I20260709 13:01:46.141287  9197 tablet_bootstrap.cc:492] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:46.158780  9201 tablet_bootstrap.cc:492] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:46.155650  9206 raft_consensus.cc:2804] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.158905  9264 consensus_queue.cc:237] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.159678  9206 raft_consensus.cc:697] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:46.149269  9152 raft_consensus.cc:2468] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 1.
I20260709 13:01:46.160524  9206 consensus_queue.cc:237] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.157747  9196 tablet_bootstrap.cc:492] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:46.160372  9312 raft_consensus.cc:515] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.166244  9198 ts_tablet_manager.cc:1434] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:01:46.166205  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:46.166965  8930 raft_consensus.cc:3060] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.167419  9198 tablet_bootstrap.cc:492] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:46.167627  9265 leader_election.cc:290] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:46.169278  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d605f782fc8f426190d3419e627d88be" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:46.169878  9152 raft_consensus.cc:3060] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.172709  9208 raft_consensus.cc:493] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.173197  9208 raft_consensus.cc:515] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.173790  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7ec3e8adfe4ef8b9c4a50b85122b90" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:46.175257  9208 leader_election.cc:290] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
W20260709 13:01:46.175420  9044 leader_election.cc:343] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.176576  9263 leader_election.cc:290] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:46.180584  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d605f782fc8f426190d3419e627d88be" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:46.181481  9002 raft_consensus.cc:3060] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.182737  9198 tablet_bootstrap.cc:654] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.182543  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e05e226d044b2eacc27e329f7c96aa" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:46.184021  8970 leader_election.cc:343] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.185019  9197 tablet_bootstrap.cc:654] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.186417  9269 raft_consensus.cc:493] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.186957  9269 raft_consensus.cc:515] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.188349  9206 raft_consensus.cc:493] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.188848  9206 raft_consensus.cc:515] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.190675  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b16540e04e406b8089acc5a6819d14" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:46.191646  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992ee582def743e2952b747ca4d9e99f" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:46.189116  9269 leader_election.cc:290] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:46.192350  9310 raft_consensus.cc:515] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.193411  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e05e226d044b2eacc27e329f7c96aa" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:46.194744  9310 leader_election.cc:290] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:46.194800  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b16540e04e406b8089acc5a6819d14" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:46.202893  9150 raft_consensus.cc:2468] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:46.203763  9269 raft_consensus.cc:493] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.204686  9312 leader_election.cc:290] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:46.195503  9004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992ee582def743e2952b747ca4d9e99f" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
W20260709 13:01:46.196148  9044 leader_election.cc:343] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.207859  8930 raft_consensus.cc:2468] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:46.197175  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:46.211171  8929 raft_consensus.cc:2393] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3ac81bf7b994af084e9929fac14de34 in current term 1: Already voted for candidate 069063a72de443729cdfb3fcbfa6a123 in this term.
I20260709 13:01:46.197736  9206 leader_election.cc:290] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:46.197999  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:46.211823  9201 tablet_bootstrap.cc:654] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.212399  9153 raft_consensus.cc:2393] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3ac81bf7b994af084e9929fac14de34 in current term 1: Already voted for candidate 069063a72de443729cdfb3fcbfa6a123 in this term.
I20260709 13:01:46.177331  8826 catalog_manager.cc:5697] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:46.204493  9269 raft_consensus.cc:515] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.216152  9196 tablet_bootstrap.cc:654] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.217438  9198 tablet_bootstrap.cc:492] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:46.217715  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ab829c10554275ae1d80198e91fa05" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:46.218394  9079 raft_consensus.cc:2468] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
W20260709 13:01:46.208068  9043 leader_election.cc:343] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.219285  9043 leader_election.cc:304] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:46.219955  9206 raft_consensus.cc:2749] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:46.219735  8828 catalog_manager.cc:5697] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.220849  9116 leader_election.cc:304] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:46.221781  9312 raft_consensus.cc:2804] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.191565  9152 raft_consensus.cc:2468] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:46.208791  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:46.222128  9312 raft_consensus.cc:493] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.222497  9312 raft_consensus.cc:3060] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.222611  9005 raft_consensus.cc:2393] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 069063a72de443729cdfb3fcbfa6a123 in current term 1: Already voted for candidate f3ac81bf7b994af084e9929fac14de34 in this term.
I20260709 13:01:46.222924  9196 tablet_bootstrap.cc:492] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
W20260709 13:01:46.197278  9118 leader_election.cc:343] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.223407  9196 ts_tablet_manager.cc:1403] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.066s	user 0.005s	sys 0.004s
I20260709 13:01:46.224207  9118 leader_election.cc:304] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:46.224977  9204 raft_consensus.cc:2804] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:01:46.225320  9117 leader_election.cc:343] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.226320  9196 raft_consensus.cc:359] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.226636  9117 leader_election.cc:304] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:46.227362  8970 leader_election.cc:304] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:46.228152  9310 raft_consensus.cc:2804] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.228533  9310 raft_consensus.cc:493] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.228855  9310 raft_consensus.cc:3060] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.228736  8970 leader_election.cc:304] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:46.217919  9198 ts_tablet_manager.cc:1403] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.003s
I20260709 13:01:46.230772  9044 leader_election.cc:304] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:46.231688  9206 raft_consensus.cc:2804] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.231684  9331 raft_consensus.cc:2749] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:46.232331  9206 raft_consensus.cc:697] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:46.233212  9198 raft_consensus.cc:359] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.233163  9206 consensus_queue.cc:237] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.234198  9208 raft_consensus.cc:2749] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:46.234412  9269 leader_election.cc:290] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:46.208457  9002 raft_consensus.cc:2468] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:46.234860  9208 raft_consensus.cc:493] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.235507  9208 raft_consensus.cc:515] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.237716  9208 leader_election.cc:290] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:46.233906  9198 raft_consensus.cc:385] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.238721  9198 raft_consensus.cc:740] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.239313  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3121fd08469404b9608676838f187ba" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:46.242838  9310 raft_consensus.cc:515] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.245038  9310 leader_election.cc:290] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:46.239467  9198 consensus_queue.cc:260] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.245858  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e05e226d044b2eacc27e329f7c96aa" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:46.246703  9152 raft_consensus.cc:3060] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.248943  9198 ts_tablet_manager.cc:1434] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:01:46.249135  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3121fd08469404b9608676838f187ba" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:46.249974  9198 tablet_bootstrap.cc:492] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:46.250070  9079 raft_consensus.cc:2468] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:46.252710  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e05e226d044b2eacc27e329f7c96aa" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:46.257061  9197 tablet_bootstrap.cc:492] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:46.258543  8968 leader_election.cc:304] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
W20260709 13:01:46.261963  9117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45405, user_credentials={real_user=slave}} blocked reactor thread for 52463.9us
I20260709 13:01:46.262799  9197 ts_tablet_manager.cc:1403] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.014s
I20260709 13:01:46.263782  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ab829c10554275ae1d80198e91fa05" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:46.264416  9003 raft_consensus.cc:2468] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:46.265537  9208 raft_consensus.cc:2804] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.266116  9208 raft_consensus.cc:493] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.266463  9208 raft_consensus.cc:3060] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.265628  9197 raft_consensus.cc:359] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.268834  9197 raft_consensus.cc:385] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.269104  9197 raft_consensus.cc:740] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.270097  9201 tablet_bootstrap.cc:492] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:46.270630  9201 ts_tablet_manager.cc:1403] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.112s	user 0.009s	sys 0.004s
I20260709 13:01:46.272326  9268 consensus_queue.cc:1048] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:01:46.277801  9204 raft_consensus.cc:697] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:46.279098  9196 raft_consensus.cc:385] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.278995  9269 consensus_queue.cc:1048] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:46.271984  9152 raft_consensus.cc:2468] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
W20260709 13:01:46.279312  8970 leader_election.cc:343] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.279469  9197 consensus_queue.cc:260] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.279013  9204 consensus_queue.cc:237] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.279013  9198 tablet_bootstrap.cc:654] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.275411  9201 raft_consensus.cc:359] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.281939  9201 raft_consensus.cc:385] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.282233  9201 raft_consensus.cc:740] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.283018  9201 consensus_queue.cc:260] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.273797  9208 raft_consensus.cc:515] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.285028  9197 ts_tablet_manager.cc:1434] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:01:46.286094  9201 ts_tablet_manager.cc:1434] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:01:46.286896  9197 tablet_bootstrap.cc:492] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:46.286502  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3121fd08469404b9608676838f187ba" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:46.287926  9201 tablet_bootstrap.cc:492] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:46.288807  8970 leader_election.cc:304] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:46.290381  9311 raft_consensus.cc:2804] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.290863  9311 raft_consensus.cc:697] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:46.291790  9311 consensus_queue.cc:237] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.279549  9196 raft_consensus.cc:740] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.298169  9196 consensus_queue.cc:260] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.299072  8930 raft_consensus.cc:2468] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:46.299907  9268 raft_consensus.cc:493] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.300705  9201 tablet_bootstrap.cc:654] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.300599  9268 raft_consensus.cc:515] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.303954  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d928cb8bbc1d4ab980a52299b33396b2" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:46.304598  9003 raft_consensus.cc:2468] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:46.304766  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d928cb8bbc1d4ab980a52299b33396b2" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:46.305866  9043 leader_election.cc:304] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:46.306398  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3121fd08469404b9608676838f187ba" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:46.306747  9265 raft_consensus.cc:2804] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.307714  9265 raft_consensus.cc:493] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.308053  9265 raft_consensus.cc:3060] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.308674  9196 ts_tablet_manager.cc:1434] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
I20260709 13:01:46.309634  9196 tablet_bootstrap.cc:492] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:46.314590  9079 raft_consensus.cc:3060] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:46.307098  9044 leader_election.cc:343] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.310002  9208 leader_election.cc:290] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:46.318532  9268 leader_election.cc:290] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:46.322926  9198 tablet_bootstrap.cc:492] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:46.323452  9198 ts_tablet_manager.cc:1403] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.001s
I20260709 13:01:46.326990  9265 raft_consensus.cc:515] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.329849  9201 tablet_bootstrap.cc:492] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:46.330442  9201 ts_tablet_manager.cc:1403] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.043s	user 0.022s	sys 0.000s
I20260709 13:01:46.331095  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d928cb8bbc1d4ab980a52299b33396b2" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:46.331997  9196 tablet_bootstrap.cc:654] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:46.332754  9044 leader_election.cc:343] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.333868  9079 raft_consensus.cc:2468] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
I20260709 13:01:46.334940  9198 raft_consensus.cc:359] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.335274  8968 leader_election.cc:304] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:46.335637  9198 raft_consensus.cc:385] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.336146  9208 raft_consensus.cc:2804] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.336639  9208 raft_consensus.cc:697] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:46.337215  9265 leader_election.cc:290] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:46.338487  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d928cb8bbc1d4ab980a52299b33396b2" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:46.333600  9201 raft_consensus.cc:359] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.339128  9003 raft_consensus.cc:3060] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.339144  9197 tablet_bootstrap.cc:654] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.339859  9201 raft_consensus.cc:385] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.340334  9201 raft_consensus.cc:740] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.344527  9201 consensus_queue.cc:260] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.346653  9208 consensus_queue.cc:237] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.349352  9201 ts_tablet_manager.cc:1434] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:01:46.350427  9201 tablet_bootstrap.cc:492] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:46.354038  9003 raft_consensus.cc:2468] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:46.357218  9043 leader_election.cc:304] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:46.358753  9206 raft_consensus.cc:2804] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.359618  9206 raft_consensus.cc:697] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:46.360976  9206 consensus_queue.cc:237] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.366937  9312 raft_consensus.cc:515] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.335927  9198 raft_consensus.cc:740] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.369887  9198 consensus_queue.cc:260] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.370857  9331 consensus_queue.cc:1048] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.372601  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ab829c10554275ae1d80198e91fa05" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:46.373451  9002 raft_consensus.cc:3060] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.385221  9002 raft_consensus.cc:2468] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:46.386394  9117 leader_election.cc:304] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:46.387368  9331 raft_consensus.cc:2804] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.387888  9331 raft_consensus.cc:697] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:46.388794  9331 consensus_queue.cc:237] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.403450  9312 leader_election.cc:290] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:46.405790  9208 raft_consensus.cc:493] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.406265  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ab829c10554275ae1d80198e91fa05" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:46.406415  9208 raft_consensus.cc:515] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.406916  9079 raft_consensus.cc:3060] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.409608  9197 tablet_bootstrap.cc:492] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:46.410820  9228 raft_consensus.cc:493] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.412597  9228 raft_consensus.cc:515] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.414716  9228 leader_election.cc:290] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:46.415196  9201 tablet_bootstrap.cc:654] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.414399  9079 raft_consensus.cc:2468] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:46.415666  9198 ts_tablet_manager.cc:1434] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.001s
I20260709 13:01:46.416399  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72207701f3449e696f990856f3d7a94" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
W20260709 13:01:46.403999  8874 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:46.419924  9196 tablet_bootstrap.cc:492] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:46.419777  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72207701f3449e696f990856f3d7a94" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:46.420372  9196 ts_tablet_manager.cc:1403] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.111s	user 0.008s	sys 0.002s
I20260709 13:01:46.420565  9152 raft_consensus.cc:2393] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4667e9699c4d413889fc866e0e560d1f in current term 1: Already voted for candidate 0717530c054a42c5aa7aca788ba070a5 in this term.
I20260709 13:01:46.416698  9198 tablet_bootstrap.cc:492] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:46.422984  8895 leader_election.cc:304] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:46.425187  9242 raft_consensus.cc:3060] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.427630  9198 tablet_bootstrap.cc:654] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.431675  9208 leader_election.cc:290] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:46.434392  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992ee582def743e2952b747ca4d9e99f" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:46.435079  9078 raft_consensus.cc:2468] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:46.432556  9196 raft_consensus.cc:359] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.436149  8968 leader_election.cc:304] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:46.438273  9263 consensus_queue.cc:1048] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.435712  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992ee582def743e2952b747ca4d9e99f" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:46.444296  9264 consensus_queue.cc:1048] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.447706  9310 raft_consensus.cc:2804] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.448155  9310 raft_consensus.cc:493] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.448509  9310 raft_consensus.cc:3060] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.449347  8828 catalog_manager.cc:5697] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.453478  8827 catalog_manager.cc:5697] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.457754  9310 raft_consensus.cc:515] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.460183  9242 raft_consensus.cc:2749] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:46.435693  9196 raft_consensus.cc:385] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.462040  9196 raft_consensus.cc:740] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.463227  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992ee582def743e2952b747ca4d9e99f" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:46.463685  9196 consensus_queue.cc:260] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.464756  8928 raft_consensus.cc:2468] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:46.468375  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992ee582def743e2952b747ca4d9e99f" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:46.468981  9078 raft_consensus.cc:3060] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.455583  8827 catalog_manager.cc:5697] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.476459  8827 catalog_manager.cc:5697] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.477192  9078 raft_consensus.cc:2468] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
I20260709 13:01:46.478741  9310 leader_election.cc:290] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:46.478879  8968 leader_election.cc:304] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:46.478943  9197 ts_tablet_manager.cc:1403] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.193s	user 0.030s	sys 0.025s
I20260709 13:01:46.480909  9312 raft_consensus.cc:493] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.482197  9312 raft_consensus.cc:515] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.483084  9310 raft_consensus.cc:2804] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.484421  9310 raft_consensus.cc:697] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:46.485329  9197 raft_consensus.cc:359] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.486104  9196 ts_tablet_manager.cc:1434] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.002s
I20260709 13:01:46.486186  9197 raft_consensus.cc:385] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.486204  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1401c096fd97413881197bb35d4a55af" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:46.486900  9197 raft_consensus.cc:740] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.487172  9196 tablet_bootstrap.cc:492] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:46.487097  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1401c096fd97413881197bb35d4a55af" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
W20260709 13:01:46.487645  9118 leader_election.cc:343] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.487919  9197 consensus_queue.cc:260] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
W20260709 13:01:46.488447  9116 leader_election.cc:343] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.488880  9116 leader_election.cc:304] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:46.486150  9312 leader_election.cc:290] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:46.489718  9331 raft_consensus.cc:2749] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:46.490675  9197 ts_tablet_manager.cc:1434] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:01:46.485301  9310 consensus_queue.cc:237] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.492105  9197 tablet_bootstrap.cc:492] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:46.508678  9198 tablet_bootstrap.cc:492] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:46.509215  9198 ts_tablet_manager.cc:1403] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.002s
I20260709 13:01:46.512120  9198 raft_consensus.cc:359] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.512814  9198 raft_consensus.cc:385] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.513088  9198 raft_consensus.cc:740] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.514971  8824 catalog_manager.cc:5697] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:46.516585  9197 tablet_bootstrap.cc:654] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.517583  9228 consensus_queue.cc:1048] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.529184  9197 tablet_bootstrap.cc:492] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:46.530015  9197 ts_tablet_manager.cc:1403] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.004s
I20260709 13:01:46.533849  9197 raft_consensus.cc:359] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.534902  9197 raft_consensus.cc:385] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.535389  9197 raft_consensus.cc:740] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.536430  9197 consensus_queue.cc:260] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.529867  9196 tablet_bootstrap.cc:654] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.539664  9197 ts_tablet_manager.cc:1434] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:01:46.541041  9197 tablet_bootstrap.cc:492] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:46.541491  9198 consensus_queue.cc:260] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.543598  9228 consensus_queue.cc:1048] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.549161  9197 tablet_bootstrap.cc:654] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.546756  8828 catalog_manager.cc:5697] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:46.560742  9197 tablet_bootstrap.cc:492] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:46.561180  9197 ts_tablet_manager.cc:1403] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.010s
I20260709 13:01:46.562101  9198 ts_tablet_manager.cc:1434] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:01:46.563134  9198 tablet_bootstrap.cc:492] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:46.563771  9201 tablet_bootstrap.cc:492] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:46.563668  9197 raft_consensus.cc:359] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.564373  9201 ts_tablet_manager.cc:1403] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.214s	user 0.046s	sys 0.054s
I20260709 13:01:46.564517  9197 raft_consensus.cc:385] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.564895  9197 raft_consensus.cc:740] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.565768  9197 consensus_queue.cc:260] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.567770  9201 raft_consensus.cc:359] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.568501  9201 raft_consensus.cc:385] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.568821  9201 raft_consensus.cc:740] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.569671  9201 consensus_queue.cc:260] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.571836  9201 ts_tablet_manager.cc:1434] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:46.572199  9197 ts_tablet_manager.cc:1434] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:01:46.572850  9201 tablet_bootstrap.cc:492] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:46.573109  9197 tablet_bootstrap.cc:492] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:46.573580  9196 tablet_bootstrap.cc:492] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:46.574047  9196 ts_tablet_manager.cc:1403] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.001s
I20260709 13:01:46.576613  9196 raft_consensus.cc:359] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.577253  9196 raft_consensus.cc:385] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.577530  9196 raft_consensus.cc:740] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.579133  9197 tablet_bootstrap.cc:654] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.580415  9201 tablet_bootstrap.cc:654] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.586251  9198 tablet_bootstrap.cc:654] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.590278  8824 catalog_manager.cc:5697] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.593050  8824 catalog_manager.cc:5697] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:46.597899  9196 consensus_queue.cc:260] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.600062  9196 ts_tablet_manager.cc:1434] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 13:01:46.601009  9196 tablet_bootstrap.cc:492] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:46.608189  9207 raft_consensus.cc:493] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.610319  9207 raft_consensus.cc:515] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.612382  9207 leader_election.cc:290] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:46.616537  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e05e226d044b2eacc27e329f7c96aa" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:46.617717  9312 raft_consensus.cc:493] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.618683  9312 raft_consensus.cc:515] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.620726  9312 leader_election.cc:290] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:46.622478  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e05e226d044b2eacc27e329f7c96aa" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:46.623291  9153 raft_consensus.cc:2393] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4667e9699c4d413889fc866e0e560d1f in current term 1: Already voted for candidate f3ac81bf7b994af084e9929fac14de34 in this term.
I20260709 13:01:46.626516  8894 leader_election.cc:304] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:46.627580  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5916411ff15d473591594797dfb09193" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:46.629086  8828 catalog_manager.cc:5697] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:46.630254  9078 raft_consensus.cc:2468] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:46.631518  9116 leader_election.cc:304] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:46.632395  9331 raft_consensus.cc:2804] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.632795  9331 raft_consensus.cc:493] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.633133  9331 raft_consensus.cc:3060] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.635449  9207 raft_consensus.cc:3060] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.633682  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5916411ff15d473591594797dfb09193" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:46.628150  9312 raft_consensus.cc:493] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.636698  9312 raft_consensus.cc:515] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.638846  9312 leader_election.cc:290] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
W20260709 13:01:46.638922  9117 leader_election.cc:343] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.640612  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5073cf5195c44a18922f4eb358531263" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:46.642190  9197 tablet_bootstrap.cc:492] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:46.642688  9197 ts_tablet_manager.cc:1403] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.070s	user 0.023s	sys 0.013s
I20260709 13:01:46.642536  9265 consensus_queue.cc:1048] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.644922  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5073cf5195c44a18922f4eb358531263" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:46.645514  9197 raft_consensus.cc:359] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.646327  9197 raft_consensus.cc:385] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.646584  9197 raft_consensus.cc:740] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.647301  9197 consensus_queue.cc:260] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
W20260709 13:01:46.648022  9118 leader_election.cc:343] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:46.649092  9117 leader_election.cc:343] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.649546  9117 leader_election.cc:304] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:46.650275  9312 raft_consensus.cc:2749] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:46.649924  9197 ts_tablet_manager.cc:1434] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:46.651732  9197 tablet_bootstrap.cc:492] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:46.656544  9201 tablet_bootstrap.cc:492] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:46.657056  9201 ts_tablet_manager.cc:1403] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.009s
I20260709 13:01:46.658221  9197 tablet_bootstrap.cc:654] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.659219  9198 tablet_bootstrap.cc:492] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:46.659736  9198 ts_tablet_manager.cc:1403] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.009s
I20260709 13:01:46.672624  9265 consensus_queue.cc:1048] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.675318  9198 raft_consensus.cc:359] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.676275  9198 raft_consensus.cc:385] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.676636  9198 raft_consensus.cc:740] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.664288  9201 raft_consensus.cc:359] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.678273  9201 raft_consensus.cc:385] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.664671  9331 raft_consensus.cc:515] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.678678  9201 raft_consensus.cc:740] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.679620  9201 consensus_queue.cc:260] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.681259  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5916411ff15d473591594797dfb09193" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
W20260709 13:01:46.682855  9117 leader_election.cc:343] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.684795  9207 raft_consensus.cc:2749] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:46.685149  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5916411ff15d473591594797dfb09193" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:46.670555  9197 tablet_bootstrap.cc:492] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:46.685752  9079 raft_consensus.cc:3060] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.685958  9197 ts_tablet_manager.cc:1403] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.003s
I20260709 13:01:46.688288  9265 consensus_queue.cc:1048] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.688936  9197 raft_consensus.cc:359] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.689602  9197 raft_consensus.cc:385] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.689868  9197 raft_consensus.cc:740] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.684880  9263 raft_consensus.cc:493] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.691478  9263 raft_consensus.cc:515] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.693354  9201 ts_tablet_manager.cc:1434] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 13:01:46.693666  9263 leader_election.cc:290] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:46.694460  9201 tablet_bootstrap.cc:492] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:46.695034  9079 raft_consensus.cc:2468] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:46.695875  9331 leader_election.cc:290] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:46.696580  9116 leader_election.cc:304] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:46.698199  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa3bccd3d02438e863f3fce74229335" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:46.698777  9312 raft_consensus.cc:2804] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:46.699271  9312 raft_consensus.cc:697] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:46.700098  9312 consensus_queue.cc:237] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.697371  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa3bccd3d02438e863f3fce74229335" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:46.677460  9198 consensus_queue.cc:260] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
W20260709 13:01:46.706408  9044 leader_election.cc:343] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.707562  9265 consensus_queue.cc:1048] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:01:46.669183  9196 tablet_bootstrap.cc:654] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:46.707731  9044 leader_election.cc:343] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.707319  9198 ts_tablet_manager.cc:1434] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:01:46.713218  9044 leader_election.cc:304] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:46.714367  9198 tablet_bootstrap.cc:492] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:46.708145  9197 consensus_queue.cc:260] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.718255  9265 raft_consensus.cc:2749] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:46.718529  9197 ts_tablet_manager.cc:1434] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.001s
I20260709 13:01:46.721644  9198 tablet_bootstrap.cc:654] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.727516  9197 tablet_bootstrap.cc:492] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:46.730186  9201 tablet_bootstrap.cc:654] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.743196  9198 tablet_bootstrap.cc:492] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:46.743642  9198 ts_tablet_manager.cc:1403] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.003s
I20260709 13:01:46.746649  9196 tablet_bootstrap.cc:492] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:46.747270  9196 ts_tablet_manager.cc:1403] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.146s	user 0.010s	sys 0.001s
I20260709 13:01:46.747889  9201 tablet_bootstrap.cc:492] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:46.748438  9201 ts_tablet_manager.cc:1403] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.054s	user 0.005s	sys 0.008s
I20260709 13:01:46.750032  9196 raft_consensus.cc:359] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.750787  9196 raft_consensus.cc:385] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.751070  9196 raft_consensus.cc:740] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.751250  9201 raft_consensus.cc:359] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.752236  9201 raft_consensus.cc:385] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.751788  9196 consensus_queue.cc:260] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.746411  9198 raft_consensus.cc:359] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.752673  9201 raft_consensus.cc:740] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.752967  9198 raft_consensus.cc:385] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.753298  9198 raft_consensus.cc:740] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.753705  9201 consensus_queue.cc:260] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.754247  9196 ts_tablet_manager.cc:1434] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:46.765748  9269 consensus_queue.cc:1048] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.766798  9196 tablet_bootstrap.cc:492] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:46.768402  8826 catalog_manager.cc:5697] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:46.770876  9201 ts_tablet_manager.cc:1434] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:01:46.773207  9201 tablet_bootstrap.cc:492] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:46.778927  9201 tablet_bootstrap.cc:654] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.763620  8928 raft_consensus.cc:3060] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:46.764365  9044 consensus_peers.cc:597] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:46.764585  9310 raft_consensus.cc:493] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.786448  9196 tablet_bootstrap.cc:654] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.786811  9310 raft_consensus.cc:515] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.789523  9310 leader_election.cc:290] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:46.790313  9197 tablet_bootstrap.cc:654] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.792333  9201 tablet_bootstrap.cc:492] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:46.792055  9265 consensus_queue.cc:1048] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.793820  9201 ts_tablet_manager.cc:1403] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.001s
I20260709 13:01:46.795895  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b16540e04e406b8089acc5a6819d14" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:46.796576  9152 raft_consensus.cc:2468] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:46.797942  8970 leader_election.cc:304] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:46.798543  9196 tablet_bootstrap.cc:492] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:46.799041  9196 ts_tablet_manager.cc:1403] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:01:46.801713  9196 raft_consensus.cc:359] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.802390  9196 raft_consensus.cc:385] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.802663  9196 raft_consensus.cc:740] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.796576  9201 raft_consensus.cc:359] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.803995  9201 raft_consensus.cc:385] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:46.804267  9201 raft_consensus.cc:740] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:46.805025  9196 consensus_queue.cc:260] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.806183  9201 consensus_queue.cc:260] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.808374  9201 ts_tablet_manager.cc:1434] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:01:46.809262  9201 tablet_bootstrap.cc:492] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:46.809996  9208 raft_consensus.cc:2804] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:46.810566  9208 raft_consensus.cc:493] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.811002  9208 raft_consensus.cc:3060] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.815888  8930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b16540e04e406b8089acc5a6819d14" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:46.818657  9310 consensus_queue.cc:1048] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.819087  9196 ts_tablet_manager.cc:1434] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:01:46.821696  9196 tablet_bootstrap.cc:492] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:46.826020  9269 consensus_queue.cc:1048] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:46.829986  9312 raft_consensus.cc:493] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.830766  9312 raft_consensus.cc:515] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.835811  9196 tablet_bootstrap.cc:654] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.836428  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44fd9d19a243248566560af21b992e" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:46.838855  9201 tablet_bootstrap.cc:654] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:46.840384  9117 leader_election.cc:343] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.833770  9312 leader_election.cc:290] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:46.848282  9311 consensus_queue.cc:1048] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:46.853324  8929 raft_consensus.cc:3060] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:46.861744  8970 leader_election.cc:343] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.870990  9312 raft_consensus.cc:493] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.871583  9208 raft_consensus.cc:515] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:46.764277  9198 consensus_queue.cc:260] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.896663  9206 consensus_queue.cc:1048] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:46.896725  9208 leader_election.cc:290] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:46.892359  9310 raft_consensus.cc:493] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.892670  9312 raft_consensus.cc:515] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:46.896914  9269 consensus_queue.cc:1048] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:01:46.921761  9204 raft_consensus.cc:493] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.922616  9204 raft_consensus.cc:515] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:46.927541  9204 leader_election.cc:290] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:46.929538  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
W20260709 13:01:46.931753  9116 leader_election.cc:343] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:46.941442  9206 consensus_queue.cc:1048] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:46.907457  9310 raft_consensus.cc:515] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:46.956046  9198 ts_tablet_manager.cc:1434] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.212s	user 0.006s	sys 0.003s
I20260709 13:01:46.975901  9198 tablet_bootstrap.cc:492] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:46.983975  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b16540e04e406b8089acc5a6819d14" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:47.001042  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44fd9d19a243248566560af21b992e" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:47.003921  9201 tablet_bootstrap.cc:492] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:47.004456  9201 ts_tablet_manager.cc:1403] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.195s	user 0.009s	sys 0.016s
I20260709 13:01:47.006712  9198 tablet_bootstrap.cc:654] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:46.994406  9204 raft_consensus.cc:493] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.997027  9312 leader_election.cc:290] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:47.018959  9204 raft_consensus.cc:515] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.028657  9204 leader_election.cc:290] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:47.031424  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc6dd2b3764d889a6840a0eb8bcb46" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:47.036317  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc6dd2b3764d889a6840a0eb8bcb46" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:47.038221  9004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5dadd1a4f24668bef129668013d3da" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:47.040184  9331 consensus_queue.cc:1048] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:01:47.043051  9117 leader_election.cc:343] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:47.050343  9117 leader_election.cc:343] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:47.054458  9116 leader_election.cc:343] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.055022  9116 leader_election.cc:304] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:47.055841  9312 raft_consensus.cc:2749] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:47.056777  9208 raft_consensus.cc:493] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.057420  9208 raft_consensus.cc:515] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.010916  9152 raft_consensus.cc:3060] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.059391  9238 raft_consensus.cc:493] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.060024  9238 raft_consensus.cc:515] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.043527  9201 raft_consensus.cc:359] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.062315  9201 raft_consensus.cc:385] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.062601  9201 raft_consensus.cc:740] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.063186  9201 consensus_queue.cc:260] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.065133  9201 ts_tablet_manager.cc:1434] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.002s
I20260709 13:01:47.045424  9310 leader_election.cc:290] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:47.067523  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df48aa0fec43379ee059d845b123b4" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
W20260709 13:01:47.069396  8970 leader_election.cc:343] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.069722  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b16540e04e406b8089acc5a6819d14" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:47.080552  9201 tablet_bootstrap.cc:492] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
W20260709 13:01:47.074589  8970 leader_election.cc:343] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.086441  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:47.087551  9152 raft_consensus.cc:2468] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
I20260709 13:01:47.074268  9310 consensus_queue.cc:1048] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 13:01:47.106472  9382 raft_consensus.cc:493] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.107074  9382 raft_consensus.cc:515] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.075215  9238 leader_election.cc:290] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:47.081416  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1348d8ae8e8444fac9cc8f6bebfc852" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:47.071300  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5dadd1a4f24668bef129668013d3da" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:47.072163  9118 leader_election.cc:343] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.070891  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:47.069995  9208 leader_election.cc:290] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:47.082896  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1348d8ae8e8444fac9cc8f6bebfc852" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:47.078240  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:47.116766  9207 raft_consensus.cc:493] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.083659  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df48aa0fec43379ee059d845b123b4" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:47.117645  9201 tablet_bootstrap.cc:654] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.118778  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:47.119176  9197 tablet_bootstrap.cc:492] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
W20260709 13:01:47.124213  9044 leader_election.cc:343] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.127133  9197 ts_tablet_manager.cc:1403] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.400s	user 0.076s	sys 0.121s
I20260709 13:01:47.109089  9382 leader_election.cc:290] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:47.134541  9208 consensus_queue.cc:1048] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:47.139063  9196 tablet_bootstrap.cc:492] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:47.139729  9196 ts_tablet_manager.cc:1403] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.318s	user 0.073s	sys 0.084s
I20260709 13:01:47.132339  9001 raft_consensus.cc:2468] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
W20260709 13:01:47.142917  8970 leader_election.cc:343] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:47.146631  8970 leader_election.cc:343] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.123335  9118 leader_election.cc:304] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:47.151883  9331 raft_consensus.cc:2749] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:47.152781  9118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41567, user_credentials={real_user=slave}} blocked reactor thread for 80669.7us
I20260709 13:01:47.153050  8925 raft_consensus.cc:3060] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.153940  8970 leader_election.cc:304] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:47.157568  9196 raft_consensus.cc:359] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.158565  9196 raft_consensus.cc:385] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.158918  9196 raft_consensus.cc:740] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.159785  9196 consensus_queue.cc:260] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.135023  9206 raft_consensus.cc:493] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.130355  9207 raft_consensus.cc:515] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.169847  9043 leader_election.cc:304] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:47.167691  9208 consensus_queue.cc:1048] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:01:47.171190  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:47.171880  9078 raft_consensus.cc:2468] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:47.172695  9264 raft_consensus.cc:2804] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.173043  9264 raft_consensus.cc:493] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.173365  9264 raft_consensus.cc:3060] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:47.173482  8968 leader_election.cc:343] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.173548  9207 leader_election.cc:290] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:47.174037  8968 leader_election.cc:304] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:47.176193  9196 ts_tablet_manager.cc:1434] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 13:01:47.178180  8926 raft_consensus.cc:3060] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.179148  9196 tablet_bootstrap.cc:492] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:47.182597  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7ec3e8adfe4ef8b9c4a50b85122b90" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:47.182714  9197 raft_consensus.cc:359] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.183468  9197 raft_consensus.cc:385] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.183722  9197 raft_consensus.cc:740] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.185233  9196 tablet_bootstrap.cc:654] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.177246  9311 raft_consensus.cc:2749] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:47.191188  9381 raft_consensus.cc:2804] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:47.191797  9381 raft_consensus.cc:697] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:47.192654  9381 consensus_queue.cc:237] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
W20260709 13:01:47.165098  9118 leader_election.cc:343] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.193881  9118 leader_election.cc:304] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
W20260709 13:01:47.195835  9118 leader_election.cc:343] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.166692  9206 raft_consensus.cc:515] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.200158  9206 leader_election.cc:290] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:47.200335  9198 tablet_bootstrap.cc:492] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:47.196672  9207 raft_consensus.cc:493] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.200878  9198 ts_tablet_manager.cc:1403] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.236s	user 0.008s	sys 0.008s
I20260709 13:01:47.200937  9207 raft_consensus.cc:515] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.202286  9312 raft_consensus.cc:2749] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:47.197206  9197 consensus_queue.cc:260] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
W20260709 13:01:47.197660  8968 leader_election.cc:343] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.207371  9198 raft_consensus.cc:359] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.208915  9198 raft_consensus.cc:385] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.209326  9198 raft_consensus.cc:740] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.188491  9264 raft_consensus.cc:515] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.213092  9264 leader_election.cc:290] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:47.214530  9198 consensus_queue.cc:260] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.215540  8968 leader_election.cc:304] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:47.216950  9196 tablet_bootstrap.cc:492] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:47.216199  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7ec3e8adfe4ef8b9c4a50b85122b90" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:47.231330  9201 tablet_bootstrap.cc:492] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:47.231961  9201 ts_tablet_manager.cc:1403] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.005s
I20260709 13:01:47.232721  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1401c096fd97413881197bb35d4a55af" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:47.233404  9152 raft_consensus.cc:2468] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:47.229702  9196 ts_tablet_manager.cc:1403] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.016s
I20260709 13:01:47.233800  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b16540e04e406b8089acc5a6819d14" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:47.234984  9151 raft_consensus.cc:2393] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4667e9699c4d413889fc866e0e560d1f in current term 1: Already voted for candidate f3ac81bf7b994af084e9929fac14de34 in this term.
I20260709 13:01:47.235146  9044 leader_election.cc:304] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:47.238054  9264 raft_consensus.cc:2804] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.238464  9264 raft_consensus.cc:493] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.238816  9264 raft_consensus.cc:3060] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.239931  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1401c096fd97413881197bb35d4a55af" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:47.240758  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:47.241668  8893 leader_election.cc:304] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:47.243474  9197 ts_tablet_manager.cc:1434] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.116s	user 0.005s	sys 0.003s
I20260709 13:01:47.244506  9197 tablet_bootstrap.cc:492] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
W20260709 13:01:47.247367  9044 leader_election.cc:343] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.247838  9384 raft_consensus.cc:2749] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:47.251722  9198 ts_tablet_manager.cc:1434] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.002s
I20260709 13:01:47.253127  9201 raft_consensus.cc:359] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.253989  9201 raft_consensus.cc:385] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.254364  9201 raft_consensus.cc:740] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.254698  9198 tablet_bootstrap.cc:492] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:47.256134  9201 consensus_queue.cc:260] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.210415  9118 leader_election.cc:304] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
W20260709 13:01:47.248414  9044 leader_election.cc:343] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.253147  9207 leader_election.cc:290] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
W20260709 13:01:47.256863  8968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:46841, user_credentials={real_user=slave}} blocked reactor thread for 59237.2us
I20260709 13:01:47.273722  9201 ts_tablet_manager.cc:1434] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:01:47.274828  9201 tablet_bootstrap.cc:492] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:47.275735  8968 leader_election.cc:304] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:47.278254  9208 raft_consensus.cc:2804] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.278635  9208 raft_consensus.cc:493] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.278999  9208 raft_consensus.cc:3060] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.271910  9312 raft_consensus.cc:2749] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:47.286111  9196 raft_consensus.cc:359] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.287129  9196 raft_consensus.cc:385] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.287479  9196 raft_consensus.cc:740] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.288354  9196 consensus_queue.cc:260] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.266201  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b16540e04e406b8089acc5a6819d14" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:47.298681  9196 ts_tablet_manager.cc:1434] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:01:47.300015  9196 tablet_bootstrap.cc:492] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
W20260709 13:01:47.285161  9118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41567, user_credentials={real_user=slave}} blocked reactor thread for 85803us
I20260709 13:01:47.315575  9196 tablet_bootstrap.cc:654] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.272564  9381 consensus_queue.cc:1048] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:01:47.320331  9311 raft_consensus.cc:493] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.321653  8894 leader_election.cc:304] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:47.323464  8826 catalog_manager.cc:5697] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:47.312477  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:47.330003  9384 raft_consensus.cc:493] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.331146  9207 raft_consensus.cc:3060] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.331094  9384 raft_consensus.cc:515] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.330067  9311 raft_consensus.cc:515] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.334836  9331 consensus_queue.cc:1048] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.335506  9311 leader_election.cc:290] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:47.337163  9198 tablet_bootstrap.cc:654] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.313300  9208 raft_consensus.cc:515] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.339931  9207 raft_consensus.cc:2749] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:47.340058  9002 raft_consensus.cc:2393] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0717530c054a42c5aa7aca788ba070a5 in current term 1: Already voted for candidate f3ac81bf7b994af084e9929fac14de34 in this term.
I20260709 13:01:47.333879  9384 leader_election.cc:290] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:47.344167  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
W20260709 13:01:47.347980  8970 leader_election.cc:343] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.349913  9201 tablet_bootstrap.cc:654] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:47.355054  9387 log.cc:927] Time spent T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:01:47.345870  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5dadd1a4f24668bef129668013d3da" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:47.357321  9264 raft_consensus.cc:515] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
W20260709 13:01:47.345795  9117 consensus_peers.cc:597] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:47.351541  9197 tablet_bootstrap.cc:654] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.368700  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5dadd1a4f24668bef129668013d3da" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:47.369577  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc6dd2b3764d889a6840a0eb8bcb46" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:47.369966  9152 raft_consensus.cc:2468] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:47.370273  9151 raft_consensus.cc:2468] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
W20260709 13:01:47.360944  9117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45405, user_credentials={real_user=slave}} blocked reactor thread for 74967.6us
W20260709 13:01:47.363534  8970 leader_election.cc:343] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.374310  9208 leader_election.cc:290] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:47.386899  9196 tablet_bootstrap.cc:492] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:47.387486  9196 ts_tablet_manager.cc:1403] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.088s	user 0.007s	sys 0.011s
I20260709 13:01:47.390252  9196 raft_consensus.cc:359] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.390910  9196 raft_consensus.cc:385] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.391192  9196 raft_consensus.cc:740] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.391832  9196 consensus_queue.cc:260] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.393889  9196 ts_tablet_manager.cc:1434] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:01:47.394795  9196 tablet_bootstrap.cc:492] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:47.397018  8970 leader_election.cc:304] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:47.397902  9381 raft_consensus.cc:2804] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.398313  9381 raft_consensus.cc:493] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.398638  9381 raft_consensus.cc:3060] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.401646  9196 tablet_bootstrap.cc:654] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.403517  8970 leader_election.cc:304] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:47.404349  9208 raft_consensus.cc:2804] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.407359  9390 raft_consensus.cc:2749] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:47.407673  9208 raft_consensus.cc:493] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.410526  9208 raft_consensus.cc:3060] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.409294  9264 leader_election.cc:290] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:47.412700  9312 raft_consensus.cc:493] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.413374  9312 raft_consensus.cc:515] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.417464  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1401c096fd97413881197bb35d4a55af" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:47.418426  9151 raft_consensus.cc:3060] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.417639  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1401c096fd97413881197bb35d4a55af" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:47.426024  9312 leader_election.cc:290] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:47.427541  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa3bccd3d02438e863f3fce74229335" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:47.428215  8925 raft_consensus.cc:2468] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:47.429466  9118 leader_election.cc:304] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:47.438704  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa3bccd3d02438e863f3fce74229335" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
W20260709 13:01:47.439090  9044 leader_election.cc:343] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.439682  9312 raft_consensus.cc:2804] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.458461  9208 raft_consensus.cc:515] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.455163  9078 raft_consensus.cc:2468] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:47.453311  9312 raft_consensus.cc:493] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.472357  9312 raft_consensus.cc:3060] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.463987  9043 leader_election.cc:304] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:47.460156  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc6dd2b3764d889a6840a0eb8bcb46" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:47.466733  9201 tablet_bootstrap.cc:492] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:47.482638  9201 ts_tablet_manager.cc:1403] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.208s	user 0.017s	sys 0.000s
I20260709 13:01:47.469358  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:47.470865  9196 tablet_bootstrap.cc:492] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:47.484900  9196 ts_tablet_manager.cc:1403] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.004s
I20260709 13:01:47.483762  9197 tablet_bootstrap.cc:492] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:47.485608  9197 ts_tablet_manager.cc:1403] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.241s	user 0.022s	sys 0.013s
I20260709 13:01:47.482378  9264 raft_consensus.cc:2749] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:47.487323  9079 raft_consensus.cc:2393] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3ac81bf7b994af084e9929fac14de34 in current term 1: Already voted for candidate 0717530c054a42c5aa7aca788ba070a5 in this term.
I20260709 13:01:47.488866  9197 raft_consensus.cc:359] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.489562  9197 raft_consensus.cc:385] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.489833  9197 raft_consensus.cc:740] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.490120  9201 raft_consensus.cc:359] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.490968  9201 raft_consensus.cc:385] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.490515  9197 consensus_queue.cc:260] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.491250  9201 raft_consensus.cc:740] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.492161  9201 consensus_queue.cc:260] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.493846  9197 ts_tablet_manager.cc:1434] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:01:47.494741  9197 tablet_bootstrap.cc:492] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:47.496855  8968 leader_election.cc:304] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:47.501214  9201 ts_tablet_manager.cc:1434] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:01:47.502492  9201 tablet_bootstrap.cc:492] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:47.508741  9208 leader_election.cc:290] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:47.504480  9384 raft_consensus.cc:2749] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:47.511504  9198 tablet_bootstrap.cc:492] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:47.512055  9198 ts_tablet_manager.cc:1403] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.259s	user 0.040s	sys 0.043s
I20260709 13:01:47.512795  9265 raft_consensus.cc:493] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.514256  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc6dd2b3764d889a6840a0eb8bcb46" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:47.514942  9152 raft_consensus.cc:3060] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.514581  9265 raft_consensus.cc:515] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.518882  9332 raft_consensus.cc:493] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.519454  9332 raft_consensus.cc:515] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.516670  9196 raft_consensus.cc:359] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.522118  9196 raft_consensus.cc:385] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.522671  9196 raft_consensus.cc:740] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.523800  9196 consensus_queue.cc:260] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.525110  9312 raft_consensus.cc:515] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.525761  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "173098da7c34450aa6f93bcafd377922" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:47.527926  9118 leader_election.cc:343] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.530086  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc6dd2b3764d889a6840a0eb8bcb46" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:47.530107  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1348d8ae8e8444fac9cc8f6bebfc852" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:47.530723  9381 raft_consensus.cc:515] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.532193  9265 leader_election.cc:290] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:47.533017  9381 leader_election.cc:290] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
W20260709 13:01:47.529816  8968 leader_election.cc:343] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.521780  9332 leader_election.cc:290] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
W20260709 13:01:47.533329  9044 leader_election.cc:343] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:47.534799  8968 leader_election.cc:343] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.535238  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5dadd1a4f24668bef129668013d3da" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:47.535691  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1348d8ae8e8444fac9cc8f6bebfc852" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:47.536084  9153 raft_consensus.cc:3060] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.536377  9001 raft_consensus.cc:2468] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:47.532121  9196 ts_tablet_manager.cc:1434] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.004s
I20260709 13:01:47.527667  9151 raft_consensus.cc:2468] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:47.538021  9043 leader_election.cc:304] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:47.538092  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5dadd1a4f24668bef129668013d3da" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:47.539510  9196 tablet_bootstrap.cc:492] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
W20260709 13:01:47.541369  8970 leader_election.cc:343] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.539585  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "173098da7c34450aa6f93bcafd377922" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:47.540160  9265 raft_consensus.cc:2804] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.542392  9044 leader_election.cc:304] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:47.542707  9265 raft_consensus.cc:493] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.543294  9264 raft_consensus.cc:2804] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:47.543313  9265 raft_consensus.cc:3060] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.543838  9264 raft_consensus.cc:697] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:47.544688  9201 tablet_bootstrap.cc:654] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.544829  9264 consensus_queue.cc:237] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.541880  9197 tablet_bootstrap.cc:654] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:47.547029  9116 leader_election.cc:343] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.555037  9116 leader_election.cc:304] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:47.555951  9332 raft_consensus.cc:2749] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:47.552904  8874 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:47.561720  9153 raft_consensus.cc:2468] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
I20260709 13:01:47.568137  8970 leader_election.cc:304] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:47.568910  9201 tablet_bootstrap.cc:492] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:47.569468  9201 ts_tablet_manager.cc:1403] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.004s
I20260709 13:01:47.570706  9312 leader_election.cc:290] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:47.570991  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa3bccd3d02438e863f3fce74229335" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:47.572156  9076 raft_consensus.cc:3060] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.573325  9152 raft_consensus.cc:2468] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
I20260709 13:01:47.573361  9265 raft_consensus.cc:515] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.576030  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa3bccd3d02438e863f3fce74229335" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:47.576634  8925 raft_consensus.cc:3060] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.577418  9196 tablet_bootstrap.cc:654] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.577343  9265 leader_election.cc:290] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:47.578421  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1348d8ae8e8444fac9cc8f6bebfc852" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:47.578944  9001 raft_consensus.cc:3060] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.580438  9201 raft_consensus.cc:359] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.581120  9201 raft_consensus.cc:385] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.581377  9201 raft_consensus.cc:740] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.582082  9201 consensus_queue.cc:260] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.583228  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1348d8ae8e8444fac9cc8f6bebfc852" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:47.574483  9381 raft_consensus.cc:2804] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:01:47.584626  9044 leader_election.cc:343] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.584384  9201 ts_tablet_manager.cc:1434] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:01:47.587425  9201 tablet_bootstrap.cc:492] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:47.584841  8970 leader_election.cc:304] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:47.588305  9196 tablet_bootstrap.cc:492] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:47.588801  9196 ts_tablet_manager.cc:1403] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.050s	user 0.004s	sys 0.007s
I20260709 13:01:47.588752  9384 raft_consensus.cc:2804] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:47.585287  9381 raft_consensus.cc:697] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:47.589414  9384 raft_consensus.cc:697] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:47.589999  9381 consensus_queue.cc:237] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.590487  9384 consensus_queue.cc:237] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.592363  9196 raft_consensus.cc:359] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.592797  9201 tablet_bootstrap.cc:654] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.593084  9196 raft_consensus.cc:385] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.593374  9196 raft_consensus.cc:740] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.583596  9197 tablet_bootstrap.cc:492] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:47.594131  9196 consensus_queue.cc:260] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.594923  9197 ts_tablet_manager.cc:1403] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.012s
I20260709 13:01:47.596463  9196 ts_tablet_manager.cc:1434] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:01:47.597739  9196 tablet_bootstrap.cc:492] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:47.599021  9197 raft_consensus.cc:359] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.599947  9197 raft_consensus.cc:385] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.600291  9197 raft_consensus.cc:740] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.601176  9197 consensus_queue.cc:260] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.585562  9001 raft_consensus.cc:2468] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:47.609436  9076 raft_consensus.cc:2468] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:47.604597  9196 tablet_bootstrap.cc:654] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.611325  9197 ts_tablet_manager.cc:1434] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:01:47.612366  9197 tablet_bootstrap.cc:492] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:47.615195  9196 tablet_bootstrap.cc:492] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:47.615656  9196 ts_tablet_manager.cc:1403] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.001s
I20260709 13:01:47.616581  9043 leader_election.cc:304] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:47.617429  9206 raft_consensus.cc:2804] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:47.617928  9206 raft_consensus.cc:697] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:47.618873  9206 consensus_queue.cc:237] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.619902  9197 tablet_bootstrap.cc:654] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.621874  9116 leader_election.cc:304] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:47.607112  9201 tablet_bootstrap.cc:492] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:47.622905  9312 raft_consensus.cc:2804] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:47.607460  8925 raft_consensus.cc:2468] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:47.623400  9201 ts_tablet_manager.cc:1403] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.008s
I20260709 13:01:47.623418  9312 raft_consensus.cc:697] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:47.625878  9312 consensus_queue.cc:237] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.626701  9201 raft_consensus.cc:359] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.626880  9196 raft_consensus.cc:359] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.608321  9198 raft_consensus.cc:359] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.627517  9201 raft_consensus.cc:385] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.628224  9201 raft_consensus.cc:740] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.627709  9198 raft_consensus.cc:385] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.629005  9198 raft_consensus.cc:740] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.627529  9196 raft_consensus.cc:385] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.629731  9198 consensus_queue.cc:260] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.629807  9201 consensus_queue.cc:260] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.630348  9196 raft_consensus.cc:740] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.631803  9196 consensus_queue.cc:260] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.632560  9201 ts_tablet_manager.cc:1434] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:01:47.633924  9201 tablet_bootstrap.cc:492] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:47.634307  9198 ts_tablet_manager.cc:1434] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.122s	user 0.009s	sys 0.000s
I20260709 13:01:47.635298  9198 tablet_bootstrap.cc:492] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:47.635737  9196 ts_tablet_manager.cc:1434] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:01:47.640141  9201 tablet_bootstrap.cc:654] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.662596  9198 tablet_bootstrap.cc:654] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.668026  8826 catalog_manager.cc:5697] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:47.672009  8826 catalog_manager.cc:5697] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.681881  9197 tablet_bootstrap.cc:492] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:47.682453  9197 ts_tablet_manager.cc:1403] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.003s
I20260709 13:01:47.685240  9197 raft_consensus.cc:359] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.685921  9197 raft_consensus.cc:385] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.686228  9197 raft_consensus.cc:740] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.686915  9197 consensus_queue.cc:260] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.687575  9196 tablet_bootstrap.cc:492] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:47.703809  9384 raft_consensus.cc:493] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.704969  9384 raft_consensus.cc:515] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.707890  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44fd9d19a243248566560af21b992e" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:47.708539  9152 raft_consensus.cc:2468] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:47.708870  9197 ts_tablet_manager.cc:1434] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 13:01:47.687863  9390 raft_consensus.cc:493] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.709883  8970 leader_election.cc:304] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:47.709860  9197 tablet_bootstrap.cc:492] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:47.710355  9312 raft_consensus.cc:493] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.710976  9208 raft_consensus.cc:2804] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.711009  9312 raft_consensus.cc:515] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.712039  9390 raft_consensus.cc:515] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.713326  9312 leader_election.cc:290] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:47.711570  9208 raft_consensus.cc:493] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.714965  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df48aa0fec43379ee059d845b123b4" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:47.715706  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:47.715025  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df48aa0fec43379ee059d845b123b4" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:47.716185  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:47.715206  9208 raft_consensus.cc:3060] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.716492  9079 raft_consensus.cc:2468] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 0.
I20260709 13:01:47.716907  9152 raft_consensus.cc:2468] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 0.
I20260709 13:01:47.718266  8893 leader_election.cc:304] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:47.719144  9207 raft_consensus.cc:2804] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.719492  9207 raft_consensus.cc:493] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.719831  9207 raft_consensus.cc:3060] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.721109  9312 raft_consensus.cc:493] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.716549  9001 raft_consensus.cc:2468] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:47.716820  9197 tablet_bootstrap.cc:654] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.701117  8828 catalog_manager.cc:5697] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.723467  9117 leader_election.cc:304] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:47.721802  9312 raft_consensus.cc:515] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.724326  9332 raft_consensus.cc:2804] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.724818  9332 raft_consensus.cc:493] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.725270  9332 raft_consensus.cc:3060] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.726264  9208 raft_consensus.cc:515] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.727438  9381 raft_consensus.cc:493] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.728243  9381 raft_consensus.cc:515] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.714913  9390 leader_election.cc:290] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
W20260709 13:01:47.727373  9116 leader_election.cc:343] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.730626  9207 raft_consensus.cc:515] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.731403  9208 leader_election.cc:290] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:47.732796  9196 tablet_bootstrap.cc:654] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.733992  9198 tablet_bootstrap.cc:492] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:47.733748  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:47.734155  9381 leader_election.cc:290] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:47.734552  9198 ts_tablet_manager.cc:1403] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.006s
I20260709 13:01:47.734649  9079 raft_consensus.cc:3060] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.735831  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5073cf5195c44a18922f4eb358531263" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:47.736513  8924 raft_consensus.cc:2468] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:47.737905  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5073cf5195c44a18922f4eb358531263" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:47.738533  9153 raft_consensus.cc:2468] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:47.739487  8970 leader_election.cc:304] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:47.737427  9198 raft_consensus.cc:359] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.742750  9198 raft_consensus.cc:385] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.743026  9198 raft_consensus.cc:740] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.743429  9207 leader_election.cc:290] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:47.743723  9198 consensus_queue.cc:260] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.745942  9198 ts_tablet_manager.cc:1434] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.001s
I20260709 13:01:47.746333  9381 raft_consensus.cc:2804] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.746781  9381 raft_consensus.cc:493] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.747144  9381 raft_consensus.cc:3060] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.732473  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44fd9d19a243248566560af21b992e" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:47.748615  9198 tablet_bootstrap.cc:492] T a5df48aa0fec43379ee059d845b123b4 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:47.749236  9201 tablet_bootstrap.cc:492] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
W20260709 13:01:47.749588  8970 leader_election.cc:343] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.749786  9201 ts_tablet_manager.cc:1403] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.116s	user 0.043s	sys 0.023s
I20260709 13:01:47.750852  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44fd9d19a243248566560af21b992e" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:47.751452  9152 raft_consensus.cc:3060] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.757582  9079 raft_consensus.cc:2468] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 1.
I20260709 13:01:47.758899  9208 raft_consensus.cc:493] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.759402  8893 leader_election.cc:304] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:47.759426  9208 raft_consensus.cc:515] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.753409  9201 raft_consensus.cc:359] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.760865  9201 raft_consensus.cc:385] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.760659  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c744829b78b4069a658ca2a4d2dbb5e" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:47.761261  9390 raft_consensus.cc:2804] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:47.761695  9208 leader_election.cc:290] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:47.761778  9390 raft_consensus.cc:697] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 1 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
W20260709 13:01:47.762318  9117 leader_election.cc:343] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.763113  9201 raft_consensus.cc:740] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.762825  9390 consensus_queue.cc:237] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.763399  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5916411ff15d473591594797dfb09193" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:47.763998  9201 consensus_queue.cc:260] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.766824  9201 ts_tablet_manager.cc:1434] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:01:47.758953  9198 tablet_bootstrap.cc:654] T a5df48aa0fec43379ee059d845b123b4 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.766944  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5916411ff15d473591594797dfb09193" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:47.769678  9201 tablet_bootstrap.cc:492] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:47.774825  9384 leader_election.cc:290] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:47.779690  8970 leader_election.cc:304] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:47.781631  9384 raft_consensus.cc:2749] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:47.782172  8895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38603, user_credentials={real_user=slave}} blocked reactor thread for 63842.9us
I20260709 13:01:47.784148  9207 raft_consensus.cc:493] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.784614  9207 raft_consensus.cc:515] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:47.786715  9207 leader_election.cc:290] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:47.787673  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1401c096fd97413881197bb35d4a55af" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:47.787905  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:47.788452  9153 raft_consensus.cc:3060] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.789155  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44fd9d19a243248566560af21b992e" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:47.791916  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1401c096fd97413881197bb35d4a55af" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:47.792866  9151 raft_consensus.cc:2393] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4667e9699c4d413889fc866e0e560d1f in current term 1: Already voted for candidate 0717530c054a42c5aa7aca788ba070a5 in this term.
W20260709 13:01:47.791921  8970 leader_election.cc:343] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.794025  9201 tablet_bootstrap.cc:654] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.794299  8895 leader_election.cc:304] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:47.795542  9207 raft_consensus.cc:3060] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.807091  8827 catalog_manager.cc:5697] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:47.812827  8827 catalog_manager.cc:5697] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.823678  9312 leader_election.cc:290] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:47.769301  9332 raft_consensus.cc:515] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.841480  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c744829b78b4069a658ca2a4d2dbb5e" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:47.843044  9196 tablet_bootstrap.cc:492] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:47.843570  9196 ts_tablet_manager.cc:1403] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.207s	user 0.021s	sys 0.019s
I20260709 13:01:47.845949  9384 consensus_queue.cc:1048] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.846472  9196 raft_consensus.cc:359] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.847321  9196 raft_consensus.cc:385] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.847661  9196 raft_consensus.cc:740] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.847752  9153 raft_consensus.cc:2468] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 1.
I20260709 13:01:47.848984  9196 consensus_queue.cc:260] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.830302  9238 raft_consensus.cc:493] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:47.856626  9116 leader_election.cc:343] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.859709  9381 raft_consensus.cc:515] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.873200  9198 tablet_bootstrap.cc:492] T a5df48aa0fec43379ee059d845b123b4 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:47.876406  9198 ts_tablet_manager.cc:1403] T a5df48aa0fec43379ee059d845b123b4 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.128s	user 0.018s	sys 0.028s
I20260709 13:01:47.872779  9201 tablet_bootstrap.cc:492] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:47.877630  9201 ts_tablet_manager.cc:1403] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.020s
I20260709 13:01:47.882767  9208 raft_consensus.cc:493] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.889168  9208 raft_consensus.cc:515] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.890465  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df48aa0fec43379ee059d845b123b4" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:47.891093  9002 raft_consensus.cc:3060] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.891371  9208 leader_election.cc:290] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:47.889922  9197 tablet_bootstrap.cc:492] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:47.894965  9197 ts_tablet_manager.cc:1403] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.185s	user 0.011s	sys 0.041s
I20260709 13:01:47.868685  9001 raft_consensus.cc:3060] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.899501  9197 raft_consensus.cc:359] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.900195  9197 raft_consensus.cc:385] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.900445  9197 raft_consensus.cc:740] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.862591  9238 raft_consensus.cc:515] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.901604  9197 consensus_queue.cc:260] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.871201  9152 raft_consensus.cc:2468] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
I20260709 13:01:47.903220  9198 raft_consensus.cc:359] T a5df48aa0fec43379ee059d845b123b4 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.865351  9116 leader_election.cc:304] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:47.909533  9198 raft_consensus.cc:385] T a5df48aa0fec43379ee059d845b123b4 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.911772  9198 raft_consensus.cc:740] T a5df48aa0fec43379ee059d845b123b4 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.912472  9198 consensus_queue.cc:260] T a5df48aa0fec43379ee059d845b123b4 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:47.914503  9198 ts_tablet_manager.cc:1434] T a5df48aa0fec43379ee059d845b123b4 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:01:47.916568  9198 tablet_bootstrap.cc:492] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:47.917490  9197 ts_tablet_manager.cc:1434] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
W20260709 13:01:47.909169  8895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38603, user_credentials={real_user=slave}} blocked reactor thread for 55386.2us
I20260709 13:01:47.920783  9312 raft_consensus.cc:2749] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:47.922662  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef292f6bccd14fe2a930cd9e26f10d3b" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:47.923352  8924 raft_consensus.cc:2468] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:47.923904  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5073cf5195c44a18922f4eb358531263" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:47.924491  9152 raft_consensus.cc:3060] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.921926  8970 leader_election.cc:304] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:47.925510  9384 raft_consensus.cc:2804] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:47.925907  8970 leader_election.cc:304] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:47.926164  9384 raft_consensus.cc:697] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:47.926929  9382 raft_consensus.cc:2804] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:47.927315  9382 raft_consensus.cc:493] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.927664  9382 raft_consensus.cc:3060] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.927405  9384 consensus_queue.cc:237] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.930959  9332 leader_election.cc:290] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:47.917994  9201 raft_consensus.cc:359] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.931900  9201 raft_consensus.cc:385] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:47.932175  9201 raft_consensus.cc:740] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:47.932925  9201 consensus_queue.cc:260] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:47.933766  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef292f6bccd14fe2a930cd9e26f10d3b" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:47.936018  9197 tablet_bootstrap.cc:492] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
W20260709 13:01:47.945093  8968 leader_election.cc:343] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:47.947359  9207 raft_consensus.cc:2749] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:47.952082  9116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:46841, user_credentials={real_user=slave}} blocked reactor thread for 95494.1us
I20260709 13:01:47.954118  9238 leader_election.cc:290] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:47.911895  9208 consensus_queue.cc:1048] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260709 13:01:47.963546  9152 raft_consensus.cc:2468] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
I20260709 13:01:47.964490  9198 tablet_bootstrap.cc:654] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.965581  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc6dd2b3764d889a6840a0eb8bcb46" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:47.966635  9153 raft_consensus.cc:2393] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0717530c054a42c5aa7aca788ba070a5 in current term 1: Already voted for candidate f3ac81bf7b994af084e9929fac14de34 in this term.
I20260709 13:01:47.968954  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df48aa0fec43379ee059d845b123b4" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:47.969551  9079 raft_consensus.cc:3060] T a5df48aa0fec43379ee059d845b123b4 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:47.969472  8970 leader_election.cc:304] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:47.970624  9311 raft_consensus.cc:2804] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:47.971115  9311 raft_consensus.cc:697] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:47.971936  9311 consensus_queue.cc:237] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:47.976634  9201 ts_tablet_manager.cc:1434] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.099s	user 0.005s	sys 0.003s
I20260709 13:01:47.977602  9201 tablet_bootstrap.cc:492] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:47.983870  9201 tablet_bootstrap.cc:654] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.986951  9310 consensus_queue.cc:1048] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.992321  9196 ts_tablet_manager.cc:1434] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.148s	user 0.018s	sys 0.020s
I20260709 13:01:47.993474  9196 tablet_bootstrap.cc:492] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:47.981047  9197 tablet_bootstrap.cc:654] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:47.978576  9079 raft_consensus.cc:2468] T a5df48aa0fec43379ee059d845b123b4 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:47.992201  9002 raft_consensus.cc:2468] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:47.997165  9382 raft_consensus.cc:515] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:48.061244  9382 leader_election.cc:290] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:48.049495  9208 raft_consensus.cc:493] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.062469  9208 raft_consensus.cc:515] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:48.065155  9208 leader_election.cc:290] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:48.068254  9381 leader_election.cc:290] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:48.070612  9117 leader_election.cc:304] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:48.071586  9269 raft_consensus.cc:2804] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:48.106221  9381 consensus_queue.cc:1048] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:48.106465  8827 catalog_manager.cc:5697] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:48.113464  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69e9a34c48e4dbd8f8d3c71a475a7c3" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:48.114849  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef292f6bccd14fe2a930cd9e26f10d3b" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:48.115429  8926 raft_consensus.cc:3060] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:48.113103  9196 tablet_bootstrap.cc:654] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:48.119475  8970 consensus_peers.cc:597] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.120188  8970 leader_election.cc:343] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:48.124337  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30dc6dd2b3764d889a6840a0eb8bcb46" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:48.129688  8826 catalog_manager.cc:5697] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:48.134395  9077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69e9a34c48e4dbd8f8d3c71a475a7c3" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:48.136026  9075 raft_consensus.cc:3060] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:48.099005  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5073cf5195c44a18922f4eb358531263" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:48.151013  8925 raft_consensus.cc:3060] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:48.167865  9201 tablet_bootstrap.cc:492] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:48.168392  9201 ts_tablet_manager.cc:1403] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.191s	user 0.024s	sys 0.011s
W20260709 13:01:48.170527  9429 log.cc:927] Time spent T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:01:48.173671  9197 tablet_bootstrap.cc:492] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:48.174139  9197 ts_tablet_manager.cc:1403] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.238s	user 0.017s	sys 0.013s
I20260709 13:01:48.146782  9269 raft_consensus.cc:697] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
W20260709 13:01:48.149711  9116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:46841, user_credentials={real_user=slave}} blocked reactor thread for 48738us
I20260709 13:01:48.153208  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef292f6bccd14fe2a930cd9e26f10d3b" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:48.193606  9201 raft_consensus.cc:359] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.194583  9201 raft_consensus.cc:385] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.194912  9201 raft_consensus.cc:740] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.195762  9201 consensus_queue.cc:260] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.196926  9197 raft_consensus.cc:359] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.197840  9197 raft_consensus.cc:385] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.198184  9197 raft_consensus.cc:740] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.198984  9197 consensus_queue.cc:260] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.209410  9201 ts_tablet_manager.cc:1434] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:01:48.212200  9197 ts_tablet_manager.cc:1434] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 13:01:48.242388  9198 tablet_bootstrap.cc:492] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:48.243156  9198 ts_tablet_manager.cc:1403] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.328s	user 0.019s	sys 0.017s
I20260709 13:01:48.231431  9238 consensus_queue.cc:1048] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:01:48.250998  9197 tablet_bootstrap.cc:492] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:48.254004  9201 tablet_bootstrap.cc:492] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:48.210960  9269 consensus_queue.cc:237] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.264411  9432 consensus_queue.cc:1048] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:01:48.252367  9043 leader_election.cc:304] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34
W20260709 13:01:48.260658  8968 leader_election.cc:343] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:48.271818  8968 leader_election.cc:304] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:48.273988  9430 raft_consensus.cc:493] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.274477  9384 raft_consensus.cc:2749] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:48.274880  8925 raft_consensus.cc:2468] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
I20260709 13:01:48.277310  9441 consensus_queue.cc:1048] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:48.280356  9428 consensus_queue.cc:1048] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:48.274534  9430 raft_consensus.cc:515] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:48.296284  9198 raft_consensus.cc:359] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:48.297032  9198 raft_consensus.cc:385] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.297362  9198 raft_consensus.cc:740] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.298276  9201 tablet_bootstrap.cc:654] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:48.300024  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1348d8ae8e8444fac9cc8f6bebfc852" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:48.301028  9002 raft_consensus.cc:2393] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4667e9699c4d413889fc866e0e560d1f in current term 1: Already voted for candidate 0717530c054a42c5aa7aca788ba070a5 in this term.
I20260709 13:01:48.303048  9198 consensus_queue.cc:260] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:48.306945  9198 ts_tablet_manager.cc:1434] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.001s
I20260709 13:01:48.307622  9196 tablet_bootstrap.cc:492] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:48.309168  9196 ts_tablet_manager.cc:1403] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.316s	user 0.037s	sys 0.028s
I20260709 13:01:48.307916  9198 tablet_bootstrap.cc:492] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:48.318509  9430 leader_election.cc:290] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:48.338282  9197 tablet_bootstrap.cc:654] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:48.323112  9264 raft_consensus.cc:2749] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:48.345134  8968 leader_election.cc:343] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:48.346156  9382 raft_consensus.cc:493] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.346760  9382 raft_consensus.cc:515] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.347558  9206 consensus_queue.cc:1048] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:48.351137  9382 leader_election.cc:290] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:48.353843  9312 raft_consensus.cc:493] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.354391  9312 raft_consensus.cc:515] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.356115  8926 raft_consensus.cc:2468] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
I20260709 13:01:48.356549  9312 leader_election.cc:290] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:48.357327  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c744829b78b4069a658ca2a4d2dbb5e" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:48.357972  9150 raft_consensus.cc:2468] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:48.360718  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9762d913154929be832b5508ebad68" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:48.362581  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1348d8ae8e8444fac9cc8f6bebfc852" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
W20260709 13:01:48.363301  9117 leader_election.cc:343] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:48.364522  8970 leader_election.cc:304] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:48.364867  8926 raft_consensus.cc:3060] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:48.368733  9381 raft_consensus.cc:2804] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:48.369316  9381 raft_consensus.cc:697] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:48.371223  8970 leader_election.cc:304] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:48.372179  9311 raft_consensus.cc:2804] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:48.372597  9311 raft_consensus.cc:493] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.373001  9311 raft_consensus.cc:3060] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:48.374812  8893 leader_election.cc:304] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:48.378993  9381 consensus_queue.cc:237] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:48.381724  9228 consensus_queue.cc:1048] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:48.384057  9196 raft_consensus.cc:359] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.384953  9196 raft_consensus.cc:385] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.385262  9196 raft_consensus.cc:740] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.386010  9196 consensus_queue.cc:260] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.386377  9431 raft_consensus.cc:2749] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:48.389480  9198 tablet_bootstrap.cc:654] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:48.413985  9311 raft_consensus.cc:515] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.416309  9311 leader_election.cc:290] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
W20260709 13:01:48.412549  9044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41567, user_credentials={real_user=slave}} blocked reactor thread for 64348.4us
I20260709 13:01:48.424325  8828 catalog_manager.cc:5697] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:48.434976  9269 consensus_queue.cc:1048] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:48.437585  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9762d913154929be832b5508ebad68" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:48.437842  9381 consensus_queue.cc:1048] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:48.441047  9197 tablet_bootstrap.cc:492] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:48.441802  9197 ts_tablet_manager.cc:1403] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.191s	user 0.008s	sys 0.008s
I20260709 13:01:48.443540  9201 tablet_bootstrap.cc:492] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:48.444264  9201 ts_tablet_manager.cc:1403] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.192s	user 0.005s	sys 0.010s
I20260709 13:01:48.448572  9196 ts_tablet_manager.cc:1434] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.139s	user 0.007s	sys 0.000s
I20260709 13:01:48.449443  9196 tablet_bootstrap.cc:492] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:48.452389  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c744829b78b4069a658ca2a4d2dbb5e" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:48.453328  9151 raft_consensus.cc:3060] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:48.466514  9228 raft_consensus.cc:493] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.467133  9228 raft_consensus.cc:515] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.468223  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c744829b78b4069a658ca2a4d2dbb5e" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:48.469640  9077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c744829b78b4069a658ca2a4d2dbb5e" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:48.471922  9238 consensus_queue.cc:1048] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:48.477365  9116 leader_election.cc:343] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:48.477912  9116 leader_election.cc:304] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:48.479702  9269 raft_consensus.cc:2749] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:48.482813  9197 raft_consensus.cc:359] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:48.483462  9197 raft_consensus.cc:385] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.483719  9197 raft_consensus.cc:740] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.485071  9263 raft_consensus.cc:493] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.485565  9263 raft_consensus.cc:515] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
W20260709 13:01:48.486617  8968 leader_election.cc:343] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:48.487640  8968 leader_election.cc:343] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:48.487771  9263 leader_election.cc:290] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:48.488345  9197 consensus_queue.cc:260] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:48.469241  9228 leader_election.cc:290] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:48.503520  9147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5dadd1a4f24668bef129668013d3da" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:48.506350  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5dadd1a4f24668bef129668013d3da" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:48.507623  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef292f6bccd14fe2a930cd9e26f10d3b" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:48.508757  8927 raft_consensus.cc:2393] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0717530c054a42c5aa7aca788ba070a5 in current term 1: Already voted for candidate f3ac81bf7b994af084e9929fac14de34 in this term.
I20260709 13:01:48.510808  8895 leader_election.cc:304] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:48.511866  9228 raft_consensus.cc:2749] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:48.514954  9311 consensus_queue.cc:1048] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:48.522562  9381 consensus_queue.cc:1048] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:48.522778  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef292f6bccd14fe2a930cd9e26f10d3b" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:48.524621  9196 tablet_bootstrap.cc:654] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:48.525427  9043 leader_election.cc:304] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:48.526728  9265 raft_consensus.cc:3060] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:48.534566  9197 ts_tablet_manager.cc:1434] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.000s
I20260709 13:01:48.535976  9197 tablet_bootstrap.cc:492] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:48.547304  9201 raft_consensus.cc:359] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.548178  9201 raft_consensus.cc:385] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.548511  9201 raft_consensus.cc:740] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.549358  9201 consensus_queue.cc:260] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.561903  9201 ts_tablet_manager.cc:1434] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.000s
I20260709 13:01:48.563556  9201 tablet_bootstrap.cc:492] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
W20260709 13:01:48.577802  8970 consensus_peers.cc:597] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.580338  8924 raft_consensus.cc:3060] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:48.604384  9196 tablet_bootstrap.cc:492] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:48.605168  9196 ts_tablet_manager.cc:1403] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.001s
I20260709 13:01:48.599351  9151 raft_consensus.cc:2468] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
I20260709 13:01:48.616812  9196 raft_consensus.cc:359] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:48.617512  9196 raft_consensus.cc:385] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.617789  9196 raft_consensus.cc:740] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.620929  9382 consensus_queue.cc:1048] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:48.642436  9196 consensus_queue.cc:260] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:48.622233  8970 leader_election.cc:304] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:48.643862  9382 raft_consensus.cc:2804] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:48.644227  9196 ts_tablet_manager.cc:1434] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:01:48.644285  9382 raft_consensus.cc:697] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:48.645284  9196 tablet_bootstrap.cc:492] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:48.645257  9382 consensus_queue.cc:237] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.629916  9265 raft_consensus.cc:2749] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:48.630782  9198 tablet_bootstrap.cc:492] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:48.652370  9198 ts_tablet_manager.cc:1403] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.345s	user 0.004s	sys 0.076s
I20260709 13:01:48.631623  8828 catalog_manager.cc:5697] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:48.634577  9311 raft_consensus.cc:493] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.638689  9197 tablet_bootstrap.cc:654] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:48.641340  9201 tablet_bootstrap.cc:654] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:48.670121  9198 raft_consensus.cc:359] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.671584  9198 raft_consensus.cc:385] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.671849  9198 raft_consensus.cc:740] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.672488  9198 consensus_queue.cc:260] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.658200  9311 raft_consensus.cc:515] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.670589  9312 raft_consensus.cc:493] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.675787  9312 raft_consensus.cc:515] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.677646  9311 leader_election.cc:290] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:48.677768  9312 leader_election.cc:290] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:48.678514  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713d7f8692bf457fb28973349764534b" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:48.679083  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713d7f8692bf457fb28973349764534b" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
W20260709 13:01:48.683423  9118 leader_election.cc:343] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:48.684196  9117 leader_election.cc:343] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:48.684638  9117 leader_election.cc:304] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:48.685751  9312 raft_consensus.cc:2749] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:48.679446  9198 ts_tablet_manager.cc:1434] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.001s
I20260709 13:01:48.689852  9198 tablet_bootstrap.cc:492] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:48.719074  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9762d913154929be832b5508ebad68" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:48.720861  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9762d913154929be832b5508ebad68" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
W20260709 13:01:48.722117  8968 leader_election.cc:343] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:48.721850  9148 raft_consensus.cc:2468] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:48.731340  8970 leader_election.cc:304] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:48.732609  9381 raft_consensus.cc:2804] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:48.732997  9381 raft_consensus.cc:493] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.733314  9381 raft_consensus.cc:3060] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:48.739871  9196 tablet_bootstrap.cc:654] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:48.757993  9201 tablet_bootstrap.cc:492] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:48.762924  9201 ts_tablet_manager.cc:1403] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.200s	user 0.021s	sys 0.007s
I20260709 13:01:48.774416  9312 consensus_queue.cc:1048] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:48.788484  9310 consensus_queue.cc:1048] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:48.801389  9198 tablet_bootstrap.cc:654] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:48.809139  9312 consensus_queue.cc:1048] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:48.811363  9201 raft_consensus.cc:359] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:48.812356  9201 raft_consensus.cc:385] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.812701  9201 raft_consensus.cc:740] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.757961  9381 raft_consensus.cc:515] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.817611  9381 leader_election.cc:290] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:48.820216  9197 tablet_bootstrap.cc:492] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:48.820726  9197 ts_tablet_manager.cc:1403] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.285s	user 0.041s	sys 0.023s
I20260709 13:01:48.823451  9197 raft_consensus.cc:359] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.824101  9197 raft_consensus.cc:385] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.824373  9197 raft_consensus.cc:740] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.825021  9197 consensus_queue.cc:260] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.813524  9201 consensus_queue.cc:260] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:48.827695  9197 ts_tablet_manager.cc:1434] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:48.828068  9201 ts_tablet_manager.cc:1434] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 13:01:48.828717  9197 tablet_bootstrap.cc:492] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:48.828971  9201 tablet_bootstrap.cc:492] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:48.830511  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9762d913154929be832b5508ebad68" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
W20260709 13:01:48.831997  8968 leader_election.cc:343] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:48.833515  9312 raft_consensus.cc:493] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.834019  9312 raft_consensus.cc:515] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.835948  9312 leader_election.cc:290] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:48.840477  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e007e79ba94ae88d703e10d65910a9" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:48.839924  8825 catalog_manager.cc:5697] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } }
W20260709 13:01:48.841775  9117 leader_election.cc:343] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:48.843499  8874 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:48.844326  9201 tablet_bootstrap.cc:654] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:48.844516  9198 tablet_bootstrap.cc:492] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:48.845041  9198 ts_tablet_manager.cc:1403] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.000s
I20260709 13:01:48.850188  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e007e79ba94ae88d703e10d65910a9" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:48.851588  9197 tablet_bootstrap.cc:654] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:48.856268  9118 leader_election.cc:343] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:48.856786  9118 leader_election.cc:304] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:48.858211  9269 raft_consensus.cc:2749] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:48.857599  8828 catalog_manager.cc:5697] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:48.862098  9201 tablet_bootstrap.cc:492] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:48.862739  9201 ts_tablet_manager.cc:1403] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.004s
I20260709 13:01:48.869338  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9762d913154929be832b5508ebad68" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:48.869978  9150 raft_consensus.cc:3060] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:48.871809  9201 raft_consensus.cc:359] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.877422  9201 raft_consensus.cc:385] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.877792  9201 raft_consensus.cc:740] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.878829  9201 consensus_queue.cc:260] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.880089  9198 raft_consensus.cc:359] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:48.880789  9198 raft_consensus.cc:385] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.881067  9198 raft_consensus.cc:740] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.883551  9198 consensus_queue.cc:260] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:48.886845  9198 ts_tablet_manager.cc:1434] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:01:48.887778  9198 tablet_bootstrap.cc:492] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:48.899156  9198 tablet_bootstrap.cc:654] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:48.905997  9201 ts_tablet_manager.cc:1434] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 13:01:48.907223  9201 tablet_bootstrap.cc:492] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:48.911337  9382 raft_consensus.cc:493] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.911654  9198 tablet_bootstrap.cc:492] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:48.912130  9198 ts_tablet_manager.cc:1403] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:01:48.911896  9382 raft_consensus.cc:515] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:48.914916  9198 raft_consensus.cc:359] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:48.914510  9382 leader_election.cc:290] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:48.915627  9198 raft_consensus.cc:385] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.915916  9198 raft_consensus.cc:740] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.916555  9198 consensus_queue.cc:260] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:48.916884  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a7ca8dc8c64156ba3dd859eb2fdf1c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
W20260709 13:01:48.918802  8968 leader_election.cc:343] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:48.919394  9201 tablet_bootstrap.cc:654] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:48.925215  9150 raft_consensus.cc:2468] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
I20260709 13:01:48.925761  9198 ts_tablet_manager.cc:1434] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:01:48.926728  9198 tablet_bootstrap.cc:492] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:48.928956  8970 leader_election.cc:304] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:48.931628  9381 raft_consensus.cc:2804] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:48.932253  9381 raft_consensus.cc:697] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:48.933301  9381 consensus_queue.cc:237] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.939628  9198 tablet_bootstrap.cc:654] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:48.940681  9201 tablet_bootstrap.cc:492] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:48.941125  9201 ts_tablet_manager.cc:1403] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.003s
I20260709 13:01:48.944178  9201 raft_consensus.cc:359] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.945104  9201 raft_consensus.cc:385] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.945456  9201 raft_consensus.cc:740] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.946381  9312 raft_consensus.cc:493] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.946302  9201 consensus_queue.cc:260] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.948242  9312 raft_consensus.cc:515] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:48.949803  9201 ts_tablet_manager.cc:1434] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:01:48.950840  9201 tablet_bootstrap.cc:492] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:48.951642  9382 consensus_queue.cc:1048] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:48.952409  9312 leader_election.cc:290] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:48.952723  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a074d6cac458d9de6a79b3bcceade" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:48.954651  9118 leader_election.cc:343] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:48.954856  9196 tablet_bootstrap.cc:492] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:48.955421  9196 ts_tablet_manager.cc:1403] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.310s	user 0.012s	sys 0.024s
I20260709 13:01:48.956485  9265 raft_consensus.cc:493] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.956923  9201 tablet_bootstrap.cc:654] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:48.956995  9265 raft_consensus.cc:515] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.958036  9196 raft_consensus.cc:359] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.961941  9196 raft_consensus.cc:385] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.962329  9196 raft_consensus.cc:740] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.963747  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a7ca8dc8c64156ba3dd859eb2fdf1c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:48.959630  9265 leader_election.cc:290] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:48.959826  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c744829b78b4069a658ca2a4d2dbb5e" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:48.966868  9196 consensus_queue.cc:260] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.970007  9201 tablet_bootstrap.cc:492] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:48.970333  9196 ts_tablet_manager.cc:1434] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:01:48.970202  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a074d6cac458d9de6a79b3bcceade" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:48.970574  9201 ts_tablet_manager.cc:1403] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.020s	user 0.002s	sys 0.014s
W20260709 13:01:48.971698  9116 leader_election.cc:343] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:48.972141  9116 leader_election.cc:304] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:48.973250  9312 raft_consensus.cc:2749] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:48.973524  9201 raft_consensus.cc:359] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.974264  9201 raft_consensus.cc:385] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:48.974582  9201 raft_consensus.cc:740] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:48.975365  9201 consensus_queue.cc:260] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.976377  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c744829b78b4069a658ca2a4d2dbb5e" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:48.977684  9201 ts_tablet_manager.cc:1434] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:01:48.971398  9196 tablet_bootstrap.cc:492] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:48.983001  9201 tablet_bootstrap.cc:492] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:48.985910  9198 tablet_bootstrap.cc:492] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:48.986425  9198 ts_tablet_manager.cc:1403] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.002s
I20260709 13:01:48.991842  9201 tablet_bootstrap.cc:654] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:48.993656  9384 raft_consensus.cc:493] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.994464  9384 raft_consensus.cc:515] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:48.996564  9384 leader_election.cc:290] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:48.998788  9196 tablet_bootstrap.cc:654] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.007598  9201 tablet_bootstrap.cc:492] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
W20260709 13:01:48.998864  8970 leader_election.cc:343] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.024959  9201 ts_tablet_manager.cc:1403] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.003s
I20260709 13:01:49.024824  8970 leader_election.cc:304] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:49.025981  9382 raft_consensus.cc:2749] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:49.000756  9198 raft_consensus.cc:359] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:48.977185  9150 raft_consensus.cc:2393] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0717530c054a42c5aa7aca788ba070a5 in current term 1: Already voted for candidate f3ac81bf7b994af084e9929fac14de34 in this term.
I20260709 13:01:49.028681  9198 raft_consensus.cc:385] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:49.029031  9198 raft_consensus.cc:740] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.028838  9201 raft_consensus.cc:359] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.029646  9044 leader_election.cc:304] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:49.029991  9201 raft_consensus.cc:385] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:49.030441  9201 raft_consensus.cc:740] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.030812  9238 raft_consensus.cc:3060] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.031487  9201 consensus_queue.cc:260] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.032282  9198 consensus_queue.cc:260] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:49.034075  9201 ts_tablet_manager.cc:1434] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:01:49.038729  9201 tablet_bootstrap.cc:492] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:49.043773  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e576ab3b143d4485a1c98595bfb66af5" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:49.045984  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e576ab3b143d4485a1c98595bfb66af5" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:49.049185  9198 ts_tablet_manager.cc:1434] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.003s
I20260709 13:01:49.049983  9196 tablet_bootstrap.cc:492] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:49.050696  9196 ts_tablet_manager.cc:1403] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.080s	user 0.021s	sys 0.012s
I20260709 13:01:49.053076  9238 raft_consensus.cc:2749] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:49.053864  8970 leader_election.cc:343] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.055747  9196 raft_consensus.cc:359] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:49.057982  9196 raft_consensus.cc:385] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:49.058380  9196 raft_consensus.cc:740] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.055166  9201 tablet_bootstrap.cc:654] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.059206  9196 consensus_queue.cc:260] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:49.056919  9198 tablet_bootstrap.cc:492] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
W20260709 13:01:49.063922  8970 leader_election.cc:343] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.064389  8970 leader_election.cc:304] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:49.066310  9196 ts_tablet_manager.cc:1434] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:01:49.067791  9197 tablet_bootstrap.cc:492] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:49.068240  9382 raft_consensus.cc:2749] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:49.070433  9198 tablet_bootstrap.cc:654] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.070779  9197 ts_tablet_manager.cc:1403] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.242s	user 0.074s	sys 0.077s
I20260709 13:01:49.072963  9201 tablet_bootstrap.cc:492] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:49.073437  9201 ts_tablet_manager.cc:1403] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.002s
I20260709 13:01:49.073647  9197 raft_consensus.cc:359] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:49.074599  9197 raft_consensus.cc:385] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:49.074947  9197 raft_consensus.cc:740] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.075973  9197 consensus_queue.cc:260] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:49.076270  9201 raft_consensus.cc:359] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.077174  9201 raft_consensus.cc:385] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:49.077507  9201 raft_consensus.cc:740] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.078208  9201 consensus_queue.cc:260] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.085799  9428 raft_consensus.cc:493] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.086390  9428 raft_consensus.cc:515] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.087278  9201 ts_tablet_manager.cc:1434] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:01:49.088281  9201 tablet_bootstrap.cc:492] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:49.088506  9428 leader_election.cc:290] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:49.090579  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:49.091478  9001 raft_consensus.cc:2393] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4667e9699c4d413889fc866e0e560d1f in current term 1: Already voted for candidate f3ac81bf7b994af084e9929fac14de34 in this term.
I20260709 13:01:49.093974  9197 ts_tablet_manager.cc:1434] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:01:49.101603  9201 tablet_bootstrap.cc:654] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.105580  9197 tablet_bootstrap.cc:492] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:49.112113  9196 tablet_bootstrap.cc:492] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:49.115198  9201 tablet_bootstrap.cc:492] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:49.118103  9201 ts_tablet_manager.cc:1403] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.003s
I20260709 13:01:49.118537  9382 raft_consensus.cc:493] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.119726  9382 raft_consensus.cc:515] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.122992  9197 tablet_bootstrap.cc:654] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.123476  9382 leader_election.cc:290] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:49.126674  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:49.132929  8924 raft_consensus.cc:2468] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:49.121819  9201 raft_consensus.cc:359] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.141139  9201 raft_consensus.cc:385] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:49.141472  9201 raft_consensus.cc:740] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.142195  9265 raft_consensus.cc:493] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.142813  9265 raft_consensus.cc:515] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.143405  8970 leader_election.cc:304] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:49.145154  9265 leader_election.cc:290] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:49.146515  9382 raft_consensus.cc:2804] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:49.148123  9382 raft_consensus.cc:493] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.148510  9201 consensus_queue.cc:260] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.148550  9382 raft_consensus.cc:3060] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:49.133719  9196 tablet_bootstrap.cc:654] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.152984  8824 catalog_manager.cc:5697] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:49.159296  9428 raft_consensus.cc:493] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.160045  9428 raft_consensus.cc:515] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.162339  9382 raft_consensus.cc:515] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.164143  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44fd9d19a243248566560af21b992e" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:49.164680  9428 leader_election.cc:290] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:49.165714  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44fd9d19a243248566560af21b992e" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:49.167725  9381 raft_consensus.cc:493] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.168332  9381 raft_consensus.cc:515] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.172379  8894 leader_election.cc:304] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:49.172497  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:49.174932  9381 leader_election.cc:290] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:49.177866  9197 tablet_bootstrap.cc:492] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:49.173849  8924 raft_consensus.cc:3060] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 2
I20260709 13:01:49.179860  9197 ts_tablet_manager.cc:1403] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.001s
I20260709 13:01:49.180377  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e007e79ba94ae88d703e10d65910a9" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:49.181434  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e007e79ba94ae88d703e10d65910a9" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:49.182098  9150 raft_consensus.cc:2468] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:49.183102  9197 raft_consensus.cc:359] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.183847  9197 raft_consensus.cc:385] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:49.183705  8970 leader_election.cc:343] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.184171  9197 raft_consensus.cc:740] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.184566  8970 leader_election.cc:304] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:49.184893  9197 consensus_queue.cc:260] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.186923  9382 leader_election.cc:290] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:49.187021  9311 raft_consensus.cc:2804] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:49.187444  9311 raft_consensus.cc:493] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.187760  9311 raft_consensus.cc:3060] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.187920  9197 ts_tablet_manager.cc:1434] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:49.174012  9428 raft_consensus.cc:2749] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:49.189844  9197 tablet_bootstrap.cc:492] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:49.196175  9201 ts_tablet_manager.cc:1434] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.077s	user 0.004s	sys 0.004s
I20260709 13:01:49.268134  9201 tablet_bootstrap.cc:492] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:49.271430  9498 raft_consensus.cc:493] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.271998  9498 raft_consensus.cc:515] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:49.273240  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69e9a34c48e4dbd8f8d3c71a475a7c3" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:49.276358  9498 leader_election.cc:290] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:49.204097  9311 raft_consensus.cc:515] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.218225  9310 consensus_queue.cc:1048] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260709 13:01:49.280768  9311 leader_election.cc:290] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:49.211974  9381 raft_consensus.cc:493] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.190198  8925 raft_consensus.cc:3060] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.281078  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e007e79ba94ae88d703e10d65910a9" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:49.190742  9075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:49.194202  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69e9a34c48e4dbd8f8d3c71a475a7c3" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:49.287523  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:49.288936  9152 raft_consensus.cc:3060] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.294556  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e007e79ba94ae88d703e10d65910a9" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:49.211477  8924 raft_consensus.cc:2468] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 2.
W20260709 13:01:49.296106  8970 leader_election.cc:343] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.284228  9381 raft_consensus.cc:515] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.298353  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "173098da7c34450aa6f93bcafd377922" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:49.298581  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "173098da7c34450aa6f93bcafd377922" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:49.299032  9150 raft_consensus.cc:2468] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:49.299177  8929 raft_consensus.cc:2468] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:49.299391  9381 leader_election.cc:290] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:49.297539  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:49.302248  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8bc830d85cb40fda2ac909a09c75e07" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:49.302465  9152 raft_consensus.cc:2468] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
W20260709 13:01:49.305598  8970 leader_election.cc:343] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.306357  8970 leader_election.cc:304] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:49.307135  9197 tablet_bootstrap.cc:654] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.307214  9044 leader_election.cc:304] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:49.308044  9001 raft_consensus.cc:2468] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:49.297519  9075 raft_consensus.cc:2393] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4667e9699c4d413889fc866e0e560d1f in current term 1: Already voted for candidate 0717530c054a42c5aa7aca788ba070a5 in this term.
I20260709 13:01:49.309401  9265 raft_consensus.cc:2804] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:49.311761  9381 raft_consensus.cc:2804] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:49.311856  9265 raft_consensus.cc:493] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.312381  9265 raft_consensus.cc:3060] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.309648  9198 tablet_bootstrap.cc:492] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
W20260709 13:01:49.310333  9044 leader_election.cc:343] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.313589  9198 ts_tablet_manager.cc:1403] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.257s	user 0.055s	sys 0.080s
I20260709 13:01:49.322775  9201 tablet_bootstrap.cc:654] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.323526  9381 raft_consensus.cc:697] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:49.327406  8970 leader_election.cc:304] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:49.327320  8893 leader_election.cc:304] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:49.329597  9043 leader_election.cc:304] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:49.330303  9075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8bc830d85cb40fda2ac909a09c75e07" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:49.331220  9497 raft_consensus.cc:2804] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:49.331631  9497 raft_consensus.cc:493] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.331967  9497 raft_consensus.cc:3060] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.341156  9310 raft_consensus.cc:2804] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:49.341722  9310 raft_consensus.cc:697] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 2 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:49.331898  9381 consensus_queue.cc:237] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.342326  9228 raft_consensus.cc:2749] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:49.349411  9196 tablet_bootstrap.cc:492] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:49.349861  9196 ts_tablet_manager.cc:1403] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.238s	user 0.013s	sys 0.000s
I20260709 13:01:49.342664  9310 consensus_queue.cc:237] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.339488  9497 raft_consensus.cc:515] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.344193  9265 raft_consensus.cc:515] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
W20260709 13:01:49.364864  8968 leader_election.cc:343] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.365396  8968 leader_election.cc:304] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:49.372335  9382 consensus_queue.cc:1048] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:49.377923  9382 raft_consensus.cc:2749] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:49.380463  9201 tablet_bootstrap.cc:492] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:49.380338  9198 raft_consensus.cc:359] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.381042  9201 ts_tablet_manager.cc:1403] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.113s	user 0.021s	sys 0.007s
I20260709 13:01:49.381127  9198 raft_consensus.cc:385] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:49.381489  9198 raft_consensus.cc:740] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.384012  9201 raft_consensus.cc:359] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:49.384745  9201 raft_consensus.cc:385] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:49.385030  9201 raft_consensus.cc:740] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.384402  9196 raft_consensus.cc:359] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:49.386513  9196 raft_consensus.cc:385] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:49.385737  9201 consensus_queue.cc:260] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:49.386817  9196 raft_consensus.cc:740] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.387722  9198 consensus_queue.cc:260] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.388630  9196 consensus_queue.cc:260] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:49.390161  9201 ts_tablet_manager.cc:1434] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:01:49.391935  9201 tablet_bootstrap.cc:492] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:49.396010  9497 leader_election.cc:290] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:49.397305  9265 leader_election.cc:290] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:49.399075  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69e9a34c48e4dbd8f8d3c71a475a7c3" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:49.399684  9500 raft_consensus.cc:493] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.400219  9500 raft_consensus.cc:515] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.402205  9384 raft_consensus.cc:493] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.402688  9384 raft_consensus.cc:515] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:49.403457  9198 ts_tablet_manager.cc:1434] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.001s
I20260709 13:01:49.404513  9198 tablet_bootstrap.cc:492] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:49.405810  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed7e446fa14e71894176ab3ceb8318" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:49.408270  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69e9a34c48e4dbd8f8d3c71a475a7c3" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
W20260709 13:01:49.408458  9044 leader_election.cc:343] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.408872  9001 raft_consensus.cc:3060] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:49.408993  8970 leader_election.cc:343] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.405306  9500 leader_election.cc:290] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:49.412101  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "173098da7c34450aa6f93bcafd377922" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:49.412732  9152 raft_consensus.cc:3060] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.414913  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "173098da7c34450aa6f93bcafd377922" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:49.415510  8929 raft_consensus.cc:3060] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.406967  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d45c07c5d6485eb2f08f154a9df317" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:49.420027  8970 leader_election.cc:343] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.423514  9001 raft_consensus.cc:2468] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:49.424343  9384 leader_election.cc:290] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:49.422544  9201 tablet_bootstrap.cc:654] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.425910  9198 tablet_bootstrap.cc:654] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.438958  9196 ts_tablet_manager.cc:1434] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.000s
I20260709 13:01:49.443159  9196 tablet_bootstrap.cc:492] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:49.448534  9043 leader_election.cc:304] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:49.446215  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d45c07c5d6485eb2f08f154a9df317" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:49.466516  9197 tablet_bootstrap.cc:492] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:49.467119  9197 ts_tablet_manager.cc:1403] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.278s	user 0.016s	sys 0.015s
I20260709 13:01:49.449681  9075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed7e446fa14e71894176ab3ceb8318" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:49.456414  9265 raft_consensus.cc:2804] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:49.478972  9197 raft_consensus.cc:359] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:49.479980  9197 raft_consensus.cc:385] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:49.480342  9197 raft_consensus.cc:740] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.481114  9196 tablet_bootstrap.cc:654] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.481734  9265 raft_consensus.cc:697] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:49.483392  9265 consensus_queue.cc:237] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.484778  9197 consensus_queue.cc:260] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:49.448333  9152 raft_consensus.cc:2468] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:49.495486  9238 raft_consensus.cc:493] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.481154  8929 raft_consensus.cc:2468] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:49.524080  9044 leader_election.cc:304] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:49.518627  9238 raft_consensus.cc:515] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
W20260709 13:01:49.526477  8968 leader_election.cc:343] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.527000  8968 leader_election.cc:304] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:49.527271  9238 leader_election.cc:290] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:49.527804  9238 raft_consensus.cc:2804] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:01:49.528183  8968 leader_election.cc:343] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.528266  9238 raft_consensus.cc:697] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:49.528752  8968 leader_election.cc:304] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:49.528923  9500 raft_consensus.cc:493] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.529871  9384 raft_consensus.cc:2749] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:49.529659  9500 raft_consensus.cc:515] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.530573  9384 raft_consensus.cc:2749] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:49.520308  9507 raft_consensus.cc:493] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.538673  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9762d913154929be832b5508ebad68" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:49.541213  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713d7f8692bf457fb28973349764534b" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:49.541955  9151 raft_consensus.cc:2468] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:49.534936  9507 raft_consensus.cc:515] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:49.544354  9507 leader_election.cc:290] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
W20260709 13:01:49.544535  9508 log.cc:927] Time spent T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:01:49.529364  9238 consensus_queue.cc:237] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:49.561616  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9762d913154929be832b5508ebad68" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:49.562029  9269 raft_consensus.cc:493] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.567281  9198 tablet_bootstrap.cc:492] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:49.567837  9198 ts_tablet_manager.cc:1403] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.164s	user 0.006s	sys 0.015s
I20260709 13:01:49.558656  8970 leader_election.cc:304] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:49.565883  9269 raft_consensus.cc:515] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:49.570493  9197 ts_tablet_manager.cc:1434] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.103s	user 0.012s	sys 0.010s
I20260709 13:01:49.571981  9197 tablet_bootstrap.cc:492] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:49.574577  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:49.571830  9384 raft_consensus.cc:2804] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:49.579632  9384 raft_consensus.cc:493] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.579455  9311 consensus_queue.cc:1048] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:49.580053  9384 raft_consensus.cc:3060] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.585776  9198 raft_consensus.cc:359] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:49.586830  9198 raft_consensus.cc:385] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:49.587219  9198 raft_consensus.cc:740] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.587739  9198 consensus_queue.cc:260] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:49.589339  9198 ts_tablet_manager.cc:1434] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 13:01:49.590345  9198 tablet_bootstrap.cc:492] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:49.590900  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e69234154ae46418e61ba3eb8a89c2a" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:49.591630  8929 raft_consensus.cc:2468] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:49.586194  9201 tablet_bootstrap.cc:492] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:49.589228  9269 leader_election.cc:290] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:49.592646  9201 ts_tablet_manager.cc:1403] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.201s	user 0.021s	sys 0.031s
I20260709 13:01:49.599582  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:49.599130  8824 catalog_manager.cc:5697] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:49.602690  9312 raft_consensus.cc:493] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.603255  9312 raft_consensus.cc:515] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.605222  9043 leader_election.cc:304] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:49.605386  9312 leader_election.cc:290] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
W20260709 13:01:49.606204  8970 leader_election.cc:343] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.607590  9500 leader_election.cc:290] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:49.609341  9384 raft_consensus.cc:515] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.610064  9496 raft_consensus.cc:493] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.610754  9498 raft_consensus.cc:2749] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:49.610577  9496 raft_consensus.cc:515] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.612666  9496 leader_election.cc:290] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
W20260709 13:01:49.612917  8968 leader_election.cc:343] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.612547  8827 catalog_manager.cc:5697] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:49.613389  8968 leader_election.cc:304] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:49.622263  9196 tablet_bootstrap.cc:492] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:49.622833  9196 ts_tablet_manager.cc:1403] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.180s	user 0.011s	sys 0.015s
I20260709 13:01:49.607628  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e576ab3b143d4485a1c98595bfb66af5" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:49.624307  9001 raft_consensus.cc:2468] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:49.628307  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:49.628701  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e576ab3b143d4485a1c98595bfb66af5" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:49.629534  8929 raft_consensus.cc:2393] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0717530c054a42c5aa7aca788ba070a5 in current term 2: Already voted for candidate f3ac81bf7b994af084e9929fac14de34 in this term.
I20260709 13:01:49.630549  9117 leader_election.cc:304] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:49.631486  9507 raft_consensus.cc:2749] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:49.631376  9118 leader_election.cc:304] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:49.632977  9269 raft_consensus.cc:2804] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:49.633327  9269 raft_consensus.cc:493] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.633630  9269 raft_consensus.cc:3060] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.637648  9312 raft_consensus.cc:2804] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:49.639335  9074 raft_consensus.cc:3060] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.628396  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713d7f8692bf457fb28973349764534b" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:49.643972  9496 raft_consensus.cc:493] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.649034  9198 tablet_bootstrap.cc:654] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.652702  9496 raft_consensus.cc:515] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.655220  9496 leader_election.cc:290] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:49.651391  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e69234154ae46418e61ba3eb8a89c2a" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:49.655917  9078 raft_consensus.cc:2468] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:49.656082  9384 leader_election.cc:290] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:49.657075  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e1e49fe15e4d22be2c7582c6803d8c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:49.648972  9312 raft_consensus.cc:493] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.658928  9312 raft_consensus.cc:3060] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.669842  9043 leader_election.cc:304] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:49.670847  9496 raft_consensus.cc:3060] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:49.671427  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a7ca8dc8c64156ba3dd859eb2fdf1c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:49.672166  9000 raft_consensus.cc:2468] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
W20260709 13:01:49.674367  8970 leader_election.cc:343] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.675508  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713d7f8692bf457fb28973349764534b" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:49.681087  9043 leader_election.cc:304] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:49.689862  9496 raft_consensus.cc:2749] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:49.691084  9196 raft_consensus.cc:359] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.692112  9196 raft_consensus.cc:385] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:49.692457  9196 raft_consensus.cc:740] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.694205  9497 raft_consensus.cc:2804] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:49.694777  9497 raft_consensus.cc:493] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.695194  9497 raft_consensus.cc:3060] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:49.707499  8970 leader_election.cc:343] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.705694  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a7ca8dc8c64156ba3dd859eb2fdf1c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:49.721575  9441 raft_consensus.cc:493] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.722527  9441 raft_consensus.cc:515] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:49.725378  9441 leader_election.cc:290] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:49.726146  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed7e446fa14e71894176ab3ceb8318" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:49.726858  9003 raft_consensus.cc:2468] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:49.728420  9117 leader_election.cc:304] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:49.729321  9512 raft_consensus.cc:2804] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:49.729691  9512 raft_consensus.cc:493] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.729998  9512 raft_consensus.cc:3060] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:49.733387  9044 leader_election.cc:343] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.735776  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713d7f8692bf457fb28973349764534b" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:49.736423  9148 raft_consensus.cc:3060] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:49.739830  9118 leader_election.cc:343] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.742815  9512 raft_consensus.cc:515] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:49.745743  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed7e446fa14e71894176ab3ceb8318" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:49.746567  9000 raft_consensus.cc:3060] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.761704  9000 raft_consensus.cc:2468] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:49.764943  9117 leader_election.cc:304] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:49.765879  9441 raft_consensus.cc:2804] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:49.763175  9512 leader_election.cc:290] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:49.772624  9197 tablet_bootstrap.cc:654] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.779990  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed7e446fa14e71894176ab3ceb8318" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:49.781482  8923 raft_consensus.cc:1275] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Refusing update from remote peer f3ac81bf7b994af084e9929fac14de34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:49.781622  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed7e446fa14e71894176ab3ceb8318" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:49.783150  9384 consensus_queue.cc:1048] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:49.785693  9116 leader_election.cc:343] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.693382  9196 consensus_queue.cc:260] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
W20260709 13:01:49.802096  8970 consensus_peers.cc:597] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:49.802999  9196 ts_tablet_manager.cc:1434] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.180s	user 0.008s	sys 0.000s
I20260709 13:01:49.804215  9196 tablet_bootstrap.cc:492] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:49.807811  8824 catalog_manager.cc:5697] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 0 to 2, leader changed from <none> to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:49.813556  9312 raft_consensus.cc:515] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:49.769501  9201 raft_consensus.cc:359] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.844990  9201 raft_consensus.cc:385] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:49.845491  9201 raft_consensus.cc:740] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.846465  9201 consensus_queue.cc:260] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.717494  9269 raft_consensus.cc:515] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.864691  9228 raft_consensus.cc:493] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.875610  9201 ts_tablet_manager.cc:1434] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.282s	user 0.009s	sys 0.000s
I20260709 13:01:49.866248  9148 raft_consensus.cc:2468] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
I20260709 13:01:49.877830  9201 tablet_bootstrap.cc:492] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
W20260709 13:01:49.871631  9116 leader_election.cc:343] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:49.867643  9441 raft_consensus.cc:697] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:49.876645  9228 raft_consensus.cc:515] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.911044  9441 consensus_queue.cc:237] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:49.914364  9497 raft_consensus.cc:515] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.916062  9228 leader_election.cc:290] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:49.916492  9497 leader_election.cc:290] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:49.914413  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e69234154ae46418e61ba3eb8a89c2a" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:49.917626  8925 raft_consensus.cc:3060] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.920603  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a7ca8dc8c64156ba3dd859eb2fdf1c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:49.921231  9003 raft_consensus.cc:3060] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.932821  9003 raft_consensus.cc:2468] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:49.934341  8925 raft_consensus.cc:2468] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:49.936137  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69e9a34c48e4dbd8f8d3c71a475a7c3" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:49.942692  9196 tablet_bootstrap.cc:654] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:49.904752  9312 leader_election.cc:290] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:49.956120  9382 raft_consensus.cc:493] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.956712  9382 raft_consensus.cc:515] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:49.959295  9382 leader_election.cc:290] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:49.964295  9043 leader_election.cc:304] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:49.965354  9497 raft_consensus.cc:2804] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:49.965852  9497 raft_consensus.cc:697] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:49.966678  9497 consensus_queue.cc:237] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:49.969060  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69e9a34c48e4dbd8f8d3c71a475a7c3" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:49.970191  9003 raft_consensus.cc:2393] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4667e9699c4d413889fc866e0e560d1f in current term 1: Already voted for candidate 0717530c054a42c5aa7aca788ba070a5 in this term.
I20260709 13:01:49.971544  8894 leader_election.cc:304] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:49.972381  9390 raft_consensus.cc:3060] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.984157  8825 catalog_manager.cc:5697] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:49.985203  9390 raft_consensus.cc:2749] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:49.961798  9118 leader_election.cc:304] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:49.988579  9521 raft_consensus.cc:2804] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:49.989118  9521 raft_consensus.cc:697] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:49.989959  9521 consensus_queue.cc:237] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:49.994563  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e576ab3b143d4485a1c98595bfb66af5" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:49.995388  9003 raft_consensus.cc:3060] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:49.996163  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e576ab3b143d4485a1c98595bfb66af5" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:50.002193  9269 leader_election.cc:290] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:50.006037  8970 leader_election.cc:304] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:50.007472  9382 raft_consensus.cc:2804] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:50.008083  9382 raft_consensus.cc:697] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:50.009124  9382 consensus_queue.cc:237] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:50.014580  9201 tablet_bootstrap.cc:654] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.024524  9496 consensus_queue.cc:1048] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:01:50.027613  9118 leader_election.cc:343] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.030623  9003 raft_consensus.cc:2468] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:50.034832  9507 consensus_queue.cc:1048] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:50.036013  9117 leader_election.cc:304] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:50.039265  9312 raft_consensus.cc:2804] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:50.043062  9312 raft_consensus.cc:697] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:50.044099  9312 consensus_queue.cc:237] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
W20260709 13:01:50.051622  9044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38603, user_credentials={real_user=slave}} blocked reactor thread for 190794us
I20260709 13:01:50.074231  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a7ca8dc8c64156ba3dd859eb2fdf1c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:50.075816  9198 tablet_bootstrap.cc:492] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:50.076480  9198 ts_tablet_manager.cc:1403] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.486s	user 0.069s	sys 0.074s
I20260709 13:01:50.070998  9077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e69234154ae46418e61ba3eb8a89c2a" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:50.078639  9077 raft_consensus.cc:3060] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:50.079404  9078 raft_consensus.cc:1275] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer f3ac81bf7b994af084e9929fac14de34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:01:50.095060  9044 leader_election.cc:343] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.109002  9198 raft_consensus.cc:359] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:50.110337  9198 raft_consensus.cc:385] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.110607  9198 raft_consensus.cc:740] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.094560  9498 consensus_queue.cc:1048] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:01:50.111765  9198 consensus_queue.cc:260] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:50.100729  9384 consensus_queue.cc:1048] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:01:50.128856  9198 ts_tablet_manager.cc:1434] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:01:50.131625  9198 tablet_bootstrap.cc:492] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
W20260709 13:01:50.159621  9044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41567, user_credentials={real_user=slave}} blocked reactor thread for 62191.8us
I20260709 13:01:50.186164  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42ffd5f054411aba877e8c374e5c15" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:50.186337  9508 log.cc:927] Time spent T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:50.204097  9197 tablet_bootstrap.cc:492] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:50.204759  9197 ts_tablet_manager.cc:1403] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.633s	user 0.015s	sys 0.015s
I20260709 13:01:50.206790  9381 consensus_queue.cc:1048] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:50.210736  9077 raft_consensus.cc:2468] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:50.212693  9196 tablet_bootstrap.cc:492] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:50.213235  9196 ts_tablet_manager.cc:1403] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.409s	user 0.009s	sys 0.008s
I20260709 13:01:50.137929  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42ffd5f054411aba877e8c374e5c15" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:50.225668  8825 catalog_manager.cc:5697] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:50.229472  9197 raft_consensus.cc:359] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:50.231189  9197 raft_consensus.cc:385] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.231462  9197 raft_consensus.cc:740] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.235035  9197 consensus_queue.cc:260] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:50.221876  9498 consensus_queue.cc:1048] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
W20260709 13:01:50.240994  8970 leader_election.cc:343] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:50.241750  8970 leader_election.cc:343] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.246606  9198 tablet_bootstrap.cc:654] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.242502  9197 ts_tablet_manager.cc:1434] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:01:50.248061  9197 tablet_bootstrap.cc:492] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:50.250998  8827 catalog_manager.cc:5697] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:50.252759  9196 raft_consensus.cc:359] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:50.253304  9196 raft_consensus.cc:385] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.253578  9196 raft_consensus.cc:740] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.254230  9196 consensus_queue.cc:260] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:50.261591  9196 ts_tablet_manager.cc:1434] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:01:50.256647  9238 consensus_queue.cc:1048] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:01:50.246232  8970 leader_election.cc:304] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:50.270582  9382 raft_consensus.cc:2749] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:50.283118  9196 tablet_bootstrap.cc:492] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:50.324572  9201 tablet_bootstrap.cc:492] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:50.325105  9201 ts_tablet_manager.cc:1403] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.448s	user 0.010s	sys 0.017s
I20260709 13:01:50.330744  9197 tablet_bootstrap.cc:654] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.330947  8824 catalog_manager.cc:5697] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:50.411692  8970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38603, user_credentials={real_user=slave}} blocked reactor thread for 55249.1us
I20260709 13:01:50.430588  9196 tablet_bootstrap.cc:654] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.462805  9521 consensus_queue.cc:1048] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:50.486120  9198 tablet_bootstrap.cc:492] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:50.486687  9198 ts_tablet_manager.cc:1403] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.357s	user 0.029s	sys 0.016s
I20260709 13:01:50.482574  9523 raft_consensus.cc:493] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.487919  9523 raft_consensus.cc:515] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:50.518958  9201 raft_consensus.cc:359] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:50.520080  9201 raft_consensus.cc:385] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.520433  9201 raft_consensus.cc:740] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.523180  9197 tablet_bootstrap.cc:492] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:50.523900  9197 ts_tablet_manager.cc:1403] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.276s	user 0.025s	sys 0.024s
W20260709 13:01:50.525507  9541 log.cc:927] Time spent T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5: Append to log took a long time: real 0.091s	user 0.003s	sys 0.000s
I20260709 13:01:50.521446  8827 catalog_manager.cc:5697] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:50.530009  9044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41567, user_credentials={real_user=slave}} blocked reactor thread for 50398.7us
I20260709 13:01:50.529784  8827 catalog_manager.cc:5697] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.531635  9197 raft_consensus.cc:359] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:50.532788  9197 raft_consensus.cc:385] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.533051  9197 raft_consensus.cc:740] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.544379  9201 consensus_queue.cc:260] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:50.549640  9201 ts_tablet_manager.cc:1434] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.224s	user 0.007s	sys 0.006s
W20260709 13:01:50.552042  8970 consensus_peers.cc:597] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.552649  9043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45405, user_credentials={real_user=slave}} blocked reactor thread for 56855.6us
I20260709 13:01:50.556241  9198 raft_consensus.cc:359] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:50.556594  9441 raft_consensus.cc:493] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.556998  9198 raft_consensus.cc:385] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.557315  9198 raft_consensus.cc:740] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.557192  9441 raft_consensus.cc:515] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:50.559316  9441 leader_election.cc:290] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:50.562254  9201 tablet_bootstrap.cc:492] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:50.564589  9523 leader_election.cc:290] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:50.566691  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed7e446fa14e71894176ab3ceb8318" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:50.576840  9079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec71963326742b199b954dc1c0bbacb" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:50.581797  9077 raft_consensus.cc:3060] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:50.583280  9269 consensus_queue.cc:1048] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:50.585037  9384 consensus_queue.cc:1048] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:50.587447  9197 consensus_queue.cc:260] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:50.590107  9197 ts_tablet_manager.cc:1434] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.001s
I20260709 13:01:50.557953  9198 consensus_queue.cc:260] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:50.591137  9197 tablet_bootstrap.cc:492] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:50.610531  8926 raft_consensus.cc:3060] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:50.612702  9116 leader_election.cc:343] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.613715  9196 tablet_bootstrap.cc:492] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:50.614396  9196 ts_tablet_manager.cc:1403] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.331s	user 0.017s	sys 0.004s
I20260709 13:01:50.615926  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ed7e446fa14e71894176ab3ceb8318" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:50.630522  9198 ts_tablet_manager.cc:1434] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.144s	user 0.007s	sys 0.000s
I20260709 13:01:50.632085  9201 tablet_bootstrap.cc:654] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.634778  9198 tablet_bootstrap.cc:492] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:50.644645  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec71963326742b199b954dc1c0bbacb" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:50.641882  9196 raft_consensus.cc:359] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:50.649557  9196 raft_consensus.cc:385] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.649854  9196 raft_consensus.cc:740] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.650486  9196 consensus_queue.cc:260] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:50.655339  9043 leader_election.cc:304] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34
W20260709 13:01:50.677165  9118 leader_election.cc:343] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.677672  9118 leader_election.cc:304] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:50.679363  9196 ts_tablet_manager.cc:1434] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
W20260709 13:01:50.680359  9044 consensus_peers.cc:597] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:50.690680  9312 raft_consensus.cc:2749] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:50.731871  9381 raft_consensus.cc:493] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.732474  9381 raft_consensus.cc:515] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:50.782505  9512 consensus_queue.cc:1048] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:50.796151  9498 raft_consensus.cc:2749] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:50.801460  9512 consensus_queue.cc:1048] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:50.820528  9552 raft_consensus.cc:493] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.821187  9552 raft_consensus.cc:515] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
W20260709 13:01:50.867385  8894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45405, user_credentials={real_user=slave}} blocked reactor thread for 118929us
I20260709 13:01:50.873754  9197 tablet_bootstrap.cc:654] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:50.876401  9118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:41567, user_credentials={real_user=slave}} blocked reactor thread for 199260us
I20260709 13:01:50.882215  9201 tablet_bootstrap.cc:492] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:50.938973  9558 consensus_queue.cc:1048] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:50.892277  9381 leader_election.cc:290] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:50.909364  9196 tablet_bootstrap.cc:492] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:50.939352  9201 ts_tablet_manager.cc:1403] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.377s	user 0.023s	sys 0.015s
I20260709 13:01:50.945185  9201 raft_consensus.cc:359] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:50.949175  9196 tablet_bootstrap.cc:654] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.950327  9201 raft_consensus.cc:385] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.950814  9201 raft_consensus.cc:740] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.951671  9201 consensus_queue.cc:260] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:50.954521  9512 raft_consensus.cc:493] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.955216  9512 raft_consensus.cc:515] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:50.955754  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c7c3cea0934ff59d24774835ed3e79" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:50.958456  9512 leader_election.cc:290] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:50.959007  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c7c3cea0934ff59d24774835ed3e79" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:50.959403  9196 tablet_bootstrap.cc:492] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:50.960378  9201 ts_tablet_manager.cc:1434] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:01:50.960387  9196 ts_tablet_manager.cc:1403] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 13:01:50.961460  9077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a074d6cac458d9de6a79b3bcceade" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:50.961797  9201 tablet_bootstrap.cc:492] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:50.962162  9077 raft_consensus.cc:2468] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:50.963380  9116 leader_election.cc:304] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:50.964247  9512 raft_consensus.cc:2804] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:50.964712  9521 consensus_queue.cc:1048] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:50.964748  9312 consensus_queue.cc:1048] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:01:50.926064  9198 tablet_bootstrap.cc:654] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:50.968127  9512 raft_consensus.cc:493] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.968739  9512 raft_consensus.cc:3060] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:50.974509  9197 tablet_bootstrap.cc:492] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:50.974177  9196 raft_consensus.cc:359] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:50.975033  9196 raft_consensus.cc:385] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:50.975045  9197 ts_tablet_manager.cc:1403] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.384s	user 0.013s	sys 0.029s
I20260709 13:01:50.975423  9196 raft_consensus.cc:740] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.050261  9390 raft_consensus.cc:493] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.052040  9390 raft_consensus.cc:515] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:51.069638  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a074d6cac458d9de6a79b3bcceade" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:51.045429  9521 raft_consensus.cc:493] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.081120  9521 raft_consensus.cc:515] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:51.085088  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e576ab3b143d4485a1c98595bfb66af5" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:51.086526  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42ffd5f054411aba877e8c374e5c15" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:51.086915  9198 tablet_bootstrap.cc:492] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:51.087651  9003 raft_consensus.cc:2468] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:51.090696  9198 ts_tablet_manager.cc:1403] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.459s	user 0.020s	sys 0.001s
I20260709 13:01:51.103042  9201 tablet_bootstrap.cc:654] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:51.104110  8970 leader_election.cc:343] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.089607  9521 leader_election.cc:290] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:51.098943  9512 raft_consensus.cc:515] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.110664  9117 leader_election.cc:304] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:51.112898  9521 raft_consensus.cc:2804] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:51.113323  9521 raft_consensus.cc:493] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.113677  9521 raft_consensus.cc:3060] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.118296  9512 leader_election.cc:290] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:51.125985  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a074d6cac458d9de6a79b3bcceade" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:51.136355  9073 raft_consensus.cc:3060] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.136816  9198 raft_consensus.cc:359] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:51.137969  9198 raft_consensus.cc:385] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.138835  9198 raft_consensus.cc:740] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.139698  9198 consensus_queue.cc:260] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:51.132279  9197 raft_consensus.cc:359] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:51.144158  9197 raft_consensus.cc:385] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.145182  9197 raft_consensus.cc:740] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
W20260709 13:01:51.145464  8894 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45405, user_credentials={real_user=slave}} blocked reactor thread for 89659.7us
I20260709 13:01:51.147065  9197 consensus_queue.cc:260] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:51.153191  9497 raft_consensus.cc:493] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.153462  8927 raft_consensus.cc:3060] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.153817  9497 raft_consensus.cc:515] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:51.156924  9497 leader_election.cc:290] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:51.133534  9552 leader_election.cc:290] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
W20260709 13:01:51.134255  8968 leader_election.cc:343] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.169766  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713d7f8692bf457fb28973349764534b" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:51.172035  9390 leader_election.cc:290] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
W20260709 13:01:51.172488  8874 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:51.173590  8968 leader_election.cc:304] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:51.175537  9384 raft_consensus.cc:2749] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:51.173609  9311 raft_consensus.cc:493] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:51.175534  8968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:46841, user_credentials={real_user=slave}} blocked reactor thread for 67278.5us
I20260709 13:01:51.176810  9196 consensus_queue.cc:260] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:51.181581  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d45c07c5d6485eb2f08f154a9df317" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:51.185839  8928 raft_consensus.cc:2468] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:51.176863  9311 raft_consensus.cc:515] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:51.185978  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e576ab3b143d4485a1c98595bfb66af5" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:51.196943  9196 ts_tablet_manager.cc:1434] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.230s	user 0.008s	sys 0.004s
I20260709 13:01:51.198807  9311 leader_election.cc:290] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:51.213704  9197 ts_tablet_manager.cc:1434] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.238s	user 0.009s	sys 0.003s
I20260709 13:01:51.229341  9196 tablet_bootstrap.cc:492] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
W20260709 13:01:51.241369  9118 leader_election.cc:343] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.228956  9073 raft_consensus.cc:2468] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:51.247481  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713d7f8692bf457fb28973349764534b" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:51.248967  9044 leader_election.cc:304] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:51.248850  9116 leader_election.cc:304] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:51.250278  9312 raft_consensus.cc:2804] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:51.250660  9497 raft_consensus.cc:2804] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:51.250926  9312 raft_consensus.cc:697] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:51.251197  9497 raft_consensus.cc:493] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.252197  9497 raft_consensus.cc:3060] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.252470  9312 consensus_queue.cc:237] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.257725  9198 ts_tablet_manager.cc:1434] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.167s	user 0.005s	sys 0.004s
I20260709 13:01:51.205317  9521 raft_consensus.cc:515] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:51.260910  9198 tablet_bootstrap.cc:492] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:51.262491  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42ffd5f054411aba877e8c374e5c15" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:51.263317  9003 raft_consensus.cc:3060] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.269539  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d45c07c5d6485eb2f08f154a9df317" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:51.270462  9000 raft_consensus.cc:2468] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:51.274492  9521 leader_election.cc:290] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:51.281435  9197 tablet_bootstrap.cc:492] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:51.285801  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42ffd5f054411aba877e8c374e5c15" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:51.288110  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8bc830d85cb40fda2ac909a09c75e07" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:51.289469  9196 tablet_bootstrap.cc:654] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.291551  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b42ffd5f054411aba877e8c374e5c15" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:51.297186  9521 raft_consensus.cc:493] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.297751  9521 raft_consensus.cc:515] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:51.298410  9003 raft_consensus.cc:2468] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:51.300098  9521 leader_election.cc:290] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
W20260709 13:01:51.300876  9118 leader_election.cc:343] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.298318  9201 tablet_bootstrap.cc:492] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:51.302728  9201 ts_tablet_manager.cc:1403] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.341s	user 0.021s	sys 0.001s
W20260709 13:01:51.301983  9118 leader_election.cc:343] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.298434  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a074d6cac458d9de6a79b3bcceade" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:51.331732  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:51.331764  9117 leader_election.cc:304] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:51.333033  8894 leader_election.cc:304] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:51.333600  9512 raft_consensus.cc:2804] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:51.334324  9512 raft_consensus.cc:697] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:51.335462  9512 consensus_queue.cc:237] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:51.339098  8894 leader_election.cc:304] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:51.356809  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:51.351783  9500 raft_consensus.cc:493] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.360065  9500 raft_consensus.cc:515] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:51.350858  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8bc830d85cb40fda2ac909a09c75e07" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:51.363030  8968 leader_election.cc:343] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:51.368108  8970 leader_election.cc:343] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.367110  9000 raft_consensus.cc:2468] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:51.372699  9198 tablet_bootstrap.cc:654] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:51.366712  9118 leader_election.cc:343] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.375170  9570 raft_consensus.cc:2749] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:51.353747  9116 leader_election.cc:343] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.368502  8970 leader_election.cc:304] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:51.380218  9500 leader_election.cc:290] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:51.349432  9201 raft_consensus.cc:359] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:51.385805  9201 raft_consensus.cc:385] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.386816  9201 raft_consensus.cc:740] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.391353  9077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
W20260709 13:01:51.393508  8968 leader_election.cc:343] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.383541  9500 raft_consensus.cc:2749] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:51.399794  9197 tablet_bootstrap.cc:654] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.404199  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:51.408557  9150 raft_consensus.cc:2468] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 0.
I20260709 13:01:51.414163  9497 raft_consensus.cc:515] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:51.417658  9390 raft_consensus.cc:2749] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:51.436511  9197 tablet_bootstrap.cc:492] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:51.438869  9196 tablet_bootstrap.cc:492] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:51.439373  9196 ts_tablet_manager.cc:1403] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.211s	user 0.012s	sys 0.016s
I20260709 13:01:51.439880  8970 leader_election.cc:304] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:51.441735  9311 raft_consensus.cc:2804] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:51.442147  9311 raft_consensus.cc:493] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.442487  9311 raft_consensus.cc:3060] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.443758  9196 raft_consensus.cc:359] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:51.444515  9196 raft_consensus.cc:385] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.444801  9196 raft_consensus.cc:740] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.445688  9196 consensus_queue.cc:260] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:51.437186  9197 ts_tablet_manager.cc:1403] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.213s	user 0.023s	sys 0.020s
I20260709 13:01:51.451098  9197 raft_consensus.cc:359] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.451828  9197 raft_consensus.cc:385] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.452083  9197 raft_consensus.cc:740] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.453019  9196 ts_tablet_manager.cc:1434] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:01:51.431047  9201 consensus_queue.cc:260] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:51.464774  9196 tablet_bootstrap.cc:492] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:51.475384  9196 tablet_bootstrap.cc:654] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.475915  9197 consensus_queue.cc:260] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.479795  9117 leader_election.cc:304] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:51.489442  9310 raft_consensus.cc:493] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.494613  9310 raft_consensus.cc:515] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:51.496927  9310 leader_election.cc:290] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:51.499701  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d45c07c5d6485eb2f08f154a9df317" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:51.499912  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8af72e77c964acd910c3ec90fe52078" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:51.500283  8927 raft_consensus.cc:3060] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.502666  9497 leader_election.cc:290] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:51.504379  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d45c07c5d6485eb2f08f154a9df317" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:51.505424  9000 raft_consensus.cc:3060] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:51.508183  9117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:45405, user_credentials={real_user=slave}} blocked reactor thread for 135300us
I20260709 13:01:51.508961  9441 raft_consensus.cc:2804] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:51.509451  9441 raft_consensus.cc:493] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.509791  9441 raft_consensus.cc:3060] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.515204  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8af72e77c964acd910c3ec90fe52078" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:51.518730  9000 raft_consensus.cc:2468] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
W20260709 13:01:51.523766  8970 leader_election.cc:343] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.524588  9043 leader_election.cc:304] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:51.525534  9534 raft_consensus.cc:2804] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:51.526088  9534 raft_consensus.cc:697] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:51.526973  9534 consensus_queue.cc:237] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
W20260709 13:01:51.527359  8968 leader_election.cc:343] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.528162  8968 leader_election.cc:304] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:51.528270  9512 raft_consensus.cc:493] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.529640  9310 raft_consensus.cc:2749] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:51.530077  9512 raft_consensus.cc:515] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.532431  9512 leader_election.cc:290] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:51.533967  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69981197f2a5423a8758576940d1bf76" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
W20260709 13:01:51.535181  9116 leader_election.cc:343] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.536124  9500 raft_consensus.cc:493] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.536932  9201 ts_tablet_manager.cc:1434] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.234s	user 0.014s	sys 0.000s
I20260709 13:01:51.536662  9500 raft_consensus.cc:515] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:51.537560  9198 tablet_bootstrap.cc:492] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:51.538152  9198 ts_tablet_manager.cc:1403] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.278s	user 0.020s	sys 0.019s
I20260709 13:01:51.538785  9500 leader_election.cc:290] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:51.539676  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:51.540375  9201 tablet_bootstrap.cc:492] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:51.497565  9311 raft_consensus.cc:515] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
W20260709 13:01:51.541643  8970 leader_election.cc:343] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.545819  9197 ts_tablet_manager.cc:1434] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.097s	user 0.006s	sys 0.002s
I20260709 13:01:51.545665  9198 raft_consensus.cc:359] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:51.546593  9198 raft_consensus.cc:385] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.547019  9197 tablet_bootstrap.cc:492] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:51.548116  9077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:51.546967  9198 raft_consensus.cc:740] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
W20260709 13:01:51.549899  8968 leader_election.cc:343] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.550343  8968 leader_election.cc:304] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:51.553308  9077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:51.554371  9500 raft_consensus.cc:2749] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:51.556537  8968 leader_election.cc:343] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.542601  9311 leader_election.cc:290] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:51.557129  9198 consensus_queue.cc:260] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:51.580284  9196 tablet_bootstrap.cc:492] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:51.580708  9196 ts_tablet_manager.cc:1403] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.116s	user 0.010s	sys 0.004s
I20260709 13:01:51.569792  8824 catalog_manager.cc:5697] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.583662  9197 tablet_bootstrap.cc:654] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.569150  9441 raft_consensus.cc:515] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:51.586090  8824 catalog_manager.cc:5697] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.596241  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:51.597107  9152 raft_consensus.cc:2393] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3ac81bf7b994af084e9929fac14de34 in current term 1: Already voted for candidate 069063a72de443729cdfb3fcbfa6a123 in this term.
I20260709 13:01:51.597759  9201 tablet_bootstrap.cc:654] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.599592  9005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:51.600440  9005 raft_consensus.cc:2393] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 069063a72de443729cdfb3fcbfa6a123 in current term 1: Already voted for candidate f3ac81bf7b994af084e9929fac14de34 in this term.
I20260709 13:01:51.602407  8927 raft_consensus.cc:2468] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:51.600075  8828 catalog_manager.cc:5697] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:51.608767  9198 ts_tablet_manager.cc:1434] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.003s
I20260709 13:01:51.612013  9441 leader_election.cc:290] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:51.613312  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:51.615331  9198 tablet_bootstrap.cc:492] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:51.616251  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69981197f2a5423a8758576940d1bf76" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:51.616946  9116 leader_election.cc:343] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.613734  9196 raft_consensus.cc:359] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:51.617442  9116 leader_election.cc:304] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:51.617745  9196 raft_consensus.cc:385] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.618103  9196 raft_consensus.cc:740] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.620400  8970 leader_election.cc:304] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:51.621860  9310 raft_consensus.cc:2749] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:51.619675  9521 raft_consensus.cc:2749] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:51.618824  9196 consensus_queue.cc:260] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
W20260709 13:01:51.621673  9118 leader_election.cc:343] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.625473  9196 ts_tablet_manager.cc:1434] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:01:51.624125  9118 leader_election.cc:304] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:51.628768  9521 raft_consensus.cc:2749] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:51.630439  9198 tablet_bootstrap.cc:654] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.630915  9197 tablet_bootstrap.cc:492] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:51.631428  9197 ts_tablet_manager.cc:1403] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.001s
I20260709 13:01:51.634040  9196 tablet_bootstrap.cc:492] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:51.639523  9201 tablet_bootstrap.cc:492] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:51.640039  9201 ts_tablet_manager.cc:1403] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.100s	user 0.003s	sys 0.008s
I20260709 13:01:51.641021  9197 raft_consensus.cc:359] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:51.641856  9197 raft_consensus.cc:385] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.642218  9197 raft_consensus.cc:740] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.642886  9201 raft_consensus.cc:359] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:51.642995  9197 consensus_queue.cc:260] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:51.643764  9201 raft_consensus.cc:385] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.644187  9201 raft_consensus.cc:740] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.641366  9196 tablet_bootstrap.cc:654] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.648829  9521 consensus_queue.cc:1048] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:51.649523  9198 tablet_bootstrap.cc:492] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:51.650028  9198 ts_tablet_manager.cc:1403] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.003s
I20260709 13:01:51.650413  9201 consensus_queue.cc:260] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:51.664963  9201 ts_tablet_manager.cc:1434] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:01:51.673645  9197 ts_tablet_manager.cc:1434] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:01:51.674034  9198 raft_consensus.cc:359] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.674862  9198 raft_consensus.cc:385] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.675011  9197 tablet_bootstrap.cc:492] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:51.675154  9198 raft_consensus.cc:740] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.678627  9198 consensus_queue.cc:260] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.680227  9201 tablet_bootstrap.cc:492] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
I20260709 13:01:51.685374  9197 tablet_bootstrap.cc:654] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.701592  9198 ts_tablet_manager.cc:1434] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.010s
W20260709 13:01:51.721347  9118 consensus_peers.cc:597] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.722510  9198 tablet_bootstrap.cc:492] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:51.724144  9196 tablet_bootstrap.cc:492] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:51.724658  9196 ts_tablet_manager.cc:1403] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.091s	user 0.020s	sys 0.005s
I20260709 13:01:51.727736  9196 raft_consensus.cc:359] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.728566  9196 raft_consensus.cc:385] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.728953  9196 raft_consensus.cc:740] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.730384  9196 consensus_queue.cc:260] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.732846  9201 tablet_bootstrap.cc:654] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.733767  9196 ts_tablet_manager.cc:1434] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:01:51.735096  9196 tablet_bootstrap.cc:492] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:51.741811  9198 tablet_bootstrap.cc:654] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.749449  9196 tablet_bootstrap.cc:654] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.745067  9197 tablet_bootstrap.cc:492] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:51.750188  9197 ts_tablet_manager.cc:1403] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.076s	user 0.008s	sys 0.024s
I20260709 13:01:51.759742  9201 tablet_bootstrap.cc:492] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:51.760277  9201 ts_tablet_manager.cc:1403] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.001s
I20260709 13:01:51.761483  9583 raft_consensus.cc:493] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.762234  9583 raft_consensus.cc:515] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:51.762979  9201 raft_consensus.cc:359] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:51.763712  9201 raft_consensus.cc:385] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.763978  9201 raft_consensus.cc:740] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.764920  9583 leader_election.cc:290] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:51.765694  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a12c81f118b4261bdad649a5d121e25" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:51.766992  9118 leader_election.cc:343] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.767481  9534 raft_consensus.cc:493] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.767750  8928 raft_consensus.cc:3060] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.767952  9534 raft_consensus.cc:515] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.769657  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a12c81f118b4261bdad649a5d121e25" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:51.770126  9534 leader_election.cc:290] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:51.774066  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec71963326742b199b954dc1c0bbacb" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:51.774509  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec71963326742b199b954dc1c0bbacb" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:51.775230  9151 raft_consensus.cc:2468] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:51.776439  9044 leader_election.cc:304] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:51.777297  9497 raft_consensus.cc:2804] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:51.764946  9201 consensus_queue.cc:260] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:51.777661  9497 raft_consensus.cc:493] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.778021  9497 raft_consensus.cc:3060] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.777967  9000 raft_consensus.cc:2468] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:51.784413  9497 raft_consensus.cc:515] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
W20260709 13:01:51.784567  9044 leader_election.cc:343] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.786625  9497 leader_election.cc:290] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:51.789229  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec71963326742b199b954dc1c0bbacb" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:51.790099  9151 raft_consensus.cc:3060] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.764788  9197 raft_consensus.cc:359] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.790809  9197 raft_consensus.cc:385] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.792479  9197 raft_consensus.cc:740] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.793889  9117 leader_election.cc:304] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:51.794274  9521 consensus_queue.cc:1048] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:01:51.805124  9583 raft_consensus.cc:2804] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:51.805840  9583 raft_consensus.cc:493] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.806324  9583 raft_consensus.cc:3060] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.807096  9151 raft_consensus.cc:2468] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:51.807926  9197 consensus_queue.cc:260] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.809441  9044 leader_election.cc:304] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:51.810801  9197 ts_tablet_manager.cc:1434] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:01:51.812126  9197 tablet_bootstrap.cc:492] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:51.813627  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec71963326742b199b954dc1c0bbacb" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:51.814024  9534 raft_consensus.cc:2804] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:51.814621  9534 raft_consensus.cc:697] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:51.815549  9201 ts_tablet_manager.cc:1434] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.001s
I20260709 13:01:51.815512  9534 consensus_queue.cc:237] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.816818  9201 tablet_bootstrap.cc:492] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34: Bootstrap starting.
W20260709 13:01:51.819357  9044 leader_election.cc:343] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.829592  9390 raft_consensus.cc:493] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.830202  9390 raft_consensus.cc:515] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.831594  9197 tablet_bootstrap.cc:654] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.832412  9390 leader_election.cc:290] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:51.833087  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a074d6cac458d9de6a79b3bcceade" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:51.836625  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89a074d6cac458d9de6a79b3bcceade" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:51.838409  9310 raft_consensus.cc:493] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.839013  9310 raft_consensus.cc:515] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:51.841742  9196 tablet_bootstrap.cc:492] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:51.842250  9196 ts_tablet_manager.cc:1403] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.108s	user 0.046s	sys 0.020s
I20260709 13:01:51.842180  9310 leader_election.cc:290] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:51.845160  9196 raft_consensus.cc:359] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.846391  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b06a466054767b5daa1085aca6ea5" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:51.846136  9196 raft_consensus.cc:385] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.847090  9196 raft_consensus.cc:740] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.850142  9201 tablet_bootstrap.cc:654] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.850553  8895 leader_election.cc:304] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:51.851351  9390 raft_consensus.cc:2749] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:51.852308  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b06a466054767b5daa1085aca6ea5" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
W20260709 13:01:51.852962  8970 leader_election.cc:343] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:51.853828  8968 leader_election.cc:343] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.854238  8968 leader_election.cc:304] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:51.858304  9384 raft_consensus.cc:2749] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:51.858855  9198 tablet_bootstrap.cc:492] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:51.859440  9198 ts_tablet_manager.cc:1403] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.009s
I20260709 13:01:51.855082  9196 consensus_queue.cc:260] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.862264  9198 raft_consensus.cc:359] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.863101  9198 raft_consensus.cc:385] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.863341  9198 raft_consensus.cc:740] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.851089  9583 raft_consensus.cc:515] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:51.875021  9390 raft_consensus.cc:493] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.875564  9390 raft_consensus.cc:515] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:51.876991  9583 leader_election.cc:290] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:51.882246  9196 ts_tablet_manager.cc:1434] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.002s
I20260709 13:01:51.882203  9198 consensus_queue.cc:260] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:51.884164  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a12c81f118b4261bdad649a5d121e25" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:51.884799  9002 raft_consensus.cc:3060] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.896325  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a12c81f118b4261bdad649a5d121e25" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
W20260709 13:01:51.897082  9118 consensus_peers.cc:597] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.906392  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a7ca8dc8c64156ba3dd859eb2fdf1c" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:51.907202  9390 leader_election.cc:290] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:51.907546  9198 ts_tablet_manager.cc:1434] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:01:51.908615  9198 tablet_bootstrap.cc:492] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:51.914000  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a7ca8dc8c64156ba3dd859eb2fdf1c" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:51.915155  9196 tablet_bootstrap.cc:492] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:51.918818  9002 raft_consensus.cc:2468] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:51.919027  8893 leader_election.cc:304] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34
W20260709 13:01:51.920481  9118 leader_election.cc:343] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.924549  9117 leader_election.cc:304] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:51.926013  9521 raft_consensus.cc:2804] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:51.926590  9521 raft_consensus.cc:697] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:51.930212  9573 raft_consensus.cc:2749] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:51.944187  9197 tablet_bootstrap.cc:492] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:51.936618  8926 raft_consensus.cc:3060] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:51.944713  9197 ts_tablet_manager.cc:1403] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.133s	user 0.011s	sys 0.010s
I20260709 13:01:51.927368  9521 consensus_queue.cc:237] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:51.948486  9201 tablet_bootstrap.cc:492] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34: No bootstrap required, opened a new log
I20260709 13:01:51.948940  9201 ts_tablet_manager.cc:1403] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34: Time spent bootstrapping tablet: real 0.132s	user 0.011s	sys 0.014s
W20260709 13:01:51.959676  9602 log.cc:927] Time spent T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.004s
I20260709 13:01:51.973533  9196 tablet_bootstrap.cc:654] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:51.984555  9197 raft_consensus.cc:359] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:51.985356  9197 raft_consensus.cc:385] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:51.985638  9197 raft_consensus.cc:740] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.991586  9197 consensus_queue.cc:260] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.004515  9201 raft_consensus.cc:359] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:52.009055  9201 raft_consensus.cc:385] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.009449  9201 raft_consensus.cc:740] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.010690  9201 consensus_queue.cc:260] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:52.012141  9197 ts_tablet_manager.cc:1434] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.001s
I20260709 13:01:52.011590  8828 catalog_manager.cc:5697] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.013226  9197 tablet_bootstrap.cc:492] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:52.013489  9201 ts_tablet_manager.cc:1434] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.003s
I20260709 13:01:52.013809  9198 tablet_bootstrap.cc:654] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.025009  9558 raft_consensus.cc:493] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.025589  9558 raft_consensus.cc:515] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:52.029039  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8bc830d85cb40fda2ac909a09c75e07" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:52.030917  9044 leader_election.cc:343] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:52.031731  9196 tablet_bootstrap.cc:492] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:52.032243  9196 ts_tablet_manager.cc:1403] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.117s	user 0.008s	sys 0.013s
I20260709 13:01:52.028386  9198 tablet_bootstrap.cc:492] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:52.033980  9198 ts_tablet_manager.cc:1403] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.002s
I20260709 13:01:52.025555  9197 tablet_bootstrap.cc:654] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.038626  9198 raft_consensus.cc:359] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.039664  9198 raft_consensus.cc:385] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.040072  9198 raft_consensus.cc:740] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.041270  9198 consensus_queue.cc:260] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.044576  9198 ts_tablet_manager.cc:1434] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:01:52.045890  9198 tablet_bootstrap.cc:492] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:52.046027  8824 catalog_manager.cc:5697] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.054234  9198 tablet_bootstrap.cc:654] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.054473  9197 tablet_bootstrap.cc:492] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:52.054961  9197 ts_tablet_manager.cc:1403] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.000s
I20260709 13:01:52.058230  9197 raft_consensus.cc:359] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:52.058986  9197 raft_consensus.cc:385] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.059249  9197 raft_consensus.cc:740] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.059508  9498 consensus_queue.cc:1048] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:52.060029  9197 consensus_queue.cc:260] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:52.063135  9197 ts_tablet_manager.cc:1434] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:01:52.079389  9197 tablet_bootstrap.cc:492] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:52.093155  9558 leader_election.cc:290] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:52.094406  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8bc830d85cb40fda2ac909a09c75e07" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:52.095150  9000 raft_consensus.cc:2468] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:52.084378  9196 raft_consensus.cc:359] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:52.098277  9196 raft_consensus.cc:385] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.098562  9196 raft_consensus.cc:740] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.099205  9196 consensus_queue.cc:260] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:52.101374  9196 ts_tablet_manager.cc:1434] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 13:01:52.101694  9497 consensus_queue.cc:1048] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:52.109485  9558 raft_consensus.cc:493] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.109969  9558 raft_consensus.cc:515] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:52.112104  9558 leader_election.cc:290] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:52.112644  9043 leader_election.cc:304] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:52.113399  9558 raft_consensus.cc:2804] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:52.113744  9558 raft_consensus.cc:493] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.114200  9558 raft_consensus.cc:3060] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.114302  9312 raft_consensus.cc:493] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.115067  9312 raft_consensus.cc:515] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:52.120146  9312 leader_election.cc:290] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:52.122857  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69981197f2a5423a8758576940d1bf76" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:52.123494  8929 raft_consensus.cc:2468] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:52.128631  9312 raft_consensus.cc:493] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.129175  9312 raft_consensus.cc:515] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.128680  9044 leader_election.cc:304] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:52.130246  9196 tablet_bootstrap.cc:492] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:52.132071  9534 raft_consensus.cc:2804] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:52.134723  9534 raft_consensus.cc:493] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.135140  9534 raft_consensus.cc:3060] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.135983  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a907eff584544e28628c20d7addb69c" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:52.140487  9312 leader_election.cc:290] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:52.139788  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c7c3cea0934ff59d24774835ed3e79" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:52.131129  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a907eff584544e28628c20d7addb69c" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:52.141861  9002 raft_consensus.cc:2468] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
W20260709 13:01:52.142400  9118 leader_election.cc:343] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:52.143055  9117 leader_election.cc:304] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:52.143872  9312 raft_consensus.cc:2804] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:52.144309  9312 raft_consensus.cc:493] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.144681  9312 raft_consensus.cc:3060] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:52.148844  9116 leader_election.cc:343] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:52.149422  9116 leader_election.cc:304] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:52.150204  9521 raft_consensus.cc:2749] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:52.134676  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69981197f2a5423a8758576940d1bf76" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:52.160151  9148 raft_consensus.cc:2468] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:52.164505  9312 raft_consensus.cc:515] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.173751  9197 tablet_bootstrap.cc:654] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.169888  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c7c3cea0934ff59d24774835ed3e79" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:52.194813  9074 raft_consensus.cc:2468] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:52.196089  9196 tablet_bootstrap.cc:654] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.196419  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c7c3cea0934ff59d24774835ed3e79" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:52.197113  9003 raft_consensus.cc:3060] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.203663  9198 tablet_bootstrap.cc:492] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:52.204277  9198 ts_tablet_manager.cc:1403] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.159s	user 0.019s	sys 0.010s
I20260709 13:01:52.207327  9198 raft_consensus.cc:359] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.214568  9198 raft_consensus.cc:385] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.214951  9198 raft_consensus.cc:740] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.216704  9312 leader_election.cc:290] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:52.214957  9583 raft_consensus.cc:493] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.201741  9534 raft_consensus.cc:515] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:52.220777  9583 raft_consensus.cc:515] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:52.225518  9583 leader_election.cc:290] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:52.226810  9004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a489378335c74a0fb5932be1e308fc64" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:52.227492  9004 raft_consensus.cc:2468] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:52.228700  9117 leader_election.cc:304] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:52.229462  9521 raft_consensus.cc:2804] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:52.229810  9521 raft_consensus.cc:493] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.232918  9198 consensus_queue.cc:260] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.230191  9521 raft_consensus.cc:3060] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.229980  9558 raft_consensus.cc:515] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:52.239964  9534 leader_election.cc:290] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:52.240514  9558 leader_election.cc:290] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:52.243678  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a489378335c74a0fb5932be1e308fc64" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
W20260709 13:01:52.245239  9118 leader_election.cc:343] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:52.250679  9573 raft_consensus.cc:493] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.251453  9573 raft_consensus.cc:515] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:52.253743  9198 ts_tablet_manager.cc:1434] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.002s
W20260709 13:01:52.266597  9044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38603, user_credentials={real_user=slave}} blocked reactor thread for 79175.8us
I20260709 13:01:52.257071  9521 raft_consensus.cc:515] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:52.259123  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec71963326742b199b954dc1c0bbacb" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:52.245898  9001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8bc830d85cb40fda2ac909a09c75e07" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:52.262295  9003 raft_consensus.cc:2468] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:52.268308  9198 tablet_bootstrap.cc:492] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:52.268540  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69981197f2a5423a8758576940d1bf76" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:52.269083  9197 tablet_bootstrap.cc:492] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:52.270570  9152 raft_consensus.cc:3060] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.274956  9197 ts_tablet_manager.cc:1403] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.196s	user 0.016s	sys 0.009s
I20260709 13:01:52.278221  9001 raft_consensus.cc:3060] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.270012  9573 leader_election.cc:290] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:52.290228  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec71963326742b199b954dc1c0bbacb" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:52.290814  9196 tablet_bootstrap.cc:492] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:52.291087  9151 raft_consensus.cc:2393] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4667e9699c4d413889fc866e0e560d1f in current term 1: Already voted for candidate 0717530c054a42c5aa7aca788ba070a5 in this term.
I20260709 13:01:52.291314  9196 ts_tablet_manager.cc:1403] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.172s	user 0.012s	sys 0.005s
I20260709 13:01:52.294030  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8bc830d85cb40fda2ac909a09c75e07" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:52.294994  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69981197f2a5423a8758576940d1bf76" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:52.295676  8926 raft_consensus.cc:3060] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.299664  9117 leader_election.cc:304] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:52.300088  9152 raft_consensus.cc:2468] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:52.300513  9521 leader_election.cc:290] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:52.300591  9312 raft_consensus.cc:2804] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:52.301177  9312 raft_consensus.cc:697] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:52.302026  9312 consensus_queue.cc:237] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.306334  9196 raft_consensus.cc:359] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:52.307078  9196 raft_consensus.cc:385] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.307353  9196 raft_consensus.cc:740] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.307960  9196 consensus_queue.cc:260] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:52.309078  8895 leader_election.cc:304] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:52.310822  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a489378335c74a0fb5932be1e308fc64" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:52.311411  9003 raft_consensus.cc:3060] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.311255  9197 raft_consensus.cc:359] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.312270  8927 raft_consensus.cc:3060] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.315090  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c7c3cea0934ff59d24774835ed3e79" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:52.315703  9074 raft_consensus.cc:3060] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.316926  9390 raft_consensus.cc:3060] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.300612  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a489378335c74a0fb5932be1e308fc64" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
W20260709 13:01:52.322969  9118 leader_election.cc:343] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:52.324858  9074 raft_consensus.cc:2468] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:52.326519  9044 leader_election.cc:304] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:52.326519  9558 consensus_queue.cc:1048] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:52.329200  9558 raft_consensus.cc:2804] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:52.329699  9558 raft_consensus.cc:697] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:52.330497  9558 consensus_queue.cc:237] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
W20260709 13:01:52.336998  9044 leader_election.cc:343] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:52.311960  9197 raft_consensus.cc:385] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.339134  9196 ts_tablet_manager.cc:1434] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:01:52.342474  9197 raft_consensus.cc:740] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.333907  9390 raft_consensus.cc:2749] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:52.350991  9197 consensus_queue.cc:260] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.370921  9196 tablet_bootstrap.cc:492] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:52.390069  9312 raft_consensus.cc:493] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.368618  9003 raft_consensus.cc:2468] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:52.394449  9312 raft_consensus.cc:515] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.406013  9001 raft_consensus.cc:2468] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:52.409155  8926 raft_consensus.cc:2468] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:52.417557  9043 leader_election.cc:304] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:52.418203  9312 leader_election.cc:290] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:52.419597  9197 ts_tablet_manager.cc:1434] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.144s	user 0.006s	sys 0.002s
I20260709 13:01:52.422276  9523 raft_consensus.cc:2804] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:52.433393  9523 raft_consensus.cc:697] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:52.417580  8824 catalog_manager.cc:5697] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:52.437680  8874 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:52.441107  9198 tablet_bootstrap.cc:654] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.444342  9117 leader_election.cc:304] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:52.446610  9616 consensus_queue.cc:1048] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:52.446309  9197 tablet_bootstrap.cc:492] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123: Bootstrap starting.
I20260709 13:01:52.458873  9523 consensus_queue.cc:237] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:52.464680  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b06a466054767b5daa1085aca6ea5" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:52.465317  9583 raft_consensus.cc:2804] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:52.465958  9583 raft_consensus.cc:697] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:52.466933  9583 consensus_queue.cc:237] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
W20260709 13:01:52.471541  9116 leader_election.cc:343] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:52.476241  9196 tablet_bootstrap.cc:654] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.490772  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b06a466054767b5daa1085aca6ea5" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:52.491730  9002 raft_consensus.cc:2468] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 0.
I20260709 13:01:52.494489  8825 catalog_manager.cc:5697] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.497377  9197 tablet_bootstrap.cc:654] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.500937  9117 leader_election.cc:304] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:52.513993  8927 raft_consensus.cc:3060] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.515120  9583 raft_consensus.cc:2804] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:52.530809  9583 raft_consensus.cc:493] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.531189  9583 raft_consensus.cc:3060] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:52.581705  9118 consensus_peers.cc:597] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:52.585296  9583 raft_consensus.cc:515] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.589644  9583 leader_election.cc:290] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
W20260709 13:01:52.594185  9117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:45405, user_credentials={real_user=slave}} blocked reactor thread for 50329us
I20260709 13:01:52.587495  8828 catalog_manager.cc:5697] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:52.598423  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b06a466054767b5daa1085aca6ea5" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:52.598994  9002 raft_consensus.cc:3060] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.599076  9198 tablet_bootstrap.cc:492] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:52.599586  9198 ts_tablet_manager.cc:1403] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.332s	user 0.012s	sys 0.012s
I20260709 13:01:52.606838  9198 raft_consensus.cc:359] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:52.607896  9198 raft_consensus.cc:385] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.608196  9198 raft_consensus.cc:740] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.613492  9077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b06a466054767b5daa1085aca6ea5" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:52.607900  9002 raft_consensus.cc:2468] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:52.615195  9198 consensus_queue.cc:260] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:52.617008  9197 tablet_bootstrap.cc:492] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123: No bootstrap required, opened a new log
I20260709 13:01:52.617727  9197 ts_tablet_manager.cc:1403] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123: Time spent bootstrapping tablet: real 0.183s	user 0.026s	sys 0.008s
I20260709 13:01:52.624015  9196 tablet_bootstrap.cc:492] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:52.624531  9312 consensus_queue.cc:1048] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:52.625694  9117 leader_election.cc:304] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:52.626633  9198 ts_tablet_manager.cc:1434] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:01:52.627564  9583 raft_consensus.cc:2804] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:52.628648  9198 tablet_bootstrap.cc:492] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:52.630031  9583 raft_consensus.cc:697] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:52.631326  9583 consensus_queue.cc:237] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.628286  9197 raft_consensus.cc:359] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:52.624579  9196 ts_tablet_manager.cc:1403] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.256s	user 0.010s	sys 0.007s
I20260709 13:01:52.637785  9197 raft_consensus.cc:385] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.638387  9197 raft_consensus.cc:740] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.649052  9197 consensus_queue.cc:260] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:52.653221  8828 catalog_manager.cc:5697] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:52.658725  9116 leader_election.cc:343] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:52.669034  9196 raft_consensus.cc:359] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:52.669829  9196 raft_consensus.cc:385] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.670138  9196 raft_consensus.cc:740] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.671136  9198 tablet_bootstrap.cc:654] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.670794  9196 consensus_queue.cc:260] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:52.673141  9197 ts_tablet_manager.cc:1434] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:01:52.679020  9523 raft_consensus.cc:493] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.679582  9523 raft_consensus.cc:515] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.681980  9523 leader_election.cc:290] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:52.684634  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:52.685477  9002 raft_consensus.cc:2393] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0717530c054a42c5aa7aca788ba070a5 in current term 1: Already voted for candidate f3ac81bf7b994af084e9929fac14de34 in this term.
I20260709 13:01:52.689188  9196 ts_tablet_manager.cc:1434] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.002s
I20260709 13:01:52.689742  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:52.690609  9150 raft_consensus.cc:2393] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0717530c054a42c5aa7aca788ba070a5 in current term 1: Already voted for candidate 069063a72de443729cdfb3fcbfa6a123 in this term.
I20260709 13:01:52.693928  9044 leader_election.cc:304] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:52.694801  9558 raft_consensus.cc:3060] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.696605  9196 tablet_bootstrap.cc:492] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:52.707579  9558 raft_consensus.cc:2749] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:52.709797  9583 raft_consensus.cc:493] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.710646  9583 raft_consensus.cc:515] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:52.725054  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03db717c8e2a41c09a753240a6dbbb02" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:52.726243  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03db717c8e2a41c09a753240a6dbbb02" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:52.727481  9198 tablet_bootstrap.cc:492] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
W20260709 13:01:52.727965  9118 leader_election.cc:343] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:52.728688  9583 leader_election.cc:290] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:52.727978  9198 ts_tablet_manager.cc:1403] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.100s	user 0.009s	sys 0.003s
I20260709 13:01:52.731731  8828 catalog_manager.cc:5697] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:52.732187  9198 raft_consensus.cc:359] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:52.732913  9198 raft_consensus.cc:385] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.733207  9198 raft_consensus.cc:740] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
W20260709 13:01:52.734517  9116 leader_election.cc:343] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:52.735034  9116 leader_election.cc:304] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:52.736248  9583 raft_consensus.cc:2749] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:52.733906  9198 consensus_queue.cc:260] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:52.749147  9198 ts_tablet_manager.cc:1434] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:01:52.750010  9196 tablet_bootstrap.cc:654] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.750797  9198 tablet_bootstrap.cc:492] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:52.768827  9198 tablet_bootstrap.cc:654] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.780558  9196 tablet_bootstrap.cc:492] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:52.781047  9196 ts_tablet_manager.cc:1403] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.012s
I20260709 13:01:52.784150  9196 raft_consensus.cc:359] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:52.784818  9196 raft_consensus.cc:385] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.785080  9196 raft_consensus.cc:740] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.785686  9196 consensus_queue.cc:260] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:52.787814  9196 ts_tablet_manager.cc:1434] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:52.788767  9196 tablet_bootstrap.cc:492] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:52.793566  9583 consensus_queue.cc:1048] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:52.794687  9196 tablet_bootstrap.cc:654] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.805540  9198 tablet_bootstrap.cc:492] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:52.806195  9198 ts_tablet_manager.cc:1403] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.006s
I20260709 13:01:52.813860  9390 raft_consensus.cc:493] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.814437  9390 raft_consensus.cc:515] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:52.816488  9390 leader_election.cc:290] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:52.817516  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:52.818187  9074 raft_consensus.cc:2468] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 0.
I20260709 13:01:52.819450  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:52.820091  9000 raft_consensus.cc:2468] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 0.
I20260709 13:01:52.822271  8894 leader_election.cc:304] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:52.826664  9624 consensus_queue.cc:1048] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:52.815893  9198 raft_consensus.cc:359] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.829898  9198 raft_consensus.cc:385] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.830264  9198 raft_consensus.cc:740] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.831063  9198 consensus_queue.cc:260] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:52.829036  9390 raft_consensus.cc:2804] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:52.834720  9390 raft_consensus.cc:493] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.835104  9390 raft_consensus.cc:3060] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.836089  9196 tablet_bootstrap.cc:492] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:52.836885  9196 ts_tablet_manager.cc:1403] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.012s
I20260709 13:01:52.842085  9390 raft_consensus.cc:515] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:52.844141  9390 leader_election.cc:290] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:52.846614  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:52.847239  9078 raft_consensus.cc:3060] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.848362  9196 raft_consensus.cc:359] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:52.849043  9196 raft_consensus.cc:385] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.849305  9196 raft_consensus.cc:740] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.849972  9196 consensus_queue.cc:260] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:52.851490  9196 ts_tablet_manager.cc:1434] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:01:52.852433  9196 tablet_bootstrap.cc:492] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:52.856382  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:52.857002  9000 raft_consensus.cc:3060] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.858047  9196 tablet_bootstrap.cc:654] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.857188  9078 raft_consensus.cc:2468] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 1.
I20260709 13:01:52.867374  9198 ts_tablet_manager.cc:1434] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 13:01:52.868592  9198 tablet_bootstrap.cc:492] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:52.878337  9497 consensus_queue.cc:1048] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:52.902947  9198 tablet_bootstrap.cc:654] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.886607  9000 raft_consensus.cc:2468] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 1.
I20260709 13:01:52.911522  8894 leader_election.cc:304] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:52.914760  9390 raft_consensus.cc:2804] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:52.915417  9390 raft_consensus.cc:697] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 1 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:01:52.916249  9390 consensus_queue.cc:237] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:52.917173  9523 consensus_queue.cc:1048] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:52.922286  9620 raft_consensus.cc:493] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.922796  9620 raft_consensus.cc:515] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:52.924702  9620 leader_election.cc:290] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:52.931882  9198 tablet_bootstrap.cc:492] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:52.932624  9198 ts_tablet_manager.cc:1403] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.003s
I20260709 13:01:52.934427  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8bc830d85cb40fda2ac909a09c75e07" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:52.932639  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8bc830d85cb40fda2ac909a09c75e07" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:52.941570  8894 leader_election.cc:304] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:52.946297  9620 raft_consensus.cc:2749] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:52.944912  9198 raft_consensus.cc:359] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:52.957624  9198 raft_consensus.cc:385] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.958699  9558 consensus_queue.cc:1048] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:52.959219  8827 catalog_manager.cc:5697] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.958148  9198 raft_consensus.cc:740] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.973812  9198 consensus_queue.cc:260] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
W20260709 13:01:52.982442  9118 consensus_peers.cc:597] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:52.982571  9198 ts_tablet_manager.cc:1434] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:01:52.983981  9198 tablet_bootstrap.cc:492] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5: Bootstrap starting.
I20260709 13:01:53.018571  9198 tablet_bootstrap.cc:654] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.022464  9196 tablet_bootstrap.cc:492] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:53.026489  9196 ts_tablet_manager.cc:1403] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.174s	user 0.049s	sys 0.045s
I20260709 13:01:53.038383  9521 consensus_queue.cc:1048] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:53.042876  8929 raft_consensus.cc:3060] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.030934  9196 raft_consensus.cc:359] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:53.050285  9196 raft_consensus.cc:385] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.050627  9196 raft_consensus.cc:740] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.051343  9196 consensus_queue.cc:260] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:53.056102  9497 consensus_queue.cc:1048] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:53.060294  9198 tablet_bootstrap.cc:492] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5: No bootstrap required, opened a new log
I20260709 13:01:53.062872  9198 ts_tablet_manager.cc:1403] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5: Time spent bootstrapping tablet: real 0.079s	user 0.029s	sys 0.001s
I20260709 13:01:53.065517  9198 raft_consensus.cc:359] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:53.066216  9198 raft_consensus.cc:385] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.066460  9198 raft_consensus.cc:740] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.066501  9196 ts_tablet_manager.cc:1434] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:01:53.067220  9198 consensus_queue.cc:260] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:53.069092  9196 tablet_bootstrap.cc:492] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:53.076241  9196 tablet_bootstrap.cc:654] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.084000  9198 ts_tablet_manager.cc:1434] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:01:53.095235  9196 tablet_bootstrap.cc:492] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:53.095808  9196 ts_tablet_manager.cc:1403] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.001s
I20260709 13:01:53.098673  9196 raft_consensus.cc:359] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:53.099407  9196 raft_consensus.cc:385] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.099660  9196 raft_consensus.cc:740] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.100351  9196 consensus_queue.cc:260] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:53.101208  9498 raft_consensus.cc:493] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.101739  9498 raft_consensus.cc:515] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:53.102519  9196 ts_tablet_manager.cc:1434] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:53.103514  9196 tablet_bootstrap.cc:492] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:53.103825  9498 leader_election.cc:290] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:53.104332  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b06a466054767b5daa1085aca6ea5" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:53.105021  9002 raft_consensus.cc:2393] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0717530c054a42c5aa7aca788ba070a5 in current term 1: Already voted for candidate 069063a72de443729cdfb3fcbfa6a123 in this term.
I20260709 13:01:53.108327  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b06a466054767b5daa1085aca6ea5" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:53.109261  9196 tablet_bootstrap.cc:654] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.109745  9390 raft_consensus.cc:493] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.109953  9044 leader_election.cc:304] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:53.110292  9390 raft_consensus.cc:515] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:53.110818  9498 raft_consensus.cc:3060] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.112323  9390 leader_election.cc:290] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:53.115928  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8af72e77c964acd910c3ec90fe52078" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:53.116605  9000 raft_consensus.cc:2468] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 0.
I20260709 13:01:53.117921  9498 raft_consensus.cc:2749] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:53.117937  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8af72e77c964acd910c3ec90fe52078" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:53.118811  9078 raft_consensus.cc:2468] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 0.
I20260709 13:01:53.119656  8894 leader_election.cc:304] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:53.120327  9390 raft_consensus.cc:2804] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.120738  9390 raft_consensus.cc:493] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.121102  9390 raft_consensus.cc:3060] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.124605  9196 tablet_bootstrap.cc:492] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
I20260709 13:01:53.125167  9196 ts_tablet_manager.cc:1403] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.002s
I20260709 13:01:53.127460  9196 raft_consensus.cc:359] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:53.127981  9196 raft_consensus.cc:385] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.128280  9196 raft_consensus.cc:740] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.127723  9390 raft_consensus.cc:515] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:53.128911  9196 consensus_queue.cc:260] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:53.131350  9196 ts_tablet_manager.cc:1434] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:53.132305  9196 tablet_bootstrap.cc:492] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:53.136349  9390 leader_election.cc:290] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:53.137645  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8af72e77c964acd910c3ec90fe52078" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:53.138121  9196 tablet_bootstrap.cc:654] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.138370  9002 raft_consensus.cc:3060] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.139441  9498 raft_consensus.cc:493] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.139921  9498 raft_consensus.cc:515] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:53.143527  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8af72e77c964acd910c3ec90fe52078" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:53.144112  9078 raft_consensus.cc:3060] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.145424  9512 consensus_queue.cc:1048] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:53.154788  8926 raft_consensus.cc:3060] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.152487  9002 raft_consensus.cc:2468] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 1.
I20260709 13:01:53.157617  8894 leader_election.cc:304] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:53.158576  9390 raft_consensus.cc:2804] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:53.162698  9497 raft_consensus.cc:493] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.163240  9497 raft_consensus.cc:515] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:53.165247  9497 leader_election.cc:290] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:53.166884  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03db717c8e2a41c09a753240a6dbbb02" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:53.167714  9152 raft_consensus.cc:2468] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:53.169935  9078 raft_consensus.cc:2468] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 1.
I20260709 13:01:53.170712  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03db717c8e2a41c09a753240a6dbbb02" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:53.174242  9044 leader_election.cc:304] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:53.175525  9497 raft_consensus.cc:2804] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.176020  9497 raft_consensus.cc:493] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.176450  9497 raft_consensus.cc:3060] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:53.175612  9044 leader_election.cc:343] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.180980  9624 consensus_queue.cc:1048] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:53.187588  9498 leader_election.cc:290] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:53.190482  9497 raft_consensus.cc:515] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:53.192876  9497 leader_election.cc:290] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:53.229532  9620 raft_consensus.cc:493] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.236817  9620 raft_consensus.cc:515] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:53.244122  9620 leader_election.cc:290] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:53.252099  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03db717c8e2a41c09a753240a6dbbb02" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:53.252841  9150 raft_consensus.cc:3060] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.253923  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a907eff584544e28628c20d7addb69c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:53.254654  9152 raft_consensus.cc:2468] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 0.
I20260709 13:01:53.260308  9150 raft_consensus.cc:2468] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:53.289654  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a907eff584544e28628c20d7addb69c" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:53.290522  9078 raft_consensus.cc:2468] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 0.
I20260709 13:01:53.291625  8893 leader_election.cc:304] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:01:53.282619  9390 raft_consensus.cc:697] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 1 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:01:53.293283  9390 consensus_queue.cc:237] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:53.300683  9044 leader_election.cc:304] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:53.301571  9498 raft_consensus.cc:2804] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.302300  9498 raft_consensus.cc:493] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.302814  9498 raft_consensus.cc:3060] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.303217  9656 raft_consensus.cc:2804] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.303659  9656 raft_consensus.cc:493] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.304009  9656 raft_consensus.cc:3060] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.327873  9044 leader_election.cc:304] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:53.328817  9523 raft_consensus.cc:2804] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:53.329962  9523 raft_consensus.cc:697] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:53.331101  9523 consensus_queue.cc:237] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:53.364714  9498 raft_consensus.cc:515] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:53.367084  9498 leader_election.cc:290] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:53.367915  9196 tablet_bootstrap.cc:492] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f: No bootstrap required, opened a new log
W20260709 13:01:53.368289  8895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38603, user_credentials={real_user=slave}} blocked reactor thread for 142616us
I20260709 13:01:53.368469  9196 ts_tablet_manager.cc:1403] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.236s	user 0.052s	sys 0.125s
I20260709 13:01:53.369854  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a907eff584544e28628c20d7addb69c" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:53.370474  9152 raft_consensus.cc:2468] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 0.
I20260709 13:01:53.374378  9196 raft_consensus.cc:359] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:53.376250  9196 raft_consensus.cc:385] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.376529  9196 raft_consensus.cc:740] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.377146  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a907eff584544e28628c20d7addb69c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:53.377187  9196 consensus_queue.cc:260] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:53.377856  9150 raft_consensus.cc:3060] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.379405  9196 ts_tablet_manager.cc:1434] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:01:53.383486  8929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03db717c8e2a41c09a753240a6dbbb02" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:53.383616  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a907eff584544e28628c20d7addb69c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f" is_pre_election: true
I20260709 13:01:53.384068  8929 raft_consensus.cc:3060] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.388126  9150 raft_consensus.cc:2468] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:53.388461  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a907eff584544e28628c20d7addb69c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
I20260709 13:01:53.389547  9044 leader_election.cc:304] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:01:53.390749  9523 raft_consensus.cc:2804] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:53.391250  9523 raft_consensus.cc:697] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:53.392073  9523 consensus_queue.cc:237] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:53.396188  8929 raft_consensus.cc:2468] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:53.397307  9390 consensus_queue.cc:1048] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:53.400221  8828 catalog_manager.cc:5697] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:53.410832  9656 raft_consensus.cc:515] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:53.413502  8926 raft_consensus.cc:2393] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0717530c054a42c5aa7aca788ba070a5 in current term 1: Already voted for candidate 4667e9699c4d413889fc866e0e560d1f in this term.
I20260709 13:01:53.417524  9659 raft_consensus.cc:493] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.418010  9659 raft_consensus.cc:515] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:53.419852  9659 leader_election.cc:290] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:53.421380  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a489378335c74a0fb5932be1e308fc64" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:53.422319  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a907eff584544e28628c20d7addb69c" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:53.427923  9659 consensus_queue.cc:1048] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:53.434271  9656 leader_election.cc:290] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:53.439072  8827 catalog_manager.cc:5697] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:53.440933  8827 catalog_manager.cc:5697] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:53.442622  8926 raft_consensus.cc:3060] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.448841  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a489378335c74a0fb5932be1e308fc64" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:53.449795  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a907eff584544e28628c20d7addb69c" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:01:53.450594  9151 raft_consensus.cc:2393] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4667e9699c4d413889fc866e0e560d1f in current term 1: Already voted for candidate 0717530c054a42c5aa7aca788ba070a5 in this term.
I20260709 13:01:53.456707  8895 leader_election.cc:304] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:53.459220  8895 leader_election.cc:304] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
I20260709 13:01:53.460191  9656 raft_consensus.cc:2749] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:53.468065  9620 raft_consensus.cc:2749] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:53.489712  8874 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:53.690385  9312 raft_consensus.cc:493] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.690925  9312 raft_consensus.cc:515] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:53.692644  9312 leader_election.cc:290] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:53.693236  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:53.693653  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:53.693966  9000 raft_consensus.cc:2468] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:53.694357  9078 raft_consensus.cc:2468] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:53.695116  9117 leader_election.cc:304] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:53.695814  9312 raft_consensus.cc:2804] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:53.696177  9312 raft_consensus.cc:493] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.696480  9312 raft_consensus.cc:3060] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:53.702397  9312 raft_consensus.cc:515] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:53.704109  9312 leader_election.cc:290] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:53.705006  9000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:53.705351  9078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "673fe46efdf148bc9fd1720f67d50193" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:53.705528  9000 raft_consensus.cc:3060] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:53.705909  9078 raft_consensus.cc:3060] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:53.711037  9000 raft_consensus.cc:2468] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
I20260709 13:01:53.711712  9078 raft_consensus.cc:2468] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
I20260709 13:01:53.712245  9117 leader_election.cc:304] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:53.712976  9312 raft_consensus.cc:2804] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:53.713424  9312 raft_consensus.cc:697] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:53.714126  9312 consensus_queue.cc:237] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:01:53.724751  8825 catalog_manager.cc:5697] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 0 to 2, leader changed from <none> to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.743590  9620 consensus_queue.cc:1048] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:53.755896  9656 consensus_queue.cc:1048] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:53.821048  9558 consensus_queue.cc:1048] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:53.832947  9497 consensus_queue.cc:1048] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:53.891233  9523 consensus_queue.cc:1048] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:53.904855  9523 consensus_queue.cc:1048] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.272333  9000 raft_consensus.cc:1275] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:54.275848  9512 consensus_queue.cc:1048] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.289691  9074 raft_consensus.cc:1275] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:54.290903  9312 consensus_queue.cc:1048] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:55.627468  9042 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.007s	sys 0.008s
W20260709 13:01:55.629912  9116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:46841, user_credentials={real_user=slave}} blocked reactor thread for 48816.7us
I20260709 13:01:55.687474  9684 raft_consensus.cc:493] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0717530c054a42c5aa7aca788ba070a5)
I20260709 13:01:55.688004  9684 raft_consensus.cc:515] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:55.694629  9684 leader_election.cc:290] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:01:55.696529  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec71963326742b199b954dc1c0bbacb" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
W20260709 13:01:55.700672  9118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41567, user_credentials={real_user=slave}} blocked reactor thread for 64039.3us
I20260709 13:01:55.715957  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec71963326742b199b954dc1c0bbacb" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:55.724501   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:01:55.727154  8951 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd0a0 after lost signal to thread 434
W20260709 13:01:55.728317  8951 debug-util.cc:398] Leaking SignalData structure 0x7b080036cb40 after lost signal to thread 8862
W20260709 13:01:55.729615  8951 debug-util.cc:398] Leaking SignalData structure 0x7b0800043e20 after lost signal to thread 8954
W20260709 13:01:55.733956  8951 debug-util.cc:398] Leaking SignalData structure 0x7b08003e91a0 after lost signal to thread 9029
W20260709 13:01:55.735234  8951 debug-util.cc:398] Leaking SignalData structure 0x7b0800280980 after lost signal to thread 9103
I20260709 13:01:55.735551  8893 leader_election.cc:304] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f; no voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5
W20260709 13:01:55.736411  8951 debug-util.cc:398] Leaking SignalData structure 0x7b0800104b20 after lost signal to thread 9177
I20260709 13:01:55.736753  9684 raft_consensus.cc:2749] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:55.739790  8970 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:01:55.791937  9044 consensus_peers.cc:597] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:55.792712  9044 consensus_peers.cc:597] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:55.793277  9044 consensus_peers.cc:597] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:55.796077  9044 consensus_peers.cc:597] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:55.799467  8970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41567, user_credentials={real_user=slave}} blocked reactor thread for 59702.3us
W20260709 13:01:55.821890  8970 consensus_peers.cc:597] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:55.822620  8970 consensus_peers.cc:597] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:55.823220  8970 consensus_peers.cc:597] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:55.828568   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:55.831034   431 tablet_replica.cc:333] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.832013   431 raft_consensus.cc:2243] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.832615   431 raft_consensus.cc:2272] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.835430   431 tablet_replica.cc:333] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.836321   431 raft_consensus.cc:2243] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.836849   431 raft_consensus.cc:2272] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.839131   431 tablet_replica.cc:333] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.839922   431 raft_consensus.cc:2243] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.841502   431 raft_consensus.cc:2272] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.843701   431 tablet_replica.cc:333] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.844457   431 raft_consensus.cc:2243] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.844925   431 raft_consensus.cc:2272] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.847133   431 tablet_replica.cc:333] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.847975   431 raft_consensus.cc:2243] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.848451   431 raft_consensus.cc:2272] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.850745   431 tablet_replica.cc:333] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.851364   431 raft_consensus.cc:2243] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.851806   431 raft_consensus.cc:2272] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.853492   431 tablet_replica.cc:333] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.854130   431 raft_consensus.cc:2243] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.854571   431 raft_consensus.cc:2272] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.856299   431 tablet_replica.cc:333] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.856897   431 raft_consensus.cc:2243] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.857349   431 raft_consensus.cc:2272] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.859664   431 tablet_replica.cc:333] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.860211   431 raft_consensus.cc:2243] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.860714   431 raft_consensus.cc:2272] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.862772   431 tablet_replica.cc:333] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.863353   431 raft_consensus.cc:2243] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.863759   431 raft_consensus.cc:2272] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.865656   431 tablet_replica.cc:333] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.866480   431 raft_consensus.cc:2243] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.867092   431 raft_consensus.cc:2272] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.869165   431 tablet_replica.cc:333] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.869839   431 raft_consensus.cc:2243] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.870754   431 raft_consensus.cc:2272] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.872390   431 tablet_replica.cc:333] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.872948   431 raft_consensus.cc:2243] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.873426   431 raft_consensus.cc:2272] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.875506   431 tablet_replica.cc:333] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.876098   431 raft_consensus.cc:2243] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.876554   431 raft_consensus.cc:2272] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.879076   431 tablet_replica.cc:333] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.879804   431 raft_consensus.cc:2243] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.880319   431 raft_consensus.cc:2272] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:55.883297  8970 consensus_peers.cc:597] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:55.883740   431 tablet_replica.cc:333] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.884413   431 raft_consensus.cc:2243] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.884872   431 raft_consensus.cc:2272] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.886982   431 tablet_replica.cc:333] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.887658   431 raft_consensus.cc:2243] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.888119   431 raft_consensus.cc:2272] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.890223   431 tablet_replica.cc:333] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.890761   431 raft_consensus.cc:2243] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.891182   431 raft_consensus.cc:2272] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.893528   431 tablet_replica.cc:333] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.894099   431 raft_consensus.cc:2243] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.894631   431 raft_consensus.cc:2272] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.896708   431 tablet_replica.cc:333] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.897267   431 raft_consensus.cc:2243] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.897712   431 raft_consensus.cc:2272] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.899824   431 tablet_replica.cc:333] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.900365   431 raft_consensus.cc:2243] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.900763   431 raft_consensus.cc:2272] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.902469   431 tablet_replica.cc:333] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.903015   431 raft_consensus.cc:2243] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.903573   431 raft_consensus.cc:2272] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.905691   431 tablet_replica.cc:333] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.906319   431 raft_consensus.cc:2243] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.906811   431 raft_consensus.cc:2272] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.910476   431 tablet_replica.cc:333] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.911346   431 raft_consensus.cc:2243] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.911975   431 raft_consensus.cc:2272] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.914615   431 tablet_replica.cc:333] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.915472   431 raft_consensus.cc:2243] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.916028   431 raft_consensus.cc:2272] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.918648   431 tablet_replica.cc:333] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.919486   431 raft_consensus.cc:2243] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.920141   431 raft_consensus.cc:2272] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:55.921221  9044 consensus_peers.cc:597] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:55.938776   431 tablet_replica.cc:333] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.940012   431 raft_consensus.cc:2243] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.940644   431 raft_consensus.cc:2272] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.943193   431 tablet_replica.cc:333] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.944024   431 raft_consensus.cc:2243] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.944826   431 raft_consensus.cc:2272] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:55.938800  8970 consensus_peers.cc:597] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:55.947975   431 tablet_replica.cc:333] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.948885   431 raft_consensus.cc:2243] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.949509   431 raft_consensus.cc:2272] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:55.950663  8970 consensus_peers.cc:597] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:55.952543   431 tablet_replica.cc:333] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.953516   431 raft_consensus.cc:2243] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.954627   431 raft_consensus.cc:2272] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.957368   431 tablet_replica.cc:333] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.958246   431 raft_consensus.cc:2243] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.958829   431 raft_consensus.cc:2272] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:55.959787  9044 consensus_peers.cc:597] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:55.961663   431 tablet_replica.cc:333] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.962549   431 raft_consensus.cc:2243] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.963591   431 raft_consensus.cc:2272] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.966384   431 tablet_replica.cc:333] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.967233   431 raft_consensus.cc:2243] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.967829   431 raft_consensus.cc:2272] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.970201   431 tablet_replica.cc:333] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.970983   431 raft_consensus.cc:2243] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.972146   431 raft_consensus.cc:2272] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.975080   431 tablet_replica.cc:333] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.975867   431 raft_consensus.cc:2243] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.976384   431 raft_consensus.cc:2272] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.978606   431 tablet_replica.cc:333] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.979236   431 raft_consensus.cc:2243] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.980186   431 raft_consensus.cc:2272] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.982805   431 tablet_replica.cc:333] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.983539   431 raft_consensus.cc:2243] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.983999   431 raft_consensus.cc:2272] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.986622   431 tablet_replica.cc:333] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.987306   431 raft_consensus.cc:2243] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.988292   431 raft_consensus.cc:2272] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.991070   431 tablet_replica.cc:333] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.991861   431 raft_consensus.cc:2243] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.992357   431 raft_consensus.cc:2272] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.995002   431 tablet_replica.cc:333] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.995692   431 raft_consensus.cc:2243] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.996167   431 raft_consensus.cc:2272] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.998677   431 tablet_replica.cc:333] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:55.999320   431 raft_consensus.cc:2243] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:55.999769   431 raft_consensus.cc:2272] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:56.002379   431 tablet_replica.cc:333] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:56.003016   431 raft_consensus.cc:2243] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:56.003595   431 raft_consensus.cc:2272] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:56.006347   431 tablet_replica.cc:333] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:56.007030   431 raft_consensus.cc:2243] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:56.007537   431 raft_consensus.cc:2272] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:56.009752   431 tablet_replica.cc:333] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
I20260709 13:01:56.011850   431 raft_consensus.cc:2243] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:56.012415   431 raft_consensus.cc:2272] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:56.015206   431 tablet_replica.cc:333] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f: stopping tablet replica
W20260709 13:01:56.015532  9118 consensus_peers.cc:597] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:56.015821   431 raft_consensus.cc:2243] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:56.017028   431 raft_consensus.cc:2272] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:56.022334  9118 consensus_peers.cc:597] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.037267  9118 consensus_peers.cc:597] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.084906  8970 consensus_peers.cc:597] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.090730  9118 consensus_peers.cc:597] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.125423  8970 consensus_peers.cc:597] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.145512  9044 connection.cc:573] client connection to 127.0.107.193:41567 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:01:56.148224  9044 consensus_peers.cc:597] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.165971  8970 consensus_peers.cc:597] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.168030  8970 consensus_peers.cc:597] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.187796  9044 consensus_peers.cc:597] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.188539  9044 consensus_peers.cc:597] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.188746  9118 consensus_peers.cc:597] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.189038  9044 consensus_peers.cc:597] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.189345  9118 consensus_peers.cc:597] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.189638  9044 consensus_peers.cc:597] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.190208  9044 consensus_peers.cc:597] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.190717  9044 consensus_peers.cc:597] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.191278  9044 consensus_peers.cc:597] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.192198  9118 consensus_peers.cc:597] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.192724  9118 consensus_peers.cc:597] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.202142  8970 consensus_peers.cc:597] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.237075  9044 consensus_peers.cc:597] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.240307  9044 consensus_peers.cc:597] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.241804  9118 consensus_peers.cc:597] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.255316  9044 consensus_peers.cc:597] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:56.268424  9044 consensus_peers.cc:597] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:57.007439  9680 raft_consensus.cc:493] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.008024  9680 raft_consensus.cc:515] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:57.010536  9680 leader_election.cc:290] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:57.012223  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
W20260709 13:01:57.014025  8970 leader_election.cc:336] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.014496  8970 leader_election.cc:304] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:57.015236  9680 raft_consensus.cc:2749] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:57.101269  9706 raft_consensus.cc:493] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.101846  9706 raft_consensus.cc:515] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:57.104140  9706 leader_election.cc:290] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:57.104704  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:57.104869  9706 raft_consensus.cc:493] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.105458  9706 raft_consensus.cc:515] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:57.107527  9706 leader_election.cc:290] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:57.115871  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e71b9614d4212a6d10378b169fe21" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
W20260709 13:01:57.117934  8970 leader_election.cc:336] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.118496  9706 raft_consensus.cc:493] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.118472  8970 leader_election.cc:304] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:57.119889  9680 raft_consensus.cc:2749] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:57.120085  8970 leader_election.cc:336] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.120958  8970 leader_election.cc:304] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:57.119149  9706 raft_consensus.cc:515] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:57.121645  9680 raft_consensus.cc:2749] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:57.123031  9696 raft_consensus.cc:493] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.123529  9696 raft_consensus.cc:515] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:57.125452  9696 leader_election.cc:290] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:57.126492  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e71b9614d4212a6d10378b169fe21" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:57.127154  9002 raft_consensus.cc:2468] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:57.127813  9706 leader_election.cc:290] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:57.128574  9117 leader_election.cc:304] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:57.129374  9696 raft_consensus.cc:2804] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:57.130844  9696 raft_consensus.cc:493] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.131279  9696 raft_consensus.cc:3060] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.131565  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
W20260709 13:01:57.133921  9118 leader_election.cc:336] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
W20260709 13:01:57.137467  8970 leader_election.cc:336] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.138136  8970 leader_election.cc:304] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:57.138809  9680 raft_consensus.cc:2749] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:57.142176  9696 raft_consensus.cc:515] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:57.149358  9696 leader_election.cc:290] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:57.149858  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457e71b9614d4212a6d10378b169fe21" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:57.151566  9002 raft_consensus.cc:3060] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:57.154434  9118 leader_election.cc:336] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.158540  9002 raft_consensus.cc:2468] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
W20260709 13:01:57.159024   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8951)
I20260709 13:01:57.159684  9117 leader_election.cc:304] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:57.160399  9696 raft_consensus.cc:2804] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:57.160917  9696 raft_consensus.cc:697] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:57.161850  9696 consensus_queue.cc:237] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:01:57.172637  8828 catalog_manager.cc:5697] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 1 to 2, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.176976  9696 raft_consensus.cc:493] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.177570  9696 raft_consensus.cc:515] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:57.179840  9696 leader_election.cc:290] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:57.181288  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:57.181908  9002 raft_consensus.cc:2468] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:57.183080  9117 leader_election.cc:304] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:57.183916  9696 raft_consensus.cc:2804] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:57.184373  9696 raft_consensus.cc:493] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.184787  9696 raft_consensus.cc:3060] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.195212  9706 raft_consensus.cc:493] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.195820  9706 raft_consensus.cc:515] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
W20260709 13:01:57.196180  9118 leader_election.cc:336] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.197919  9706 leader_election.cc:290] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:57.202603  9696 raft_consensus.cc:515] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:57.204165  9695 raft_consensus.cc:493] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.204699  9695 raft_consensus.cc:515] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:57.205596  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:57.206176  9002 raft_consensus.cc:3060] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:57.206313  8970 leader_election.cc:336] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.208531  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:57.209492  8999 raft_consensus.cc:2468] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:57.211086  9043 leader_election.cc:304] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:57.212067  9687 raft_consensus.cc:2804] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:57.212411  9687 raft_consensus.cc:493] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.212790  9687 raft_consensus.cc:3060] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.217312  9002 raft_consensus.cc:2468] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
I20260709 13:01:57.218705  9523 raft_consensus.cc:493] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.219340  9523 raft_consensus.cc:515] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:57.220192  9117 leader_election.cc:304] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:57.221077  9698 raft_consensus.cc:2804] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:57.220127  9711 raft_consensus.cc:493] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.221840  9698 raft_consensus.cc:697] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:57.222800  9698 consensus_queue.cc:237] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:57.223574  9695 leader_election.cc:290] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:57.223869  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:57.221189  9523 leader_election.cc:290] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:57.226020  9002 raft_consensus.cc:2468] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:57.224887  9696 leader_election.cc:290] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
W20260709 13:01:57.230684  9118 leader_election.cc:336] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.232775  9043 leader_election.cc:304] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:57.225798  9695 raft_consensus.cc:493] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.235092  9695 raft_consensus.cc:515] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:57.236325  9523 raft_consensus.cc:2804] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:57.236721  9523 raft_consensus.cc:493] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.237032  9523 raft_consensus.cc:3060] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.237219  9695 leader_election.cc:290] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:57.237835  9711 raft_consensus.cc:515] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:57.238294  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8af72e77c964acd910c3ec90fe52078" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:57.238961  9074 raft_consensus.cc:2468] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 1.
I20260709 13:01:57.239887  9711 leader_election.cc:290] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:57.240375  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8af72e77c964acd910c3ec90fe52078" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:01:57.249518  9002 raft_consensus.cc:2468] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 1.
I20260709 13:01:57.239038  9687 raft_consensus.cc:515] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:57.243825  8968 leader_election.cc:304] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:57.250620  9706 raft_consensus.cc:2804] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:57.250985  9706 raft_consensus.cc:493] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.251296  9706 raft_consensus.cc:3060] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.251655  9043 leader_election.cc:304] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:57.252496  9711 raft_consensus.cc:2804] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:57.252960  9711 raft_consensus.cc:493] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.253557  9711 raft_consensus.cc:3060] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.256264  9687 leader_election.cc:290] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:57.257740  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:57.258376  9002 raft_consensus.cc:3060] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.261125  9711 raft_consensus.cc:515] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:57.244772  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:57.262723  9695 raft_consensus.cc:493] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.263266  9695 raft_consensus.cc:515] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:57.261125  9706 raft_consensus.cc:515] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:57.266175  9695 leader_election.cc:290] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:57.267539  9711 leader_election.cc:290] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:57.268993  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8af72e77c964acd910c3ec90fe52078" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:57.271144  9003 raft_consensus.cc:2393] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0717530c054a42c5aa7aca788ba070a5 in current term 2: Already voted for candidate f3ac81bf7b994af084e9929fac14de34 in this term.
W20260709 13:01:57.271677  9044 leader_election.cc:336] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.270155  9002 raft_consensus.cc:2468] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 2.
I20260709 13:01:57.270342  9706 leader_election.cc:290] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
W20260709 13:01:57.272523  9044 leader_election.cc:336] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
W20260709 13:01:57.273003  8970 leader_election.cc:336] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.246405  9523 raft_consensus.cc:515] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:57.273741  9043 leader_election.cc:304] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
W20260709 13:01:57.273499  9044 leader_election.cc:336] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
W20260709 13:01:57.275600  9044 leader_election.cc:336] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.275830  9695 raft_consensus.cc:2804] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:57.276413  9695 raft_consensus.cc:697] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 2 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:57.277292  9695 consensus_queue.cc:237] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:57.278463  9523 leader_election.cc:290] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:01:57.281816  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae45916fe794471981c2ddff2693264" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:01:57.282694  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:01:57.283253  9002 raft_consensus.cc:3060] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.284549  9698 raft_consensus.cc:493] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.284619  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8af72e77c964acd910c3ec90fe52078" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:57.285458  9076 raft_consensus.cc:2393] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f3ac81bf7b994af084e9929fac14de34 in current term 2: Already voted for candidate 0717530c054a42c5aa7aca788ba070a5 in this term.
I20260709 13:01:57.285140  9698 raft_consensus.cc:515] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:57.287755  9698 leader_election.cc:290] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:57.291028  9044 leader_election.cc:304] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:57.293399  9002 raft_consensus.cc:2468] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 2.
I20260709 13:01:57.295408  9043 leader_election.cc:304] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:57.296142  9523 raft_consensus.cc:2749] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:57.295516  8828 catalog_manager.cc:5697] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 1 to 2, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.296757  9523 raft_consensus.cc:2804] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:57.297223  9523 raft_consensus.cc:697] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:01:57.297953  9523 consensus_queue.cc:237] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
W20260709 13:01:57.298287  9044 leader_election.cc:336] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.300357  8825 catalog_manager.cc:5697] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 1 to 2, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:57.313948  9118 leader_election.cc:336] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.313987  8968 leader_election.cc:304] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:57.315299  9706 raft_consensus.cc:2749] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:57.315490  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:57.316308  9076 raft_consensus.cc:2468] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:57.320514  9116 leader_election.cc:304] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:57.321547  9698 raft_consensus.cc:2804] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:57.321925  9698 raft_consensus.cc:493] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.322389  9698 raft_consensus.cc:3060] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:57.322460  9044 leader_election.cc:336] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.322954  9044 leader_election.cc:304] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:57.323647  9523 raft_consensus.cc:2749] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:57.324465  9044 leader_election.cc:336] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.325273  9044 leader_election.cc:304] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:01:57.325925  9523 raft_consensus.cc:2749] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:57.326792  9044 leader_election.cc:336] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.328253  8828 catalog_manager.cc:5697] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 1 to 2, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.330152  9698 raft_consensus.cc:515] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:57.332442  9698 leader_election.cc:290] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:57.333067  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:57.333674  9076 raft_consensus.cc:3060] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:57.339221  9118 leader_election.cc:336] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.341863  9076 raft_consensus.cc:2468] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
I20260709 13:01:57.343190  9116 leader_election.cc:304] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:57.344025  9698 raft_consensus.cc:2804] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:57.344486  9698 raft_consensus.cc:697] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:57.345276  9698 consensus_queue.cc:237] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:57.356108  8828 catalog_manager.cc:5697] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 1 to 2, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.410938  9698 raft_consensus.cc:493] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.411414  9698 raft_consensus.cc:515] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:57.413228  9698 leader_election.cc:290] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:57.415000  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae45916fe794471981c2ddff2693264" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:57.415663  9074 raft_consensus.cc:2468] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 1.
I20260709 13:01:57.417804  9116 leader_election.cc:304] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
W20260709 13:01:57.419795  9118 leader_election.cc:336] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.424103  9698 raft_consensus.cc:2804] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:57.424547  9698 raft_consensus.cc:493] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:01:57.425062  9698 raft_consensus.cc:3060] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:57.430567  9698 raft_consensus.cc:515] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:57.432351  9698 leader_election.cc:290] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:01:57.432988  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae45916fe794471981c2ddff2693264" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:57.433527  9074 raft_consensus.cc:3060] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:57.436527  9118 leader_election.cc:336] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:57.438692  9074 raft_consensus.cc:2468] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
I20260709 13:01:57.440163  9116 leader_election.cc:304] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:57.441032  9698 raft_consensus.cc:2804] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:57.441558  9698 raft_consensus.cc:697] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:01:57.442451  9698 consensus_queue.cc:237] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:57.453482  8828 catalog_manager.cc:5697] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 1 to 2, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.546999  9003 raft_consensus.cc:1275] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:57.548451  9698 consensus_queue.cc:1048] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:57.569914  9118 consensus_peers.cc:597] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:57.674687  9118 consensus_peers.cc:597] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:57.726997  9044 consensus_peers.cc:597] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:57.765018  9044 consensus_peers.cc:597] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:57.828912  9002 raft_consensus.cc:1275] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:57.830304  9698 consensus_queue.cc:1048] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:57.859256  9118 consensus_peers.cc:597] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:57.893175  9002 raft_consensus.cc:1275] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Refusing update from remote peer 0717530c054a42c5aa7aca788ba070a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:57.894440  9711 consensus_queue.cc:1048] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:57.909269  9003 raft_consensus.cc:1275] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Refusing update from remote peer 0717530c054a42c5aa7aca788ba070a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:57.910746  9074 raft_consensus.cc:1275] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:57.912177  9512 consensus_queue.cc:1048] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:57.912628  9711 consensus_queue.cc:1048] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:57.978451  9076 raft_consensus.cc:1275] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:58.010010  9118 consensus_peers.cc:597] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:58.049701  9725 consensus_queue.cc:1048] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:01:58.124688  8970 consensus_peers.cc:597] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.159535   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8951)
W20260709 13:01:58.255050  9044 consensus_peers.cc:597] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.265471  8970 consensus_peers.cc:597] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.268044  9044 consensus_peers.cc:597] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.268620  9044 consensus_peers.cc:597] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.283964  9044 consensus_peers.cc:597] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.356513  8970 consensus_peers.cc:597] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.379115  9044 consensus_peers.cc:597] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.430668  9044 consensus_peers.cc:597] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.444309  8970 consensus_peers.cc:597] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.493191  8970 consensus_peers.cc:597] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.527366  9118 consensus_peers.cc:597] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.535710  8970 consensus_peers.cc:597] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.551748  8970 consensus_peers.cc:597] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.556974  8970 consensus_peers.cc:597] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.564967  8970 consensus_peers.cc:597] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.567121  9044 consensus_peers.cc:597] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.576653  9044 consensus_peers.cc:597] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.588711  8970 consensus_peers.cc:597] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.595633  9118 consensus_peers.cc:597] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.602454  9044 consensus_peers.cc:597] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.624100  9044 consensus_peers.cc:597] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.640981  9044 consensus_peers.cc:597] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.646340  9118 consensus_peers.cc:597] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.655110  9044 consensus_peers.cc:597] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.659456  9118 consensus_peers.cc:597] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.669065  9044 consensus_peers.cc:597] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.687333  9118 consensus_peers.cc:597] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.696329  9044 consensus_peers.cc:597] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.725226  9044 consensus_peers.cc:597] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.753259  9044 consensus_peers.cc:597] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.758169  8970 consensus_peers.cc:597] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.783514  9118 consensus_peers.cc:597] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.785431  9118 consensus_peers.cc:597] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.795661  9118 consensus_peers.cc:597] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.862766  9044 consensus_peers.cc:597] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.913300  9044 consensus_peers.cc:597] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:58.935228  9118 consensus_peers.cc:597] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:59.153918  9733 raft_consensus.cc:493] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.157419  9733 raft_consensus.cc:515] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
W20260709 13:01:59.160045   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8951)
I20260709 13:01:59.163348  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8af72e77c964acd910c3ec90fe52078" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:01:59.164048  9074 raft_consensus.cc:2468] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 2.
I20260709 13:01:59.165076  8968 leader_election.cc:304] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:01:59.165908  9706 raft_consensus.cc:2804] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:59.166352  9706 raft_consensus.cc:493] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.166602  9733 leader_election.cc:290] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:59.166708  9706 raft_consensus.cc:3060] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:59.169255  8970 leader_election.cc:336] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:59.176100  9706 raft_consensus.cc:515] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
W20260709 13:01:59.186900  8970 leader_election.cc:336] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:01:59.190691  9706 leader_election.cc:290] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:01:59.192871  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8af72e77c964acd910c3ec90fe52078" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:01:59.193533  9074 raft_consensus.cc:3060] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:59.200464  9074 raft_consensus.cc:2468] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 3.
I20260709 13:01:59.201864  8968 leader_election.cc:304] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:01:59.208096  9733 raft_consensus.cc:2804] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:59.261224  9733 raft_consensus.cc:697] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 3 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:01:59.262516  9733 consensus_queue.cc:237] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:59.284307  8825 catalog_manager.cc:5697] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 1 to 3, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:59.413092   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:01:59.489037   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:59.497555  9750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:59.500798  9749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:59.504921  9752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:59.506398   431 server_base.cc:1061] running on GCE node
I20260709 13:01:59.507722   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:59.508031   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:59.508237   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602119508221 us; error 0 us; skew 500 ppm
I20260709 13:01:59.508968   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:59.520656   431 webserver.cc:533] Webserver started at http://127.0.107.193:36563/ using document root <none> and password file <none>
I20260709 13:01:59.521509   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:59.521853   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:01:59.527269   431 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:01:59.536635  9757 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:59.537647   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:01:59.538044   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-0-root
uuid: "4667e9699c4d413889fc866e0e560d1f"
format_stamp: "Formatted at 2026-07-09 13:01:42 on dist-test-slave-zhdc"
I20260709 13:01:59.538583   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601840662384-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:59.574982   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:59.576598   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:59.578557   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:59.583475  9764 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:01:59.704355  9076 raft_consensus.cc:1275] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Refusing update from remote peer f3ac81bf7b994af084e9929fac14de34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:59.706002  9733 consensus_queue.cc:1048] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:59.732115  8970 consensus_peers.cc:597] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:59.839645   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:01:59.840035   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.258s	user 0.007s	sys 0.000s
I20260709 13:01:59.840406   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:01:59.845932  9764 tablet_bootstrap.cc:492] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:59.862473  9764 tablet_bootstrap.cc:492] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:59.863188  9764 tablet_bootstrap.cc:492] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:01:59.863775  9764 ts_tablet_manager.cc:1403] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:01:59.866330  9764 raft_consensus.cc:359] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:59.866923  9764 raft_consensus.cc:740] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.867619  9764 consensus_queue.cc:260] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:59.869761  9764 ts_tablet_manager.cc:1434] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:01:59.870688  9764 tablet_bootstrap.cc:492] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:59.883083  9764 tablet_bootstrap.cc:492] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:59.883764  9764 tablet_bootstrap.cc:492] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:01:59.884256  9764 ts_tablet_manager.cc:1403] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:01:59.885929  9764 raft_consensus.cc:359] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:59.886478  9764 raft_consensus.cc:740] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.887091  9764 consensus_queue.cc:260] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:59.888398  9764 ts_tablet_manager.cc:1434] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:59.889094  9764 tablet_bootstrap.cc:492] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:59.900427  9764 tablet_bootstrap.cc:492] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:59.901137  9764 tablet_bootstrap.cc:492] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:01:59.901630  9764 ts_tablet_manager.cc:1403] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:01:59.903470  9764 raft_consensus.cc:359] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:59.903944  9764 raft_consensus.cc:740] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.904536  9764 consensus_queue.cc:260] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:59.905936  9764 ts_tablet_manager.cc:1434] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:01:59.906576  9764 tablet_bootstrap.cc:492] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:59.935729  9764 tablet_bootstrap.cc:492] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:59.936681  9764 tablet_bootstrap.cc:492] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:01:59.937325  9764 ts_tablet_manager.cc:1403] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.004s
I20260709 13:01:59.940060  9764 raft_consensus.cc:359] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:59.940760  9764 raft_consensus.cc:740] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.941439  9764 consensus_queue.cc:260] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:59.943331  9764 ts_tablet_manager.cc:1434] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:01:59.944070  9764 tablet_bootstrap.cc:492] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:59.963814  9764 tablet_bootstrap.cc:492] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:59.964577  9764 tablet_bootstrap.cc:492] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:01:59.965178  9764 ts_tablet_manager.cc:1403] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:01:59.967002  9764 raft_consensus.cc:359] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:59.967541  9764 raft_consensus.cc:740] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.968122  9764 consensus_queue.cc:260] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:01:59.969535  9764 ts_tablet_manager.cc:1434] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:59.970221  9764 tablet_bootstrap.cc:492] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:01:59.983757  9764 tablet_bootstrap.cc:492] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:59.984717  9764 tablet_bootstrap.cc:492] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:01:59.985330  9764 ts_tablet_manager.cc:1403] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:01:59.988180  9764 raft_consensus.cc:359] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:59.988868  9764 raft_consensus.cc:740] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.989524  9764 consensus_queue.cc:260] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:01:59.991375  9764 ts_tablet_manager.cc:1434] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:01:59.992173  9764 tablet_bootstrap.cc:492] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.010264  9764 tablet_bootstrap.cc:492] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.011159  9764 tablet_bootstrap.cc:492] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.011760  9764 ts_tablet_manager.cc:1403] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260709 13:02:00.014089  9764 raft_consensus.cc:359] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.014734  9764 raft_consensus.cc:740] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.015372  9764 consensus_queue.cc:260] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.017215  9764 ts_tablet_manager.cc:1434] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:00.017948  9764 tablet_bootstrap.cc:492] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.034785  9764 tablet_bootstrap.cc:492] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.035776  9764 tablet_bootstrap.cc:492] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.036401  9764 ts_tablet_manager.cc:1403] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:02:00.038775  9764 raft_consensus.cc:359] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.039433  9764 raft_consensus.cc:740] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.040176  9764 consensus_queue.cc:260] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.042186  9764 ts_tablet_manager.cc:1434] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:00.042938  9764 tablet_bootstrap.cc:492] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.060428  9764 tablet_bootstrap.cc:492] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.061354  9764 tablet_bootstrap.cc:492] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.061990  9764 ts_tablet_manager.cc:1403] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.008s
W20260709 13:02:00.062186  9044 consensus_peers.cc:597] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:00.064321  9764 raft_consensus.cc:359] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.065061  9764 raft_consensus.cc:740] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.065704  9764 consensus_queue.cc:260] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.068601  9764 ts_tablet_manager.cc:1434] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:00.069386  9764 tablet_bootstrap.cc:492] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
W20260709 13:02:00.075438  9118 consensus_peers.cc:597] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:00.080638   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:02:00.081007   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.241s	user 0.207s	sys 0.016s
W20260709 13:02:00.088873  9118 consensus_peers.cc:597] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:00.093537  9764 tablet_bootstrap.cc:492] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.094718  9764 tablet_bootstrap.cc:492] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.095438  9764 ts_tablet_manager.cc:1403] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.007s
I20260709 13:02:00.098882  9764 raft_consensus.cc:359] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.099803  9764 raft_consensus.cc:740] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.100853  9764 consensus_queue.cc:260] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.103351  9764 ts_tablet_manager.cc:1434] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:00.104257  9764 tablet_bootstrap.cc:492] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.121176  9764 tablet_bootstrap.cc:492] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.122277  9764 tablet_bootstrap.cc:492] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.124094  9764 ts_tablet_manager.cc:1403] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 13:02:00.127574  9764 raft_consensus.cc:359] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.128304  9764 raft_consensus.cc:740] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.129073  9764 consensus_queue.cc:260] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.131109  9764 ts_tablet_manager.cc:1434] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:02:00.131910  9764 tablet_bootstrap.cc:492] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.151670  9764 tablet_bootstrap.cc:492] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.152853  9764 tablet_bootstrap.cc:492] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.153667  9764 ts_tablet_manager.cc:1403] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 13:02:00.156610  9764 raft_consensus.cc:359] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.157469  9764 raft_consensus.cc:740] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.158275  9764 consensus_queue.cc:260] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.159766   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:41567
I20260709 13:02:00.159835  9836 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:41567 every 8 connection(s)
I20260709 13:02:00.160655  9764 ts_tablet_manager.cc:1434] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.007s	user 0.010s	sys 0.000s
I20260709 13:02:00.161520  9764 tablet_bootstrap.cc:492] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.225129  9764 tablet_bootstrap.cc:492] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.226162  9764 tablet_bootstrap.cc:492] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.226830  9764 ts_tablet_manager.cc:1403] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.030s
I20260709 13:02:00.229602  9764 raft_consensus.cc:359] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.230291  9764 raft_consensus.cc:740] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.230952  9764 consensus_queue.cc:260] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.233078  9837 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46493
I20260709 13:02:00.233517  9837 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:00.234465  9837 heartbeater.cc:507] Master 127.0.107.254:46493 requested a full tablet report, sending...
I20260709 13:02:00.233099  9764 ts_tablet_manager.cc:1434] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.002s
I20260709 13:02:00.241632  9764 tablet_bootstrap.cc:492] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
W20260709 13:02:00.244194  9118 consensus_peers.cc:597] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:00.254297  8828 ts_manager.cc:194] Re-registered known tserver with Master: 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
W20260709 13:02:00.276602  9044 consensus_peers.cc:597] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:00.305982  9764 tablet_bootstrap.cc:492] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.307195  9764 tablet_bootstrap.cc:492] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.308060  9764 ts_tablet_manager.cc:1403] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.012s
I20260709 13:02:00.312857  9764 raft_consensus.cc:359] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.313733  9764 raft_consensus.cc:740] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.314855  9764 consensus_queue.cc:260] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.316983  9764 ts_tablet_manager.cc:1434] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:02:00.317754  9764 tablet_bootstrap.cc:492] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.334594  8828 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45384
I20260709 13:02:00.336175  9764 tablet_bootstrap.cc:492] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.337170  9764 tablet_bootstrap.cc:492] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.337790  9764 ts_tablet_manager.cc:1403] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:02:00.338989  9837 heartbeater.cc:499] Master 127.0.107.254:46493 was elected leader, sending a full tablet report...
I20260709 13:02:00.340430  9764 raft_consensus.cc:359] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.341363  9764 raft_consensus.cc:740] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.342038  9764 consensus_queue.cc:260] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.344110  9764 ts_tablet_manager.cc:1434] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:00.344900  9764 tablet_bootstrap.cc:492] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.362921  9764 tablet_bootstrap.cc:492] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.363822  9764 tablet_bootstrap.cc:492] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.364581  9764 ts_tablet_manager.cc:1403] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:02:00.367235  9764 raft_consensus.cc:359] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.367934  9764 raft_consensus.cc:740] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.368769  9764 consensus_queue.cc:260] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.370956  9764 ts_tablet_manager.cc:1434] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:02:00.371749  9764 tablet_bootstrap.cc:492] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.385303  9764 tablet_bootstrap.cc:492] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.386220  9764 tablet_bootstrap.cc:492] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.386801  9764 ts_tablet_manager.cc:1403] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:02:00.389038  9764 raft_consensus.cc:359] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.389566  9764 raft_consensus.cc:740] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.390195  9764 consensus_queue.cc:260] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.391748  9764 ts_tablet_manager.cc:1434] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:00.392486  9764 tablet_bootstrap.cc:492] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.405115  9764 tablet_bootstrap.cc:492] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.406154  9764 tablet_bootstrap.cc:492] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.406852  9764 ts_tablet_manager.cc:1403] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:02:00.409565  9764 raft_consensus.cc:359] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.410239  9764 raft_consensus.cc:740] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.410876  9764 consensus_queue.cc:260] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.413023  9764 ts_tablet_manager.cc:1434] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:00.413797  9764 tablet_bootstrap.cc:492] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.427449  9764 tablet_bootstrap.cc:492] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.428156  9764 tablet_bootstrap.cc:492] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.428679  9764 ts_tablet_manager.cc:1403] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:02:00.430686  9764 raft_consensus.cc:359] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.431185  9764 raft_consensus.cc:740] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.431676  9764 consensus_queue.cc:260] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.433465  9764 ts_tablet_manager.cc:1434] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:00.434963  9764 tablet_bootstrap.cc:492] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.449220  9764 tablet_bootstrap.cc:492] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.449985  9764 tablet_bootstrap.cc:492] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.450595  9764 ts_tablet_manager.cc:1403] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.005s
I20260709 13:02:00.452364  9764 raft_consensus.cc:359] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.452872  9764 raft_consensus.cc:740] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.453454  9764 consensus_queue.cc:260] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.454690  9764 ts_tablet_manager.cc:1434] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:00.455963  9764 tablet_bootstrap.cc:492] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.457906  9811 raft_consensus.cc:3060] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.470628  9764 tablet_bootstrap.cc:492] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.471724  9764 tablet_bootstrap.cc:492] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.472301  9764 ts_tablet_manager.cc:1403] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:02:00.474732  9764 raft_consensus.cc:359] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.475332  9764 raft_consensus.cc:740] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.476037  9764 consensus_queue.cc:260] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.478179  9764 ts_tablet_manager.cc:1434] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:00.478957  9764 tablet_bootstrap.cc:492] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.492906  9764 tablet_bootstrap.cc:492] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.493650  9764 tablet_bootstrap.cc:492] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.494251  9764 ts_tablet_manager.cc:1403] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.008s
I20260709 13:02:00.496224  9764 raft_consensus.cc:359] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.496840  9764 raft_consensus.cc:740] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.497460  9764 consensus_queue.cc:260] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.499567  9764 ts_tablet_manager.cc:1434] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:00.500440  9764 tablet_bootstrap.cc:492] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.519750  9764 tablet_bootstrap.cc:492] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.520689  9764 tablet_bootstrap.cc:492] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.521381  9764 ts_tablet_manager.cc:1403] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.005s
I20260709 13:02:00.524072  9764 raft_consensus.cc:359] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.524722  9764 raft_consensus.cc:740] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.525393  9764 consensus_queue.cc:260] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
W20260709 13:02:00.525899  8970 consensus_peers.cc:597] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:00.527684  9764 ts_tablet_manager.cc:1434] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:02:00.528453  9764 tablet_bootstrap.cc:492] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.541040  9764 tablet_bootstrap.cc:492] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.541893  9764 tablet_bootstrap.cc:492] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.542577  9764 ts_tablet_manager.cc:1403] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:02:00.544970  9764 raft_consensus.cc:359] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.545585  9764 raft_consensus.cc:740] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.546224  9764 consensus_queue.cc:260] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.547966  9810 raft_consensus.cc:3060] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.548149  9764 ts_tablet_manager.cc:1434] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:00.549783  9764 tablet_bootstrap.cc:492] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.568805  9764 tablet_bootstrap.cc:492] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.570144  9764 tablet_bootstrap.cc:492] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.570811  9764 ts_tablet_manager.cc:1403] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:02:00.573225  9764 raft_consensus.cc:359] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.574015  9764 raft_consensus.cc:740] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.574738  9764 consensus_queue.cc:260] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.576817  9764 ts_tablet_manager.cc:1434] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:00.577730  9764 tablet_bootstrap.cc:492] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.595263  9764 tablet_bootstrap.cc:492] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.596165  9764 tablet_bootstrap.cc:492] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.596820  9764 ts_tablet_manager.cc:1403] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:02:00.599231  9764 raft_consensus.cc:359] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.599897  9764 raft_consensus.cc:740] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.600538  9764 consensus_queue.cc:260] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.602656  9764 ts_tablet_manager.cc:1434] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:00.604024  9764 tablet_bootstrap.cc:492] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
W20260709 13:02:00.604522  9044 consensus_peers.cc:597] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:00.617168  9764 tablet_bootstrap.cc:492] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.618211  9764 tablet_bootstrap.cc:492] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.618868  9764 ts_tablet_manager.cc:1403] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:02:00.621351  9764 raft_consensus.cc:359] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.622167  9764 raft_consensus.cc:740] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.622831  9764 consensus_queue.cc:260] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.624961  9764 ts_tablet_manager.cc:1434] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:00.627327  9764 tablet_bootstrap.cc:492] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.633523  9810 raft_consensus.cc:3060] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.649967  9764 tablet_bootstrap.cc:492] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.650992  9764 tablet_bootstrap.cc:492] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.651708  9764 ts_tablet_manager.cc:1403] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.009s
I20260709 13:02:00.654361  9811 raft_consensus.cc:3060] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.654312  9764 raft_consensus.cc:359] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.655011  9764 raft_consensus.cc:740] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.655676  9764 consensus_queue.cc:260] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.657734  9764 ts_tablet_manager.cc:1434] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:00.658550  9764 tablet_bootstrap.cc:492] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.683166  9764 tablet_bootstrap.cc:492] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.683929  9811 raft_consensus.cc:3060] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.684201  9764 tablet_bootstrap.cc:492] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.685284  9764 ts_tablet_manager.cc:1403] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.004s
I20260709 13:02:00.687738  9764 raft_consensus.cc:359] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.688421  9764 raft_consensus.cc:740] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.689087  9764 consensus_queue.cc:260] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.691169  9764 ts_tablet_manager.cc:1434] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:00.691949  9764 tablet_bootstrap.cc:492] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.710078  9764 tablet_bootstrap.cc:492] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.711131  9764 tablet_bootstrap.cc:492] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.711848  9764 ts_tablet_manager.cc:1403] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:02:00.714576  9764 raft_consensus.cc:359] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.715325  9764 raft_consensus.cc:740] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.716056  9764 consensus_queue.cc:260] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.717912  9764 ts_tablet_manager.cc:1434] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:00.723608  9764 tablet_bootstrap.cc:492] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.748636  9764 tablet_bootstrap.cc:492] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.749593  9764 tablet_bootstrap.cc:492] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.750272  9764 ts_tablet_manager.cc:1403] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.006s
I20260709 13:02:00.752682  9764 raft_consensus.cc:359] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.753346  9764 raft_consensus.cc:740] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.754166  9764 consensus_queue.cc:260] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.756541  9764 ts_tablet_manager.cc:1434] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:02:00.757378  9764 tablet_bootstrap.cc:492] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
W20260709 13:02:00.758762  9044 consensus_peers.cc:597] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:00.773168  9764 tablet_bootstrap.cc:492] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.774338  9764 tablet_bootstrap.cc:492] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.775103  9764 ts_tablet_manager.cc:1403] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:02:00.777626  9764 raft_consensus.cc:359] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.778493  9764 raft_consensus.cc:740] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.779181  9764 consensus_queue.cc:260] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.781378  9764 ts_tablet_manager.cc:1434] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:00.782276  9764 tablet_bootstrap.cc:492] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.799841  9764 tablet_bootstrap.cc:492] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.800794  9764 tablet_bootstrap.cc:492] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.801476  9764 ts_tablet_manager.cc:1403] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
W20260709 13:02:00.803805  8970 consensus_peers.cc:597] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:00.803977  9764 raft_consensus.cc:359] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.804718  9764 raft_consensus.cc:740] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.805353  9764 consensus_queue.cc:260] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.807156  9764 ts_tablet_manager.cc:1434] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:02:00.808115  9764 tablet_bootstrap.cc:492] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.822340  9764 tablet_bootstrap.cc:492] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.823254  9764 tablet_bootstrap.cc:492] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.823968  9764 ts_tablet_manager.cc:1403] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:02:00.826231  9764 raft_consensus.cc:359] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.826880  9764 raft_consensus.cc:740] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.827530  9764 consensus_queue.cc:260] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.829667  9764 ts_tablet_manager.cc:1434] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:00.830993  9764 tablet_bootstrap.cc:492] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.848400  9764 tablet_bootstrap.cc:492] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.849419  9764 tablet_bootstrap.cc:492] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.850095  9764 ts_tablet_manager.cc:1403] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 13:02:00.852553  9764 raft_consensus.cc:359] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.853194  9764 raft_consensus.cc:740] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.853889  9764 consensus_queue.cc:260] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.856050  9764 ts_tablet_manager.cc:1434] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:00.856729  9764 tablet_bootstrap.cc:492] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.870766  9764 tablet_bootstrap.cc:492] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.871507  9764 tablet_bootstrap.cc:492] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.872032  9764 ts_tablet_manager.cc:1403] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:02:00.874024  9764 raft_consensus.cc:359] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.874676  9764 raft_consensus.cc:740] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.875315  9764 consensus_queue.cc:260] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:00.876935  9764 ts_tablet_manager.cc:1434] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:02:00.877579  9764 tablet_bootstrap.cc:492] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.890452  9764 tablet_bootstrap.cc:492] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.891242  9764 tablet_bootstrap.cc:492] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.891782  9764 ts_tablet_manager.cc:1403] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:02:00.893702  9764 raft_consensus.cc:359] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.894302  9764 raft_consensus.cc:740] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.894946  9764 consensus_queue.cc:260] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.896895  9764 ts_tablet_manager.cc:1434] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:00.897658  9764 tablet_bootstrap.cc:492] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.910940  9764 tablet_bootstrap.cc:492] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.911651  9764 tablet_bootstrap.cc:492] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.912201  9764 ts_tablet_manager.cc:1403] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:02:00.914091  9764 raft_consensus.cc:359] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.914583  9764 raft_consensus.cc:740] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.915105  9764 consensus_queue.cc:260] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.916916  9764 ts_tablet_manager.cc:1434] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:00.917837  9764 tablet_bootstrap.cc:492] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.931473  9764 tablet_bootstrap.cc:492] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.932367  9764 tablet_bootstrap.cc:492] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.932921  9764 ts_tablet_manager.cc:1403] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:02:00.935112  9764 raft_consensus.cc:359] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.935762  9764 raft_consensus.cc:740] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.936430  9764 consensus_queue.cc:260] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:00.938393  9764 ts_tablet_manager.cc:1434] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:02:00.939010  9764 tablet_bootstrap.cc:492] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.955498  9764 tablet_bootstrap.cc:492] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.956422  9764 tablet_bootstrap.cc:492] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.957104  9764 ts_tablet_manager.cc:1403] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.006s
I20260709 13:02:00.959685  9764 raft_consensus.cc:359] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.960336  9764 raft_consensus.cc:740] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.961062  9764 consensus_queue.cc:260] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.963590  9764 ts_tablet_manager.cc:1434] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:02:00.964313  9764 tablet_bootstrap.cc:492] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:00.976998  9764 tablet_bootstrap.cc:492] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:00.977761  9764 tablet_bootstrap.cc:492] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:00.978345  9764 ts_tablet_manager.cc:1403] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:02:00.979982  9764 raft_consensus.cc:359] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.980458  9764 raft_consensus.cc:740] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.981046  9764 consensus_queue.cc:260] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:00.982563  9764 ts_tablet_manager.cc:1434] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:00.983434  9764 tablet_bootstrap.cc:492] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:01.003607  9764 tablet_bootstrap.cc:492] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:01.004483  9764 tablet_bootstrap.cc:492] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:01.005157  9764 ts_tablet_manager.cc:1403] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:02:01.007058  9764 raft_consensus.cc:359] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:01.007611  9764 raft_consensus.cc:740] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.008237  9764 consensus_queue.cc:260] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:01.010334  9764 ts_tablet_manager.cc:1434] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:02:01.011287  9764 tablet_bootstrap.cc:492] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:01.026712  9764 tablet_bootstrap.cc:492] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:01.027896  9764 tablet_bootstrap.cc:492] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:01.028625  9764 ts_tablet_manager.cc:1403] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:02:01.030799  9764 raft_consensus.cc:359] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:01.031473  9764 raft_consensus.cc:740] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.032311  9764 consensus_queue.cc:260] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:01.035064  9764 ts_tablet_manager.cc:1434] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:02:01.036157  9764 tablet_bootstrap.cc:492] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:01.068117  9764 tablet_bootstrap.cc:492] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:01.068871  9764 tablet_bootstrap.cc:492] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:01.069412  9764 ts_tablet_manager.cc:1403] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.001s
I20260709 13:02:01.071270  9764 raft_consensus.cc:359] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:01.071900  9764 raft_consensus.cc:740] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.072539  9764 consensus_queue.cc:260] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:01.074782  9764 ts_tablet_manager.cc:1434] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:02:01.075924  9764 tablet_bootstrap.cc:492] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap starting.
I20260709 13:02:01.165657  9809 raft_consensus.cc:3060] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:02:01.217245  9118 consensus_peers.cc:597] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:01.218766  9764 tablet_bootstrap.cc:492] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:01.220214  9764 tablet_bootstrap.cc:492] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f: Bootstrap complete.
I20260709 13:02:01.221434  9764 ts_tablet_manager.cc:1403] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f: Time spent bootstrapping tablet: real 0.146s	user 0.010s	sys 0.007s
I20260709 13:02:01.229436  9764 raft_consensus.cc:359] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:01.230700  9764 raft_consensus.cc:740] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.231537  9764 consensus_queue.cc:260] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:01.236088  9764 ts_tablet_manager.cc:1434] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.001s
W20260709 13:02:01.284163  9044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41567, user_credentials={real_user=slave}} blocked reactor thread for 49341.7us
I20260709 13:02:01.349334  9808 raft_consensus.cc:3060] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.165968   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:10.224373  9151 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4"
dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
mode: GRACEFUL
new_leader_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:52264
I20260709 13:02:10.225266  9151 raft_consensus.cc:606] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Received request to transfer leadership to TS 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:10.227974  9152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3364bac8978243bcb6d068941312d443"
dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
mode: GRACEFUL
new_leader_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:52264
I20260709 13:02:10.228425  9152 raft_consensus.cc:606] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Received request to transfer leadership to TS 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:10.233363  9152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e69234154ae46418e61ba3eb8a89c2a"
dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
mode: GRACEFUL
new_leader_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:52264
I20260709 13:02:10.234045  9152 raft_consensus.cc:606] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Received request to transfer leadership to TS 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:10.247702  9076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69981197f2a5423a8758576940d1bf76"
dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
mode: GRACEFUL
new_leader_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:60070
I20260709 13:02:10.248278  9076 raft_consensus.cc:606] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Received request to transfer leadership to TS 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:10.250963  9151 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7ab829c10554275ae1d80198e91fa05"
dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
mode: GRACEFUL
new_leader_uuid: "f3ac81bf7b994af084e9929fac14de34"
 from {username='slave'} at 127.0.0.1:52264
I20260709 13:02:10.251478  9151 raft_consensus.cc:606] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Received request to transfer leadership to TS f3ac81bf7b994af084e9929fac14de34
I20260709 13:02:10.253531  9151 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302"
dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
mode: GRACEFUL
new_leader_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:52264
I20260709 13:02:10.254009  9151 raft_consensus.cc:606] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Received request to transfer leadership to TS 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:10.255977   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:10.257606   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:10.313337  9741 raft_consensus.cc:993] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123: : Instructing follower 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:10.313966  9905 raft_consensus.cc:1081] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Signalling peer 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:10.315249  9809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4"
dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:39444
I20260709 13:02:10.315681  9809 raft_consensus.cc:493] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:10.315929  9809 raft_consensus.cc:3060] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.320832  9809 raft_consensus.cc:515] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:10.324237  9809 leader_election.cc:290] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:02:10.343106  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:10.343845  9151 raft_consensus.cc:3055] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:10.344159  9151 raft_consensus.cc:740] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:10.344385  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:10.344185  9908 raft_consensus.cc:993] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5: : Instructing follower 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:10.344974  9003 raft_consensus.cc:3060] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.345019  9151 consensus_queue.cc:260] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:10.345779  9910 raft_consensus.cc:1081] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Signalling peer 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:10.346599  9151 raft_consensus.cc:3060] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.348408  9809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69981197f2a5423a8758576940d1bf76"
dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:39460
I20260709 13:02:10.349001  9809 raft_consensus.cc:493] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:10.349349  9809 raft_consensus.cc:3060] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.352794  9003 raft_consensus.cc:2468] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:10.354931  9759 leader_election.cc:304] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:10.356776  9151 raft_consensus.cc:2468] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:10.356945  9918 raft_consensus.cc:2804] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:10.358065  9809 raft_consensus.cc:515] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:10.359660  9918 raft_consensus.cc:697] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:02:10.360729  9918 consensus_queue.cc:237] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:10.359990  9809 leader_election.cc:290] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:02:10.362422  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69981197f2a5423a8758576940d1bf76" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:10.363039  9151 raft_consensus.cc:3060] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.369648  9151 raft_consensus.cc:2468] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:10.370994  9760 leader_election.cc:304] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:02:10.371697  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69981197f2a5423a8758576940d1bf76" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:10.372225  9918 raft_consensus.cc:2804] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:10.372373  9076 raft_consensus.cc:3055] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:10.372777  9076 raft_consensus.cc:740] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:02:10.372805  9918 raft_consensus.cc:697] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:02:10.373546  9076 consensus_queue.cc:260] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:10.375389  9076 raft_consensus.cc:3060] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.374876  9918 consensus_queue.cc:237] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:10.374786  8825 catalog_manager.cc:5697] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 1 to 2, leader changed from 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196) to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.383543  9076 raft_consensus.cc:2468] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:10.400120  8825 catalog_manager.cc:5697] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 1 to 2, leader changed from 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195) to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.455318  9905 raft_consensus.cc:993] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123: : Instructing follower f3ac81bf7b994af084e9929fac14de34 to start an election
I20260709 13:02:10.455747  9741 raft_consensus.cc:1081] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Signalling peer f3ac81bf7b994af084e9929fac14de34 to start an election
I20260709 13:02:10.457306  9003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7ab829c10554275ae1d80198e91fa05"
dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
 from {username='slave'} at 127.0.0.1:58426
I20260709 13:02:10.457844  9003 raft_consensus.cc:493] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:10.458190  9003 raft_consensus.cc:3060] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.464267  9003 raft_consensus.cc:515] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:10.466403  9003 leader_election.cc:290] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:02:10.467255  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ab829c10554275ae1d80198e91fa05" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:10.467399  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ab829c10554275ae1d80198e91fa05" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:10.467927  9072 raft_consensus.cc:3060] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.467988  9151 raft_consensus.cc:3055] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:10.468429  9151 raft_consensus.cc:740] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:10.469205  9151 consensus_queue.cc:260] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:10.470491  9151 raft_consensus.cc:3060] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.476440  9072 raft_consensus.cc:2468] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 2.
I20260709 13:02:10.477717  8968 leader_election.cc:304] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:10.478034  9151 raft_consensus.cc:2468] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 2.
I20260709 13:02:10.478566  9904 raft_consensus.cc:2804] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:10.479133  9904 raft_consensus.cc:697] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 2 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:02:10.479902  9904 consensus_queue.cc:237] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:10.489302  8825 catalog_manager.cc:5697] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 1 to 2, leader changed from 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196) to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.533138  9905 raft_consensus.cc:993] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123: : Instructing follower 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:10.533595  9905 raft_consensus.cc:1081] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Signalling peer 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:10.535173  9808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e69234154ae46418e61ba3eb8a89c2a"
dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:39444
I20260709 13:02:10.535710  9808 raft_consensus.cc:493] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:10.536007  9808 raft_consensus.cc:3060] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.541131  9808 raft_consensus.cc:515] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:10.543697  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e69234154ae46418e61ba3eb8a89c2a" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:10.543877  9808 leader_election.cc:290] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:02:10.544273  9072 raft_consensus.cc:3060] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.545747  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e69234154ae46418e61ba3eb8a89c2a" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:10.546319  9151 raft_consensus.cc:3055] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:10.546634  9151 raft_consensus.cc:740] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:10.547314  9151 consensus_queue.cc:260] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:10.549432  9151 raft_consensus.cc:3060] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.552330  9072 raft_consensus.cc:2468] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:10.554203  9758 leader_election.cc:304] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:02:10.555085  9919 raft_consensus.cc:2804] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:10.555583  9919 raft_consensus.cc:697] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:02:10.555620  9151 raft_consensus.cc:2468] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:10.555927  9905 raft_consensus.cc:993] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123: : Instructing follower 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:10.556414  9905 raft_consensus.cc:1081] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Signalling peer 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:10.556576  9919 consensus_queue.cc:237] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:10.568634  9809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3364bac8978243bcb6d068941312d443"
dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:39444
I20260709 13:02:10.569247  9809 raft_consensus.cc:493] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:10.569612  9809 raft_consensus.cc:3060] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.577201  9809 raft_consensus.cc:515] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:10.579504  9809 leader_election.cc:290] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 3 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:02:10.579766  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:10.580356  9003 raft_consensus.cc:3060] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.581343  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:10.582005  9151 raft_consensus.cc:3055] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:10.582314  9151 raft_consensus.cc:740] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:10.583021  9151 consensus_queue.cc:260] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:10.584159  9151 raft_consensus.cc:3060] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.583772  8825 catalog_manager.cc:5697] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 1 to 2, leader changed from 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196) to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.585721  9003 raft_consensus.cc:2468] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 3.
I20260709 13:02:10.586689  9759 leader_election.cc:304] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:10.587675  9919 raft_consensus.cc:2804] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:10.588102  9919 raft_consensus.cc:697] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 3 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:02:10.589063  9919 consensus_queue.cc:237] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:10.590174  9151 raft_consensus.cc:2468] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 3.
I20260709 13:02:10.600286  8825 catalog_manager.cc:5697] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 2 to 3, leader changed from 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196) to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 3 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.649024  9911 raft_consensus.cc:993] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123: : Instructing follower 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:10.649468  9741 raft_consensus.cc:1081] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Signalling peer 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:10.650852  9809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302"
dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:39444
I20260709 13:02:10.651392  9809 raft_consensus.cc:493] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:10.651728  9809 raft_consensus.cc:3060] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.657411  9809 raft_consensus.cc:515] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:10.658965  9809 leader_election.cc:290] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 3 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:02:10.659657  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:10.660280  9072 raft_consensus.cc:3060] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.659924  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:10.661255  9151 raft_consensus.cc:3055] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:10.663182  9151 raft_consensus.cc:740] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:10.663938  9151 consensus_queue.cc:260] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:10.665132  9151 raft_consensus.cc:3060] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:10.668581  9072 raft_consensus.cc:2468] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 3.
I20260709 13:02:10.669731  9758 leader_election.cc:304] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:02:10.670516  9919 raft_consensus.cc:2804] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:10.670979  9919 raft_consensus.cc:697] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 3 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:02:10.671604  9151 raft_consensus.cc:2468] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 3.
I20260709 13:02:10.671716  9919 consensus_queue.cc:237] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:10.681427  8825 catalog_manager.cc:5697] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 2 to 3, leader changed from 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196) to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 3 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.765753  9003 raft_consensus.cc:1275] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:10.767159  9919 consensus_queue.cc:1048] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:10.779053  9151 raft_consensus.cc:1275] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:10.781018  9918 consensus_queue.cc:1048] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:10.813558  9072 raft_consensus.cc:1275] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:10.814932  9918 consensus_queue.cc:1048] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:10.819322  9152 raft_consensus.cc:1275] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:10.820957  9918 consensus_queue.cc:1048] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:10.862931  9072 raft_consensus.cc:1275] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer f3ac81bf7b994af084e9929fac14de34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:10.864037  9904 consensus_queue.cc:1048] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:10.872494  9152 raft_consensus.cc:1275] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Refusing update from remote peer f3ac81bf7b994af084e9929fac14de34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:10.873769  9909 consensus_queue.cc:1048] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:11.013077  9072 raft_consensus.cc:1275] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:11.014365  9918 consensus_queue.cc:1048] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:11.026090  9152 raft_consensus.cc:1275] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:11.027678  9932 consensus_queue.cc:1048] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:11.068681  9072 raft_consensus.cc:1275] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:11.069829  9932 consensus_queue.cc:1048] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:11.081708  9151 raft_consensus.cc:1275] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:11.083909  9918 consensus_queue.cc:1048] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:11.128561  9003 raft_consensus.cc:1275] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:11.129813  9919 consensus_queue.cc:1048] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:11.141034  9152 raft_consensus.cc:1275] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:11.142697  9932 consensus_queue.cc:1048] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:11.259347   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:11.347677   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:11.425343  9076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "173098da7c34450aa6f93bcafd377922"
dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
mode: GRACEFUL
new_leader_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:60070
I20260709 13:02:11.426424  9076 raft_consensus.cc:606] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Received request to transfer leadership to TS 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:11.429185  9076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c"
dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
mode: GRACEFUL
new_leader_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:60070
I20260709 13:02:11.429744  9076 raft_consensus.cc:606] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 2 LEADER]: Received request to transfer leadership to TS 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:11.431975  9076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2"
dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
mode: GRACEFUL
new_leader_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:60070
I20260709 13:02:11.432598  9076 raft_consensus.cc:606] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 LEADER]: Received request to transfer leadership to TS 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:11.456103  8999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c744829b78b4069a658ca2a4d2dbb5e"
dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
mode: GRACEFUL
new_leader_uuid: "069063a72de443729cdfb3fcbfa6a123"
 from {username='slave'} at 127.0.0.1:50124
I20260709 13:02:11.456998  8999 raft_consensus.cc:606] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Received request to transfer leadership to TS 069063a72de443729cdfb3fcbfa6a123
I20260709 13:02:11.462302  9076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b72207701f3449e696f990856f3d7a94"
dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
mode: GRACEFUL
new_leader_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:60070
I20260709 13:02:11.462947  9076 raft_consensus.cc:606] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Received request to transfer leadership to TS 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:11.465694  9076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4"
dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
mode: GRACEFUL
new_leader_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:60070
I20260709 13:02:11.466179  9076 raft_consensus.cc:606] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Received request to transfer leadership to TS 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:11.467150   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:11.468287   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:11.513873  9904 raft_consensus.cc:993] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34: : Instructing follower 069063a72de443729cdfb3fcbfa6a123 to start an election
I20260709 13:02:11.514488  9941 raft_consensus.cc:1081] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Signalling peer 069063a72de443729cdfb3fcbfa6a123 to start an election
I20260709 13:02:11.516031  9151 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c744829b78b4069a658ca2a4d2dbb5e"
dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
 from {username='slave'} at 127.0.0.1:47690
I20260709 13:02:11.516628  9151 raft_consensus.cc:493] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:11.516979  9151 raft_consensus.cc:3060] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.525701  9151 raft_consensus.cc:515] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:11.528847  9151 leader_election.cc:290] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:02:11.529361  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c744829b78b4069a658ca2a4d2dbb5e" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:11.530277  8999 raft_consensus.cc:3055] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:11.530421  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c744829b78b4069a658ca2a4d2dbb5e" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:11.530615  8999 raft_consensus.cc:740] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:02:11.531229  9076 raft_consensus.cc:3060] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.531754  8999 consensus_queue.cc:260] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:11.533411  8999 raft_consensus.cc:3060] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.539441  8999 raft_consensus.cc:2468] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
I20260709 13:02:11.540858  9117 leader_election.cc:304] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:11.541606  9076 raft_consensus.cc:2468] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
I20260709 13:02:11.541914  9950 raft_consensus.cc:2804] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:11.542748  9950 raft_consensus.cc:697] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:11.544044  9950 consensus_queue.cc:237] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:11.554180  8828 catalog_manager.cc:5697] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 1 to 2, leader changed from f3ac81bf7b994af084e9929fac14de34 (127.0.107.194) to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.611486  9908 raft_consensus.cc:993] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5: : Instructing follower 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:11.612035  9949 raft_consensus.cc:1081] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Signalling peer 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:11.614830  9808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4"
dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:39460
I20260709 13:02:11.615399  9808 raft_consensus.cc:493] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:11.615751  9808 raft_consensus.cc:3060] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.623929  9808 raft_consensus.cc:515] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:11.625864  9808 leader_election.cc:290] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:02:11.626646  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:11.626988  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:11.627323  8999 raft_consensus.cc:3060] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.627650  9076 raft_consensus.cc:3055] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:11.627986  9076 raft_consensus.cc:740] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:02:11.628870  9076 consensus_queue.cc:260] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:11.630138  9076 raft_consensus.cc:3060] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.632699  8999 raft_consensus.cc:2468] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:11.634092  9759 leader_election.cc:304] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:11.635036  9918 raft_consensus.cc:2804] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:11.635505  9918 raft_consensus.cc:697] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:02:11.636482  9076 raft_consensus.cc:2468] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:11.636487  9918 consensus_queue.cc:237] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:11.639273  9908 raft_consensus.cc:993] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5: : Instructing follower 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:11.639657  9949 raft_consensus.cc:1081] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Signalling peer 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:11.641301  9808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "173098da7c34450aa6f93bcafd377922"
dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:39460
I20260709 13:02:11.641927  9808 raft_consensus.cc:493] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:11.642335  9808 raft_consensus.cc:3060] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.648766  9808 raft_consensus.cc:515] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:11.649716  8828 catalog_manager.cc:5697] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 1 to 2, leader changed from 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195) to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.650730  9808 leader_election.cc:290] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:02:11.651830  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "173098da7c34450aa6f93bcafd377922" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:11.651913  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "173098da7c34450aa6f93bcafd377922" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:11.652486  9076 raft_consensus.cc:3055] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:11.652577  9151 raft_consensus.cc:3060] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.652853  9076 raft_consensus.cc:740] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:02:11.653748  9076 consensus_queue.cc:260] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:11.655058  9076 raft_consensus.cc:3060] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.660511  9151 raft_consensus.cc:2468] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:11.661960  9760 leader_election.cc:304] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:02:11.662168  9076 raft_consensus.cc:2468] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:11.663130  9919 raft_consensus.cc:2804] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:11.663619  9919 raft_consensus.cc:697] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:02:11.664646  9919 consensus_queue.cc:237] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:11.677116  8828 catalog_manager.cc:5697] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 1 to 2, leader changed from 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195) to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.792704  9908 raft_consensus.cc:993] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5: : Instructing follower 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:11.793220  9949 raft_consensus.cc:1081] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 2 LEADER]: Signalling peer 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:11.794747  9808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c"
dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:39460
I20260709 13:02:11.795287  9808 raft_consensus.cc:493] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:11.795680  9808 raft_consensus.cc:3060] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:11.801913  9808 raft_consensus.cc:515] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:11.803763  9808 leader_election.cc:290] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 3 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:02:11.805426  8999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:11.805461  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:11.806191  8999 raft_consensus.cc:3060] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:11.806241  9072 raft_consensus.cc:3055] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:11.806748  9072 raft_consensus.cc:740] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:02:11.807597  9072 consensus_queue.cc:260] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:11.808818  9072 raft_consensus.cc:3060] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:11.811401  8999 raft_consensus.cc:2468] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 3.
I20260709 13:02:11.812423  9759 leader_election.cc:304] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:11.813171  9919 raft_consensus.cc:2804] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:11.813592  9919 raft_consensus.cc:697] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 3 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:02:11.813912  9072 raft_consensus.cc:2468] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 3.
I20260709 13:02:11.814669  9919 consensus_queue.cc:237] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:11.824869  8828 catalog_manager.cc:5697] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 2 to 3, leader changed from 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195) to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 3 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.825814  9908 raft_consensus.cc:993] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5: : Instructing follower 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:11.826478  9949 raft_consensus.cc:1081] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Signalling peer 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:11.828119  9811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b72207701f3449e696f990856f3d7a94"
dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:39460
I20260709 13:02:11.828634  9811 raft_consensus.cc:493] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:11.828972  9811 raft_consensus.cc:3060] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.835843  9811 raft_consensus.cc:515] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:11.837301  9811 leader_election.cc:290] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:02:11.838217  9151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72207701f3449e696f990856f3d7a94" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:11.838845  9151 raft_consensus.cc:3060] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.839357  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72207701f3449e696f990856f3d7a94" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:11.840860  9072 raft_consensus.cc:3055] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:11.841136  9072 raft_consensus.cc:740] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:02:11.842291  9072 consensus_queue.cc:260] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:11.843252  9072 raft_consensus.cc:3060] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.845595  9151 raft_consensus.cc:2468] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:11.847776  9760 leader_election.cc:304] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:02:11.848618  9919 raft_consensus.cc:2804] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:11.849335  9919 raft_consensus.cc:697] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:02:11.850304  9919 consensus_queue.cc:237] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:11.851222  9072 raft_consensus.cc:2468] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:11.859508  8828 catalog_manager.cc:5697] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 1 to 2, leader changed from 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195) to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.873273  9949 raft_consensus.cc:993] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5: : Instructing follower 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:11.873796  9908 raft_consensus.cc:1081] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 LEADER]: Signalling peer 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:11.875188  9811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2"
dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:39460
I20260709 13:02:11.875675  9811 raft_consensus.cc:493] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:11.875955  9811 raft_consensus.cc:3060] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:11.881976  9811 raft_consensus.cc:515] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:11.884236  9811 leader_election.cc:290] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 3 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:02:11.887495  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:11.888140  9002 raft_consensus.cc:3060] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:11.890028  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:11.890669  9072 raft_consensus.cc:3055] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:11.890905  9072 raft_consensus.cc:740] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:02:11.891598  9072 consensus_queue.cc:260] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:11.892452  9072 raft_consensus.cc:3060] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:11.900128  9072 raft_consensus.cc:2468] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 3.
I20260709 13:02:11.901194  9758 leader_election.cc:304] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:02:11.901955  9918 raft_consensus.cc:2804] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:11.903177  9918 raft_consensus.cc:697] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 3 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:02:11.904174  9002 raft_consensus.cc:2468] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 3.
I20260709 13:02:11.904114  9918 consensus_queue.cc:237] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:11.914245  8828 catalog_manager.cc:5697] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 2 to 3, leader changed from 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195) to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 3 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.925285  9002 raft_consensus.cc:1275] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:11.926478  9911 consensus_queue.cc:1048] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:11.948462  9076 raft_consensus.cc:1275] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:11.950035  9961 consensus_queue.cc:1048] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:12.032997  9072 raft_consensus.cc:1275] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:12.034190  9919 consensus_queue.cc:1048] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:12.061116  9002 raft_consensus.cc:1275] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:12.064035  9962 consensus_queue.cc:1048] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:12.084722  9072 raft_consensus.cc:1275] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:12.086127  9918 consensus_queue.cc:1048] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:12.095240  9152 raft_consensus.cc:1275] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:12.097288  9919 consensus_queue.cc:1048] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:12.277063  9076 raft_consensus.cc:1275] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:12.278407  9919 consensus_queue.cc:1048] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:12.291664  9151 raft_consensus.cc:1275] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:12.293097  9932 consensus_queue.cc:1048] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:12.348321  9076 raft_consensus.cc:1275] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:12.349588  9932 consensus_queue.cc:1048] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:12.360487  9002 raft_consensus.cc:1275] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:12.362042  9919 consensus_queue.cc:1048] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:12.407693  9002 raft_consensus.cc:1275] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:12.409195  9919 consensus_queue.cc:1048] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:12.418285  9076 raft_consensus.cc:1275] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:12.421924  9919 consensus_queue.cc:1048] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:12.469053   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:12.512925   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:12.553496  9076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "317ccde7219b44848d0dd04ca340a83f"
dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
mode: GRACEFUL
new_leader_uuid: "069063a72de443729cdfb3fcbfa6a123"
 from {username='slave'} at 127.0.0.1:60070
I20260709 13:02:12.554090  9076 raft_consensus.cc:606] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Received request to transfer leadership to TS 069063a72de443729cdfb3fcbfa6a123
I20260709 13:02:12.556506  9152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad5b06a466054767b5daa1085aca6ea5"
dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
mode: GRACEFUL
new_leader_uuid: "f3ac81bf7b994af084e9929fac14de34"
 from {username='slave'} at 127.0.0.1:52264
I20260709 13:02:12.556934  9152 raft_consensus.cc:606] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Received request to transfer leadership to TS f3ac81bf7b994af084e9929fac14de34
I20260709 13:02:12.559361  9076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9a11453401345558e4c1e70b91f288c"
dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
mode: GRACEFUL
new_leader_uuid: "069063a72de443729cdfb3fcbfa6a123"
 from {username='slave'} at 127.0.0.1:60070
I20260709 13:02:12.559859  9076 raft_consensus.cc:606] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Received request to transfer leadership to TS 069063a72de443729cdfb3fcbfa6a123
I20260709 13:02:12.562201  9076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d928cb8bbc1d4ab980a52299b33396b2"
dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
mode: GRACEFUL
new_leader_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:60070
I20260709 13:02:12.562580  9076 raft_consensus.cc:606] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Received request to transfer leadership to TS 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:12.563515   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:02:12.564662   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:12.588750  9949 raft_consensus.cc:993] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5: : Instructing follower 069063a72de443729cdfb3fcbfa6a123 to start an election
I20260709 13:02:12.589429  9980 raft_consensus.cc:1081] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Signalling peer 069063a72de443729cdfb3fcbfa6a123 to start an election
I20260709 13:02:12.591140  9152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "317ccde7219b44848d0dd04ca340a83f"
dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
 from {username='slave'} at 127.0.0.1:47706
I20260709 13:02:12.591755  9152 raft_consensus.cc:493] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:12.592159  9152 raft_consensus.cc:3060] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.599913  9152 raft_consensus.cc:515] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:12.602466  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317ccde7219b44848d0dd04ca340a83f" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:12.602636  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317ccde7219b44848d0dd04ca340a83f" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:12.603039  9003 raft_consensus.cc:3060] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.603245  9076 raft_consensus.cc:3055] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:12.603634  9076 raft_consensus.cc:740] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:02:12.604370  9076 consensus_queue.cc:260] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:12.605389  9076 raft_consensus.cc:3060] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.603266  9152 leader_election.cc:290] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:02:12.609027  9003 raft_consensus.cc:2468] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
I20260709 13:02:12.610942  9117 leader_election.cc:304] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:12.611793  9950 raft_consensus.cc:2804] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:12.612303  9950 raft_consensus.cc:697] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:12.612052  9076 raft_consensus.cc:2468] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
I20260709 13:02:12.613245  9950 consensus_queue.cc:237] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:12.639514  8827 catalog_manager.cc:5697] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 1 to 2, leader changed from 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195) to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:12.888331  9949 raft_consensus.cc:993] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5: : Instructing follower 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:12.888865  9908 raft_consensus.cc:1081] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Signalling peer 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:12.890533  9811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d928cb8bbc1d4ab980a52299b33396b2"
dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:39460
I20260709 13:02:12.890990  9811 raft_consensus.cc:493] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:12.891275  9811 raft_consensus.cc:3060] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.896531  9811 raft_consensus.cc:515] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:12.897557  9961 raft_consensus.cc:993] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123: : Instructing follower f3ac81bf7b994af084e9929fac14de34 to start an election
I20260709 13:02:12.898132  9911 raft_consensus.cc:1081] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Signalling peer f3ac81bf7b994af084e9929fac14de34 to start an election
I20260709 13:02:12.898914  9811 leader_election.cc:290] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:02:12.898967  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d928cb8bbc1d4ab980a52299b33396b2" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:12.899621  9002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad5b06a466054767b5daa1085aca6ea5"
dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
 from {username='slave'} at 127.0.0.1:58426
I20260709 13:02:12.899718  9003 raft_consensus.cc:3060] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.899955  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d928cb8bbc1d4ab980a52299b33396b2" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:12.900146  9002 raft_consensus.cc:493] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:12.900552  9072 raft_consensus.cc:3055] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:12.900547  9002 raft_consensus.cc:3060] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.901031  9072 raft_consensus.cc:740] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:02:12.901880  9072 consensus_queue.cc:260] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:12.902956  9072 raft_consensus.cc:3060] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.906569  9003 raft_consensus.cc:2468] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:12.907656  9759 leader_election.cc:304] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:12.908478  9919 raft_consensus.cc:2804] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:12.908403  9002 raft_consensus.cc:515] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:12.909898  9919 raft_consensus.cc:697] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:02:12.909890  9072 raft_consensus.cc:2468] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:12.915099  9002 leader_election.cc:290] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:02:12.916014  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b06a466054767b5daa1085aca6ea5" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:12.916640  9152 raft_consensus.cc:3055] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:12.916960  9152 raft_consensus.cc:740] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:12.917450  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad5b06a466054767b5daa1085aca6ea5" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:12.918006  9076 raft_consensus.cc:3060] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.918273  9152 consensus_queue.cc:260] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:12.919412  9152 raft_consensus.cc:3060] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.924302  9076 raft_consensus.cc:2468] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 2.
I20260709 13:02:12.916517  9919 consensus_queue.cc:237] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:12.929808  8968 leader_election.cc:304] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:12.930716  9941 raft_consensus.cc:2804] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:12.931197  9941 raft_consensus.cc:697] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 2 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:02:12.932040  9941 consensus_queue.cc:237] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:12.932969  9152 raft_consensus.cc:2468] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 2.
I20260709 13:02:12.941689  8827 catalog_manager.cc:5697] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 1 to 2, leader changed from 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195) to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.943012  8825 catalog_manager.cc:5697] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 1 to 2, leader changed from 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196) to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.967293  9980 raft_consensus.cc:993] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5: : Instructing follower 069063a72de443729cdfb3fcbfa6a123 to start an election
I20260709 13:02:12.967842  9980 raft_consensus.cc:1081] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Signalling peer 069063a72de443729cdfb3fcbfa6a123 to start an election
I20260709 13:02:12.969415  9152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9a11453401345558e4c1e70b91f288c"
dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
 from {username='slave'} at 127.0.0.1:47706
I20260709 13:02:12.969978  9152 raft_consensus.cc:493] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:12.970337  9152 raft_consensus.cc:3060] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.976797  9152 raft_consensus.cc:515] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:12.978507  9152 leader_election.cc:290] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:02:12.979059  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a11453401345558e4c1e70b91f288c" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:12.979425  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9a11453401345558e4c1e70b91f288c" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:12.979707  9003 raft_consensus.cc:3060] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.980019  9076 raft_consensus.cc:3055] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:12.980345  9076 raft_consensus.cc:740] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:02:12.981096  9076 consensus_queue.cc:260] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:12.982297  9076 raft_consensus.cc:3060] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.986610  9003 raft_consensus.cc:2468] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
I20260709 13:02:12.987643  9117 leader_election.cc:304] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:12.988462  9950 raft_consensus.cc:2804] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:12.988735  9076 raft_consensus.cc:2468] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
I20260709 13:02:12.988991  9950 raft_consensus.cc:697] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:12.990090  9950 consensus_queue.cc:237] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:12.999761  8827 catalog_manager.cc:5697] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 1 to 2, leader changed from 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195) to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:13.083611  9002 raft_consensus.cc:1275] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:13.085112  9911 consensus_queue.cc:1048] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:13.103686  9076 raft_consensus.cc:1275] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:13.105314  9911 consensus_queue.cc:1048] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:13.381196  9076 raft_consensus.cc:1275] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer f3ac81bf7b994af084e9929fac14de34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:13.382542  9941 consensus_queue.cc:1048] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:02:13.403640  9076 raft_consensus.cc:1275] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:13.406473  9152 raft_consensus.cc:1275] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Refusing update from remote peer f3ac81bf7b994af084e9929fac14de34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:13.409160  9983 consensus_queue.cc:1048] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:13.405359  9918 consensus_queue.cc:1048] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:13.441895  9002 raft_consensus.cc:1275] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:13.446679  9962 consensus_queue.cc:1048] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:13.545590  9072 raft_consensus.cc:1275] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:13.546993  9950 consensus_queue.cc:1048] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:13.557883  9002 raft_consensus.cc:1275] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:13.560760  9950 consensus_queue.cc:1048] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:13.565596   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:13.611884   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:13.648340  9150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ae45916fe794471981c2ddff2693264"
dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
mode: GRACEFUL
new_leader_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:52264
I20260709 13:02:13.648871  9150 raft_consensus.cc:606] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Received request to transfer leadership to TS 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:13.651392  9150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a489378335c74a0fb5932be1e308fc64"
dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
mode: GRACEFUL
new_leader_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:52264
I20260709 13:02:13.651854  9150 raft_consensus.cc:606] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Received request to transfer leadership to TS 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:13.654449  9002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7ab829c10554275ae1d80198e91fa05"
dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
mode: GRACEFUL
new_leader_uuid: "069063a72de443729cdfb3fcbfa6a123"
 from {username='slave'} at 127.0.0.1:50124
I20260709 13:02:13.654964  9002 raft_consensus.cc:606] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 2 LEADER]: Received request to transfer leadership to TS 069063a72de443729cdfb3fcbfa6a123
I20260709 13:02:13.656536   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:02:13.657876   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:13.891222  9996 raft_consensus.cc:993] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34: : Instructing follower 069063a72de443729cdfb3fcbfa6a123 to start an election
I20260709 13:02:13.891878  9997 raft_consensus.cc:1081] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 2 LEADER]: Signalling peer 069063a72de443729cdfb3fcbfa6a123 to start an election
I20260709 13:02:13.893215  9150 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7ab829c10554275ae1d80198e91fa05"
dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
 from {username='slave'} at 127.0.0.1:47690
I20260709 13:02:13.893769  9150 raft_consensus.cc:493] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:13.894114  9150 raft_consensus.cc:3060] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:13.899560  9150 raft_consensus.cc:515] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:13.901180  9150 leader_election.cc:290] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:02:13.902204  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ab829c10554275ae1d80198e91fa05" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:13.902827  9076 raft_consensus.cc:3060] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:13.902876  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ab829c10554275ae1d80198e91fa05" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:13.903545  9002 raft_consensus.cc:3055] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:13.903885  9002 raft_consensus.cc:740] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:02:13.904680  9002 consensus_queue.cc:260] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:13.905973  9002 raft_consensus.cc:3060] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:13.909094  9076 raft_consensus.cc:2468] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 3.
I20260709 13:02:13.911233  9116 leader_election.cc:304] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:02:13.912011  9950 raft_consensus.cc:2804] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:13.912103  9002 raft_consensus.cc:2468] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 3.
I20260709 13:02:13.913462  9950 raft_consensus.cc:697] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 3 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:13.914335  9950 consensus_queue.cc:237] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } }
I20260709 13:02:13.923920  8825 catalog_manager.cc:5697] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 2 to 3, leader changed from f3ac81bf7b994af084e9929fac14de34 (127.0.107.194) to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:13.928210  9911 raft_consensus.cc:993] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123: : Instructing follower 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:13.928797  9911 raft_consensus.cc:1081] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Signalling peer 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:13.930377  9811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ae45916fe794471981c2ddff2693264"
dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:39444
I20260709 13:02:13.931002  9811 raft_consensus.cc:493] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:13.931422  9811 raft_consensus.cc:3060] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:13.938099  9811 raft_consensus.cc:515] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:13.940253  9811 leader_election.cc:290] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 3 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:02:13.941063  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae45916fe794471981c2ddff2693264" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:13.941687  9072 raft_consensus.cc:3060] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:13.941721  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae45916fe794471981c2ddff2693264" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:13.942396  9150 raft_consensus.cc:3055] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:13.942688  9150 raft_consensus.cc:740] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:13.943499  9150 consensus_queue.cc:260] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:13.944624  9150 raft_consensus.cc:3060] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:13.947868  9072 raft_consensus.cc:2468] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 3.
I20260709 13:02:13.949218  9758 leader_election.cc:304] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:02:13.950027  9918 raft_consensus.cc:2804] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:13.950980  9918 raft_consensus.cc:697] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 3 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:02:13.951261  9150 raft_consensus.cc:2468] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 3.
I20260709 13:02:13.951870  9918 consensus_queue.cc:237] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:13.962123  8825 catalog_manager.cc:5697] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 2 to 3, leader changed from 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196) to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 3 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.011034  9950 raft_consensus.cc:993] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123: : Instructing follower 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:14.011524  9950 raft_consensus.cc:1081] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Signalling peer 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:14.013686  9811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a489378335c74a0fb5932be1e308fc64"
dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:39444
I20260709 13:02:14.014230  9811 raft_consensus.cc:493] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:14.014583  9811 raft_consensus.cc:3060] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.025785  9811 raft_consensus.cc:515] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:14.028712  9811 leader_election.cc:290] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:02:14.029562  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a489378335c74a0fb5932be1e308fc64" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:14.030220  9152 raft_consensus.cc:3055] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:14.030515  9152 raft_consensus.cc:740] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:14.031031  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a489378335c74a0fb5932be1e308fc64" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:14.031620  9002 raft_consensus.cc:3060] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.031363  9152 consensus_queue.cc:260] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:14.032730  9152 raft_consensus.cc:3060] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.037096  9002 raft_consensus.cc:2468] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:14.038887  9759 leader_election.cc:304] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:14.039687  9918 raft_consensus.cc:2804] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:14.040014  9152 raft_consensus.cc:2468] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:14.040159  9918 raft_consensus.cc:697] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:02:14.041167  9918 consensus_queue.cc:237] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:14.052497  8825 catalog_manager.cc:5697] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 1 to 2, leader changed from 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196) to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.296058  9002 raft_consensus.cc:1275] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:14.297639  9911 consensus_queue.cc:1048] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:14.312368  9072 raft_consensus.cc:1275] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:14.314739  9961 consensus_queue.cc:1048] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:14.364952  9076 raft_consensus.cc:1275] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:14.366371 10013 consensus_queue.cc:1048] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:14.391490  9152 raft_consensus.cc:1275] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:14.392889  9918 consensus_queue.cc:1048] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:14.606650  9152 raft_consensus.cc:1275] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:14.607878  9918 consensus_queue.cc:1048] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:14.618153  9002 raft_consensus.cc:1275] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:14.619827 10013 consensus_queue.cc:1048] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:14.658804   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:14.713436   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:14.746345  9152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0aa3bccd3d02438e863f3fce74229335"
dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
mode: GRACEFUL
new_leader_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:52264
I20260709 13:02:14.746899  9152 raft_consensus.cc:606] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Received request to transfer leadership to TS 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:14.748296   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:02:14.749733   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:15.058478 10011 raft_consensus.cc:993] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123: : Instructing follower 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:15.058991 10011 raft_consensus.cc:1081] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Signalling peer 4667e9699c4d413889fc866e0e560d1f to start an election
I20260709 13:02:15.060436  9808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0aa3bccd3d02438e863f3fce74229335"
dest_uuid: "4667e9699c4d413889fc866e0e560d1f"
 from {username='slave'} at 127.0.0.1:39444
I20260709 13:02:15.060947  9808 raft_consensus.cc:493] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:15.061283  9808 raft_consensus.cc:3060] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:15.071244  9808 raft_consensus.cc:515] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:15.074020  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa3bccd3d02438e863f3fce74229335" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:15.074716  9150 raft_consensus.cc:3055] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:15.075084  9150 raft_consensus.cc:740] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:15.074051  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa3bccd3d02438e863f3fce74229335" candidate_uuid: "4667e9699c4d413889fc866e0e560d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:15.076010  9076 raft_consensus.cc:3060] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:15.075498  9808 leader_election.cc:290] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603)
I20260709 13:02:15.076874  9150 consensus_queue.cc:260] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:15.078233  9150 raft_consensus.cc:3060] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:15.082717  9076 raft_consensus.cc:2468] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:15.084056  9758 leader_election.cc:304] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f; no voters: 
I20260709 13:02:15.084895  9962 raft_consensus.cc:2804] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:15.085407  9962 raft_consensus.cc:697] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Becoming Leader. State: Replica: 4667e9699c4d413889fc866e0e560d1f, State: Running, Role: LEADER
I20260709 13:02:15.086048  9150 raft_consensus.cc:2468] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4667e9699c4d413889fc866e0e560d1f in term 2.
I20260709 13:02:15.087751  9962 consensus_queue.cc:237] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:15.098979  8827 catalog_manager.cc:5697] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f reported cstate change: term changed from 1 to 2, leader changed from 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196) to 4667e9699c4d413889fc866e0e560d1f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "4667e9699c4d413889fc866e0e560d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.476467  9150 raft_consensus.cc:1275] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.477684  9918 consensus_queue.cc:1048] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.500978  9072 raft_consensus.cc:1275] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Refusing update from remote peer 4667e9699c4d413889fc866e0e560d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.502286  9918 consensus_queue.cc:1048] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.750598   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:15.788321   431 tablet_server.cc:179] TabletServer@127.0.107.193:41567 shutting down...
I20260709 13:02:15.823308   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:15.824368   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:15.825255   431 raft_consensus.cc:2243] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:15.825798   431 raft_consensus.cc:2272] T ef292f6bccd14fe2a930cd9e26f10d3b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:15.828580   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:15.829171   431 raft_consensus.cc:2243] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:15.829520   431 raft_consensus.cc:2272] T 7dffac6d3a0342be9474526316a71a85 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:15.831545   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:15.832067   431 raft_consensus.cc:2243] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:15.832438   431 raft_consensus.cc:2272] T 992ee582def743e2952b747ca4d9e99f P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:15.834527   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:15.835054   431 raft_consensus.cc:2243] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:15.835439   431 raft_consensus.cc:2272] T a8af72e77c964acd910c3ec90fe52078 P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:15.837486   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:15.838037   431 raft_consensus.cc:2243] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:15.838835   431 raft_consensus.cc:2272] T 5e69234154ae46418e61ba3eb8a89c2a P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:15.841058   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:15.841786   431 raft_consensus.cc:2243] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:15.842738   431 raft_consensus.cc:2272] T 55c00dbf47fd4608bc730f65286bd4a2 P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:15.844779   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:15.845633   431 raft_consensus.cc:2243] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:15.846112   431 raft_consensus.cc:2272] T 0f5dadd1a4f24668bef129668013d3da P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:15.847036  8970 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 389 similar messages]
I20260709 13:02:15.848917   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:15.849824   431 raft_consensus.cc:2243] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:15.850329  8970 consensus_peers.cc:597] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:15.850407   431 raft_consensus.cc:2272] T b6b16540e04e406b8089acc5a6819d14 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:15.853557   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:15.854297   431 raft_consensus.cc:2243] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:15.854823   431 raft_consensus.cc:2272] T 1b42ffd5f054411aba877e8c374e5c15 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:15.858116   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:15.859269   431 raft_consensus.cc:2243] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:15.860165   431 raft_consensus.cc:2272] T 393fbe653f874c5fb76f1464a9641a6c P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:15.860211  8970 consensus_peers.cc:597] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:15.862524   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:15.863133   431 raft_consensus.cc:2243] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:15.863533   431 raft_consensus.cc:2272] T 03db717c8e2a41c09a753240a6dbbb02 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:15.866361   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:15.867151   431 raft_consensus.cc:2243] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:15.867964   431 raft_consensus.cc:2272] T a489378335c74a0fb5932be1e308fc64 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:16.025394  9044 consensus_peers.cc:597] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.027453  9044 consensus_peers.cc:597] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.072000  9044 consensus_peers.cc:597] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.076529  9044 consensus_peers.cc:597] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.114212  9044 consensus_peers.cc:597] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.236434  9044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41567, user_credentials={real_user=slave}} blocked reactor thread for 122275us
I20260709 13:02:16.423889   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.425004   431 raft_consensus.cc:2243] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.425670   431 raft_consensus.cc:2272] T 1401c096fd97413881197bb35d4a55af P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.448855   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.452235   431 raft_consensus.cc:2243] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:16.502628   431 raft_consensus.cc:2272] T 0aa3bccd3d02438e863f3fce74229335 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.505815   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.517468   431 raft_consensus.cc:2243] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.528535   431 raft_consensus.cc:2272] T 5073cf5195c44a18922f4eb358531263 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.535347   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.537849   431 raft_consensus.cc:2243] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:16.534605  9044 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38603, user_credentials={real_user=slave}} blocked reactor thread for 44777.5us
I20260709 13:02:16.538456   431 raft_consensus.cc:2272] T 68d45c07c5d6485eb2f08f154a9df317 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.541531   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.542483   431 raft_consensus.cc:2243] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.543078   431 raft_consensus.cc:2272] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.549443   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.550343   431 raft_consensus.cc:2243] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:16.551739   431 raft_consensus.cc:2272] T ee1fc193b3ad439ab1c05519323d3302 P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.555495   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.556383   431 raft_consensus.cc:2243] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.557286   431 raft_consensus.cc:2272] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.562204   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:02:16.570214  8970 consensus_peers.cc:597] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.570899  8970 consensus_peers.cc:597] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.571377  8970 consensus_peers.cc:597] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.571844  8970 consensus_peers.cc:597] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.572350  9118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:41567, user_credentials={real_user=slave}} blocked reactor thread for 57549.5us
W20260709 13:02:16.572376  8970 consensus_peers.cc:597] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.576521  8970 consensus_peers.cc:597] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.581135  8970 consensus_peers.cc:597] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.581749  8970 consensus_peers.cc:597] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.582394  8970 consensus_peers.cc:597] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.582990  8970 consensus_peers.cc:597] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:16.584220   431 raft_consensus.cc:2243] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.584935   431 raft_consensus.cc:2272] T 80e007e79ba94ae88d703e10d65910a9 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.591383   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.592231   431 raft_consensus.cc:2243] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:16.593251   431 raft_consensus.cc:2272] T 0e7047cf3dbc4806aad2882c18cea1f4 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:16.596926  9044 consensus_peers.cc:597] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.605521  9118 consensus_peers.cc:597] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:16.605755   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:02:16.606453  9118 consensus_peers.cc:597] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.607024  9118 consensus_peers.cc:597] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:16.607125   431 raft_consensus.cc:2243] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:16.607587  9118 consensus_peers.cc:597] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:16.607836   431 raft_consensus.cc:2272] T 1b6fcb3fac4347a1bd0de44956d459d8 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:16.608175  9118 consensus_peers.cc:597] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.608865  9118 consensus_peers.cc:597] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:16.611097   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.611871   431 raft_consensus.cc:2243] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:16.613336   431 raft_consensus.cc:2272] T d928cb8bbc1d4ab980a52299b33396b2 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.617681   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.618588   431 raft_consensus.cc:2243] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.619179   431 raft_consensus.cc:2272] T a8e1e49fe15e4d22be2c7582c6803d8c P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.622337   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.623174   431 raft_consensus.cc:2243] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.623757   431 raft_consensus.cc:2272] T fe53d907711b42008ace8e547dc6f7fc P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.627302   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.628118   431 raft_consensus.cc:2243] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.628603   431 raft_consensus.cc:2272] T 51e05e226d044b2eacc27e329f7c96aa P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.633008   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:02:16.633301  9044 consensus_peers.cc:597] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:16.633827   431 raft_consensus.cc:2243] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:02:16.633878  9044 consensus_peers.cc:597] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.634599  9044 consensus_peers.cc:597] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:16.634971   431 raft_consensus.cc:2272] T 5ae45916fe794471981c2ddff2693264 P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:16.635120  9044 consensus_peers.cc:597] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.635673  9044 consensus_peers.cc:597] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.636104  9044 consensus_peers.cc:597] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:16.636641  9044 consensus_peers.cc:597] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:16.638167   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.639072   431 raft_consensus.cc:2243] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.639592   431 raft_consensus.cc:2272] T e3121fd08469404b9608676838f187ba P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.642405   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.643112   431 raft_consensus.cc:2243] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.643554   431 raft_consensus.cc:2272] T 0a44fd9d19a243248566560af21b992e P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.646171   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.646905   431 raft_consensus.cc:2243] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:16.647940   431 raft_consensus.cc:2272] T 69981197f2a5423a8758576940d1bf76 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.650390   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.650900   431 raft_consensus.cc:2243] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.651281   431 raft_consensus.cc:2272] T a8bc830d85cb40fda2ac909a09c75e07 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.653205   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.653669   431 raft_consensus.cc:2243] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.653995   431 raft_consensus.cc:2272] T 9a12c81f118b4261bdad649a5d121e25 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.655819   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.656402   431 raft_consensus.cc:2243] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:16.657068   431 raft_consensus.cc:2272] T 3364bac8978243bcb6d068941312d443 P 4667e9699c4d413889fc866e0e560d1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.658944   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.659473   431 raft_consensus.cc:2243] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.659919   431 raft_consensus.cc:2272] T 7a907eff584544e28628c20d7addb69c P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.662550   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.663019   431 raft_consensus.cc:2243] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.663363   431 raft_consensus.cc:2272] T 457e71b9614d4212a6d10378b169fe21 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.665256   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.665859   431 raft_consensus.cc:2243] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:16.667027   431 raft_consensus.cc:2272] T eb6a98baac484a1c96cdafe7f0ba43f4 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.669829   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.670456   431 raft_consensus.cc:2243] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.670847   431 raft_consensus.cc:2272] T d89a074d6cac458d9de6a79b3bcceade P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.673375   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.674090   431 raft_consensus.cc:2243] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.674557   431 raft_consensus.cc:2272] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.676980   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.677484   431 raft_consensus.cc:2243] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:16.678197   431 raft_consensus.cc:2272] T b72207701f3449e696f990856f3d7a94 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.679981   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.680486   431 raft_consensus.cc:2243] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.680867   431 raft_consensus.cc:2272] T 2ec71963326742b199b954dc1c0bbacb P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.682893   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.683377   431 raft_consensus.cc:2243] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:16.684144   431 raft_consensus.cc:2272] T 173098da7c34450aa6f93bcafd377922 P 4667e9699c4d413889fc866e0e560d1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.686892   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.687589   431 raft_consensus.cc:2243] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.688006   431 raft_consensus.cc:2272] T e576ab3b143d4485a1c98595bfb66af5 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.690538   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.691165   431 raft_consensus.cc:2243] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.691642   431 raft_consensus.cc:2272] T 713d7f8692bf457fb28973349764534b P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.694283   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.694872   431 raft_consensus.cc:2243] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.695215   431 raft_consensus.cc:2272] T a1348d8ae8e8444fac9cc8f6bebfc852 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.697078   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:16.697480   431 raft_consensus.cc:2243] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:16.697930   431 raft_consensus.cc:2272] T 37e725e7a33445fb9c78550251c3db98 P 4667e9699c4d413889fc866e0e560d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:16.884177 10053 raft_consensus.cc:493] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:16.884822 10053 raft_consensus.cc:515] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:16.887383  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e69234154ae46418e61ba3eb8a89c2a" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:02:16.887571 10053 leader_election.cc:290] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
W20260709 13:02:16.890465  9118 leader_election.cc:336] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:16.890856  9118 leader_election.cc:304] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:16.891433 10053 raft_consensus.cc:2749] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:16.928201 10000 raft_consensus.cc:493] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:16.928690 10000 raft_consensus.cc:515] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:16.931083 10000 leader_election.cc:290] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:02:16.931787  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
W20260709 13:02:16.937145  9044 leader_election.cc:336] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:16.937650  9044 leader_election.cc:304] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:02:16.940591 10000 raft_consensus.cc:2749] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:17.000142 10056 raft_consensus.cc:493] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.000674 10056 raft_consensus.cc:515] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:17.002813 10056 leader_election.cc:290] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:02:17.004812  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:02:17.005509  9074 raft_consensus.cc:2468] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 3.
W20260709 13:02:17.008656  8970 leader_election.cc:336] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.021411  8968 leader_election.cc:304] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:17.023350 10056 raft_consensus.cc:2804] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:17.023764 10056 raft_consensus.cc:493] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.024127 10056 raft_consensus.cc:3060] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:17.031625 10000 raft_consensus.cc:493] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.032274 10000 raft_consensus.cc:515] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:17.038269 10000 leader_election.cc:290] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:17.038394  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e69234154ae46418e61ba3eb8a89c2a" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:02:17.039110  9150 raft_consensus.cc:2468] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 2.
I20260709 13:02:17.043241  9044 leader_election.cc:304] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:02:17.046247 10050 raft_consensus.cc:2804] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:17.046667 10050 raft_consensus.cc:493] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.047049 10050 raft_consensus.cc:3060] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:17.046984 10056 raft_consensus.cc:515] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:17.060340 10056 leader_election.cc:290] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 4 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
W20260709 13:02:17.061499  9044 leader_election.cc:336] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.062976  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393fbe653f874c5fb76f1464a9641a6c" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:17.063532  9074 raft_consensus.cc:3060] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:17.063583 10050 raft_consensus.cc:515] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:17.065990 10050 leader_election.cc:290] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:17.070411  9074 raft_consensus.cc:2468] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 4.
I20260709 13:02:17.078929  8968 leader_election.cc:304] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:17.079739 10056 raft_consensus.cc:2804] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:17.079844  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e69234154ae46418e61ba3eb8a89c2a" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:17.080272 10056 raft_consensus.cc:697] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 4 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:02:17.080476  9150 raft_consensus.cc:3060] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:17.081175 10056 consensus_queue.cc:237] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:17.082003 10044 raft_consensus.cc:493] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.082581 10044 raft_consensus.cc:515] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:17.087275 10044 leader_election.cc:290] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:02:17.087442  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a489378335c74a0fb5932be1e308fc64" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
W20260709 13:02:17.088214  9044 leader_election.cc:336] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.089552  9150 raft_consensus.cc:2468] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 3.
W20260709 13:02:17.093684  9118 leader_election.cc:336] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.094209  9118 leader_election.cc:304] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
W20260709 13:02:17.094978  8970 leader_election.cc:336] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.095598 10044 raft_consensus.cc:2749] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:17.098739  9044 leader_election.cc:304] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:17.099541 10057 raft_consensus.cc:2804] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:17.099989 10057 raft_consensus.cc:697] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 3 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:02:17.100859 10057 consensus_queue.cc:237] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:17.107487  8825 catalog_manager.cc:5697] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 3 to 4, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:17.111882  8827 catalog_manager.cc:5697] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 2 to 3, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:17.165645 10056 raft_consensus.cc:493] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.166200 10056 raft_consensus.cc:515] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:17.168033 10056 leader_election.cc:290] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:17.168638  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a489378335c74a0fb5932be1e308fc64" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:02:17.169343  9150 raft_consensus.cc:2468] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 2.
I20260709 13:02:17.170380  8970 leader_election.cc:304] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:17.171005 10056 raft_consensus.cc:2804] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:17.171373 10056 raft_consensus.cc:493] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.171834 10056 raft_consensus.cc:3060] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:17.172391  8970 leader_election.cc:336] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.177498 10056 raft_consensus.cc:515] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:17.179255 10056 leader_election.cc:290] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:17.180320  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a489378335c74a0fb5932be1e308fc64" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:17.180928  9150 raft_consensus.cc:3060] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:17.183035  8970 leader_election.cc:336] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.186133  9150 raft_consensus.cc:2468] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 3.
I20260709 13:02:17.187078  8970 leader_election.cc:304] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:17.187693 10056 raft_consensus.cc:2804] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:17.188143 10056 raft_consensus.cc:697] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 3 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:02:17.188835 10056 consensus_queue.cc:237] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:17.190380 10041 raft_consensus.cc:493] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.190867 10041 raft_consensus.cc:515] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:17.193058 10041 leader_election.cc:290] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:02:17.194546  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
W20260709 13:02:17.196662  8970 leader_election.cc:336] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.197062  8970 leader_election.cc:304] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:17.197768 10041 raft_consensus.cc:2749] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:17.200592  8827 catalog_manager.cc:5697] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 2 to 3, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:17.259959 10000 raft_consensus.cc:493] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.260457 10000 raft_consensus.cc:515] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:17.262359 10000 leader_election.cc:290] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:02:17.263489  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:02:17.264173  9003 raft_consensus.cc:2468] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 3.
I20260709 13:02:17.265228  9043 leader_election.cc:304] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
W20260709 13:02:17.265969  9044 leader_election.cc:336] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.266124 10000 raft_consensus.cc:2804] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:17.266637 10000 raft_consensus.cc:493] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.266930 10000 raft_consensus.cc:3060] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:17.272554 10000 raft_consensus.cc:515] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:17.274178 10000 leader_election.cc:290] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:02:17.275206  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c00dbf47fd4608bc730f65286bd4a2" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:17.275800  9003 raft_consensus.cc:3060] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:17.278795  9044 leader_election.cc:336] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.280763  9003 raft_consensus.cc:2468] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 4.
I20260709 13:02:17.281679  9043 leader_election.cc:304] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:17.282331 10000 raft_consensus.cc:2804] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:17.282723 10000 raft_consensus.cc:697] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 4 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:02:17.283416 10000 consensus_queue.cc:237] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:17.292802  8827 catalog_manager.cc:5697] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 3 to 4, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:17.444738  9833 debug-util.cc:398] Leaking SignalData structure 0x7b08002baee0 after lost signal to thread 434
W20260709 13:02:17.445644  9833 debug-util.cc:398] Leaking SignalData structure 0x7b08001318a0 after lost signal to thread 8862
W20260709 13:02:17.446662  9833 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf440 after lost signal to thread 9029
W20260709 13:02:17.447638  9833 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4860 after lost signal to thread 9103
W20260709 13:02:17.448575  9833 debug-util.cc:398] Leaking SignalData structure 0x7b080012dc20 after lost signal to thread 9177
I20260709 13:02:17.513803  9072 raft_consensus.cc:1275] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Refusing update from remote peer f3ac81bf7b994af084e9929fac14de34: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:17.515097 10056 consensus_queue.cc:1048] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:17.532876  8970 consensus_peers.cc:597] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:17.632232  9044 consensus_peers.cc:597] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:17.663156  9150 raft_consensus.cc:1275] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Refusing update from remote peer 0717530c054a42c5aa7aca788ba070a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:17.664402 10000 consensus_queue.cc:1048] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:17.729331  8970 consensus_peers.cc:597] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:17.733355  9044 consensus_peers.cc:597] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:17.760217  9150 raft_consensus.cc:1275] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Refusing update from remote peer f3ac81bf7b994af084e9929fac14de34: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:17.761384 10045 consensus_queue.cc:1048] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:17.779376   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 9833)
I20260709 13:02:17.854516 10000 raft_consensus.cc:493] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.855104 10000 raft_consensus.cc:515] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:17.857064 10000 leader_election.cc:290] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:17.857771  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:02:17.859707 10000 raft_consensus.cc:493] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.860376 10000 raft_consensus.cc:515] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:17.863065 10000 leader_election.cc:290] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:17.865257  9003 raft_consensus.cc:1275] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Refusing update from remote peer 0717530c054a42c5aa7aca788ba070a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:17.868956 10057 consensus_queue.cc:1048] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:17.873348  9044 leader_election.cc:336] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.873845  9044 leader_election.cc:304] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:02:17.876775 10057 raft_consensus.cc:2749] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:02:17.879763  9044 leader_election.cc:336] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.873363  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae45916fe794471981c2ddff2693264" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:02:17.886615  9044 leader_election.cc:304] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:17.887328 10057 raft_consensus.cc:2749] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:17.948184 10058 raft_consensus.cc:493] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.948652 10058 raft_consensus.cc:515] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:17.950507 10058 leader_election.cc:290] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:02:17.951649  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d928cb8bbc1d4ab980a52299b33396b2" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
W20260709 13:02:17.954423  9044 leader_election.cc:336] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.955008  9044 leader_election.cc:304] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:02:17.956017 10058 raft_consensus.cc:2749] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:17.961021 10041 raft_consensus.cc:493] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.961593 10041 raft_consensus.cc:515] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:17.963215 10056 raft_consensus.cc:493] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.963702 10041 leader_election.cc:290] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:02:17.963829 10056 raft_consensus.cc:515] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:17.966171 10056 leader_election.cc:290] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:17.966322  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d928cb8bbc1d4ab980a52299b33396b2" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:02:17.966990  9071 raft_consensus.cc:2468] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 2.
I20260709 13:02:17.968004  8968 leader_election.cc:304] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:17.968885 10045 raft_consensus.cc:2804] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:17.969255 10045 raft_consensus.cc:493] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.969645 10045 raft_consensus.cc:3060] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:17.971441  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:02:17.978307 10045 raft_consensus.cc:515] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:17.978583 10052 raft_consensus.cc:493] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.978498 10011 raft_consensus.cc:493] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.979411 10057 raft_consensus.cc:493] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.979696 10011 raft_consensus.cc:515] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:17.980048 10057 raft_consensus.cc:515] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:17.981732 10057 leader_election.cc:290] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:17.981971 10011 leader_election.cc:290] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:17.982604  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:02:17.983219  9150 raft_consensus.cc:2468] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 3.
I20260709 13:02:17.979465 10052 raft_consensus.cc:515] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:17.977567 10044 raft_consensus.cc:493] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.986239 10052 leader_election.cc:290] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:17.986729  9044 leader_election.cc:304] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:02:17.986392 10044 raft_consensus.cc:515] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:17.988025  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:02:17.988636  9071 raft_consensus.cc:2468] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 3.
I20260709 13:02:17.988940 10000 raft_consensus.cc:493] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.989526 10000 raft_consensus.cc:515] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:17.989537  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa3bccd3d02438e863f3fce74229335" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:02:17.991143  9072 raft_consensus.cc:2468] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
W20260709 13:02:17.992986  9118 leader_election.cc:336] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.993767 10000 leader_election.cc:290] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:17.994993 10000 raft_consensus.cc:493] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:17.995550 10000 raft_consensus.cc:515] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
W20260709 13:02:17.996615  9118 leader_election.cc:336] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:17.997699 10000 leader_election.cc:290] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:17.999117 10044 leader_election.cc:290] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.000185 10057 raft_consensus.cc:2804] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:18.005237 10057 raft_consensus.cc:493] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.005854 10057 raft_consensus.cc:3060] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:18.006709 10000 raft_consensus.cc:493] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.007246 10000 raft_consensus.cc:515] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.009114 10000 leader_election.cc:290] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.012809 10052 raft_consensus.cc:493] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.013525 10011 raft_consensus.cc:493] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.013402 10052 raft_consensus.cc:515] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:18.014127 10011 raft_consensus.cc:515] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.015671 10052 leader_election.cc:290] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
W20260709 13:02:18.014693  8970 leader_election.cc:336] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.016355 10011 leader_election.cc:290] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.016587  9116 leader_election.cc:304] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
W20260709 13:02:18.017524  8970 leader_election.cc:336] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.024968  8970 leader_election.cc:304] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.019951  9116 leader_election.cc:304] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.020040  9150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72207701f3449e696f990856f3d7a94" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:02:18.025995 10044 raft_consensus.cc:493] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.026645 10041 raft_consensus.cc:2749] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:18.023020 10045 leader_election.cc:290] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:02:18.026649 10044 raft_consensus.cc:515] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
W20260709 13:02:18.030668  9044 leader_election.cc:336] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.013108 10080 raft_consensus.cc:493] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.024158 10057 raft_consensus.cc:515] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.025626  9153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa3bccd3d02438e863f3fce74229335" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:02:18.018381 10052 raft_consensus.cc:2804] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:18.022598  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69981197f2a5423a8758576940d1bf76" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:02:18.017899 10011 raft_consensus.cc:493] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.032369  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d928cb8bbc1d4ab980a52299b33396b2" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:18.032663  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "173098da7c34450aa6f93bcafd377922" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:02:18.038877  9072 raft_consensus.cc:3060] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:18.032956  9074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae45916fe794471981c2ddff2693264" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:02:18.040370  9074 raft_consensus.cc:2468] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 3.
I20260709 13:02:18.043634 10057 leader_election.cc:290] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
W20260709 13:02:18.035842  9118 leader_election.cc:336] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.037110  9153 raft_consensus.cc:2468] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 2.
I20260709 13:02:18.037716 10052 raft_consensus.cc:493] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.048111  9072 raft_consensus.cc:2468] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 3.
W20260709 13:02:18.059139  8970 leader_election.cc:336] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.053855  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:18.047657 10045 raft_consensus.cc:493] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.048207 10041 raft_consensus.cc:493] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.049852  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:02:18.066082 10045 raft_consensus.cc:515] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:18.066838  9002 raft_consensus.cc:2468] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 3.
I20260709 13:02:18.067477  9116 leader_election.cc:304] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.066342 10041 raft_consensus.cc:515] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:18.068306 10084 raft_consensus.cc:2749] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:18.068384  9117 leader_election.cc:304] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:18.036183 10080 raft_consensus.cc:515] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.069420 10082 raft_consensus.cc:2804] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:18.069994  9152 raft_consensus.cc:2468] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 2.
I20260709 13:02:18.070706 10041 leader_election.cc:290] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
I20260709 13:02:18.071230 10080 leader_election.cc:290] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.049607  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:02:18.072346  9003 raft_consensus.cc:2468] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
I20260709 13:02:18.031875 10044 leader_election.cc:290] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.073586 10045 leader_election.cc:290] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.074255 10084 raft_consensus.cc:2804] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:18.074666 10084 raft_consensus.cc:493] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.075016 10084 raft_consensus.cc:3060] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:18.068706  9116 leader_election.cc:304] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:02:18.038031 10011 raft_consensus.cc:515] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.082836  9150 raft_consensus.cc:2468] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 2.
I20260709 13:02:18.084079 10011 leader_election.cc:290] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.084715 10011 raft_consensus.cc:2804] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:18.084926  9117 leader_election.cc:304] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:18.086350 10082 raft_consensus.cc:493] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
W20260709 13:02:18.086694  8970 leader_election.cc:336] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.087201 10052 raft_consensus.cc:3060] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:18.087296  8970 leader_election.cc:336] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.086826 10082 raft_consensus.cc:3060] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:18.087707  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:02:18.088433  9152 raft_consensus.cc:2468] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 2.
I20260709 13:02:18.090233 10083 raft_consensus.cc:2804] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:18.090613 10083 raft_consensus.cc:493] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.090965 10083 raft_consensus.cc:3060] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:18.092880  9118 leader_election.cc:336] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
W20260709 13:02:18.093698  9118 leader_election.cc:336] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.094307 10084 raft_consensus.cc:515] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.095930 10082 raft_consensus.cc:515] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.097666  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3364bac8978243bcb6d068941312d443" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:18.098330  9002 raft_consensus.cc:3060] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:18.101019  8970 leader_election.cc:304] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.102177 10045 raft_consensus.cc:2804] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:18.102547 10045 raft_consensus.cc:493] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.102905 10045 raft_consensus.cc:3060] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:18.107128 10082 leader_election.cc:290] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.085114 10011 raft_consensus.cc:493] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
W20260709 13:02:18.109570  9044 leader_election.cc:336] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
W20260709 13:02:18.110134  9044 leader_election.cc:336] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
W20260709 13:02:18.110376  9118 leader_election.cc:336] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
W20260709 13:02:18.110566  9044 leader_election.cc:336] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
W20260709 13:02:18.111200  9118 leader_election.cc:336] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.111819  9002 raft_consensus.cc:2468] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 4.
I20260709 13:02:18.112317 10052 raft_consensus.cc:515] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.112933 10045 raft_consensus.cc:515] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:18.114711 10052 leader_election.cc:290] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.108265 10011 raft_consensus.cc:3060] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:18.118187  9118 leader_election.cc:336] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.119213  9148 raft_consensus.cc:2393] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0717530c054a42c5aa7aca788ba070a5 in current term 4: Already voted for candidate 069063a72de443729cdfb3fcbfa6a123 in this term.
I20260709 13:02:18.119736 10084 leader_election.cc:290] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: Requested vote from peers f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
W20260709 13:02:18.124845  8970 leader_election.cc:336] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.125957 10045 leader_election.cc:290] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.128939 10011 raft_consensus.cc:515] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.131093 10011 leader_election.cc:290] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.126644  9117 leader_election.cc:304] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 
I20260709 13:02:18.134104 10083 raft_consensus.cc:515] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:18.135231 10080 raft_consensus.cc:2804] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:18.135702 10080 raft_consensus.cc:697] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 4 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:18.137323  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72207701f3449e696f990856f3d7a94" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:02:18.138033  9076 raft_consensus.cc:2468] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
I20260709 13:02:18.138351  9071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69981197f2a5423a8758576940d1bf76" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:02:18.138888  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:18.139029  9071 raft_consensus.cc:2468] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 2.
I20260709 13:02:18.139228  9075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aa3bccd3d02438e863f3fce74229335" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:18.139724  9073 raft_consensus.cc:2393] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 069063a72de443729cdfb3fcbfa6a123 in current term 4: Already voted for candidate 0717530c054a42c5aa7aca788ba070a5 in this term.
I20260709 13:02:18.139977  9075 raft_consensus.cc:3060] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:18.141058  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae45916fe794471981c2ddff2693264" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:18.141420 10081 raft_consensus.cc:493] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.141713  9073 raft_consensus.cc:3060] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:18.141973 10081 raft_consensus.cc:515] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.144080 10081 leader_election.cc:290] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.144877 10080 consensus_queue.cc:237] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.152426  9075 raft_consensus.cc:2468] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 3.
W20260709 13:02:18.153380  9118 leader_election.cc:336] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.156635  9002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:18.157436  9002 raft_consensus.cc:2393] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 069063a72de443729cdfb3fcbfa6a123 in current term 3: Already voted for candidate f3ac81bf7b994af084e9929fac14de34 in this term.
W20260709 13:02:18.161790  8970 consensus_peers.cc:597] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:18.156662 10083 leader_election.cc:290] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:02:18.165875  9073 raft_consensus.cc:2468] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 4.
I20260709 13:02:18.169126  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:18.169945  9148 raft_consensus.cc:2393] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f3ac81bf7b994af084e9929fac14de34 in current term 3: Already voted for candidate 069063a72de443729cdfb3fcbfa6a123 in this term.
I20260709 13:02:18.173542  8825 catalog_manager.cc:5697] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 3 to 4, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.175416  8970 leader_election.cc:304] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3ac81bf7b994af084e9929fac14de34; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.177160 10041 raft_consensus.cc:2749] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:18.177980  9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:02:18.178663  9072 raft_consensus.cc:2468] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 2.
W20260709 13:02:18.181980  9118 leader_election.cc:336] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
W20260709 13:02:18.185773  9118 leader_election.cc:336] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.187058  9044 leader_election.cc:304] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.187916 10081 raft_consensus.cc:2764] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:02:18.189091  9044 leader_election.cc:304] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.189956 10081 raft_consensus.cc:2804] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:18.190482 10081 raft_consensus.cc:493] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.190969 10081 raft_consensus.cc:3060] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:18.192526  9044 leader_election.cc:304] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.193681 10057 raft_consensus.cc:2804] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:18.194191 10057 raft_consensus.cc:493] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.194669 10057 raft_consensus.cc:3060] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:18.190397  9118 leader_election.cc:336] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
W20260709 13:02:18.198598  9118 leader_election.cc:336] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.199002  9118 leader_election.cc:304] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 4667e9699c4d413889fc866e0e560d1f, f3ac81bf7b994af084e9929fac14de34
I20260709 13:02:18.199734 10052 raft_consensus.cc:2749] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:18.199317 10081 raft_consensus.cc:515] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.205073  8968 leader_election.cc:304] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.206202 10045 raft_consensus.cc:2804] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:18.206736 10081 leader_election.cc:290] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.206696 10045 raft_consensus.cc:697] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 3 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
I20260709 13:02:18.208026 10045 consensus_queue.cc:237] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:18.208480 10057 raft_consensus.cc:515] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.211393 10057 leader_election.cc:290] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.220003  9116 leader_election.cc:304] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.220953 10052 raft_consensus.cc:2804] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:18.221347  9116 leader_election.cc:304] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.222638  9116 leader_election.cc:304] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.221351 10052 raft_consensus.cc:493] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.223920 10084 raft_consensus.cc:2804] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:18.224272 10052 raft_consensus.cc:3060] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:18.224442 10084 raft_consensus.cc:493] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.224970 10084 raft_consensus.cc:3060] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:18.227358  8825 catalog_manager.cc:5697] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 2 to 3, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.228684 10080 raft_consensus.cc:2749] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:18.221377  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "173098da7c34450aa6f93bcafd377922" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:02:18.230348  9148 raft_consensus.cc:2468] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 2.
I20260709 13:02:18.231688 10052 raft_consensus.cc:515] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.233830 10052 leader_election.cc:290] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.234910  8968 leader_election.cc:304] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.235948 10045 raft_consensus.cc:2804] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:18.236316 10045 raft_consensus.cc:493] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.236685 10045 raft_consensus.cc:3060] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:18.239645  9118 leader_election.cc:336] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.240597  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69981197f2a5423a8758576940d1bf76" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:18.244474  9152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72207701f3449e696f990856f3d7a94" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:18.245263  9152 raft_consensus.cc:2393] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0717530c054a42c5aa7aca788ba070a5 in current term 3: Already voted for candidate 069063a72de443729cdfb3fcbfa6a123 in this term.
I20260709 13:02:18.248641  9116 leader_election.cc:304] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.249799  9116 leader_election.cc:304] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.249886 10083 raft_consensus.cc:2804] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:18.250468 10083 raft_consensus.cc:697] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 3 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:18.250842 10044 raft_consensus.cc:2804] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:02:18.251626  9044 leader_election.cc:336] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.251328 10083 consensus_queue.cc:237] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.252097  9044 leader_election.cc:304] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.252816 10081 raft_consensus.cc:2749] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:18.251370 10044 raft_consensus.cc:697] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 4 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:18.255039 10044 consensus_queue.cc:237] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.256901 10045 raft_consensus.cc:515] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:18.261577 10045 leader_election.cc:290] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841)
W20260709 13:02:18.263664  8970 leader_election.cc:336] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.262025  9044 leader_election.cc:304] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:02:18.265180 10081 raft_consensus.cc:2804] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:18.265558 10081 raft_consensus.cc:493] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4667e9699c4d413889fc866e0e560d1f)
I20260709 13:02:18.265960 10081 raft_consensus.cc:3060] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:18.269459 10084 raft_consensus.cc:515] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.271235  9148 raft_consensus.cc:2393] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0717530c054a42c5aa7aca788ba070a5 in current term 3: Already voted for candidate 069063a72de443729cdfb3fcbfa6a123 in this term.
W20260709 13:02:18.275527  8970 consensus_peers.cc:597] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:18.287951 10081 raft_consensus.cc:515] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
W20260709 13:02:18.288916  9118 leader_election.cc:336] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.290011 10084 leader_election.cc:290] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:18.290369 10081 leader_election.cc:290] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
W20260709 13:02:18.294888  9044 leader_election.cc:336] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
W20260709 13:02:18.295902  9044 leader_election.cc:336] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.296252  9044 leader_election.cc:304] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
W20260709 13:02:18.297072  9044 leader_election.cc:336] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.297452  9044 leader_election.cc:304] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5; no voters: 069063a72de443729cdfb3fcbfa6a123, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.298095 10057 raft_consensus.cc:2749] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:18.298794 10057 raft_consensus.cc:2749] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:18.300283  9075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a98baac484a1c96cdafe7f0ba43f4" candidate_uuid: "f3ac81bf7b994af084e9929fac14de34" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:18.300872  9075 raft_consensus.cc:3060] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:18.301139  9073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72207701f3449e696f990856f3d7a94" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:18.301928  9073 raft_consensus.cc:2393] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 069063a72de443729cdfb3fcbfa6a123 in current term 3: Already voted for candidate 0717530c054a42c5aa7aca788ba070a5 in this term.
I20260709 13:02:18.302384  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "173098da7c34450aa6f93bcafd377922" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:18.302991  9148 raft_consensus.cc:3060] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:18.307960  9076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69981197f2a5423a8758576940d1bf76" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:18.308756  9076 raft_consensus.cc:2393] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 069063a72de443729cdfb3fcbfa6a123 in current term 3: Already voted for candidate 0717530c054a42c5aa7aca788ba070a5 in this term.
I20260709 13:02:18.310952  9148 raft_consensus.cc:2468] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 3.
I20260709 13:02:18.313927  9044 leader_election.cc:304] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:02:18.314749 10057 raft_consensus.cc:2804] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:18.315327 10057 raft_consensus.cc:697] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 3 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:02:18.314546  8825 catalog_manager.cc:5697] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 2 to 3, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.316139 10057 consensus_queue.cc:237] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:18.320199  9075 raft_consensus.cc:2468] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3ac81bf7b994af084e9929fac14de34 in term 3.
I20260709 13:02:18.322747  9116 leader_election.cc:304] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.323680 10083 raft_consensus.cc:2749] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:18.325224  9116 leader_election.cc:304] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123; no voters: 0717530c054a42c5aa7aca788ba070a5, 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.325989 10044 raft_consensus.cc:2749] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:18.327868  8968 leader_election.cc:304] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0717530c054a42c5aa7aca788ba070a5, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:18.328627 10045 raft_consensus.cc:2804] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:18.329341 10045 raft_consensus.cc:697] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 3 LEADER]: Becoming Leader. State: Replica: f3ac81bf7b994af084e9929fac14de34, State: Running, Role: LEADER
W20260709 13:02:18.331238  9044 leader_election.cc:336] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:18.330251 10045 consensus_queue.cc:237] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } }
I20260709 13:02:18.331482  8827 catalog_manager.cc:5697] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 2 to 3, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.346554  8824 catalog_manager.cc:5697] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 reported cstate change: term changed from 2 to 3, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to f3ac81bf7b994af084e9929fac14de34 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "f3ac81bf7b994af084e9929fac14de34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.355720  8827 catalog_manager.cc:5697] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 3 to 4, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:18.443760  9118 consensus_peers.cc:597] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.587634  9044 consensus_peers.cc:597] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.605912  9044 consensus_peers.cc:597] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.630574  9044 consensus_peers.cc:597] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.656145  8970 consensus_peers.cc:597] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.694624  9118 consensus_peers.cc:597] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:18.695130  9118 consensus_peers.cc:597] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:18.696506  8970 consensus_peers.cc:597] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:18.702395  9002 raft_consensus.cc:1275] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:18.704056 10044 consensus_queue.cc:1048] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:18.743985  9148 raft_consensus.cc:1275] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Refusing update from remote peer 0717530c054a42c5aa7aca788ba070a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:18.745353 10057 consensus_queue.cc:1048] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:18.770238  9118 consensus_peers.cc:597] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.780009   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 9833)
W20260709 13:02:18.800866  9044 consensus_peers.cc:597] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:18.802847  9075 raft_consensus.cc:1275] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Refusing update from remote peer f3ac81bf7b994af084e9929fac14de34: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:02:18.804570  9044 consensus_peers.cc:597] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:18.804958 10045 consensus_queue.cc:1048] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:18.827065  8970 consensus_peers.cc:597] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.827561  8970 consensus_peers.cc:597] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.837080  9044 consensus_peers.cc:597] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:18.837642  9075 raft_consensus.cc:1275] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:18.840622 10044 consensus_queue.cc:1048] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:18.840857  9044 consensus_peers.cc:597] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.844723  8970 consensus_peers.cc:597] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.845302  8970 consensus_peers.cc:597] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:18.851356  9118 consensus_peers.cc:597] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.880185  9118 consensus_peers.cc:597] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:18.881491  9075 raft_consensus.cc:1275] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:18.882652 10044 consensus_queue.cc:1048] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:18.909986  9044 consensus_peers.cc:597] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.924342  8970 consensus_peers.cc:597] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:18.936049  9075 raft_consensus.cc:1275] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Refusing update from remote peer f3ac81bf7b994af084e9929fac14de34: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:18.937532 10100 consensus_queue.cc:1048] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:18.964864  8970 consensus_peers.cc:597] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.972790  9044 consensus_peers.cc:597] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.973416  9044 consensus_peers.cc:597] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.974299  9118 consensus_peers.cc:597] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:18.994771  9044 consensus_peers.cc:597] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:19.035483  8970 consensus_peers.cc:597] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:19.049805  9044 consensus_peers.cc:597] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:19.062328  9118 consensus_peers.cc:597] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:19.123449  8970 consensus_peers.cc:597] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:19.158042  9118 consensus_peers.cc:597] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:19.161413  8970 consensus_peers.cc:597] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:19.274252  9044 consensus_peers.cc:597] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:19.283615  8970 consensus_peers.cc:597] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:19.288311  9044 consensus_peers.cc:597] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:19.780509   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 9833)
I20260709 13:02:19.915623 10083 raft_consensus.cc:493] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.916138 10083 raft_consensus.cc:515] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:19.917938 10083 leader_election.cc:290] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:19.918439  9075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69981197f2a5423a8758576940d1bf76" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5" is_pre_election: true
I20260709 13:02:19.919168  9075 raft_consensus.cc:2468] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 3.
I20260709 13:02:19.920817  9116 leader_election.cc:304] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
W20260709 13:02:19.921401  9118 leader_election.cc:336] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:19.921566 10083 raft_consensus.cc:2804] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:19.921984 10083 raft_consensus.cc:493] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.922394 10083 raft_consensus.cc:3060] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:19.935247  8970 consensus_peers.cc:597] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:19.942350 10083 raft_consensus.cc:515] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:19.944346 10083 leader_election.cc:290] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: Requested vote from peers 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:19.945451  9075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69981197f2a5423a8758576940d1bf76" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0717530c054a42c5aa7aca788ba070a5"
I20260709 13:02:19.946161  9075 raft_consensus.cc:3060] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:19.962589  9118 leader_election.cc:336] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:19.963760  9075 raft_consensus.cc:2468] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 4.
I20260709 13:02:19.974227 10084 raft_consensus.cc:493] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.974898  9116 leader_election.cc:304] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:19.974987 10084 raft_consensus.cc:515] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:19.977752 10084 leader_election.cc:290] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:02:19.978273 10083 raft_consensus.cc:2804] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:19.986418 10083 raft_consensus.cc:697] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 4 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
W20260709 13:02:19.987237  9118 leader_election.cc:336] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:19.987844 10083 consensus_queue.cc:237] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:19.992249  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34" is_pre_election: true
I20260709 13:02:19.993147  9003 raft_consensus.cc:2468] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 3.
I20260709 13:02:19.994596  9117 leader_election.cc:304] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:19.995492 10083 raft_consensus.cc:2804] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:19.995929 10083 raft_consensus.cc:493] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.996284 10083 raft_consensus.cc:3060] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:20.001616 10083 raft_consensus.cc:515] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:20.003476 10083 leader_election.cc:290] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: Requested vote from peers 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567), f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405)
I20260709 13:02:20.003832  8824 catalog_manager.cc:5697] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 2 to 4, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:20.007287  9003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7047cf3dbc4806aad2882c18cea1f4" candidate_uuid: "069063a72de443729cdfb3fcbfa6a123" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f3ac81bf7b994af084e9929fac14de34"
I20260709 13:02:20.007893  9003 raft_consensus.cc:3060] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:20.009357  9118 leader_election.cc:336] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:20.017678  9003 raft_consensus.cc:2468] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069063a72de443729cdfb3fcbfa6a123 in term 4.
I20260709 13:02:20.018872  9117 leader_election.cc:304] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, f3ac81bf7b994af084e9929fac14de34; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:20.020124 10083 raft_consensus.cc:2804] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:20.020604 10083 raft_consensus.cc:697] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 4 LEADER]: Becoming Leader. State: Replica: 069063a72de443729cdfb3fcbfa6a123, State: Running, Role: LEADER
I20260709 13:02:20.021417 10083 consensus_queue.cc:237] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } }
I20260709 13:02:20.067849  8824 catalog_manager.cc:5697] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 reported cstate change: term changed from 2 to 4, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "069063a72de443729cdfb3fcbfa6a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:20.099313  8970 consensus_peers.cc:597] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:20.113387 10000 raft_consensus.cc:493] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.113853 10000 raft_consensus.cc:515] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:20.115394 10000 leader_election.cc:290] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:20.116230  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72207701f3449e696f990856f3d7a94" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:02:20.116883  9148 raft_consensus.cc:2468] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 3.
I20260709 13:02:20.118155  9044 leader_election.cc:304] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:02:20.118757 10000 raft_consensus.cc:2804] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:20.119129 10000 raft_consensus.cc:493] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.119473 10000 raft_consensus.cc:3060] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:20.121639  9044 leader_election.cc:336] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:20.125458 10000 raft_consensus.cc:515] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:20.127128 10000 leader_election.cc:290] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:20.127840  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72207701f3449e696f990856f3d7a94" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:20.128469  9148 raft_consensus.cc:3060] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:20.131690  9044 leader_election.cc:336] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:20.136727  9148 raft_consensus.cc:2468] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 4.
I20260709 13:02:20.137905  9044 leader_election.cc:304] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:20.138652 10000 raft_consensus.cc:2804] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:20.139122 10000 raft_consensus.cc:697] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 4 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:02:20.139827 10000 consensus_queue.cc:237] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:20.150808  8824 catalog_manager.cc:5697] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 2 to 4, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:20.168762  9044 consensus_peers.cc:597] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:20.214001 10113 raft_consensus.cc:493] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.214706 10113 raft_consensus.cc:515] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:20.217028 10113 leader_election.cc:290] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:20.217667  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123" is_pre_election: true
I20260709 13:02:20.218314  9148 raft_consensus.cc:2468] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 4.
I20260709 13:02:20.219298  9044 leader_election.cc:304] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 
I20260709 13:02:20.220184 10113 raft_consensus.cc:2804] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:20.220726 10113 raft_consensus.cc:493] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.222900 10113 raft_consensus.cc:3060] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:20.224090  9044 leader_election.cc:336] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
I20260709 13:02:20.232996 10113 raft_consensus.cc:515] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:20.235617  9148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1fc193b3ad439ab1c05519323d3302" candidate_uuid: "0717530c054a42c5aa7aca788ba070a5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "069063a72de443729cdfb3fcbfa6a123"
I20260709 13:02:20.235502 10113 leader_election.cc:290] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 5 election: Requested vote from peers 069063a72de443729cdfb3fcbfa6a123 (127.0.107.196:38603), 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567)
I20260709 13:02:20.236297  9148 raft_consensus.cc:3060] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:20.241806  9044 leader_election.cc:336] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111)
W20260709 13:02:20.242642  9044 consensus_peers.cc:597] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:20.246833  9148 raft_consensus.cc:2468] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0717530c054a42c5aa7aca788ba070a5 in term 5.
I20260709 13:02:20.247928  9044 leader_election.cc:304] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069063a72de443729cdfb3fcbfa6a123, 0717530c054a42c5aa7aca788ba070a5; no voters: 4667e9699c4d413889fc866e0e560d1f
I20260709 13:02:20.248628 10000 raft_consensus.cc:2804] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:20.249104 10000 raft_consensus.cc:697] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 5 LEADER]: Becoming Leader. State: Replica: 0717530c054a42c5aa7aca788ba070a5, State: Running, Role: LEADER
I20260709 13:02:20.249888 10000 consensus_queue.cc:237] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } }
I20260709 13:02:20.259641  8824 catalog_manager.cc:5697] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 reported cstate change: term changed from 3 to 5, leader changed from 4667e9699c4d413889fc866e0e560d1f (127.0.107.193) to 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "0717530c054a42c5aa7aca788ba070a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4667e9699c4d413889fc866e0e560d1f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:20.418955  9075 raft_consensus.cc:1275] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:20.420188 10105 consensus_queue.cc:1048] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0717530c054a42c5aa7aca788ba070a5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:20.456864  9118 consensus_peers.cc:597] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:20.486896  8970 consensus_peers.cc:597] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:20.643313  9118 consensus_peers.cc:597] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.646955  9002 raft_consensus.cc:1275] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Refusing update from remote peer 069063a72de443729cdfb3fcbfa6a123: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:20.648214 10084 consensus_queue.cc:1048] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ac81bf7b994af084e9929fac14de34" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:20.685871  9150 raft_consensus.cc:1275] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Refusing update from remote peer 0717530c054a42c5aa7aca788ba070a5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:20.687216 10000 consensus_queue.cc:1048] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:20.703516  9044 consensus_peers.cc:597] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:20.781045   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 9833)
I20260709 13:02:20.813093  9150 raft_consensus.cc:1275] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 5 FOLLOWER]: Refusing update from remote peer 0717530c054a42c5aa7aca788ba070a5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:20.814517 10081 consensus_queue.cc:1048] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069063a72de443729cdfb3fcbfa6a123" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:20.827708  9044 consensus_peers.cc:597] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:20.851219  9118 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111) [suppressed 403 similar messages]
W20260709 13:02:20.879550  8970 consensus_peers.cc:597] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:20.965538  8970 consensus_peers.cc:597] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:20.987542  9118 consensus_peers.cc:597] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:21.016634  9044 consensus_peers.cc:597] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.081024  9118 consensus_peers.cc:597] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.217815  9044 consensus_peers.cc:597] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.234951  9118 consensus_peers.cc:597] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:21.287665  9118 consensus_peers.cc:597] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.296773  8970 consensus_peers.cc:597] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:21.301218  9044 consensus_peers.cc:597] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.311234  9118 consensus_peers.cc:597] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.312248  8970 consensus_peers.cc:597] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.326122  9044 consensus_peers.cc:597] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.341483  9118 consensus_peers.cc:597] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.352170  9044 consensus_peers.cc:597] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.360698  8970 consensus_peers.cc:597] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.363997  8970 consensus_peers.cc:597] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.375675  9044 consensus_peers.cc:597] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.375660  9118 consensus_peers.cc:597] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.446631  9118 consensus_peers.cc:597] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.465873  9044 consensus_peers.cc:597] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:21.466431  9044 consensus_peers.cc:597] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.502152  8970 consensus_peers.cc:597] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:21.504138  8970 consensus_peers.cc:597] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.543111  9044 consensus_peers.cc:597] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.553172  9044 consensus_peers.cc:597] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.556885  9044 consensus_peers.cc:597] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.569447  8970 consensus_peers.cc:597] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.582594  9118 consensus_peers.cc:597] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:21.608961  8970 consensus_peers.cc:597] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.650722  8970 consensus_peers.cc:597] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.706187  9044 consensus_peers.cc:597] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.712733  8970 consensus_peers.cc:597] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.724213  9044 consensus_peers.cc:597] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.781646   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 9833)
W20260709 13:02:21.782580  9044 consensus_peers.cc:597] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:21.787866  8970 consensus_peers.cc:597] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:22.180670   431 tablet_server.cc:196] TabletServer@127.0.107.193:41567 shutdown complete.
I20260709 13:02:22.317597   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:02:22.331357  9117 consensus_peers.cc:597] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:22.334352  9043 consensus_peers.cc:597] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:22.342155  9043 consensus_peers.cc:597] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.371582   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:22.372572   431 tablet_replica.cc:333] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.373734   431 raft_consensus.cc:2243] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.374912   431 raft_consensus.cc:2272] T a8af72e77c964acd910c3ec90fe52078 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.378126   431 tablet_replica.cc:333] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.379130   431 raft_consensus.cc:2243] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.379746   431 raft_consensus.cc:2272] T 36c7c3cea0934ff59d24774835ed3e79 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:22.380504  9117 consensus_peers.cc:597] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.382500   431 tablet_replica.cc:333] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.383603   431 raft_consensus.cc:2243] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.384179   431 raft_consensus.cc:2272] T 1b42ffd5f054411aba877e8c374e5c15 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.387379   431 tablet_replica.cc:333] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.388262   431 raft_consensus.cc:2243] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.388836   431 raft_consensus.cc:2272] T 673fe46efdf148bc9fd1720f67d50193 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:22.389158  9043 consensus_peers.cc:597] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:22.390789  9117 consensus_peers.cc:597] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.391582   431 tablet_replica.cc:333] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.392439   431 raft_consensus.cc:2243] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.393034   431 raft_consensus.cc:2272] T a8bc830d85cb40fda2ac909a09c75e07 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.396128   431 tablet_replica.cc:333] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.396943   431 raft_consensus.cc:2243] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.397518   431 raft_consensus.cc:2272] T 68d45c07c5d6485eb2f08f154a9df317 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.399912   431 tablet_replica.cc:333] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.400449   431 raft_consensus.cc:2243] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.400863   431 raft_consensus.cc:2272] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.402954   431 tablet_replica.cc:333] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.403542   431 raft_consensus.cc:2243] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.404368   431 raft_consensus.cc:2272] T a489378335c74a0fb5932be1e308fc64 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.406582   431 tablet_replica.cc:333] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.407099   431 raft_consensus.cc:2243] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.407899   431 raft_consensus.cc:2272] T 2d9762d913154929be832b5508ebad68 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.409883   431 tablet_replica.cc:333] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.410516   431 raft_consensus.cc:2243] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.411048   431 raft_consensus.cc:2272] T 5c744829b78b4069a658ca2a4d2dbb5e P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.413738   431 tablet_replica.cc:333] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.414419   431 raft_consensus.cc:2243] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.414862   431 raft_consensus.cc:2272] T 5916411ff15d473591594797dfb09193 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.417661   431 tablet_replica.cc:333] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.418437   431 raft_consensus.cc:2243] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.419214   431 raft_consensus.cc:2272] T ef292f6bccd14fe2a930cd9e26f10d3b P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.421185   431 tablet_replica.cc:333] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.421716   431 raft_consensus.cc:2243] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.422904   431 raft_consensus.cc:2272] T 5073cf5195c44a18922f4eb358531263 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.425989   431 tablet_replica.cc:333] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.426772   431 raft_consensus.cc:2243] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.427862   431 raft_consensus.cc:2272] T 30dc6dd2b3764d889a6840a0eb8bcb46 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.430464   431 tablet_replica.cc:333] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.431043   431 raft_consensus.cc:2243] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.431572   431 raft_consensus.cc:2272] T 1b6fcb3fac4347a1bd0de44956d459d8 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.433919   431 tablet_replica.cc:333] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.434536   431 raft_consensus.cc:2243] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.435467   431 raft_consensus.cc:2272] T d928cb8bbc1d4ab980a52299b33396b2 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.438262   431 tablet_replica.cc:333] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.438897   431 raft_consensus.cc:2243] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.439731   431 raft_consensus.cc:2272] T a8e1e49fe15e4d22be2c7582c6803d8c P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.441572   431 tablet_replica.cc:333] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.442232   431 raft_consensus.cc:2243] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.442803   431 raft_consensus.cc:2272] T e8ed7e446fa14e71894176ab3ceb8318 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.444801   431 tablet_replica.cc:333] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.445322   431 raft_consensus.cc:2243] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.446170   431 raft_consensus.cc:2272] T 0a44fd9d19a243248566560af21b992e P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.448167   431 tablet_replica.cc:333] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.448712   431 raft_consensus.cc:2243] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.449514   431 raft_consensus.cc:2272] T b6b16540e04e406b8089acc5a6819d14 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.451809   431 tablet_replica.cc:333] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.452414   431 raft_consensus.cc:2243] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.453317   431 raft_consensus.cc:2272] T 992ee582def743e2952b747ca4d9e99f P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.455168   431 tablet_replica.cc:333] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.455705   431 raft_consensus.cc:2243] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.456148   431 raft_consensus.cc:2272] T 55c00dbf47fd4608bc730f65286bd4a2 P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.458750   431 tablet_replica.cc:333] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.459399   431 raft_consensus.cc:2243] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.460420   431 raft_consensus.cc:2272] T 0f5dadd1a4f24668bef129668013d3da P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.462529   431 tablet_replica.cc:333] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.463120   431 raft_consensus.cc:2243] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.463891   431 raft_consensus.cc:2272] T 80e007e79ba94ae88d703e10d65910a9 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.465826   431 tablet_replica.cc:333] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.466607   431 raft_consensus.cc:2243] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.467231   431 raft_consensus.cc:2272] T 0e7047cf3dbc4806aad2882c18cea1f4 P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.469733   431 tablet_replica.cc:333] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.470486   431 raft_consensus.cc:2243] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.470994   431 raft_consensus.cc:2272] T a7ab829c10554275ae1d80198e91fa05 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.473307   431 tablet_replica.cc:333] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.473886   431 raft_consensus.cc:2243] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.475041   431 raft_consensus.cc:2272] T ad5b06a466054767b5daa1085aca6ea5 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.477547   431 tablet_replica.cc:333] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.478391   431 raft_consensus.cc:2243] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.479462   431 raft_consensus.cc:2272] T 51e05e226d044b2eacc27e329f7c96aa P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.482291   431 tablet_replica.cc:333] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.482774   431 raft_consensus.cc:2243] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.483140   431 raft_consensus.cc:2272] T 7dffac6d3a0342be9474526316a71a85 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.485276   431 tablet_replica.cc:333] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.485769   431 raft_consensus.cc:2243] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.486841   431 raft_consensus.cc:2272] T e3121fd08469404b9608676838f187ba P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.489389   431 tablet_replica.cc:333] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.489921   431 raft_consensus.cc:2243] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.490453   431 raft_consensus.cc:2272] T 317ccde7219b44848d0dd04ca340a83f P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.492448   431 tablet_replica.cc:333] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.493019   431 raft_consensus.cc:2243] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.493920   431 raft_consensus.cc:2272] T 393fbe653f874c5fb76f1464a9641a6c P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.496305   431 tablet_replica.cc:333] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.496912   431 raft_consensus.cc:2243] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.497447   431 raft_consensus.cc:2272] T b9a11453401345558e4c1e70b91f288c P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.500113   431 tablet_replica.cc:333] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.500692   431 raft_consensus.cc:2243] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.501101   431 raft_consensus.cc:2272] T 9a12c81f118b4261bdad649a5d121e25 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.503053   431 tablet_replica.cc:333] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.503629   431 raft_consensus.cc:2243] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.504175   431 raft_consensus.cc:2272] T 3364bac8978243bcb6d068941312d443 P f3ac81bf7b994af084e9929fac14de34 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.506843   431 tablet_replica.cc:333] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.507474   431 raft_consensus.cc:2243] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.507872   431 raft_consensus.cc:2272] T 457e71b9614d4212a6d10378b169fe21 P f3ac81bf7b994af084e9929fac14de34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.509783   431 tablet_replica.cc:333] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.510315   431 raft_consensus.cc:2243] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.511169   431 raft_consensus.cc:2272] T eb6a98baac484a1c96cdafe7f0ba43f4 P f3ac81bf7b994af084e9929fac14de34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.513077   431 tablet_replica.cc:333] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.513515   431 raft_consensus.cc:2243] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.514281   431 raft_consensus.cc:2272] T 713d7f8692bf457fb28973349764534b P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.516304   431 tablet_replica.cc:333] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.516829   431 raft_consensus.cc:2243] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.517283   431 raft_consensus.cc:2272] T e576ab3b143d4485a1c98595bfb66af5 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.519415   431 tablet_replica.cc:333] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
W20260709 13:02:22.519372  9043 consensus_peers.cc:597] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.520151   431 raft_consensus.cc:2243] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.520675   431 raft_consensus.cc:2272] T a1348d8ae8e8444fac9cc8f6bebfc852 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.523334   431 tablet_replica.cc:333] T fcf32f9353564e799c94067d0f6b4c5b P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.523792   431 raft_consensus.cc:2243] T fcf32f9353564e799c94067d0f6b4c5b P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.524278   431 raft_consensus.cc:2272] T fcf32f9353564e799c94067d0f6b4c5b P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:22.525118  9117 consensus_peers.cc:597] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.527232   431 tablet_replica.cc:333] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.527959   431 raft_consensus.cc:2243] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.528519   431 raft_consensus.cc:2272] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.531133   431 tablet_replica.cc:333] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.531785   431 raft_consensus.cc:2243] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.532344   431 raft_consensus.cc:2272] T d605f782fc8f426190d3419e627d88be P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.535022   431 tablet_replica.cc:333] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34: stopping tablet replica
I20260709 13:02:22.535595   431 raft_consensus.cc:2243] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.536156   431 raft_consensus.cc:2272] T a5df48aa0fec43379ee059d845b123b4 P f3ac81bf7b994af084e9929fac14de34 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:22.572909  9117 consensus_peers.cc:597] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:22.579440  9117 consensus_peers.cc:597] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:22.594367  9117 consensus_peers.cc:597] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Network error: recv got EOF from 127.0.107.194:45405 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:22.594944   431 connection.cc:466] server connection from 127.0.0.1:58426 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58426 (request call id 997) could send its response
W20260709 13:02:22.599458  9117 consensus_peers.cc:597] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.611889   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:02:22.620385  9117 consensus_peers.cc:597] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:22.640352  9117 consensus_peers.cc:597] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:22.662122  9117 consensus_peers.cc:597] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.688145   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:02:22.698777  9044 consensus_peers.cc:597] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:22.718259  9116 consensus_peers.cc:597] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Couldn't send request to peer 0717530c054a42c5aa7aca788ba070a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:22.719254  9116 consensus_peers.cc:597] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 -> Peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Couldn't send request to peer 0717530c054a42c5aa7aca788ba070a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:22.723754  9117 consensus_peers.cc:597] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:22.738519  9044 consensus_peers.cc:597] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:22.740998   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:22.741873   431 tablet_replica.cc:333] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.742658   431 raft_consensus.cc:2243] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.743191   431 raft_consensus.cc:2272] T a8af72e77c964acd910c3ec90fe52078 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.745641   431 tablet_replica.cc:333] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.746400   431 raft_consensus.cc:2243] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.747471   431 raft_consensus.cc:2272] T 55c00dbf47fd4608bc730f65286bd4a2 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:22.749294  9043 consensus_peers.cc:597] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.750455   431 tablet_replica.cc:333] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.751327   431 raft_consensus.cc:2243] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.751833   431 raft_consensus.cc:2272] T 673fe46efdf148bc9fd1720f67d50193 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.754011   431 tablet_replica.cc:333] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.754652   431 raft_consensus.cc:2243] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.755084   431 raft_consensus.cc:2272] T 36c7c3cea0934ff59d24774835ed3e79 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.756971   431 tablet_replica.cc:333] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.757588   431 raft_consensus.cc:2243] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.758361   431 raft_consensus.cc:2272] T a8bc830d85cb40fda2ac909a09c75e07 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.760694   431 tablet_replica.cc:333] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.761529   431 raft_consensus.cc:2243] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.762658   431 raft_consensus.cc:2272] T 68d45c07c5d6485eb2f08f154a9df317 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.765352   431 tablet_replica.cc:333] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
W20260709 13:02:22.765909  9117 consensus_peers.cc:597] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.766157   431 raft_consensus.cc:2243] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.766861   431 raft_consensus.cc:2272] T 69981197f2a5423a8758576940d1bf76 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.768851   431 tablet_replica.cc:333] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.769629   431 raft_consensus.cc:2243] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.770167   431 raft_consensus.cc:2272] T e8ed7e446fa14e71894176ab3ceb8318 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.773077   431 tablet_replica.cc:333] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
W20260709 13:02:22.773043  9116 consensus_peers.cc:597] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 -> Peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Couldn't send request to peer 0717530c054a42c5aa7aca788ba070a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.773991   431 raft_consensus.cc:2243] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.774849   431 raft_consensus.cc:2272] T 5e69234154ae46418e61ba3eb8a89c2a P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.777202   431 tablet_replica.cc:333] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.777896   431 raft_consensus.cc:2243] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.778860   431 raft_consensus.cc:2272] T b3a7ca8dc8c64156ba3dd859eb2fdf1c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.781414   431 tablet_replica.cc:333] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.782007   431 raft_consensus.cc:2243] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.783064   431 raft_consensus.cc:2272] T 03db717c8e2a41c09a753240a6dbbb02 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.786195   431 tablet_replica.cc:333] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.786999   431 raft_consensus.cc:2243] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.787642   431 raft_consensus.cc:2272] T 2d9762d913154929be832b5508ebad68 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.790565   431 tablet_replica.cc:333] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.791326   431 raft_consensus.cc:2243] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.791864   431 raft_consensus.cc:2272] T 5c744829b78b4069a658ca2a4d2dbb5e P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.794616   431 tablet_replica.cc:333] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
W20260709 13:02:22.795047  9117 consensus_peers.cc:597] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.795207   431 raft_consensus.cc:2243] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.795814   431 raft_consensus.cc:2272] T ef292f6bccd14fe2a930cd9e26f10d3b P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.798892   431 tablet_replica.cc:333] T a5df48aa0fec43379ee059d845b123b4 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.799748   431 raft_consensus.cc:2243] T a5df48aa0fec43379ee059d845b123b4 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.800436   431 raft_consensus.cc:2272] T a5df48aa0fec43379ee059d845b123b4 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.802953   431 tablet_replica.cc:333] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.803490   431 raft_consensus.cc:2243] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.804574   431 raft_consensus.cc:2272] T 37e725e7a33445fb9c78550251c3db98 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:22.804625  9117 consensus_peers.cc:597] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.807001   431 tablet_replica.cc:333] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.807566   431 raft_consensus.cc:2243] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.807962   431 raft_consensus.cc:2272] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.809890   431 tablet_replica.cc:333] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.810505   431 raft_consensus.cc:2243] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.810990   431 raft_consensus.cc:2272] T d928cb8bbc1d4ab980a52299b33396b2 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.812934   431 tablet_replica.cc:333] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.813495   431 raft_consensus.cc:2243] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.813915   431 raft_consensus.cc:2272] T a8e1e49fe15e4d22be2c7582c6803d8c P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.815686   431 tablet_replica.cc:333] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.816262   431 raft_consensus.cc:2243] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.817070   431 raft_consensus.cc:2272] T 173098da7c34450aa6f93bcafd377922 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.818981   431 tablet_replica.cc:333] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.819535   431 raft_consensus.cc:2243] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.820003   431 raft_consensus.cc:2272] T 5916411ff15d473591594797dfb09193 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.822517   431 tablet_replica.cc:333] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.823276   431 raft_consensus.cc:2243] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.824314   431 raft_consensus.cc:2272] T 1401c096fd97413881197bb35d4a55af P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.827009   431 tablet_replica.cc:333] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
W20260709 13:02:22.827001  9117 consensus_peers.cc:597] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 -> Peer f3ac81bf7b994af084e9929fac14de34 (127.0.107.194:45405): Couldn't send request to peer f3ac81bf7b994af084e9929fac14de34. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.828040   431 raft_consensus.cc:2243] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.829577   431 raft_consensus.cc:2272] T 0aa3bccd3d02438e863f3fce74229335 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.831724   431 tablet_replica.cc:333] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.832494   431 raft_consensus.cc:2243] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.832887   431 raft_consensus.cc:2272] T 992ee582def743e2952b747ca4d9e99f P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.834800   431 tablet_replica.cc:333] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.835403   431 raft_consensus.cc:2243] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.835868   431 raft_consensus.cc:2272] T d89a074d6cac458d9de6a79b3bcceade P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.837805   431 tablet_replica.cc:333] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.838446   431 raft_consensus.cc:2243] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.839223   431 raft_consensus.cc:2272] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.841279   431 tablet_replica.cc:333] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.841804   431 raft_consensus.cc:2243] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.842635   431 raft_consensus.cc:2272] T b69e9a34c48e4dbd8f8d3c71a475a7c3 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.844472   431 tablet_replica.cc:333] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.844973   431 raft_consensus.cc:2243] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.845765   431 raft_consensus.cc:2272] T ee1fc193b3ad439ab1c05519323d3302 P 0717530c054a42c5aa7aca788ba070a5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.847651   431 tablet_replica.cc:333] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.848237   431 raft_consensus.cc:2243] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.848981   431 raft_consensus.cc:2272] T d605f782fc8f426190d3419e627d88be P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.851817   431 tablet_replica.cc:333] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.852468   431 raft_consensus.cc:2243] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.853048   431 raft_consensus.cc:2272] T a7ab829c10554275ae1d80198e91fa05 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.855350   431 tablet_replica.cc:333] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.855882   431 raft_consensus.cc:2243] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.856705   431 raft_consensus.cc:2272] T 2ec71963326742b199b954dc1c0bbacb P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.859335   431 tablet_replica.cc:333] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.860049   431 raft_consensus.cc:2243] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 4 LEADER]: Raft consensus shutting down.
W20260709 13:02:22.860913  9116 consensus_peers.cc:597] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Couldn't send request to peer 0717530c054a42c5aa7aca788ba070a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.861116   431 raft_consensus.cc:2272] T b72207701f3449e696f990856f3d7a94 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:22.863525  9116 consensus_peers.cc:597] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Couldn't send request to peer 0717530c054a42c5aa7aca788ba070a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.864151   431 tablet_replica.cc:333] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.865137   431 raft_consensus.cc:2243] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.866221   431 raft_consensus.cc:2272] T 7dffac6d3a0342be9474526316a71a85 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:22.866739  9116 consensus_peers.cc:597] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 -> Peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Couldn't send request to peer 0717530c054a42c5aa7aca788ba070a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.868353   431 tablet_replica.cc:333] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.868956   431 raft_consensus.cc:2243] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.869390   431 raft_consensus.cc:2272] T e3121fd08469404b9608676838f187ba P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.871500   431 tablet_replica.cc:333] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.872184   431 raft_consensus.cc:2243] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.872722   431 raft_consensus.cc:2272] T 5ae45916fe794471981c2ddff2693264 P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.875511   431 tablet_replica.cc:333] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
W20260709 13:02:22.875617  9116 consensus_peers.cc:597] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Couldn't send request to peer 0717530c054a42c5aa7aca788ba070a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.876163   431 raft_consensus.cc:2243] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.876694   431 raft_consensus.cc:2272] T b9a11453401345558e4c1e70b91f288c P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.878777   431 tablet_replica.cc:333] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.879433   431 raft_consensus.cc:2243] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.879964   431 raft_consensus.cc:2272] T 317ccde7219b44848d0dd04ca340a83f P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:22.881726  9116 consensus_peers.cc:597] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Couldn't send request to peer 0717530c054a42c5aa7aca788ba070a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.882479   431 tablet_replica.cc:333] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.883059   431 raft_consensus.cc:2243] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.883508   431 raft_consensus.cc:2272] T 393fbe653f874c5fb76f1464a9641a6c P 0717530c054a42c5aa7aca788ba070a5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.885453   431 tablet_replica.cc:333] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.885969   431 raft_consensus.cc:2243] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.886474   431 raft_consensus.cc:2272] T ad5b06a466054767b5daa1085aca6ea5 P 0717530c054a42c5aa7aca788ba070a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.888433   431 tablet_replica.cc:333] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.888947   431 raft_consensus.cc:2243] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.889707   431 raft_consensus.cc:2272] T fe53d907711b42008ace8e547dc6f7fc P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.891703   431 tablet_replica.cc:333] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.892212   431 raft_consensus.cc:2243] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.893007   431 raft_consensus.cc:2272] T 7a907eff584544e28628c20d7addb69c P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.894833   431 tablet_replica.cc:333] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.895319   431 raft_consensus.cc:2243] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.895805   431 raft_consensus.cc:2272] T eb6a98baac484a1c96cdafe7f0ba43f4 P 0717530c054a42c5aa7aca788ba070a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.897842   431 tablet_replica.cc:333] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.898320   431 raft_consensus.cc:2243] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.899030   431 raft_consensus.cc:2272] T fcf32f9353564e799c94067d0f6b4c5b P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.900743   431 tablet_replica.cc:333] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5: stopping tablet replica
I20260709 13:02:22.901163   431 raft_consensus.cc:2243] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.901950   431 raft_consensus.cc:2272] T a1348d8ae8e8444fac9cc8f6bebfc852 P 0717530c054a42c5aa7aca788ba070a5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:22.924080  9116 consensus_peers.cc:597] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 -> Peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Couldn't send request to peer 0717530c054a42c5aa7aca788ba070a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:22.938493  9116 consensus_peers.cc:597] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Couldn't send request to peer 0717530c054a42c5aa7aca788ba070a5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:22.972550   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:02:23.012344  9118 consensus_peers.cc:597] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 4667e9699c4d413889fc866e0e560d1f (127.0.107.193:41567): Couldn't send request to peer 4667e9699c4d413889fc866e0e560d1f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41567: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:23.044479  9116 consensus_peers.cc:597] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Couldn't send request to peer 0717530c054a42c5aa7aca788ba070a5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:46841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.049147   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
W20260709 13:02:23.083117  9116 consensus_peers.cc:597] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Couldn't send request to peer 0717530c054a42c5aa7aca788ba070a5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:46841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.102423  9116 consensus_peers.cc:597] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 -> Peer 0717530c054a42c5aa7aca788ba070a5 (127.0.107.195:46841): Couldn't send request to peer 0717530c054a42c5aa7aca788ba070a5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:46841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.111552   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:23.112535   431 tablet_replica.cc:333] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.113580   431 raft_consensus.cc:2243] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.114629   431 raft_consensus.cc:2272] T 36c7c3cea0934ff59d24774835ed3e79 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.116852   431 tablet_replica.cc:333] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.117453   431 raft_consensus.cc:2243] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.118379   431 raft_consensus.cc:2272] T 673fe46efdf148bc9fd1720f67d50193 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.120561   431 tablet_replica.cc:333] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.121160   431 raft_consensus.cc:2243] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.121938   431 raft_consensus.cc:2272] T 1b42ffd5f054411aba877e8c374e5c15 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.123965   431 tablet_replica.cc:333] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.124537   431 raft_consensus.cc:2243] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.124995   431 raft_consensus.cc:2272] T 5e69234154ae46418e61ba3eb8a89c2a P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.126915   431 tablet_replica.cc:333] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.127468   431 raft_consensus.cc:2243] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.128201   431 raft_consensus.cc:2272] T e576ab3b143d4485a1c98595bfb66af5 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.130172   431 tablet_replica.cc:333] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.130721   431 raft_consensus.cc:2243] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.131135   431 raft_consensus.cc:2272] T 713d7f8692bf457fb28973349764534b P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.132978   431 tablet_replica.cc:333] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.133543   431 raft_consensus.cc:2243] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.133952   431 raft_consensus.cc:2272] T 03db717c8e2a41c09a753240a6dbbb02 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.135963   431 tablet_replica.cc:333] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.136529   431 raft_consensus.cc:2243] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.137001   431 raft_consensus.cc:2272] T a489378335c74a0fb5932be1e308fc64 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.139017   431 tablet_replica.cc:333] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.139598   431 raft_consensus.cc:2243] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.140064   431 raft_consensus.cc:2272] T 2d9762d913154929be832b5508ebad68 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.141878   431 tablet_replica.cc:333] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.142477   431 raft_consensus.cc:2243] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.143312   431 raft_consensus.cc:2272] T 5c744829b78b4069a658ca2a4d2dbb5e P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.145138   431 tablet_replica.cc:333] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.145689   431 raft_consensus.cc:2243] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.146489   431 raft_consensus.cc:2272] T a5df48aa0fec43379ee059d845b123b4 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.148453   431 tablet_replica.cc:333] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.148988   431 raft_consensus.cc:2243] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.149396   431 raft_consensus.cc:2272] T 37e725e7a33445fb9c78550251c3db98 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.151453   431 tablet_replica.cc:333] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.151994   431 raft_consensus.cc:2243] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.152428   431 raft_consensus.cc:2272] T 30dc6dd2b3764d889a6840a0eb8bcb46 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.154692   431 tablet_replica.cc:333] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.155441   431 raft_consensus.cc:2243] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.156006   431 raft_consensus.cc:2272] T 5073cf5195c44a18922f4eb358531263 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.158686   431 tablet_replica.cc:333] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.159196   431 raft_consensus.cc:2243] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.159569   431 raft_consensus.cc:2272] T 0f5dadd1a4f24668bef129668013d3da P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.161302   431 tablet_replica.cc:333] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.161803   431 raft_consensus.cc:2243] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.162236   431 raft_consensus.cc:2272] T 80e007e79ba94ae88d703e10d65910a9 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.164052   431 tablet_replica.cc:333] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.164547   431 raft_consensus.cc:2243] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.165337   431 raft_consensus.cc:2272] T 0e7047cf3dbc4806aad2882c18cea1f4 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.167367   431 tablet_replica.cc:333] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.167845   431 raft_consensus.cc:2243] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.168556   431 raft_consensus.cc:2272] T a7ab829c10554275ae1d80198e91fa05 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.170413   431 tablet_replica.cc:333] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.170866   431 raft_consensus.cc:2243] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.171612   431 raft_consensus.cc:2272] T 69981197f2a5423a8758576940d1bf76 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.173588   431 tablet_replica.cc:333] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.174156   431 raft_consensus.cc:2243] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.174896   431 raft_consensus.cc:2272] T e8ed7e446fa14e71894176ab3ceb8318 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.177170   431 tablet_replica.cc:333] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.177907   431 raft_consensus.cc:2243] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.178460   431 raft_consensus.cc:2272] T 0a44fd9d19a243248566560af21b992e P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.181113   431 tablet_replica.cc:333] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.181658   431 raft_consensus.cc:2243] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.182163   431 raft_consensus.cc:2272] T b6b16540e04e406b8089acc5a6819d14 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.184031   431 tablet_replica.cc:333] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.184563   431 raft_consensus.cc:2243] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.184986   431 raft_consensus.cc:2272] T ad5b06a466054767b5daa1085aca6ea5 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.187126   431 tablet_replica.cc:333] T fe53d907711b42008ace8e547dc6f7fc P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.187908   431 raft_consensus.cc:2243] T fe53d907711b42008ace8e547dc6f7fc P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.188484   431 raft_consensus.cc:2272] T fe53d907711b42008ace8e547dc6f7fc P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.191071   431 tablet_replica.cc:333] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.191556   431 raft_consensus.cc:2243] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.191895   431 raft_consensus.cc:2272] T 51e05e226d044b2eacc27e329f7c96aa P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.193612   431 tablet_replica.cc:333] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.194152   431 raft_consensus.cc:2243] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.194710   431 raft_consensus.cc:2272] T 2ec71963326742b199b954dc1c0bbacb P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.197116   431 tablet_replica.cc:333] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.197858   431 raft_consensus.cc:2243] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.198355   431 raft_consensus.cc:2272] T b72207701f3449e696f990856f3d7a94 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.200626   431 tablet_replica.cc:333] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.201167   431 raft_consensus.cc:2243] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.201907   431 raft_consensus.cc:2272] T d89a074d6cac458d9de6a79b3bcceade P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.203769   431 tablet_replica.cc:333] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.204298   431 raft_consensus.cc:2243] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.204694   431 raft_consensus.cc:2272] T 4e7ec3e8adfe4ef8b9c4a50b85122b90 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.206542   431 tablet_replica.cc:333] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.207048   431 raft_consensus.cc:2243] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.207470   431 raft_consensus.cc:2272] T d605f782fc8f426190d3419e627d88be P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.209280   431 tablet_replica.cc:333] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.209892   431 raft_consensus.cc:2243] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.210629   431 raft_consensus.cc:2272] T ee1fc193b3ad439ab1c05519323d3302 P 069063a72de443729cdfb3fcbfa6a123 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.213271   431 tablet_replica.cc:333] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.213992   431 raft_consensus.cc:2243] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.215188   431 raft_consensus.cc:2272] T 5ae45916fe794471981c2ddff2693264 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.217525   431 tablet_replica.cc:333] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.218289   431 raft_consensus.cc:2243] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.218775   431 raft_consensus.cc:2272] T 173098da7c34450aa6f93bcafd377922 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.220688   431 tablet_replica.cc:333] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.221151   431 raft_consensus.cc:2243] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.221904   431 raft_consensus.cc:2272] T 5916411ff15d473591594797dfb09193 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.223699   431 tablet_replica.cc:333] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.224141   431 raft_consensus.cc:2243] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.224994   431 raft_consensus.cc:2272] T 1b6fcb3fac4347a1bd0de44956d459d8 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.226953   431 tablet_replica.cc:333] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.227473   431 raft_consensus.cc:2243] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.228160   431 raft_consensus.cc:2272] T 0aa3bccd3d02438e863f3fce74229335 P 069063a72de443729cdfb3fcbfa6a123 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.229948   431 tablet_replica.cc:333] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.230535   431 raft_consensus.cc:2243] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.231161   431 raft_consensus.cc:2272] T 1401c096fd97413881197bb35d4a55af P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.233471   431 tablet_replica.cc:333] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.234144   431 raft_consensus.cc:2243] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.234934   431 raft_consensus.cc:2272] T b9a11453401345558e4c1e70b91f288c P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.236706   431 tablet_replica.cc:333] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.237265   431 raft_consensus.cc:2243] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.238010   431 raft_consensus.cc:2272] T 317ccde7219b44848d0dd04ca340a83f P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.239893   431 tablet_replica.cc:333] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.240404   431 raft_consensus.cc:2243] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.241151   431 raft_consensus.cc:2272] T 9a12c81f118b4261bdad649a5d121e25 P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.243252   431 tablet_replica.cc:333] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.243768   431 raft_consensus.cc:2243] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.244539   431 raft_consensus.cc:2272] T 3364bac8978243bcb6d068941312d443 P 069063a72de443729cdfb3fcbfa6a123 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.246481   431 tablet_replica.cc:333] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.246975   431 raft_consensus.cc:2243] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.247455   431 raft_consensus.cc:2272] T fcf32f9353564e799c94067d0f6b4c5b P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.249420   431 tablet_replica.cc:333] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.249922   431 raft_consensus.cc:2243] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.250351   431 raft_consensus.cc:2272] T 7a907eff584544e28628c20d7addb69c P 069063a72de443729cdfb3fcbfa6a123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.252182   431 tablet_replica.cc:333] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123: stopping tablet replica
I20260709 13:02:23.252660   431 raft_consensus.cc:2243] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.253413   431 raft_consensus.cc:2272] T 457e71b9614d4212a6d10378b169fe21 P 069063a72de443729cdfb3fcbfa6a123 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.321008   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:02:23.385337   431 master.cc:562] Master@127.0.107.254:46493 shutting down...
I20260709 13:02:23.414240   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.414920   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.415248   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2c664e65dd5a4381a6bca47ce9e9316f: stopping tablet replica
I20260709 13:02:23.437233   431 master.cc:584] Master@127.0.107.254:46493 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (41313 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:02:23.531574   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:43107
I20260709 13:02:23.532848   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:23.539626 10131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:23.539727 10130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:23.540182 10133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:23.540608   431 server_base.cc:1061] running on GCE node
I20260709 13:02:23.541802   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:23.542030   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:23.542248   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602143542230 us; error 0 us; skew 500 ppm
I20260709 13:02:23.542804   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:23.545292   431 webserver.cc:533] Webserver started at http://127.0.107.254:38763/ using document root <none> and password file <none>
I20260709 13:02:23.545801   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:23.545987   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:23.546329   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:23.547456   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/master-0-root/instance:
uuid: "1ebddc538aac40199220e3b480615bc3"
format_stamp: "Formatted at 2026-07-09 13:02:23 on dist-test-slave-zhdc"
I20260709 13:02:23.551913   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:23.555312 10138 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:23.556084   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:23.556375   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/master-0-root
uuid: "1ebddc538aac40199220e3b480615bc3"
format_stamp: "Formatted at 2026-07-09 13:02:23 on dist-test-slave-zhdc"
I20260709 13:02:23.556653   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:23.569983   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:23.571319   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:23.609859   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:43107
I20260709 13:02:23.609975 10189 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:43107 every 8 connection(s)
I20260709 13:02:23.613873 10190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:23.624835 10190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3: Bootstrap starting.
I20260709 13:02:23.629631 10190 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.634326 10190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3: No bootstrap required, opened a new log
I20260709 13:02:23.636566 10190 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebddc538aac40199220e3b480615bc3" member_type: VOTER }
I20260709 13:02:23.637027 10190 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.637213 10190 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ebddc538aac40199220e3b480615bc3, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.637722 10190 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebddc538aac40199220e3b480615bc3" member_type: VOTER }
I20260709 13:02:23.638232 10190 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:23.638440 10190 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:23.638657 10190 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.643460 10190 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebddc538aac40199220e3b480615bc3" member_type: VOTER }
I20260709 13:02:23.643972 10190 leader_election.cc:304] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ebddc538aac40199220e3b480615bc3; no voters: 
I20260709 13:02:23.645210 10190 leader_election.cc:290] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:23.645597 10193 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:23.647044 10193 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [term 1 LEADER]: Becoming Leader. State: Replica: 1ebddc538aac40199220e3b480615bc3, State: Running, Role: LEADER
I20260709 13:02:23.647742 10193 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebddc538aac40199220e3b480615bc3" member_type: VOTER }
I20260709 13:02:23.648276 10190 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:23.652381 10194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ebddc538aac40199220e3b480615bc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebddc538aac40199220e3b480615bc3" member_type: VOTER } }
I20260709 13:02:23.653308 10194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:23.652956 10195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ebddc538aac40199220e3b480615bc3. Latest consensus state: current_term: 1 leader_uuid: "1ebddc538aac40199220e3b480615bc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebddc538aac40199220e3b480615bc3" member_type: VOTER } }
I20260709 13:02:23.653864 10195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:23.656462 10200 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:23.664964 10200 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:23.668017   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:23.674921 10200 catalog_manager.cc:1383] Generated new cluster ID: c453ec7c82064996af6796ad96665398
I20260709 13:02:23.675232 10200 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:23.692793 10200 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:23.694236 10200 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:23.714006 10200 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3: Generated new TSK 0
I20260709 13:02:23.714694 10200 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:23.734787   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:23.741176 10211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:23.742268 10212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:23.744489   431 server_base.cc:1061] running on GCE node
W20260709 13:02:23.744730 10214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:23.745848   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:23.746040   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:23.746235   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602143746220 us; error 0 us; skew 500 ppm
I20260709 13:02:23.746726   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:23.749109   431 webserver.cc:533] Webserver started at http://127.0.107.193:44407/ using document root <none> and password file <none>
I20260709 13:02:23.749589   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:23.749743   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:23.750135   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:23.751250   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-0-root/instance:
uuid: "e0a7f04feabc43db88767fe91713ce91"
format_stamp: "Formatted at 2026-07-09 13:02:23 on dist-test-slave-zhdc"
I20260709 13:02:23.755759   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:23.759262 10219 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:23.760039   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:02:23.760386   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-0-root
uuid: "e0a7f04feabc43db88767fe91713ce91"
format_stamp: "Formatted at 2026-07-09 13:02:23 on dist-test-slave-zhdc"
I20260709 13:02:23.760757   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:23.775749   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:23.777001   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:23.778568   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:23.780885   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:23.781114   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:23.781349   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:23.781558   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:23.821944   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:37037
I20260709 13:02:23.822080 10281 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:37037 every 8 connection(s)
I20260709 13:02:23.827193   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:23.835919 10286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:23.836973 10287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:23.840296 10289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:23.840939   431 server_base.cc:1061] running on GCE node
I20260709 13:02:23.842170   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:23.842353   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:23.842562   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602143842542 us; error 0 us; skew 500 ppm
I20260709 13:02:23.843289   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:23.846081   431 webserver.cc:533] Webserver started at http://127.0.107.194:43001/ using document root <none> and password file <none>
I20260709 13:02:23.846637   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:23.846781 10282 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43107
I20260709 13:02:23.846861   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:23.847332 10282 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:23.847396   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:23.848301 10282 heartbeater.cc:507] Master 127.0.107.254:43107 requested a full tablet report, sending...
I20260709 13:02:23.849053   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-1-root/instance:
uuid: "46860c315f4640f5ac4cbd25c1d0719d"
format_stamp: "Formatted at 2026-07-09 13:02:23 on dist-test-slave-zhdc"
I20260709 13:02:23.850620 10155 ts_manager.cc:194] Registered new tserver with Master: e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037)
I20260709 13:02:23.852393 10155 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39888
I20260709 13:02:23.853981   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:02:23.857429 10294 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:23.858196   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:23.858598   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-1-root
uuid: "46860c315f4640f5ac4cbd25c1d0719d"
format_stamp: "Formatted at 2026-07-09 13:02:23 on dist-test-slave-zhdc"
I20260709 13:02:23.858915   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:23.868327   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:23.869570   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:23.871076   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:23.873237   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:23.873458   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:23.873688   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:23.873852   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:23.914019   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33161
I20260709 13:02:23.914227 10356 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33161 every 8 connection(s)
I20260709 13:02:23.918845   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:23.925849 10360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:23.927719 10361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:23.928835 10363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:23.930225   431 server_base.cc:1061] running on GCE node
I20260709 13:02:23.931423   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:23.931694   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:23.931844 10357 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43107
I20260709 13:02:23.931898   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602143931882 us; error 0 us; skew 500 ppm
I20260709 13:02:23.932477 10357 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:23.932955   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:23.933385 10357 heartbeater.cc:507] Master 127.0.107.254:43107 requested a full tablet report, sending...
I20260709 13:02:23.935775   431 webserver.cc:533] Webserver started at http://127.0.107.195:43437/ using document root <none> and password file <none>
I20260709 13:02:23.935797 10155 ts_manager.cc:194] Registered new tserver with Master: 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:23.936424   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:23.936666   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:23.936936   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:23.937505 10155 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39894
I20260709 13:02:23.938161   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-2-root/instance:
uuid: "46d76034a38d4bd1812f4d0b46507284"
format_stamp: "Formatted at 2026-07-09 13:02:23 on dist-test-slave-zhdc"
I20260709 13:02:23.943382   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:02:23.948292 10368 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:23.949142   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:02:23.949405   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-2-root
uuid: "46d76034a38d4bd1812f4d0b46507284"
format_stamp: "Formatted at 2026-07-09 13:02:23 on dist-test-slave-zhdc"
I20260709 13:02:23.949641   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:23.968787   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:23.970021   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:23.971477   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:23.973688   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:23.973861   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:23.974187   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:23.974359   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:24.014511   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:42569
I20260709 13:02:24.014614 10430 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:42569 every 8 connection(s)
I20260709 13:02:24.029063 10431 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43107
I20260709 13:02:24.029508 10431 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:24.030320 10431 heartbeater.cc:507] Master 127.0.107.254:43107 requested a full tablet report, sending...
I20260709 13:02:24.032449 10155 ts_manager.cc:194] Registered new tserver with Master: 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:24.032660   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014845456s
I20260709 13:02:24.033907 10155 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39910
I20260709 13:02:24.058817 10155 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39918:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:24.061930 10155 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:24.153126 10396 tablet_service.cc:1511] Processing CreateTablet for tablet ea171107b1b9440eb3175176f6ec28a6 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:24.154714 10396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea171107b1b9440eb3175176f6ec28a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.156514 10395 tablet_service.cc:1511] Processing CreateTablet for tablet ab16eef5f6224488bf94ab6994023596 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:24.157505 10242 tablet_service.cc:1511] Processing CreateTablet for tablet 8fab90839de2476cb7bb6e1d0534181a (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:24.158023 10395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab16eef5f6224488bf94ab6994023596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.158995 10242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fab90839de2476cb7bb6e1d0534181a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.170305 10244 tablet_service.cc:1511] Processing CreateTablet for tablet 5554190bca4340d58a6bd621f2f307b5 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:24.171725 10244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5554190bca4340d58a6bd621f2f307b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.169971 10318 tablet_service.cc:1511] Processing CreateTablet for tablet 157a8b8ce94541508975e963ced659d5 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:24.172513 10387 tablet_service.cc:1511] Processing CreateTablet for tablet acc8b897939f4b9b96848ce5b8c6f6bd (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:24.174326 10388 tablet_service.cc:1511] Processing CreateTablet for tablet 5515b4df2def48fb9d9590161adf539a (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:24.174897 10387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc8b897939f4b9b96848ce5b8c6f6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.176625 10317 tablet_service.cc:1511] Processing CreateTablet for tablet 8fab90839de2476cb7bb6e1d0534181a (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:24.159214 10394 tablet_service.cc:1511] Processing CreateTablet for tablet c85ac435325c4f70a2b4cbe53df70a18 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:24.179132 10394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85ac435325c4f70a2b4cbe53df70a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.161572 10392 tablet_service.cc:1511] Processing CreateTablet for tablet 157a8b8ce94541508975e963ced659d5 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:24.162525 10240 tablet_service.cc:1511] Processing CreateTablet for tablet c3925f5cd8b14c538c2e7738f60338ef (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:24.183246 10392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157a8b8ce94541508975e963ced659d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.183755 10240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3925f5cd8b14c538c2e7738f60338ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.185534 10388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5515b4df2def48fb9d9590161adf539a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.160380 10393 tablet_service.cc:1511] Processing CreateTablet for tablet 5554190bca4340d58a6bd621f2f307b5 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:24.187398 10393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5554190bca4340d58a6bd621f2f307b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.173913 10318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157a8b8ce94541508975e963ced659d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.163867 10321 tablet_service.cc:1511] Processing CreateTablet for tablet ab16eef5f6224488bf94ab6994023596 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:24.191499 10321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab16eef5f6224488bf94ab6994023596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.163872 10390 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba8f845f3dc4317b48fc0a0d92bc54d (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:24.194499 10317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fab90839de2476cb7bb6e1d0534181a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.194654 10390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba8f845f3dc4317b48fc0a0d92bc54d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.164187 10239 tablet_service.cc:1511] Processing CreateTablet for tablet 5515b4df2def48fb9d9590161adf539a (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:24.199482 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5515b4df2def48fb9d9590161adf539a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.165053 10320 tablet_service.cc:1511] Processing CreateTablet for tablet c85ac435325c4f70a2b4cbe53df70a18 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:24.203553 10320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85ac435325c4f70a2b4cbe53df70a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.165053 10247 tablet_service.cc:1511] Processing CreateTablet for tablet ea171107b1b9440eb3175176f6ec28a6 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:24.207700 10247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea171107b1b9440eb3175176f6ec28a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.165884 10238 tablet_service.cc:1511] Processing CreateTablet for tablet acc8b897939f4b9b96848ce5b8c6f6bd (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:24.210327 10238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc8b897939f4b9b96848ce5b8c6f6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.166131 10246 tablet_service.cc:1511] Processing CreateTablet for tablet ab16eef5f6224488bf94ab6994023596 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:24.212558 10246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab16eef5f6224488bf94ab6994023596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.162765 10391 tablet_service.cc:1511] Processing CreateTablet for tablet 8fab90839de2476cb7bb6e1d0534181a (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:24.215023 10391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fab90839de2476cb7bb6e1d0534181a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.167142 10315 tablet_service.cc:1511] Processing CreateTablet for tablet c3925f5cd8b14c538c2e7738f60338ef (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:24.217063 10315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3925f5cd8b14c538c2e7738f60338ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.162065 10322 tablet_service.cc:1511] Processing CreateTablet for tablet ea171107b1b9440eb3175176f6ec28a6 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:24.166227 10319 tablet_service.cc:1511] Processing CreateTablet for tablet 5554190bca4340d58a6bd621f2f307b5 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:24.168895 10243 tablet_service.cc:1511] Processing CreateTablet for tablet 157a8b8ce94541508975e963ced659d5 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:24.239228 10447 tablet_bootstrap.cc:492] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284: Bootstrap starting.
I20260709 13:02:24.239533 10243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157a8b8ce94541508975e963ced659d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.167649 10245 tablet_service.cc:1511] Processing CreateTablet for tablet c85ac435325c4f70a2b4cbe53df70a18 (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:24.244005 10245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85ac435325c4f70a2b4cbe53df70a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.168735 10313 tablet_service.cc:1511] Processing CreateTablet for tablet acc8b897939f4b9b96848ce5b8c6f6bd (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:24.168615 10314 tablet_service.cc:1511] Processing CreateTablet for tablet 5515b4df2def48fb9d9590161adf539a (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:24.161197 10241 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba8f845f3dc4317b48fc0a0d92bc54d (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:24.248202 10241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba8f845f3dc4317b48fc0a0d92bc54d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.176275 10389 tablet_service.cc:1511] Processing CreateTablet for tablet c3925f5cd8b14c538c2e7738f60338ef (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:24.250846 10389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3925f5cd8b14c538c2e7738f60338ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.167371 10316 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba8f845f3dc4317b48fc0a0d92bc54d (DEFAULT_TABLE table=test-workload [id=55bf13154ee340e2afede0133ce1de07]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:24.253247 10319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5554190bca4340d58a6bd621f2f307b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.258685 10322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea171107b1b9440eb3175176f6ec28a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.267669 10314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5515b4df2def48fb9d9590161adf539a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.269969 10316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba8f845f3dc4317b48fc0a0d92bc54d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.323513 10447 tablet_bootstrap.cc:654] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.335420 10446 tablet_bootstrap.cc:492] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:24.353152 10313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc8b897939f4b9b96848ce5b8c6f6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:24.366169 10446 tablet_bootstrap.cc:654] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.399672 10448 tablet_bootstrap.cc:492] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d: Bootstrap starting.
I20260709 13:02:24.413883 10448 tablet_bootstrap.cc:654] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.414270 10446 tablet_bootstrap.cc:492] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91: No bootstrap required, opened a new log
I20260709 13:02:24.414861 10446 ts_tablet_manager.cc:1403] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.000s
I20260709 13:02:24.415406 10447 tablet_bootstrap.cc:492] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284: No bootstrap required, opened a new log
I20260709 13:02:24.417336 10447 ts_tablet_manager.cc:1403] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284: Time spent bootstrapping tablet: real 0.178s	user 0.006s	sys 0.011s
I20260709 13:02:24.418447 10446 raft_consensus.cc:359] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.419153 10446 raft_consensus.cc:385] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.419459 10446 raft_consensus.cc:740] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.420360 10447 raft_consensus.cc:359] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.420219 10446 consensus_queue.cc:260] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.420828 10448 tablet_bootstrap.cc:492] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d: No bootstrap required, opened a new log
I20260709 13:02:24.421005 10447 raft_consensus.cc:385] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.421438 10447 raft_consensus.cc:740] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.421468 10448 ts_tablet_manager.cc:1403] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.007s
I20260709 13:02:24.422626 10282 heartbeater.cc:499] Master 127.0.107.254:43107 was elected leader, sending a full tablet report...
I20260709 13:02:24.422561 10447 consensus_queue.cc:260] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.423115 10446 ts_tablet_manager.cc:1434] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:24.424188 10446 tablet_bootstrap.cc:492] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:24.425320 10447 ts_tablet_manager.cc:1434] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:24.426301 10447 tablet_bootstrap.cc:492] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284: Bootstrap starting.
I20260709 13:02:24.426981 10431 heartbeater.cc:499] Master 127.0.107.254:43107 was elected leader, sending a full tablet report...
I20260709 13:02:24.430711 10446 tablet_bootstrap.cc:654] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.430886 10447 tablet_bootstrap.cc:654] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.436241 10447 tablet_bootstrap.cc:492] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284: No bootstrap required, opened a new log
I20260709 13:02:24.436769 10447 ts_tablet_manager.cc:1403] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:02:24.439253 10447 raft_consensus.cc:359] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.439800 10447 raft_consensus.cc:385] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.439725 10446 tablet_bootstrap.cc:492] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: No bootstrap required, opened a new log
I20260709 13:02:24.440263 10447 raft_consensus.cc:740] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.440564 10446 ts_tablet_manager.cc:1403] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:02:24.441015 10447 consensus_queue.cc:260] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.442838 10447 ts_tablet_manager.cc:1434] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:02:24.443758 10447 tablet_bootstrap.cc:492] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284: Bootstrap starting.
I20260709 13:02:24.443941 10446 raft_consensus.cc:359] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.444782 10446 raft_consensus.cc:385] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.445163 10446 raft_consensus.cc:740] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.446380 10446 consensus_queue.cc:260] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.449198 10446 ts_tablet_manager.cc:1434] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:24.449903 10447 tablet_bootstrap.cc:654] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.450429 10446 tablet_bootstrap.cc:492] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:24.451637 10448 raft_consensus.cc:359] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.454475 10448 raft_consensus.cc:385] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.454918 10448 raft_consensus.cc:740] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.456020 10448 consensus_queue.cc:260] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.458909 10446 tablet_bootstrap.cc:654] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.461894 10357 heartbeater.cc:499] Master 127.0.107.254:43107 was elected leader, sending a full tablet report...
I20260709 13:02:24.462685 10448 ts_tablet_manager.cc:1434] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.003s
I20260709 13:02:24.464250 10447 tablet_bootstrap.cc:492] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284: No bootstrap required, opened a new log
I20260709 13:02:24.464440 10448 tablet_bootstrap.cc:492] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d: Bootstrap starting.
I20260709 13:02:24.464831 10447 ts_tablet_manager.cc:1403] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:02:24.468056 10447 raft_consensus.cc:359] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.468799 10447 raft_consensus.cc:385] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.469084 10447 raft_consensus.cc:740] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.469954 10447 consensus_queue.cc:260] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.472273 10447 ts_tablet_manager.cc:1434] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:24.473260 10447 tablet_bootstrap.cc:492] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284: Bootstrap starting.
I20260709 13:02:24.475770 10448 tablet_bootstrap.cc:654] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.477281 10446 tablet_bootstrap.cc:492] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: No bootstrap required, opened a new log
I20260709 13:02:24.477941 10446 ts_tablet_manager.cc:1403] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.005s
I20260709 13:02:24.480043 10447 tablet_bootstrap.cc:654] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.482199 10446 raft_consensus.cc:359] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.483455 10446 raft_consensus.cc:385] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.483944 10446 raft_consensus.cc:740] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.487015 10446 consensus_queue.cc:260] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.488322 10448 tablet_bootstrap.cc:492] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d: No bootstrap required, opened a new log
I20260709 13:02:24.489001 10448 ts_tablet_manager.cc:1403] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:02:24.489857 10446 ts_tablet_manager.cc:1434] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:02:24.491281 10446 tablet_bootstrap.cc:492] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:24.492842 10448 raft_consensus.cc:359] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.493691 10448 raft_consensus.cc:385] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.494567 10448 raft_consensus.cc:740] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.495456 10448 consensus_queue.cc:260] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.497008 10447 tablet_bootstrap.cc:492] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284: No bootstrap required, opened a new log
I20260709 13:02:24.497648 10447 ts_tablet_manager.cc:1403] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.012s
I20260709 13:02:24.498044 10448 ts_tablet_manager.cc:1434] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:02:24.498435 10446 tablet_bootstrap.cc:654] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.499141 10448 tablet_bootstrap.cc:492] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d: Bootstrap starting.
I20260709 13:02:24.500829 10447 raft_consensus.cc:359] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.501762 10447 raft_consensus.cc:385] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.502229 10447 raft_consensus.cc:740] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.503288 10447 consensus_queue.cc:260] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.506294 10448 tablet_bootstrap.cc:654] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.506508 10447 ts_tablet_manager.cc:1434] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:24.507962 10447 tablet_bootstrap.cc:492] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284: Bootstrap starting.
I20260709 13:02:24.510435 10446 tablet_bootstrap.cc:492] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91: No bootstrap required, opened a new log
I20260709 13:02:24.511032 10446 ts_tablet_manager.cc:1403] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
I20260709 13:02:24.512367 10457 raft_consensus.cc:493] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.512921 10457 raft_consensus.cc:515] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.514199 10446 raft_consensus.cc:359] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.514963 10446 raft_consensus.cc:385] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.515249 10446 raft_consensus.cc:740] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.515957 10447 tablet_bootstrap.cc:654] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.516250 10446 consensus_queue.cc:260] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.518285 10457 leader_election.cc:290] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:24.518930 10446 ts_tablet_manager.cc:1434] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:02:24.521390 10446 tablet_bootstrap.cc:492] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
W20260709 13:02:24.518872 10432 tablet.cc:2406] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:24.529994 10446 tablet_bootstrap.cc:654] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.536161 10447 tablet_bootstrap.cc:492] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284: No bootstrap required, opened a new log
I20260709 13:02:24.536672 10447 ts_tablet_manager.cc:1403] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:02:24.539698 10447 raft_consensus.cc:359] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.540817 10447 raft_consensus.cc:385] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.541288 10447 raft_consensus.cc:740] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.542620 10447 consensus_queue.cc:260] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.549897 10452 raft_consensus.cc:493] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.550704 10452 raft_consensus.cc:515] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.555861 10447 ts_tablet_manager.cc:1434] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:02:24.561928 10452 leader_election.cc:290] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:24.567281 10447 tablet_bootstrap.cc:492] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284: Bootstrap starting.
I20260709 13:02:24.577314 10447 tablet_bootstrap.cc:654] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.590263 10447 tablet_bootstrap.cc:492] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284: No bootstrap required, opened a new log
I20260709 13:02:24.590778 10446 tablet_bootstrap.cc:492] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: No bootstrap required, opened a new log
I20260709 13:02:24.591375 10446 ts_tablet_manager.cc:1403] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.005s
I20260709 13:02:24.594559 10446 raft_consensus.cc:359] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.590862 10448 tablet_bootstrap.cc:492] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d: No bootstrap required, opened a new log
I20260709 13:02:24.595399 10446 raft_consensus.cc:385] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.595782 10446 raft_consensus.cc:740] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.595968 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157a8b8ce94541508975e963ced659d5" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a7f04feabc43db88767fe91713ce91" is_pre_election: true
I20260709 13:02:24.590811 10447 ts_tablet_manager.cc:1403] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.005s
I20260709 13:02:24.596807 10257 raft_consensus.cc:2468] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 0.
I20260709 13:02:24.596783 10446 consensus_queue.cc:260] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.599507 10446 ts_tablet_manager.cc:1434] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:02:24.599601 10447 raft_consensus.cc:359] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.600405 10447 raft_consensus.cc:385] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.600576 10446 tablet_bootstrap.cc:492] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:24.600569 10296 leader_election.cc:304] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, e0a7f04feabc43db88767fe91713ce91; no voters: 
I20260709 13:02:24.601660 10457 raft_consensus.cc:2804] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:24.601998 10457 raft_consensus.cc:493] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.602380 10457 raft_consensus.cc:3060] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.606972 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc8b897939f4b9b96848ce5b8c6f6bd" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
I20260709 13:02:24.595795 10448 ts_tablet_manager.cc:1403] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d: Time spent bootstrapping tablet: real 0.097s	user 0.029s	sys 0.012s
I20260709 13:02:24.607887 10446 tablet_bootstrap.cc:654] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:24.608801 10221 leader_election.cc:343] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:24.611277 10457 raft_consensus.cc:515] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.611385 10448 raft_consensus.cc:359] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.612499 10448 raft_consensus.cc:385] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.612887 10448 raft_consensus.cc:740] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.613900 10448 consensus_queue.cc:260] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.600682 10447 raft_consensus.cc:740] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.615622 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157a8b8ce94541508975e963ced659d5" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a7f04feabc43db88767fe91713ce91"
I20260709 13:02:24.616796 10257 raft_consensus.cc:3060] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.616719 10447 consensus_queue.cc:260] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.620049 10447 ts_tablet_manager.cc:1434] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:02:24.621366 10447 tablet_bootstrap.cc:492] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284: Bootstrap starting.
I20260709 13:02:24.625039 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157a8b8ce94541508975e963ced659d5" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:24.626637 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157a8b8ce94541508975e963ced659d5" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:24.628017 10404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc8b897939f4b9b96848ce5b8c6f6bd" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:24.628667 10404 raft_consensus.cc:2468] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 0.
I20260709 13:02:24.629812 10447 tablet_bootstrap.cc:654] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.630745 10257 raft_consensus.cc:2468] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 1.
I20260709 13:02:24.631191 10457 leader_election.cc:290] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
W20260709 13:02:24.631067 10295 leader_election.cc:343] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:24.633738 10448 ts_tablet_manager.cc:1434] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.005s
W20260709 13:02:24.634500 10295 leader_election.cc:343] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:24.634913 10448 tablet_bootstrap.cc:492] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d: Bootstrap starting.
I20260709 13:02:24.637456 10446 tablet_bootstrap.cc:492] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: No bootstrap required, opened a new log
I20260709 13:02:24.637977 10446 ts_tablet_manager.cc:1403] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.004s
I20260709 13:02:24.640935 10446 raft_consensus.cc:359] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.641613 10446 raft_consensus.cc:385] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.641901 10446 raft_consensus.cc:740] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.642650 10446 consensus_queue.cc:260] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.643640 10448 tablet_bootstrap.cc:654] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.644905 10446 ts_tablet_manager.cc:1434] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:24.645964 10446 tablet_bootstrap.cc:492] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:24.651358 10296 leader_election.cc:304] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, e0a7f04feabc43db88767fe91713ce91; no voters: 46d76034a38d4bd1812f4d0b46507284
I20260709 13:02:24.652649 10457 raft_consensus.cc:2804] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:24.653052 10446 tablet_bootstrap.cc:654] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.653206 10457 raft_consensus.cc:697] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Becoming Leader. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Running, Role: LEADER
I20260709 13:02:24.654220 10457 consensus_queue.cc:237] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.657680 10448 tablet_bootstrap.cc:492] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d: No bootstrap required, opened a new log
I20260709 13:02:24.658530 10448 ts_tablet_manager.cc:1403] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.007s
W20260709 13:02:24.662513 10203 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:24.662884 10448 raft_consensus.cc:359] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.664330 10452 raft_consensus.cc:493] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.665020 10452 raft_consensus.cc:515] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.666580 10220 leader_election.cc:304] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91; no voters: 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:24.668988 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fab90839de2476cb7bb6e1d0534181a" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
I20260709 13:02:24.669806 10332 raft_consensus.cc:2468] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 0.
I20260709 13:02:24.671193 10221 leader_election.cc:304] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, e0a7f04feabc43db88767fe91713ce91; no voters: 
I20260709 13:02:24.673396 10452 leader_election.cc:290] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:24.675966 10404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fab90839de2476cb7bb6e1d0534181a" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:24.676945 10404 raft_consensus.cc:2468] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 0.
I20260709 13:02:24.663965 10448 raft_consensus.cc:385] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.681327 10448 raft_consensus.cc:740] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.683754 10448 consensus_queue.cc:260] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.689203 10448 ts_tablet_manager.cc:1434] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:02:24.690002 10452 raft_consensus.cc:2804] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:24.690693 10452 raft_consensus.cc:493] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.691273 10452 raft_consensus.cc:3060] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.694483 10477 raft_consensus.cc:2804] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:24.695101 10477 raft_consensus.cc:493] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.695526 10477 raft_consensus.cc:3060] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.697068 10453 raft_consensus.cc:493] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.697738 10453 raft_consensus.cc:515] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.689021 10152 catalog_manager.cc:5697] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.706501 10453 leader_election.cc:290] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:24.711292 10478 raft_consensus.cc:493] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.712188 10478 raft_consensus.cc:515] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.717324 10446 tablet_bootstrap.cc:492] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91: No bootstrap required, opened a new log
I20260709 13:02:24.717372 10447 tablet_bootstrap.cc:492] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284: No bootstrap required, opened a new log
I20260709 13:02:24.717722 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5554190bca4340d58a6bd621f2f307b5" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
I20260709 13:02:24.718334 10446 ts_tablet_manager.cc:1403] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.037s
I20260709 13:02:24.718343 10447 ts_tablet_manager.cc:1403] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284: Time spent bootstrapping tablet: real 0.097s	user 0.049s	sys 0.035s
W20260709 13:02:24.719692 10221 leader_election.cc:343] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:24.690809 10448 tablet_bootstrap.cc:492] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d: Bootstrap starting.
I20260709 13:02:24.721891 10447 raft_consensus.cc:359] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.722231 10446 raft_consensus.cc:359] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.722817 10447 raft_consensus.cc:385] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.723078 10446 raft_consensus.cc:385] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.723176 10447 raft_consensus.cc:740] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.723487 10446 raft_consensus.cc:740] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.725296 10478 leader_election.cc:290] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:24.726692 10404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5554190bca4340d58a6bd621f2f307b5" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:24.724269 10447 consensus_queue.cc:260] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.731314 10404 raft_consensus.cc:2468] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 0.
I20260709 13:02:24.731536 10452 raft_consensus.cc:515] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.735721 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fab90839de2476cb7bb6e1d0534181a" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:24.736431 10332 raft_consensus.cc:3060] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.736754 10447 ts_tablet_manager.cc:1434] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 13:02:24.738009 10447 tablet_bootstrap.cc:492] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284: Bootstrap starting.
I20260709 13:02:24.739713 10457 raft_consensus.cc:493] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.740250 10457 raft_consensus.cc:515] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.724419 10446 consensus_queue.cc:260] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.742481 10457 leader_election.cc:290] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:24.743786 10404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba8f845f3dc4317b48fc0a0d92bc54d" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:24.744557 10404 raft_consensus.cc:2468] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 0.
I20260709 13:02:24.745744 10295 leader_election.cc:304] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: 
I20260709 13:02:24.747627 10447 tablet_bootstrap.cc:654] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.748037 10478 raft_consensus.cc:493] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.748605 10478 raft_consensus.cc:515] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.751178 10453 raft_consensus.cc:493] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.737342 10220 leader_election.cc:304] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91; no voters: 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:24.751782 10453 raft_consensus.cc:515] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.743822 10446 ts_tablet_manager.cc:1434] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:02:24.773573 10331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5515b4df2def48fb9d9590161adf539a" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
I20260709 13:02:24.774081 10448 tablet_bootstrap.cc:654] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:24.775331 10221 leader_election.cc:343] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:24.753392 10457 raft_consensus.cc:2804] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:24.776826 10453 leader_election.cc:290] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:24.781562 10457 raft_consensus.cc:493] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.782160 10478 leader_election.cc:290] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:24.787264 10478 raft_consensus.cc:2804] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:24.787730 10478 raft_consensus.cc:493] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.788177 10478 raft_consensus.cc:3060] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.782027 10457 raft_consensus.cc:3060] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.791167 10446 tablet_bootstrap.cc:492] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:24.795455 10484 raft_consensus.cc:493] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.796042 10484 raft_consensus.cc:515] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.780771 10332 raft_consensus.cc:2468] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 1.
I20260709 13:02:24.781518 10452 leader_election.cc:290] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Requested vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:24.801182 10221 leader_election.cc:304] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, e0a7f04feabc43db88767fe91713ce91; no voters: 
I20260709 13:02:24.801534 10331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16eef5f6224488bf94ab6994023596" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
I20260709 13:02:24.801185 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea171107b1b9440eb3175176f6ec28a6" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
I20260709 13:02:24.803057 10330 raft_consensus.cc:2468] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 0.
I20260709 13:02:24.801281 10477 raft_consensus.cc:515] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
W20260709 13:02:24.803165 10370 leader_election.cc:343] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:24.803985 10457 raft_consensus.cc:515] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.804785 10370 leader_election.cc:304] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: 
I20260709 13:02:24.805770 10453 raft_consensus.cc:2804] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:24.807229 10453 raft_consensus.cc:493] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.808020 10453 raft_consensus.cc:3060] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.809031 10404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba8f845f3dc4317b48fc0a0d92bc54d" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:24.809652 10404 raft_consensus.cc:3060] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.805857 10452 raft_consensus.cc:2804] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:24.811080 10452 raft_consensus.cc:697] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: Becoming Leader. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Running, Role: LEADER
I20260709 13:02:24.811971 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc8b897939f4b9b96848ce5b8c6f6bd" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:24.811902 10452 consensus_queue.cc:237] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
W20260709 13:02:24.813436 10221 leader_election.cc:343] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:24.815219 10484 leader_election.cc:290] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:24.806197 10457 leader_election.cc:290] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:24.817575 10477 leader_election.cc:290] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Requested vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:24.819295 10447 tablet_bootstrap.cc:492] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284: No bootstrap required, opened a new log
I20260709 13:02:24.819767 10447 ts_tablet_manager.cc:1403] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.027s
W20260709 13:02:24.822166 10220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:42569, user_credentials={real_user=slave}} blocked reactor thread for 84922.5us
I20260709 13:02:24.825381 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba8f845f3dc4317b48fc0a0d92bc54d" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a7f04feabc43db88767fe91713ce91" is_pre_election: true
I20260709 13:02:24.825562 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fab90839de2476cb7bb6e1d0534181a" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:24.827427 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba8f845f3dc4317b48fc0a0d92bc54d" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a7f04feabc43db88767fe91713ce91"
I20260709 13:02:24.827744 10405 raft_consensus.cc:3060] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.825984 10406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5515b4df2def48fb9d9590161adf539a" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:24.830327 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16eef5f6224488bf94ab6994023596" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a7f04feabc43db88767fe91713ce91" is_pre_election: true
I20260709 13:02:24.831041 10406 raft_consensus.cc:2468] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 0.
W20260709 13:02:24.831305 10296 leader_election.cc:343] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:24.831846 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea171107b1b9440eb3175176f6ec28a6" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a7f04feabc43db88767fe91713ce91" is_pre_election: true
I20260709 13:02:24.827744 10446 tablet_bootstrap.cc:654] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.826996 10402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc8b897939f4b9b96848ce5b8c6f6bd" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
W20260709 13:02:24.832369 10296 leader_election.cc:343] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:24.832495 10257 raft_consensus.cc:2468] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 0.
I20260709 13:02:24.832841 10402 raft_consensus.cc:3060] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:24.833729 10370 leader_election.cc:343] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:24.826511 10403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea171107b1b9440eb3175176f6ec28a6" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:24.834161 10370 leader_election.cc:304] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46d76034a38d4bd1812f4d0b46507284; no voters: 46860c315f4640f5ac4cbd25c1d0719d, e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:24.837602 10453 raft_consensus.cc:515] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.842384 10403 raft_consensus.cc:2393] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0a7f04feabc43db88767fe91713ce91 in current term 1: Already voted for candidate 46d76034a38d4bd1812f4d0b46507284 in this term.
I20260709 13:02:24.834173 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea171107b1b9440eb3175176f6ec28a6" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
I20260709 13:02:24.846606 10332 raft_consensus.cc:2468] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 0.
I20260709 13:02:24.847491 10453 leader_election.cc:290] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 1 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:24.848052 10221 leader_election.cc:304] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, e0a7f04feabc43db88767fe91713ce91; no voters: 
I20260709 13:02:24.848299 10453 raft_consensus.cc:2749] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:24.848974 10477 raft_consensus.cc:2804] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:24.849344 10477 raft_consensus.cc:493] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.849673 10477 raft_consensus.cc:3060] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.850159 10220 leader_election.cc:304] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91; no voters: 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:24.851089 10484 raft_consensus.cc:2804] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:24.851542 10484 raft_consensus.cc:493] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.851971 10484 raft_consensus.cc:3060] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.852696 10448 tablet_bootstrap.cc:492] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d: No bootstrap required, opened a new log
I20260709 13:02:24.853288 10448 ts_tablet_manager.cc:1403] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d: Time spent bootstrapping tablet: real 0.163s	user 0.011s	sys 0.013s
I20260709 13:02:24.856436 10448 raft_consensus.cc:359] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.857152 10477 raft_consensus.cc:515] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.859283 10478 raft_consensus.cc:515] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.865024 10402 raft_consensus.cc:2468] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 1.
I20260709 13:02:24.865320 10484 raft_consensus.cc:515] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.879536 10405 raft_consensus.cc:2468] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 1.
W20260709 13:02:24.881752 10370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:37037, user_credentials={real_user=slave}} blocked reactor thread for 48047.1us
I20260709 13:02:24.883845 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea171107b1b9440eb3175176f6ec28a6" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a7f04feabc43db88767fe91713ce91"
I20260709 13:02:24.884135 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea171107b1b9440eb3175176f6ec28a6" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:24.884541 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5515b4df2def48fb9d9590161adf539a" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:24.884783 10332 raft_consensus.cc:3060] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.883874 10484 leader_election.cc:290] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Requested vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:24.876031 10447 raft_consensus.cc:359] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.886550 10447 raft_consensus.cc:385] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.886828 10447 raft_consensus.cc:740] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Initialized, Role: FOLLOWER
W20260709 13:02:24.887845 10221 leader_election.cc:343] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:24.888417 10478 leader_election.cc:290] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Requested vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:24.889261 10446 tablet_bootstrap.cc:492] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91: No bootstrap required, opened a new log
I20260709 13:02:24.889777 10403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5554190bca4340d58a6bd621f2f307b5" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:24.890938 10403 raft_consensus.cc:3060] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.891573 10477 leader_election.cc:290] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Requested vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:24.893487 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5554190bca4340d58a6bd621f2f307b5" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:24.893980 10257 raft_consensus.cc:2393] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 46d76034a38d4bd1812f4d0b46507284 in current term 1: Already voted for candidate e0a7f04feabc43db88767fe91713ce91 in this term.
I20260709 13:02:24.890547 10446 ts_tablet_manager.cc:1403] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.009s
I20260709 13:02:24.896399 10331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea171107b1b9440eb3175176f6ec28a6" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:24.897174 10446 raft_consensus.cc:359] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.897883 10446 raft_consensus.cc:385] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.897897 10332 raft_consensus.cc:2468] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 1.
I20260709 13:02:24.898298 10446 raft_consensus.cc:740] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.889771 10447 consensus_queue.cc:260] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.900481 10447 ts_tablet_manager.cc:1434] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.001s
I20260709 13:02:24.901130 10402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea171107b1b9440eb3175176f6ec28a6" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:24.901002 10446 consensus_queue.cc:260] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.901512 10447 tablet_bootstrap.cc:492] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284: Bootstrap starting.
I20260709 13:02:24.901952 10402 raft_consensus.cc:2393] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e0a7f04feabc43db88767fe91713ce91 in current term 1: Already voted for candidate 46d76034a38d4bd1812f4d0b46507284 in this term.
I20260709 13:02:24.903350 10446 ts_tablet_manager.cc:1434] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:02:24.904269 10446 tablet_bootstrap.cc:492] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:24.877775 10448 raft_consensus.cc:385] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.886201 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5515b4df2def48fb9d9590161adf539a" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:24.879364 10404 raft_consensus.cc:2468] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 1.
I20260709 13:02:24.909319 10220 leader_election.cc:304] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91; no voters: 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:24.909523 10370 leader_election.cc:304] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:24.910655 10220 leader_election.cc:304] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a7f04feabc43db88767fe91713ce91; no voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284
I20260709 13:02:24.911412 10477 raft_consensus.cc:2804] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:24.911859 10477 raft_consensus.cc:697] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: Becoming Leader. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Running, Role: LEADER
I20260709 13:02:24.908200 10405 raft_consensus.cc:3060] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.912742 10477 consensus_queue.cc:237] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.915057 10403 raft_consensus.cc:2468] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 1.
I20260709 13:02:24.916267 10220 leader_election.cc:304] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91; no voters: 
I20260709 13:02:24.917309 10447 tablet_bootstrap.cc:654] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.918143 10452 raft_consensus.cc:2804] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:24.919018 10452 raft_consensus.cc:697] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: Becoming Leader. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Running, Role: LEADER
I20260709 13:02:24.906157 10448 raft_consensus.cc:740] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.922749 10489 raft_consensus.cc:2804] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:24.923318 10489 raft_consensus.cc:697] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 1 LEADER]: Becoming Leader. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:24.922603 10452 consensus_queue.cc:237] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.924152 10489 consensus_queue.cc:237] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.911950 10478 raft_consensus.cc:2749] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:24.922629 10448 consensus_queue.cc:260] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.926796 10330 raft_consensus.cc:3060] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.935897 10295 leader_election.cc:304] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:24.937960 10446 tablet_bootstrap.cc:654] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.939800 10457 raft_consensus.cc:2804] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:24.940816 10457 raft_consensus.cc:697] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Becoming Leader. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Running, Role: LEADER
I20260709 13:02:24.941763 10457 consensus_queue.cc:237] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.933851 10155 catalog_manager.cc:5697] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0a7f04feabc43db88767fe91713ce91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e0a7f04feabc43db88767fe91713ce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.944692 10405 raft_consensus.cc:2468] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 1.
I20260709 13:02:24.945992 10220 leader_election.cc:304] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91; no voters: 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:24.947469 10477 raft_consensus.cc:2804] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:24.947970 10477 raft_consensus.cc:697] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: Becoming Leader. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Running, Role: LEADER
I20260709 13:02:24.948343 10330 raft_consensus.cc:2468] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 1.
I20260709 13:02:24.949283 10477 consensus_queue.cc:237] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.959399 10448 ts_tablet_manager.cc:1434] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d: Time spent starting tablet: real 0.106s	user 0.005s	sys 0.009s
I20260709 13:02:24.960750 10448 tablet_bootstrap.cc:492] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d: Bootstrap starting.
I20260709 13:02:24.966709 10447 tablet_bootstrap.cc:492] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284: No bootstrap required, opened a new log
I20260709 13:02:24.967329 10447 ts_tablet_manager.cc:1403] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.012s
I20260709 13:02:24.966972 10153 catalog_manager.cc:5697] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.969437 10446 tablet_bootstrap.cc:492] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: No bootstrap required, opened a new log
I20260709 13:02:24.969975 10446 ts_tablet_manager.cc:1403] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.001s
I20260709 13:02:24.973380 10447 raft_consensus.cc:359] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.974167 10447 raft_consensus.cc:385] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.974434 10447 raft_consensus.cc:740] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.975121 10447 consensus_queue.cc:260] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.977882 10447 ts_tablet_manager.cc:1434] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:02:24.974822 10446 raft_consensus.cc:359] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.979036 10446 raft_consensus.cc:385] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:24.979308 10446 raft_consensus.cc:740] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:24.980067 10446 consensus_queue.cc:260] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:24.982084 10446 ts_tablet_manager.cc:1434] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.000s
I20260709 13:02:24.983052 10446 tablet_bootstrap.cc:492] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:24.985426 10447 tablet_bootstrap.cc:492] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284: Bootstrap starting.
I20260709 13:02:24.988515 10446 tablet_bootstrap.cc:654] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.987298 10155 catalog_manager.cc:5697] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0a7f04feabc43db88767fe91713ce91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e0a7f04feabc43db88767fe91713ce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.991242 10155 catalog_manager.cc:5697] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0a7f04feabc43db88767fe91713ce91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e0a7f04feabc43db88767fe91713ce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.991467 10152 catalog_manager.cc:5697] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "46d76034a38d4bd1812f4d0b46507284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:24.993223 10447 tablet_bootstrap.cc:654] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.982117 10448 tablet_bootstrap.cc:654] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:24.993286 10155 catalog_manager.cc:5697] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0a7f04feabc43db88767fe91713ce91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e0a7f04feabc43db88767fe91713ce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.003780 10448 tablet_bootstrap.cc:492] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d: No bootstrap required, opened a new log
I20260709 13:02:25.004360 10448 ts_tablet_manager.cc:1403] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.004s
I20260709 13:02:25.007546 10448 raft_consensus.cc:359] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.008399 10448 raft_consensus.cc:385] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:25.008476 10447 tablet_bootstrap.cc:492] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284: No bootstrap required, opened a new log
I20260709 13:02:25.008785 10448 raft_consensus.cc:740] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Initialized, Role: FOLLOWER
I20260709 13:02:25.009236 10447 ts_tablet_manager.cc:1403] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 13:02:25.009883 10448 consensus_queue.cc:260] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.016126 10477 raft_consensus.cc:493] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.016260 10447 raft_consensus.cc:359] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.016947 10477 raft_consensus.cc:515] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.017306 10447 raft_consensus.cc:385] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:25.019336 10477 leader_election.cc:290] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:25.019634 10447 raft_consensus.cc:740] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Initialized, Role: FOLLOWER
I20260709 13:02:25.020638 10447 consensus_queue.cc:260] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.020936 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f5cd8b14c538c2e7738f60338ef" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
I20260709 13:02:25.022558 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f5cd8b14c538c2e7738f60338ef" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:25.022794 10447 ts_tablet_manager.cc:1434] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.007s
W20260709 13:02:25.022707 10221 leader_election.cc:343] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:25.023307 10405 raft_consensus.cc:2468] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 0.
I20260709 13:02:25.028826 10220 leader_election.cc:304] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91; no voters: 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:25.029698 10477 raft_consensus.cc:2804] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:25.030339 10448 ts_tablet_manager.cc:1434] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 13:02:25.031490 10448 tablet_bootstrap.cc:492] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d: Bootstrap starting.
I20260709 13:02:25.032191 10446 tablet_bootstrap.cc:492] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91: No bootstrap required, opened a new log
I20260709 13:02:25.032812 10446 ts_tablet_manager.cc:1403] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.050s	user 0.023s	sys 0.020s
I20260709 13:02:25.035629 10446 raft_consensus.cc:359] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.030380 10477 raft_consensus.cc:493] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.036314 10446 raft_consensus.cc:385] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:25.036653 10446 raft_consensus.cc:740] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:25.037343 10446 consensus_queue.cc:260] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.038368 10448 tablet_bootstrap.cc:654] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:25.039398 10446 ts_tablet_manager.cc:1434] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:25.043680 10452 raft_consensus.cc:493] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.044377 10452 raft_consensus.cc:515] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.045153 10477 raft_consensus.cc:3060] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:25.047165 10452 leader_election.cc:290] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:25.047888 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85ac435325c4f70a2b4cbe53df70a18" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
I20260709 13:02:25.048166 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85ac435325c4f70a2b4cbe53df70a18" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:25.048877 10405 raft_consensus.cc:2468] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 0.
W20260709 13:02:25.049036 10221 leader_election.cc:343] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:25.050175 10220 leader_election.cc:304] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91; no voters: 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:25.051132 10448 tablet_bootstrap.cc:492] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d: No bootstrap required, opened a new log
I20260709 13:02:25.051153 10452 raft_consensus.cc:2804] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:25.051751 10448 ts_tablet_manager.cc:1403] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d: Time spent bootstrapping tablet: real 0.020s	user 0.001s	sys 0.015s
I20260709 13:02:25.051784 10452 raft_consensus.cc:493] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.052337 10452 raft_consensus.cc:3060] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:25.054945 10448 raft_consensus.cc:359] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.055711 10448 raft_consensus.cc:385] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:25.055995 10448 raft_consensus.cc:740] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Initialized, Role: FOLLOWER
I20260709 13:02:25.056734 10448 consensus_queue.cc:260] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.057214 10477 raft_consensus.cc:515] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.059221 10448 ts_tablet_manager.cc:1434] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:02:25.060145 10477 leader_election.cc:290] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Requested vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:25.060283 10448 tablet_bootstrap.cc:492] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d: Bootstrap starting.
I20260709 13:02:25.060453 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f5cd8b14c538c2e7738f60338ef" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:25.061167 10405 raft_consensus.cc:3060] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:25.061582 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f5cd8b14c538c2e7738f60338ef" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
W20260709 13:02:25.063167 10221 leader_election.cc:343] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:25.064661 10452 raft_consensus.cc:515] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.067312 10452 leader_election.cc:290] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Requested vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:25.067381 10448 tablet_bootstrap.cc:654] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:25.067687 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85ac435325c4f70a2b4cbe53df70a18" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:25.067867 10404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85ac435325c4f70a2b4cbe53df70a18" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:25.068521 10404 raft_consensus.cc:3060] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:25.069404 10221 leader_election.cc:343] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:25.071455 10405 raft_consensus.cc:2468] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 1.
I20260709 13:02:25.072513 10448 tablet_bootstrap.cc:492] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d: No bootstrap required, opened a new log
I20260709 13:02:25.072979 10448 ts_tablet_manager.cc:1403] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:02:25.073030 10220 leader_election.cc:304] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91; no voters: 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:25.074364 10452 raft_consensus.cc:2804] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:25.075064 10452 raft_consensus.cc:697] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: Becoming Leader. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Running, Role: LEADER
I20260709 13:02:25.075671 10448 raft_consensus.cc:359] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.075853 10404 raft_consensus.cc:2468] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0a7f04feabc43db88767fe91713ce91 in term 1.
I20260709 13:02:25.076440 10448 raft_consensus.cc:385] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:25.075929 10452 consensus_queue.cc:237] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.077348 10448 raft_consensus.cc:740] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Initialized, Role: FOLLOWER
I20260709 13:02:25.078011 10220 leader_election.cc:304] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91; no voters: 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:25.078085 10448 consensus_queue.cc:260] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.079317 10477 raft_consensus.cc:2804] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:25.079783 10477 raft_consensus.cc:697] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: Becoming Leader. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Running, Role: LEADER
I20260709 13:02:25.080638 10448 ts_tablet_manager.cc:1434] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:25.080634 10477 consensus_queue.cc:237] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.082206 10448 tablet_bootstrap.cc:492] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d: Bootstrap starting.
I20260709 13:02:25.091300 10448 tablet_bootstrap.cc:654] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:25.101153 10448 tablet_bootstrap.cc:492] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d: No bootstrap required, opened a new log
I20260709 13:02:25.101595 10448 ts_tablet_manager.cc:1403] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:02:25.104245 10448 raft_consensus.cc:359] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.104950 10448 raft_consensus.cc:385] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:25.104363 10152 catalog_manager.cc:5697] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0a7f04feabc43db88767fe91713ce91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e0a7f04feabc43db88767fe91713ce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.105240 10448 raft_consensus.cc:740] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Initialized, Role: FOLLOWER
I20260709 13:02:25.106017 10448 consensus_queue.cc:260] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.107798 10448 ts_tablet_manager.cc:1434] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:02:25.108489 10448 tablet_bootstrap.cc:492] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d: Bootstrap starting.
I20260709 13:02:25.113345 10448 tablet_bootstrap.cc:654] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:25.117986 10448 tablet_bootstrap.cc:492] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d: No bootstrap required, opened a new log
I20260709 13:02:25.118440 10448 ts_tablet_manager.cc:1403] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d: Time spent bootstrapping tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:02:25.120334 10448 raft_consensus.cc:359] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.120992 10448 raft_consensus.cc:385] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:25.121227 10448 raft_consensus.cc:740] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Initialized, Role: FOLLOWER
I20260709 13:02:25.120549 10155 catalog_manager.cc:5697] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0a7f04feabc43db88767fe91713ce91 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e0a7f04feabc43db88767fe91713ce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.121867 10448 consensus_queue.cc:260] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.123930 10448 ts_tablet_manager.cc:1434] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:02:25.164921 10457 consensus_queue.cc:1048] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:25.175251 10404 raft_consensus.cc:3060] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:25.177064 10472 raft_consensus.cc:493] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.177623 10472 raft_consensus.cc:515] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.179685 10472 leader_election.cc:290] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:25.180713 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16eef5f6224488bf94ab6994023596" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:25.181459 10405 raft_consensus.cc:2468] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 0.
I20260709 13:02:25.182560 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16eef5f6224488bf94ab6994023596" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a7f04feabc43db88767fe91713ce91" is_pre_election: true
I20260709 13:02:25.182720 10295 leader_election.cc:304] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: 
I20260709 13:02:25.183344 10257 raft_consensus.cc:2468] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 0.
I20260709 13:02:25.183578 10472 raft_consensus.cc:2804] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:25.183998 10472 raft_consensus.cc:493] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.184343 10472 raft_consensus.cc:3060] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:25.188521 10457 consensus_queue.cc:1048] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:25.190264 10472 raft_consensus.cc:515] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.192152 10472 leader_election.cc:290] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:25.193140 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16eef5f6224488bf94ab6994023596" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a7f04feabc43db88767fe91713ce91"
I20260709 13:02:25.193482 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16eef5f6224488bf94ab6994023596" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:25.193885 10257 raft_consensus.cc:3060] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:25.194370 10405 raft_consensus.cc:3060] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:25.196763 10452 raft_consensus.cc:493] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.197288 10452 raft_consensus.cc:515] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.199419 10452 leader_election.cc:290] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:25.200209 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba8f845f3dc4317b48fc0a0d92bc54d" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
I20260709 13:02:25.200402 10404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba8f845f3dc4317b48fc0a0d92bc54d" candidate_uuid: "e0a7f04feabc43db88767fe91713ce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:25.201202 10404 raft_consensus.cc:2393] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0a7f04feabc43db88767fe91713ce91 in current term 1: Already voted for candidate 46860c315f4640f5ac4cbd25c1d0719d in this term.
I20260709 13:02:25.201614 10405 raft_consensus.cc:2468] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 1.
I20260709 13:02:25.202201 10220 leader_election.cc:304] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a7f04feabc43db88767fe91713ce91; no voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284
I20260709 13:02:25.202891 10295 leader_election.cc:304] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: 
I20260709 13:02:25.203055 10452 raft_consensus.cc:3060] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:25.203779 10472 raft_consensus.cc:2804] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:25.204239 10472 raft_consensus.cc:697] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Becoming Leader. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Running, Role: LEADER
I20260709 13:02:25.205082 10472 consensus_queue.cc:237] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.205822 10257 raft_consensus.cc:2468] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 1.
I20260709 13:02:25.214076 10452 raft_consensus.cc:2749] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:25.214893 10154 catalog_manager.cc:5697] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d reported cstate change: term changed from 0 to 1, leader changed from <none> to 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.223994 10472 raft_consensus.cc:493] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.224622 10472 raft_consensus.cc:515] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.226523 10472 leader_election.cc:290] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:25.227241 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5515b4df2def48fb9d9590161adf539a" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a7f04feabc43db88767fe91713ce91" is_pre_election: true
I20260709 13:02:25.227537 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5515b4df2def48fb9d9590161adf539a" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:25.228257 10405 raft_consensus.cc:2393] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46860c315f4640f5ac4cbd25c1d0719d in current term 1: Already voted for candidate e0a7f04feabc43db88767fe91713ce91 in this term.
I20260709 13:02:25.229194 10295 leader_election.cc:304] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d; no voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:25.229833 10472 raft_consensus.cc:3060] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:25.234640 10472 raft_consensus.cc:2749] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:25.302202 10472 raft_consensus.cc:493] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.302724 10472 raft_consensus.cc:515] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.304786 10472 leader_election.cc:290] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:25.305387 10452 consensus_queue.cc:1048] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:25.305526 10472 raft_consensus.cc:493] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.305522 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85ac435325c4f70a2b4cbe53df70a18" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a7f04feabc43db88767fe91713ce91" is_pre_election: true
I20260709 13:02:25.306034 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85ac435325c4f70a2b4cbe53df70a18" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:25.306829 10405 raft_consensus.cc:2393] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46860c315f4640f5ac4cbd25c1d0719d in current term 1: Already voted for candidate e0a7f04feabc43db88767fe91713ce91 in this term.
I20260709 13:02:25.306869 10472 raft_consensus.cc:515] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.307950 10295 leader_election.cc:304] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d; no voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:25.308972 10472 leader_election.cc:290] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:25.310438 10257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc8b897939f4b9b96848ce5b8c6f6bd" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a7f04feabc43db88767fe91713ce91" is_pre_election: true
I20260709 13:02:25.311090 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc8b897939f4b9b96848ce5b8c6f6bd" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:25.311900 10405 raft_consensus.cc:2393] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46860c315f4640f5ac4cbd25c1d0719d in current term 1: Already voted for candidate e0a7f04feabc43db88767fe91713ce91 in this term.
I20260709 13:02:25.312462 10472 raft_consensus.cc:3060] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:25.319931 10472 raft_consensus.cc:2749] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:25.320720   431 ts_manager.cc:295] Set tserver state for e0a7f04feabc43db88767fe91713ce91 to MAINTENANCE_MODE
I20260709 13:02:25.321624   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:02:25.321565 10452 consensus_queue.cc:1048] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:25.325418 10295 leader_election.cc:304] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d; no voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:25.328554 10472 raft_consensus.cc:3060] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:25.342943 10472 raft_consensus.cc:2749] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:25.365195   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:25.366297   431 tablet_replica.cc:333] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91: stopping tablet replica
I20260709 13:02:25.367476   431 raft_consensus.cc:2243] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.367854   431 raft_consensus.cc:2272] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.369730   431 tablet_replica.cc:333] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91: stopping tablet replica
I20260709 13:02:25.370337   431 raft_consensus.cc:2243] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.370790   431 raft_consensus.cc:2272] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.372561   431 tablet_replica.cc:333] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: stopping tablet replica
I20260709 13:02:25.373093   431 raft_consensus.cc:2243] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.373682   431 pending_rounds.cc:70] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: Trying to abort 1 pending ops.
I20260709 13:02:25.373880   431 pending_rounds.cc:77] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634386244132864 op_type: NO_OP noop_request { }
I20260709 13:02:25.374256   431 raft_consensus.cc:2889] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:25.374532   431 raft_consensus.cc:2272] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.377075   431 tablet_replica.cc:333] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: stopping tablet replica
I20260709 13:02:25.377703   431 raft_consensus.cc:2243] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.378356   431 pending_rounds.cc:70] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: Trying to abort 1 pending ops.
I20260709 13:02:25.378557   431 pending_rounds.cc:77] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634386278944768 op_type: NO_OP noop_request { }
I20260709 13:02:25.378836   431 raft_consensus.cc:2889] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:25.379114   431 raft_consensus.cc:2272] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.381048   431 tablet_replica.cc:333] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: stopping tablet replica
I20260709 13:02:25.381587   431 raft_consensus.cc:2243] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.382205   431 pending_rounds.cc:70] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: Trying to abort 1 pending ops.
I20260709 13:02:25.382405   431 pending_rounds.cc:77] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634385614348288 op_type: NO_OP noop_request { }
I20260709 13:02:25.382670   431 raft_consensus.cc:2889] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:25.382929   431 raft_consensus.cc:2272] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.384865   431 tablet_replica.cc:333] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91: stopping tablet replica
I20260709 13:02:25.385408   431 raft_consensus.cc:2243] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.385772   431 raft_consensus.cc:2272] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.387739   431 tablet_replica.cc:333] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: stopping tablet replica
I20260709 13:02:25.388260   431 raft_consensus.cc:2243] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.388828   431 pending_rounds.cc:70] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: Trying to abort 1 pending ops.
I20260709 13:02:25.389024   431 pending_rounds.cc:77] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634385575604224 op_type: NO_OP noop_request { }
I20260709 13:02:25.389298   431 raft_consensus.cc:2889] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:25.389564   431 raft_consensus.cc:2272] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.390307 10472 raft_consensus.cc:493] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.390899 10472 raft_consensus.cc:515] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:25.392102   431 tablet_replica.cc:333] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91: stopping tablet replica
I20260709 13:02:25.392907   431 raft_consensus.cc:2243] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.392976 10472 leader_election.cc:290] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:25.394075   431 raft_consensus.cc:2272] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.394980 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f5cd8b14c538c2e7738f60338ef" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:25.396107 10405 raft_consensus.cc:2393] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46860c315f4640f5ac4cbd25c1d0719d in current term 1: Already voted for candidate e0a7f04feabc43db88767fe91713ce91 in this term.
I20260709 13:02:25.396508   431 tablet_replica.cc:333] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91: stopping tablet replica
I20260709 13:02:25.397271   431 raft_consensus.cc:2243] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.397763   431 raft_consensus.cc:2272] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:25.399235 10296 leader_election.cc:336] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:25.399657 10296 leader_election.cc:304] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d; no voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:25.400122   431 tablet_replica.cc:333] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: stopping tablet replica
I20260709 13:02:25.400312 10472 raft_consensus.cc:3060] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:25.400852   431 raft_consensus.cc:2243] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.401597   431 pending_rounds.cc:70] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: Trying to abort 1 pending ops.
I20260709 13:02:25.401839   431 pending_rounds.cc:77] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634385723854848 op_type: NO_OP noop_request { }
I20260709 13:02:25.402185   431 raft_consensus.cc:2889] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:25.402513   431 raft_consensus.cc:2272] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.407266 10472 raft_consensus.cc:2749] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:25.434012   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:02:25.496896 10370 consensus_peers.cc:597] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:25.497067 10472 consensus_queue.cc:1048] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:25.513262 10296 consensus_peers.cc:597] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:25.533106 10489 consensus_queue.cc:1048] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:25.575230 10296 consensus_peers.cc:597] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:25.595889 10519 consensus_queue.cc:1048] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:25.608808 10296 consensus_peers.cc:597] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:25.663627 10203 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:25.943994 10370 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111) [suppressed 227 similar messages]
I20260709 13:02:26.610805 10522 raft_consensus.cc:493] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.611248 10522 raft_consensus.cc:515] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.612862 10522 leader_election.cc:290] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:26.614748 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5515b4df2def48fb9d9590161adf539a" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
I20260709 13:02:26.615456 10330 raft_consensus.cc:2468] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 1.
I20260709 13:02:26.616811 10370 leader_election.cc:304] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: 
W20260709 13:02:26.617595 10370 leader_election.cc:336] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111)
I20260709 13:02:26.617617 10522 raft_consensus.cc:2804] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:26.618119 10522 raft_consensus.cc:493] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.618409 10522 raft_consensus.cc:3060] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.623495 10522 raft_consensus.cc:515] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.625073 10522 leader_election.cc:290] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:26.625725 10522 raft_consensus.cc:493] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.626225 10522 raft_consensus.cc:515] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.626669 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5515b4df2def48fb9d9590161adf539a" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:26.627351 10330 raft_consensus.cc:3060] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.628351 10522 leader_election.cc:290] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:26.629726 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f5cd8b14c538c2e7738f60338ef" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
W20260709 13:02:26.630347 10370 leader_election.cc:336] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111)
I20260709 13:02:26.630452 10332 raft_consensus.cc:2468] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 1.
I20260709 13:02:26.631593 10370 leader_election.cc:304] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: 
I20260709 13:02:26.632244 10522 raft_consensus.cc:2804] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:26.632617 10522 raft_consensus.cc:493] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.633000 10522 raft_consensus.cc:3060] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:26.633932 10370 leader_election.cc:336] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111)
I20260709 13:02:26.634264 10472 raft_consensus.cc:493] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.634912 10330 raft_consensus.cc:2468] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 2.
I20260709 13:02:26.634784 10472 raft_consensus.cc:515] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.635998 10370 leader_election.cc:304] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:26.636919 10472 leader_election.cc:290] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:26.637530 10527 raft_consensus.cc:2804] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:26.638525 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5554190bca4340d58a6bd621f2f307b5" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
I20260709 13:02:26.639423 10405 raft_consensus.cc:2468] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 1.
I20260709 13:02:26.640226 10522 raft_consensus.cc:515] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.640894 10295 leader_election.cc:304] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: 
I20260709 13:02:26.641770 10472 raft_consensus.cc:2804] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:26.642200 10472 raft_consensus.cc:493] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.642573 10472 raft_consensus.cc:3060] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.643512 10522 leader_election.cc:290] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
W20260709 13:02:26.644289 10296 leader_election.cc:336] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111)
I20260709 13:02:26.644490 10527 raft_consensus.cc:697] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Becoming Leader. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:26.645102 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3925f5cd8b14c538c2e7738f60338ef" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:26.645776 10330 raft_consensus.cc:3060] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.645457 10527 consensus_queue.cc:237] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.650787 10472 raft_consensus.cc:515] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
W20260709 13:02:26.653641 10370 leader_election.cc:336] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111)
I20260709 13:02:26.656157 10330 raft_consensus.cc:2468] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 2.
I20260709 13:02:26.655859 10152 catalog_manager.cc:5697] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 reported cstate change: term changed from 1 to 2, leader changed from e0a7f04feabc43db88767fe91713ce91 (127.0.107.193) to 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "46d76034a38d4bd1812f4d0b46507284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.657541 10472 leader_election.cc:290] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 2 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
W20260709 13:02:26.657464 10296 leader_election.cc:336] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111)
I20260709 13:02:26.657805 10370 leader_election.cc:304] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:26.658711 10527 raft_consensus.cc:2804] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:26.659250 10527 raft_consensus.cc:697] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Becoming Leader. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:26.659336 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5554190bca4340d58a6bd621f2f307b5" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:26.660177 10405 raft_consensus.cc:3060] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.660101 10527 consensus_queue.cc:237] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
W20260709 13:02:26.664752 10203 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:26.668430 10405 raft_consensus.cc:2468] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 2.
I20260709 13:02:26.669869 10295 leader_election.cc:304] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:26.670686 10472 raft_consensus.cc:2804] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:26.671921 10472 raft_consensus.cc:697] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 LEADER]: Becoming Leader. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Running, Role: LEADER
I20260709 13:02:26.672863 10472 consensus_queue.cc:237] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.682073 10152 catalog_manager.cc:5697] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d reported cstate change: term changed from 1 to 2, leader changed from e0a7f04feabc43db88767fe91713ce91 (127.0.107.193) to 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.682150 10154 catalog_manager.cc:5697] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 reported cstate change: term changed from 1 to 2, leader changed from e0a7f04feabc43db88767fe91713ce91 (127.0.107.193) to 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "46d76034a38d4bd1812f4d0b46507284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.725693 10527 raft_consensus.cc:493] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.726230 10527 raft_consensus.cc:515] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.727969 10527 leader_election.cc:290] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:26.729700 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc8b897939f4b9b96848ce5b8c6f6bd" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
I20260709 13:02:26.730348 10330 raft_consensus.cc:2468] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 1.
I20260709 13:02:26.731391 10370 leader_election.cc:304] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: 
W20260709 13:02:26.732200 10370 leader_election.cc:336] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111)
I20260709 13:02:26.732199 10527 raft_consensus.cc:2804] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:26.732815 10527 raft_consensus.cc:493] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.733086 10527 raft_consensus.cc:3060] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.738041 10527 raft_consensus.cc:515] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.739866 10527 leader_election.cc:290] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:26.741314 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc8b897939f4b9b96848ce5b8c6f6bd" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:26.741863 10330 raft_consensus.cc:3060] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:26.743395 10370 leader_election.cc:336] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111)
I20260709 13:02:26.746641 10330 raft_consensus.cc:2468] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 2.
I20260709 13:02:26.747617 10370 leader_election.cc:304] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:26.748251 10527 raft_consensus.cc:2804] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:26.748728 10527 raft_consensus.cc:697] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Becoming Leader. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:26.749366 10527 consensus_queue.cc:237] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.757035 10154 catalog_manager.cc:5697] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 reported cstate change: term changed from 1 to 2, leader changed from e0a7f04feabc43db88767fe91713ce91 (127.0.107.193) to 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "46d76034a38d4bd1812f4d0b46507284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.819155 10472 raft_consensus.cc:493] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0a7f04feabc43db88767fe91713ce91)
I20260709 13:02:26.819801 10472 raft_consensus.cc:515] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.821513 10472 leader_election.cc:290] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:26.822698 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fab90839de2476cb7bb6e1d0534181a" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46d76034a38d4bd1812f4d0b46507284" is_pre_election: true
W20260709 13:02:26.825265 10296 leader_election.cc:336] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111)
I20260709 13:02:26.825662 10296 leader_election.cc:304] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d; no voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:26.826274 10472 raft_consensus.cc:2749] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:26.828245 10527 raft_consensus.cc:493] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e0a7f04feabc43db88767fe91713ce91)
I20260709 13:02:26.828711 10527 raft_consensus.cc:515] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.830327 10527 leader_election.cc:290] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:26.831753 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fab90839de2476cb7bb6e1d0534181a" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
I20260709 13:02:26.832320 10330 raft_consensus.cc:2468] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 1.
I20260709 13:02:26.833330 10370 leader_election.cc:304] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: 
I20260709 13:02:26.834097 10527 raft_consensus.cc:2804] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:02:26.834156 10370 leader_election.cc:336] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111)
I20260709 13:02:26.834409 10527 raft_consensus.cc:493] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e0a7f04feabc43db88767fe91713ce91)
I20260709 13:02:26.834806 10527 raft_consensus.cc:3060] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.839874 10527 raft_consensus.cc:515] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.841364 10527 leader_election.cc:290] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:26.842830 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fab90839de2476cb7bb6e1d0534181a" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:26.843391 10330 raft_consensus.cc:3060] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:26.844889 10370 leader_election.cc:336] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111)
I20260709 13:02:26.848163 10330 raft_consensus.cc:2468] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 2.
I20260709 13:02:26.849162 10370 leader_election.cc:304] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:26.849834 10527 raft_consensus.cc:2804] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:26.850358 10527 raft_consensus.cc:697] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Becoming Leader. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:26.851048 10527 consensus_queue.cc:237] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.858459 10154 catalog_manager.cc:5697] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 reported cstate change: term changed from 1 to 2, leader changed from e0a7f04feabc43db88767fe91713ce91 (127.0.107.193) to 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "46d76034a38d4bd1812f4d0b46507284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.863477 10527 raft_consensus.cc:493] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.864045 10527 raft_consensus.cc:515] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.865866 10527 leader_election.cc:290] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:26.868331 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85ac435325c4f70a2b4cbe53df70a18" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d" is_pre_election: true
I20260709 13:02:26.869074 10330 raft_consensus.cc:2468] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 1.
W20260709 13:02:26.870114 10370 leader_election.cc:336] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111)
I20260709 13:02:26.870880 10370 leader_election.cc:304] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:26.871459 10527 raft_consensus.cc:2804] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:26.871771 10527 raft_consensus.cc:493] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.872044 10527 raft_consensus.cc:3060] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.877074 10527 raft_consensus.cc:515] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.878690 10527 leader_election.cc:290] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:26.880276 10330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85ac435325c4f70a2b4cbe53df70a18" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:26.880920 10330 raft_consensus.cc:3060] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:26.882283 10370 leader_election.cc:336] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111)
I20260709 13:02:26.886277 10330 raft_consensus.cc:2468] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 2.
I20260709 13:02:26.887291 10370 leader_election.cc:304] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: e0a7f04feabc43db88767fe91713ce91
I20260709 13:02:26.887893 10527 raft_consensus.cc:2804] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:26.888325 10527 raft_consensus.cc:697] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Becoming Leader. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:26.889163 10527 consensus_queue.cc:237] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:26.896026 10154 catalog_manager.cc:5697] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 reported cstate change: term changed from 1 to 2, leader changed from e0a7f04feabc43db88767fe91713ce91 (127.0.107.193) to 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "46d76034a38d4bd1812f4d0b46507284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:27.057358 10370 consensus_peers.cc:597] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:27.066764 10330 raft_consensus.cc:1275] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Refusing update from remote peer 46d76034a38d4bd1812f4d0b46507284: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:27.068243 10528 consensus_queue.cc:1048] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:27.069850 10370 consensus_peers.cc:597] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:27.135882 10330 raft_consensus.cc:1275] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Refusing update from remote peer 46d76034a38d4bd1812f4d0b46507284: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:27.137341 10528 consensus_queue.cc:1048] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:27.150535 10370 consensus_peers.cc:597] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:27.212704 10405 raft_consensus.cc:1275] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Refusing update from remote peer 46860c315f4640f5ac4cbd25c1d0719d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:27.214038 10472 consensus_queue.cc:1048] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:27.228327 10296 consensus_peers.cc:597] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:27.268823 10330 raft_consensus.cc:1275] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Refusing update from remote peer 46d76034a38d4bd1812f4d0b46507284: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:27.270190 10527 consensus_queue.cc:1048] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.272328 10330 raft_consensus.cc:1275] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Refusing update from remote peer 46d76034a38d4bd1812f4d0b46507284: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:27.273793 10527 consensus_queue.cc:1048] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:27.285493 10370 consensus_peers.cc:597] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:27.345719 10370 consensus_peers.cc:597] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:27.380188 10332 raft_consensus.cc:1275] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Refusing update from remote peer 46d76034a38d4bd1812f4d0b46507284: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:27.381613 10549 consensus_queue.cc:1048] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:27.665810 10203 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:27.957489 10296 consensus_peers.cc:597] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:28.032614 10296 consensus_peers.cc:597] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:28.038528 10370 consensus_peers.cc:597] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:28.191056 10296 consensus_peers.cc:597] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:28.666817 10203 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:29.402304 10370 consensus_peers.cc:597] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:29.473977 10296 consensus_peers.cc:597] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:29.553076 10370 consensus_peers.cc:597] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:29.667703 10203 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:29.718663 10370 consensus_peers.cc:597] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:29.752202 10370 consensus_peers.cc:597] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:29.947875 10370 consensus_peers.cc:597] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:30.397343 10370 consensus_peers.cc:597] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:30.422683 10296 consensus_peers.cc:597] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:30.452625   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:30.458853 10552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:30.459358 10553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:30.460289 10555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:30.462440   431 server_base.cc:1061] running on GCE node
I20260709 13:02:30.463486   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:30.463717   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:30.463950   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602150463927 us; error 0 us; skew 500 ppm
I20260709 13:02:30.464469   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:30.467031   431 webserver.cc:533] Webserver started at http://127.0.107.193:44407/ using document root <none> and password file <none>
I20260709 13:02:30.467530   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:30.467831   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:02:30.471987   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:02:30.476257 10560 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:30.477236   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:02:30.477617   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-0-root
uuid: "e0a7f04feabc43db88767fe91713ce91"
format_stamp: "Formatted at 2026-07-09 13:02:23 on dist-test-slave-zhdc"
W20260709 13:02:30.477705 10296 consensus_peers.cc:597] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:30.477969   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601840662384-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:30.496965   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:30.498169   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:30.499773   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:30.503315 10567 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:02:30.554945   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:02:30.555245   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.053s	user 0.002s	sys 0.000s
I20260709 13:02:30.555490   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:02:30.560111 10567 tablet_bootstrap.cc:492] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:30.572881 10567 tablet_bootstrap.cc:492] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:30.573696 10567 tablet_bootstrap.cc:492] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91: Bootstrap complete.
I20260709 13:02:30.574317 10567 ts_tablet_manager.cc:1403] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:02:30.576335 10567 raft_consensus.cc:359] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.576885 10567 raft_consensus.cc:740] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.577481 10567 consensus_queue.cc:260] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.579783 10567 ts_tablet_manager.cc:1434] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:02:30.580493 10567 tablet_bootstrap.cc:492] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:30.592646 10567 tablet_bootstrap.cc:492] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:02:30.593616 10567 tablet_bootstrap.cc:492] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: Bootstrap complete.
I20260709 13:02:30.594416 10567 ts_tablet_manager.cc:1403] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.003s
I20260709 13:02:30.594722   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:02:30.595141   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.040s	user 0.036s	sys 0.004s
I20260709 13:02:30.597842 10567 raft_consensus.cc:359] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.598734 10567 raft_consensus.cc:740] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.599427 10567 consensus_queue.cc:260] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.600940 10567 ts_tablet_manager.cc:1434] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:02:30.601624 10567 tablet_bootstrap.cc:492] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:30.617050 10567 tablet_bootstrap.cc:492] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:02:30.618178 10567 tablet_bootstrap.cc:492] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: Bootstrap complete.
I20260709 13:02:30.618767 10567 ts_tablet_manager.cc:1403] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:02:30.620935 10567 raft_consensus.cc:359] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.621631 10567 raft_consensus.cc:740] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.622412 10567 consensus_queue.cc:260] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.624234 10567 ts_tablet_manager.cc:1434] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:30.624876 10567 tablet_bootstrap.cc:492] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:30.635596 10567 tablet_bootstrap.cc:492] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:02:30.636377 10567 tablet_bootstrap.cc:492] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: Bootstrap complete.
I20260709 13:02:30.636974 10567 ts_tablet_manager.cc:1403] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:02:30.639272 10567 raft_consensus.cc:359] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.639914 10567 raft_consensus.cc:740] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.640538 10567 consensus_queue.cc:260] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.641993 10567 ts_tablet_manager.cc:1434] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:30.642697 10567 tablet_bootstrap.cc:492] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:30.653481 10567 tablet_bootstrap.cc:492] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:02:30.654378 10567 tablet_bootstrap.cc:492] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: Bootstrap complete.
I20260709 13:02:30.654954 10567 ts_tablet_manager.cc:1403] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.012s	user 0.004s	sys 0.006s
I20260709 13:02:30.656159   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:37037
I20260709 13:02:30.656342 10629 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:37037 every 8 connection(s)
I20260709 13:02:30.657349 10567 raft_consensus.cc:359] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.658020 10567 raft_consensus.cc:740] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.658811 10567 consensus_queue.cc:260] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.660626 10567 ts_tablet_manager.cc:1434] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:02:30.661373 10567 tablet_bootstrap.cc:492] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
W20260709 13:02:30.668772 10203 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:30.674753   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:30.683454 10567 tablet_bootstrap.cc:492] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:02:30.684435 10567 tablet_bootstrap.cc:492] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: Bootstrap complete.
I20260709 13:02:30.685082 10567 ts_tablet_manager.cc:1403] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.000s
I20260709 13:02:30.687813 10567 raft_consensus.cc:359] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.688732 10567 raft_consensus.cc:740] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.689630 10567 consensus_queue.cc:260] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.691390 10567 ts_tablet_manager.cc:1434] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:30.692124 10567 tablet_bootstrap.cc:492] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
W20260709 13:02:30.697350 10296 consensus_peers.cc:597] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:30.698628 10630 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43107
I20260709 13:02:30.699101 10630 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:30.700031 10630 heartbeater.cc:507] Master 127.0.107.254:43107 requested a full tablet report, sending...
I20260709 13:02:30.706247 10152 ts_manager.cc:194] Re-registered known tserver with Master: e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037)
I20260709 13:02:30.709893 10567 tablet_bootstrap.cc:492] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:30.709681 10405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5515b4df2def48fb9d9590161adf539a"
dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
mode: GRACEFUL
new_leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
 from {username='slave'} at 127.0.0.1:57178
I20260709 13:02:30.710493 10405 raft_consensus.cc:606] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Received request to transfer leadership to TS 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:30.710920 10567 tablet_bootstrap.cc:492] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91: Bootstrap complete.
I20260709 13:02:30.711730 10567 ts_tablet_manager.cc:1403] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:02:30.713480 10405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc8b897939f4b9b96848ce5b8c6f6bd"
dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
mode: GRACEFUL
new_leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
 from {username='slave'} at 127.0.0.1:57178
I20260709 13:02:30.714100 10405 raft_consensus.cc:606] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Received request to transfer leadership to TS 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:30.714028 10567 raft_consensus.cc:359] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.714864 10567 raft_consensus.cc:740] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.715518   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:30.715564 10567 consensus_queue.cc:260] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.716212   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:30.716624 10152 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33094
I20260709 13:02:30.717005   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:30.717468 10567 ts_tablet_manager.cc:1434] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:30.718302 10567 tablet_bootstrap.cc:492] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:30.720105 10630 heartbeater.cc:499] Master 127.0.107.254:43107 was elected leader, sending a full tablet report...
I20260709 13:02:30.729202 10567 tablet_bootstrap.cc:492] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:30.729928 10567 tablet_bootstrap.cc:492] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91: Bootstrap complete.
I20260709 13:02:30.730508 10567 ts_tablet_manager.cc:1403] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:02:30.732221 10567 raft_consensus.cc:359] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.732749 10567 raft_consensus.cc:740] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.733371 10567 consensus_queue.cc:260] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.735155 10567 ts_tablet_manager.cc:1434] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:30.735980 10567 tablet_bootstrap.cc:492] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:30.746325 10567 tablet_bootstrap.cc:492] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:30.747116 10567 tablet_bootstrap.cc:492] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91: Bootstrap complete.
I20260709 13:02:30.747792 10567 ts_tablet_manager.cc:1403] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:02:30.750224 10567 raft_consensus.cc:359] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.750687 10567 raft_consensus.cc:740] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.751169 10567 consensus_queue.cc:260] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.752712 10567 ts_tablet_manager.cc:1434] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:30.753563 10567 tablet_bootstrap.cc:492] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91: Bootstrap starting.
I20260709 13:02:30.763959 10567 tablet_bootstrap.cc:492] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:30.764629 10567 tablet_bootstrap.cc:492] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91: Bootstrap complete.
I20260709 13:02:30.765180 10567 ts_tablet_manager.cc:1403] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:02:30.766988 10567 raft_consensus.cc:359] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.767490 10567 raft_consensus.cc:740] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f04feabc43db88767fe91713ce91, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.768100 10567 consensus_queue.cc:260] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.769524 10567 ts_tablet_manager.cc:1434] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:02:30.809461 10604 raft_consensus.cc:3060] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:30.814585 10604 pending_rounds.cc:85] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: Aborting all ops after (but not including) 0
I20260709 13:02:30.814786 10604 pending_rounds.cc:107] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:02:30.814949 10604 raft_consensus.cc:2889] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:30.829838 10604 raft_consensus.cc:3060] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:30.853371 10604 raft_consensus.cc:3060] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:30.858456 10604 pending_rounds.cc:85] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: Aborting all ops after (but not including) 0
I20260709 13:02:30.858673 10604 pending_rounds.cc:107] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:02:30.858932 10604 raft_consensus.cc:2889] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:30.915839 10549 raft_consensus.cc:993] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284: : Instructing follower 46860c315f4640f5ac4cbd25c1d0719d to start an election
I20260709 13:02:30.916311 10647 raft_consensus.cc:1081] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Signalling peer 46860c315f4640f5ac4cbd25c1d0719d to start an election
I20260709 13:02:30.917876 10332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5515b4df2def48fb9d9590161adf539a"
dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
 from {username='slave'} at 127.0.0.1:50526
I20260709 13:02:30.918502 10332 raft_consensus.cc:493] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:30.918880 10332 raft_consensus.cc:3060] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:30.925770 10332 raft_consensus.cc:515] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.927507 10332 leader_election.cc:290] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 3 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:30.928321 10604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5515b4df2def48fb9d9590161adf539a" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e0a7f04feabc43db88767fe91713ce91"
I20260709 13:02:30.928670 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5515b4df2def48fb9d9590161adf539a" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:30.929008 10604 raft_consensus.cc:3060] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:30.929283 10405 raft_consensus.cc:3055] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:30.929651 10405 raft_consensus.cc:740] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:30.930553 10603 raft_consensus.cc:3060] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:30.930531 10405 consensus_queue.cc:260] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.932117 10405 raft_consensus.cc:3060] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:30.932175 10601 raft_consensus.cc:3060] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:30.939311 10603 pending_rounds.cc:85] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: Aborting all ops after (but not including) 0
I20260709 13:02:30.939270 10405 raft_consensus.cc:2468] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 3.
I20260709 13:02:30.939853 10603 pending_rounds.cc:107] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:02:30.940708 10295 leader_election.cc:304] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: 
I20260709 13:02:30.940194 10603 raft_consensus.cc:2889] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:30.941788 10472 raft_consensus.cc:2804] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:30.942034 10601 pending_rounds.cc:85] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: Aborting all ops after (but not including) 0
I20260709 13:02:30.943434 10601 pending_rounds.cc:107] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:02:30.943728 10601 raft_consensus.cc:2889] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:30.947330 10472 raft_consensus.cc:697] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 3 LEADER]: Becoming Leader. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Running, Role: LEADER
I20260709 13:02:30.948304 10472 consensus_queue.cc:237] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:30.950253 10604 raft_consensus.cc:2468] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 3.
I20260709 13:02:30.958987 10152 catalog_manager.cc:5697] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d reported cstate change: term changed from 2 to 3, leader changed from 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195) to 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.090626 10549 raft_consensus.cc:993] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284: : Instructing follower 46860c315f4640f5ac4cbd25c1d0719d to start an election
I20260709 13:02:31.091081 10647 raft_consensus.cc:1081] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Signalling peer 46860c315f4640f5ac4cbd25c1d0719d to start an election
I20260709 13:02:31.092578 10332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc8b897939f4b9b96848ce5b8c6f6bd"
dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
 from {username='slave'} at 127.0.0.1:50526
I20260709 13:02:31.093050 10332 raft_consensus.cc:493] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.093297 10332 raft_consensus.cc:3060] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.098438 10332 raft_consensus.cc:515] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:31.099964 10332 leader_election.cc:290] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 3 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:31.100943 10603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc8b897939f4b9b96848ce5b8c6f6bd" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e0a7f04feabc43db88767fe91713ce91"
I20260709 13:02:31.101001 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc8b897939f4b9b96848ce5b8c6f6bd" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:31.101578 10603 raft_consensus.cc:3060] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.101722 10405 raft_consensus.cc:3055] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:31.102140 10405 raft_consensus.cc:740] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:31.102802 10405 consensus_queue.cc:260] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:31.103722 10405 raft_consensus.cc:3060] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.106616 10603 raft_consensus.cc:2468] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 3.
I20260709 13:02:31.107719 10296 leader_election.cc:304] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, e0a7f04feabc43db88767fe91713ce91; no voters: 
I20260709 13:02:31.108448 10649 raft_consensus.cc:2804] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:31.108698 10405 raft_consensus.cc:2468] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 3.
I20260709 13:02:31.108861 10649 raft_consensus.cc:697] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 3 LEADER]: Becoming Leader. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Running, Role: LEADER
I20260709 13:02:31.109802 10649 consensus_queue.cc:237] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:31.116750 10154 catalog_manager.cc:5697] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d reported cstate change: term changed from 2 to 3, leader changed from 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195) to 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.376521 10601 raft_consensus.cc:1275] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Refusing update from remote peer 46860c315f4640f5ac4cbd25c1d0719d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:31.378825 10661 consensus_queue.cc:1048] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:31.380201 10661 consensus_queue.cc:1243] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Peer e0a7f04feabc43db88767fe91713ce91 log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:02:31.383419 10601 pending_rounds.cc:85] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: Aborting all ops after (but not including) 0
I20260709 13:02:31.383839 10601 pending_rounds.cc:107] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:02:31.384258 10601 raft_consensus.cc:2889] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:31.401695 10405 raft_consensus.cc:1275] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Refusing update from remote peer 46860c315f4640f5ac4cbd25c1d0719d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:31.403275 10649 consensus_queue.cc:1048] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:31.510864 10603 raft_consensus.cc:1275] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Refusing update from remote peer 46860c315f4640f5ac4cbd25c1d0719d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:31.512530 10661 consensus_queue.cc:1048] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:31.523010 10404 raft_consensus.cc:1275] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Refusing update from remote peer 46860c315f4640f5ac4cbd25c1d0719d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:31.524498 10661 consensus_queue.cc:1048] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:31.670090 10203 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:31.724424   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:31.745741 10332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "157a8b8ce94541508975e963ced659d5"
dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
mode: GRACEFUL
new_leader_uuid: "46d76034a38d4bd1812f4d0b46507284"
 from {username='slave'} at 127.0.0.1:43268
I20260709 13:02:31.746390 10332 raft_consensus.cc:606] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Received request to transfer leadership to TS 46d76034a38d4bd1812f4d0b46507284
I20260709 13:02:31.749305 10332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab16eef5f6224488bf94ab6994023596"
dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
mode: GRACEFUL
new_leader_uuid: "46d76034a38d4bd1812f4d0b46507284"
 from {username='slave'} at 127.0.0.1:43268
I20260709 13:02:31.749752 10332 raft_consensus.cc:606] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Received request to transfer leadership to TS 46d76034a38d4bd1812f4d0b46507284
I20260709 13:02:31.750841   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:31.751379   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:31.752192   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:31.996235 10472 raft_consensus.cc:993] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d: : Instructing follower 46d76034a38d4bd1812f4d0b46507284 to start an election
I20260709 13:02:31.996680 10472 raft_consensus.cc:1081] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Signalling peer 46d76034a38d4bd1812f4d0b46507284 to start an election
I20260709 13:02:31.998153 10404 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab16eef5f6224488bf94ab6994023596"
dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
 from {username='slave'} at 127.0.0.1:57334
I20260709 13:02:31.998656 10404 raft_consensus.cc:493] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.999091 10404 raft_consensus.cc:3060] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:32.009339 10404 raft_consensus.cc:515] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:32.011281 10404 leader_election.cc:290] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:32.012181 10601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16eef5f6224488bf94ab6994023596" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0a7f04feabc43db88767fe91713ce91"
I20260709 13:02:32.012389 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16eef5f6224488bf94ab6994023596" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:32.013041 10601 raft_consensus.cc:3060] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:32.013089 10332 raft_consensus.cc:3055] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:32.013554 10332 raft_consensus.cc:740] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Running, Role: LEADER
I20260709 13:02:32.014500 10332 consensus_queue.cc:260] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:32.015590 10332 raft_consensus.cc:3060] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:32.021420 10601 raft_consensus.cc:2468] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 2.
I20260709 13:02:32.022486 10332 raft_consensus.cc:2468] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 2.
I20260709 13:02:32.023120 10370 leader_election.cc:304] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91; no voters: 
I20260709 13:02:32.024329 10659 raft_consensus.cc:2804] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:32.026993 10659 raft_consensus.cc:697] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Becoming Leader. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:32.027943 10659 consensus_queue.cc:237] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:32.034850 10152 catalog_manager.cc:5697] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 reported cstate change: term changed from 1 to 2, leader changed from 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194) to 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "46d76034a38d4bd1812f4d0b46507284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:32.090020 10649 raft_consensus.cc:993] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d: : Instructing follower 46d76034a38d4bd1812f4d0b46507284 to start an election
I20260709 13:02:32.090557 10649 raft_consensus.cc:1081] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Signalling peer 46d76034a38d4bd1812f4d0b46507284 to start an election
I20260709 13:02:32.092058 10404 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "157a8b8ce94541508975e963ced659d5"
dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
 from {username='slave'} at 127.0.0.1:57334
I20260709 13:02:32.092646 10404 raft_consensus.cc:493] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:32.093034 10404 raft_consensus.cc:3060] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:32.099114 10404 raft_consensus.cc:515] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:32.100663 10404 leader_election.cc:290] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:32.101531 10601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157a8b8ce94541508975e963ced659d5" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0a7f04feabc43db88767fe91713ce91"
I20260709 13:02:32.101603 10332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157a8b8ce94541508975e963ced659d5" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:32.102420 10601 raft_consensus.cc:3060] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:32.102676 10332 raft_consensus.cc:3055] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:32.103085 10332 raft_consensus.cc:740] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Running, Role: LEADER
I20260709 13:02:32.103897 10332 consensus_queue.cc:260] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:32.105041 10332 raft_consensus.cc:3060] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:32.108192 10601 raft_consensus.cc:2468] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 2.
I20260709 13:02:32.109465 10370 leader_election.cc:304] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91; no voters: 
I20260709 13:02:32.110006 10332 raft_consensus.cc:2468] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 2.
I20260709 13:02:32.110292 10669 raft_consensus.cc:2804] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:32.110834 10669 raft_consensus.cc:697] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Becoming Leader. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:32.111758 10669 consensus_queue.cc:237] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:32.118856 10152 catalog_manager.cc:5697] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 reported cstate change: term changed from 1 to 2, leader changed from 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194) to 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "46d76034a38d4bd1812f4d0b46507284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:32.516995 10332 raft_consensus.cc:1275] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Refusing update from remote peer 46d76034a38d4bd1812f4d0b46507284: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:32.518159 10659 consensus_queue.cc:1048] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:32.531649 10601 raft_consensus.cc:1275] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Refusing update from remote peer 46d76034a38d4bd1812f4d0b46507284: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:32.533322 10676 consensus_queue.cc:1048] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:32.585618 10601 raft_consensus.cc:1275] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Refusing update from remote peer 46d76034a38d4bd1812f4d0b46507284: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:32.586925 10676 consensus_queue.cc:1048] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:32.597402 10332 raft_consensus.cc:1275] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Refusing update from remote peer 46d76034a38d4bd1812f4d0b46507284: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:32.599215 10669 consensus_queue.cc:1048] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:32.671115 10203 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:32.816779   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:33.329380 10405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fab90839de2476cb7bb6e1d0534181a"
dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
mode: GRACEFUL
new_leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
 from {username='slave'} at 127.0.0.1:57178
I20260709 13:02:33.330092 10405 raft_consensus.cc:606] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Received request to transfer leadership to TS 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:33.333525 10404 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab16eef5f6224488bf94ab6994023596"
dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
mode: GRACEFUL
new_leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
 from {username='slave'} at 127.0.0.1:57178
I20260709 13:02:33.334201 10404 raft_consensus.cc:606] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Received request to transfer leadership to TS 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:33.335582   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:33.336206   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:33.336825   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:33.364059 10676 raft_consensus.cc:993] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284: : Instructing follower 46860c315f4640f5ac4cbd25c1d0719d to start an election
I20260709 13:02:33.364701 10676 raft_consensus.cc:1081] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Signalling peer 46860c315f4640f5ac4cbd25c1d0719d to start an election
I20260709 13:02:33.370149 10332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab16eef5f6224488bf94ab6994023596"
dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
 from {username='slave'} at 127.0.0.1:50526
I20260709 13:02:33.370718 10332 raft_consensus.cc:493] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:33.371035 10332 raft_consensus.cc:3060] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:33.371918 10686 raft_consensus.cc:993] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284: : Instructing follower 46860c315f4640f5ac4cbd25c1d0719d to start an election
I20260709 13:02:33.372478 10669 raft_consensus.cc:1081] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Signalling peer 46860c315f4640f5ac4cbd25c1d0719d to start an election
I20260709 13:02:33.374172 10329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fab90839de2476cb7bb6e1d0534181a"
dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
 from {username='slave'} at 127.0.0.1:50526
I20260709 13:02:33.374687 10329 raft_consensus.cc:493] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:33.374993 10329 raft_consensus.cc:3060] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:33.376950 10332 raft_consensus.cc:515] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:33.379112 10332 leader_election.cc:290] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 3 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:33.379503 10601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16eef5f6224488bf94ab6994023596" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e0a7f04feabc43db88767fe91713ce91"
I20260709 13:02:33.379822 10404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16eef5f6224488bf94ab6994023596" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:33.380295 10601 raft_consensus.cc:3060] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:33.380522 10404 raft_consensus.cc:3055] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:33.380946 10404 raft_consensus.cc:740] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:33.381686 10404 consensus_queue.cc:260] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:33.382714 10404 raft_consensus.cc:3060] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:33.383116 10329 raft_consensus.cc:515] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:33.386233 10600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fab90839de2476cb7bb6e1d0534181a" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e0a7f04feabc43db88767fe91713ce91"
I20260709 13:02:33.386891 10600 raft_consensus.cc:3060] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:33.386914 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fab90839de2476cb7bb6e1d0534181a" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:33.387672 10405 raft_consensus.cc:3055] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:33.387997 10405 raft_consensus.cc:740] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:33.388127 10329 leader_election.cc:290] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 3 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:33.389153 10405 consensus_queue.cc:260] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:33.389557 10404 raft_consensus.cc:2468] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 3.
I20260709 13:02:33.390192 10405 raft_consensus.cc:3060] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:33.387969 10601 raft_consensus.cc:2468] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 3.
I20260709 13:02:33.391304 10295 leader_election.cc:304] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: 
I20260709 13:02:33.392556 10685 raft_consensus.cc:2804] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:33.393095 10685 raft_consensus.cc:697] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 3 LEADER]: Becoming Leader. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Running, Role: LEADER
I20260709 13:02:33.393972 10685 consensus_queue.cc:237] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:33.395547 10600 raft_consensus.cc:2468] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 3.
I20260709 13:02:33.396967 10296 leader_election.cc:304] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, e0a7f04feabc43db88767fe91713ce91; no voters: 
I20260709 13:02:33.397979 10649 raft_consensus.cc:2804] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:33.398767 10405 raft_consensus.cc:2468] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 3.
I20260709 13:02:33.399134 10649 raft_consensus.cc:697] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 3 LEADER]: Becoming Leader. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Running, Role: LEADER
I20260709 13:02:33.400204 10649 consensus_queue.cc:237] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:33.403836 10155 catalog_manager.cc:5697] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d reported cstate change: term changed from 2 to 3, leader changed from 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195) to 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:33.418524 10155 catalog_manager.cc:5697] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d reported cstate change: term changed from 2 to 3, leader changed from 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195) to 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:33.672053 10203 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:33.789172 10353 debug-util.cc:398] Leaking SignalData structure 0x7b080025ce00 after lost signal to thread 434
W20260709 13:02:33.790293 10353 debug-util.cc:398] Leaking SignalData structure 0x7b080023ff80 after lost signal to thread 10189
W20260709 13:02:33.791332 10353 debug-util.cc:398] Leaking SignalData structure 0x7b08003050a0 after lost signal to thread 10356
W20260709 13:02:33.792625 10353 debug-util.cc:398] Leaking SignalData structure 0x7b08002e55c0 after lost signal to thread 10430
W20260709 13:02:33.793613 10353 debug-util.cc:398] Leaking SignalData structure 0x7b0800286aa0 after lost signal to thread 10629
I20260709 13:02:33.813764 10600 raft_consensus.cc:1275] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Refusing update from remote peer 46860c315f4640f5ac4cbd25c1d0719d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:33.815485 10649 consensus_queue.cc:1048] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:33.829483 10405 raft_consensus.cc:1275] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Refusing update from remote peer 46860c315f4640f5ac4cbd25c1d0719d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:33.831102 10649 consensus_queue.cc:1048] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:33.862825 10600 raft_consensus.cc:1275] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Refusing update from remote peer 46860c315f4640f5ac4cbd25c1d0719d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:33.864054 10649 consensus_queue.cc:1048] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:33.877688 10405 raft_consensus.cc:1275] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Refusing update from remote peer 46860c315f4640f5ac4cbd25c1d0719d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:33.879122 10687 consensus_queue.cc:1048] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:34.348950   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:34.356714 10329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5554190bca4340d58a6bd621f2f307b5"
dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
mode: GRACEFUL
new_leader_uuid: "46d76034a38d4bd1812f4d0b46507284"
 from {username='slave'} at 127.0.0.1:43268
I20260709 13:02:34.357597 10329 raft_consensus.cc:606] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 LEADER]: Received request to transfer leadership to TS 46d76034a38d4bd1812f4d0b46507284
I20260709 13:02:34.362279 10329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ba8f845f3dc4317b48fc0a0d92bc54d"
dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
mode: GRACEFUL
new_leader_uuid: "46d76034a38d4bd1812f4d0b46507284"
 from {username='slave'} at 127.0.0.1:43268
I20260709 13:02:34.363000 10329 raft_consensus.cc:606] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Received request to transfer leadership to TS 46d76034a38d4bd1812f4d0b46507284
I20260709 13:02:34.364283   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:34.364804   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:34.365394   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:34.650552 10649 raft_consensus.cc:993] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d: : Instructing follower 46d76034a38d4bd1812f4d0b46507284 to start an election
I20260709 13:02:34.651167 10649 raft_consensus.cc:1081] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Signalling peer 46d76034a38d4bd1812f4d0b46507284 to start an election
I20260709 13:02:34.652900 10405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ba8f845f3dc4317b48fc0a0d92bc54d"
dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
 from {username='slave'} at 127.0.0.1:57334
I20260709 13:02:34.653383 10405 raft_consensus.cc:493] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:34.653685 10405 raft_consensus.cc:3060] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:34.658634 10405 raft_consensus.cc:515] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:34.660055 10405 leader_election.cc:290] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:34.661199 10329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba8f845f3dc4317b48fc0a0d92bc54d" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:34.661073 10600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba8f845f3dc4317b48fc0a0d92bc54d" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e0a7f04feabc43db88767fe91713ce91"
I20260709 13:02:34.662077 10329 raft_consensus.cc:3055] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:34.662215 10600 raft_consensus.cc:3060] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:34.662487 10329 raft_consensus.cc:740] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Running, Role: LEADER
I20260709 13:02:34.663440 10329 consensus_queue.cc:260] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:34.664484 10329 raft_consensus.cc:3060] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:34.669459 10329 raft_consensus.cc:2468] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 2.
I20260709 13:02:34.670571 10370 leader_election.cc:304] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, 46d76034a38d4bd1812f4d0b46507284; no voters: 
I20260709 13:02:34.670465 10600 raft_consensus.cc:2468] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 2.
I20260709 13:02:34.671494 10701 raft_consensus.cc:2804] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:34.672427 10701 raft_consensus.cc:697] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Becoming Leader. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
W20260709 13:02:34.673089 10203 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:34.673521 10701 consensus_queue.cc:237] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:34.684496 10152 catalog_manager.cc:5697] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 reported cstate change: term changed from 1 to 2, leader changed from 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194) to 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "46d76034a38d4bd1812f4d0b46507284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:34.796556 10687 raft_consensus.cc:993] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d: : Instructing follower 46d76034a38d4bd1812f4d0b46507284 to start an election
I20260709 13:02:34.797073 10649 raft_consensus.cc:1081] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 LEADER]: Signalling peer 46d76034a38d4bd1812f4d0b46507284 to start an election
I20260709 13:02:34.798813 10405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5554190bca4340d58a6bd621f2f307b5"
dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
 from {username='slave'} at 127.0.0.1:57334
I20260709 13:02:34.799418 10405 raft_consensus.cc:493] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:34.799860 10405 raft_consensus.cc:3060] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.809495 10405 raft_consensus.cc:515] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:34.812214 10405 leader_election.cc:290] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 3 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161)
I20260709 13:02:34.813073 10600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5554190bca4340d58a6bd621f2f307b5" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e0a7f04feabc43db88767fe91713ce91"
I20260709 13:02:34.813874 10600 raft_consensus.cc:3060] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.819265 10329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5554190bca4340d58a6bd621f2f307b5" candidate_uuid: "46d76034a38d4bd1812f4d0b46507284" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
I20260709 13:02:34.820025 10329 raft_consensus.cc:3055] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:34.820447 10329 raft_consensus.cc:740] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Running, Role: LEADER
I20260709 13:02:34.821333 10329 consensus_queue.cc:260] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:34.822084 10600 raft_consensus.cc:2468] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 3.
I20260709 13:02:34.823153 10329 raft_consensus.cc:3060] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.823585 10370 leader_election.cc:304] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46d76034a38d4bd1812f4d0b46507284, e0a7f04feabc43db88767fe91713ce91; no voters: 
I20260709 13:02:34.824532 10701 raft_consensus.cc:2804] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:34.825361 10701 raft_consensus.cc:697] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 3 LEADER]: Becoming Leader. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:34.827556 10701 consensus_queue.cc:237] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:34.834264 10329 raft_consensus.cc:2468] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d76034a38d4bd1812f4d0b46507284 in term 3.
I20260709 13:02:34.840546 10152 catalog_manager.cc:5697] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 reported cstate change: term changed from 2 to 3, leader changed from 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194) to 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "46d76034a38d4bd1812f4d0b46507284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.059978 10329 raft_consensus.cc:1275] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Refusing update from remote peer 46d76034a38d4bd1812f4d0b46507284: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:35.061434 10701 consensus_queue.cc:1048] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:35.075268 10600 raft_consensus.cc:1275] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Refusing update from remote peer 46d76034a38d4bd1812f4d0b46507284: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:35.077270 10702 consensus_queue.cc:1048] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:35.266425 10600 raft_consensus.cc:1275] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Refusing update from remote peer 46d76034a38d4bd1812f4d0b46507284: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:35.267681 10711 consensus_queue.cc:1048] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:35.278913 10329 raft_consensus.cc:1275] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Refusing update from remote peer 46d76034a38d4bd1812f4d0b46507284: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:35.283211 10711 consensus_queue.cc:1048] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:35.374008   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:35.385357 10405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ba8f845f3dc4317b48fc0a0d92bc54d"
dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
mode: GRACEFUL
new_leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
 from {username='slave'} at 127.0.0.1:57178
I20260709 13:02:35.385875 10405 raft_consensus.cc:606] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Received request to transfer leadership to TS 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:35.388572 10405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c85ac435325c4f70a2b4cbe53df70a18"
dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
mode: GRACEFUL
new_leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
 from {username='slave'} at 127.0.0.1:57178
I20260709 13:02:35.389020 10405 raft_consensus.cc:606] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Received request to transfer leadership to TS 46860c315f4640f5ac4cbd25c1d0719d
I20260709 13:02:35.390203   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:35.390900   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:35.391649   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:35.643219 10702 raft_consensus.cc:993] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284: : Instructing follower 46860c315f4640f5ac4cbd25c1d0719d to start an election
I20260709 13:02:35.643807 10711 raft_consensus.cc:1081] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Signalling peer 46860c315f4640f5ac4cbd25c1d0719d to start an election
I20260709 13:02:35.645402 10329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ba8f845f3dc4317b48fc0a0d92bc54d"
dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
 from {username='slave'} at 127.0.0.1:50526
I20260709 13:02:35.646112 10329 raft_consensus.cc:493] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:35.646507 10329 raft_consensus.cc:3060] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.655037 10329 raft_consensus.cc:515] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:35.657671 10329 leader_election.cc:290] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 3 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:35.659034 10600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba8f845f3dc4317b48fc0a0d92bc54d" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e0a7f04feabc43db88767fe91713ce91"
I20260709 13:02:35.659912 10600 raft_consensus.cc:3060] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.660076 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba8f845f3dc4317b48fc0a0d92bc54d" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:35.660835 10405 raft_consensus.cc:3055] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:35.661185 10405 raft_consensus.cc:740] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:35.661993 10405 consensus_queue.cc:260] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:35.663141 10405 raft_consensus.cc:3060] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.668051 10600 raft_consensus.cc:2468] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 3.
I20260709 13:02:35.669361 10296 leader_election.cc:304] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, e0a7f04feabc43db88767fe91713ce91; no voters: 
I20260709 13:02:35.670104 10649 raft_consensus.cc:2804] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:35.670655 10405 raft_consensus.cc:2468] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 3.
I20260709 13:02:35.672860 10649 raft_consensus.cc:697] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 3 LEADER]: Becoming Leader. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Running, Role: LEADER
W20260709 13:02:35.674337 10203 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:35.673804 10649 consensus_queue.cc:237] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:35.682595 10155 catalog_manager.cc:5697] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d reported cstate change: term changed from 2 to 3, leader changed from 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195) to 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.756805 10701 raft_consensus.cc:993] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284: : Instructing follower 46860c315f4640f5ac4cbd25c1d0719d to start an election
I20260709 13:02:35.757329 10711 raft_consensus.cc:1081] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Signalling peer 46860c315f4640f5ac4cbd25c1d0719d to start an election
I20260709 13:02:35.758947 10329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c85ac435325c4f70a2b4cbe53df70a18"
dest_uuid: "46860c315f4640f5ac4cbd25c1d0719d"
 from {username='slave'} at 127.0.0.1:50526
I20260709 13:02:35.759442 10329 raft_consensus.cc:493] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:35.759775 10329 raft_consensus.cc:3060] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.766276 10329 raft_consensus.cc:515] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:35.768326 10329 leader_election.cc:290] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 3 election: Requested vote from peers e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037), 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195:42569)
I20260709 13:02:35.769335 10405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85ac435325c4f70a2b4cbe53df70a18" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "46d76034a38d4bd1812f4d0b46507284"
I20260709 13:02:35.769203 10600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c85ac435325c4f70a2b4cbe53df70a18" candidate_uuid: "46860c315f4640f5ac4cbd25c1d0719d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e0a7f04feabc43db88767fe91713ce91"
I20260709 13:02:35.770076 10405 raft_consensus.cc:3055] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:35.770138 10600 raft_consensus.cc:3060] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.770481 10405 raft_consensus.cc:740] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46d76034a38d4bd1812f4d0b46507284, State: Running, Role: LEADER
I20260709 13:02:35.771309 10405 consensus_queue.cc:260] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:35.772608 10405 raft_consensus.cc:3060] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:35.777751 10600 raft_consensus.cc:2468] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 3.
I20260709 13:02:35.779126 10296 leader_election.cc:304] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46860c315f4640f5ac4cbd25c1d0719d, e0a7f04feabc43db88767fe91713ce91; no voters: 
I20260709 13:02:35.779534 10405 raft_consensus.cc:2468] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46860c315f4640f5ac4cbd25c1d0719d in term 3.
I20260709 13:02:35.780035 10649 raft_consensus.cc:2804] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:35.780715 10649 raft_consensus.cc:697] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 3 LEADER]: Becoming Leader. State: Replica: 46860c315f4640f5ac4cbd25c1d0719d, State: Running, Role: LEADER
I20260709 13:02:35.781858 10649 consensus_queue.cc:237] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } }
I20260709 13:02:35.790797 10155 catalog_manager.cc:5697] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d reported cstate change: term changed from 2 to 3, leader changed from 46d76034a38d4bd1812f4d0b46507284 (127.0.107.195) to 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "46860c315f4640f5ac4cbd25c1d0719d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46860c315f4640f5ac4cbd25c1d0719d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.150628 10405 raft_consensus.cc:1275] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Refusing update from remote peer 46860c315f4640f5ac4cbd25c1d0719d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:36.151814 10649 consensus_queue.cc:1048] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:36.155128 10600 raft_consensus.cc:1275] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Refusing update from remote peer 46860c315f4640f5ac4cbd25c1d0719d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:36.156965 10649 consensus_queue.cc:1048] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:36.194288 10405 raft_consensus.cc:1275] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Refusing update from remote peer 46860c315f4640f5ac4cbd25c1d0719d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:36.195503 10687 consensus_queue.cc:1048] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d76034a38d4bd1812f4d0b46507284" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:36.205581 10601 raft_consensus.cc:1275] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Refusing update from remote peer 46860c315f4640f5ac4cbd25c1d0719d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:36.207646 10649 consensus_queue.cc:1048] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0a7f04feabc43db88767fe91713ce91" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:36.401479   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:36.441780   431 tablet_server.cc:179] TabletServer@127.0.107.193:37037 shutting down...
I20260709 13:02:36.477017   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:36.478036   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:36.479269   431 raft_consensus.cc:2243] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.479943   431 raft_consensus.cc:2272] T ea171107b1b9440eb3175176f6ec28a6 P e0a7f04feabc43db88767fe91713ce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.483753   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:36.484731   431 raft_consensus.cc:2243] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.485323   431 raft_consensus.cc:2272] T 5ba8f845f3dc4317b48fc0a0d92bc54d P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.489207   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:36.490180   431 raft_consensus.cc:2243] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.490800   431 raft_consensus.cc:2272] T 5515b4df2def48fb9d9590161adf539a P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.494534   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:36.495563   431 raft_consensus.cc:2243] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.496397   431 raft_consensus.cc:2272] T c3925f5cd8b14c538c2e7738f60338ef P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.500165   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:36.501030   431 raft_consensus.cc:2243] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.501660   431 raft_consensus.cc:2272] T c85ac435325c4f70a2b4cbe53df70a18 P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.505667   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:36.506547   431 raft_consensus.cc:2243] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.507194   431 raft_consensus.cc:2272] T 5554190bca4340d58a6bd621f2f307b5 P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.510515   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:36.511366   431 raft_consensus.cc:2243] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.511997   431 raft_consensus.cc:2272] T ab16eef5f6224488bf94ab6994023596 P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.515280   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:36.516057   431 raft_consensus.cc:2243] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.516649   431 raft_consensus.cc:2272] T acc8b897939f4b9b96848ce5b8c6f6bd P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.519976   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:36.520712   431 raft_consensus.cc:2243] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.521235   431 raft_consensus.cc:2272] T 157a8b8ce94541508975e963ced659d5 P e0a7f04feabc43db88767fe91713ce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.524366   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:36.525056   431 raft_consensus.cc:2243] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.525630   431 raft_consensus.cc:2272] T 8fab90839de2476cb7bb6e1d0534181a P e0a7f04feabc43db88767fe91713ce91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.568092   431 tablet_server.cc:196] TabletServer@127.0.107.193:37037 shutdown complete.
W20260709 13:02:36.580752 10370 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111) [suppressed 97 similar messages]
W20260709 13:02:36.584543 10370 consensus_peers.cc:597] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:36.604476 10370 consensus_peers.cc:597] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:36.611064   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:02:36.650301   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:36.651149   431 tablet_replica.cc:333] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d: stopping tablet replica
I20260709 13:02:36.652235   431 raft_consensus.cc:2243] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.653136   431 raft_consensus.cc:2272] T 5515b4df2def48fb9d9590161adf539a P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.655819   431 tablet_replica.cc:333] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d: stopping tablet replica
I20260709 13:02:36.656807   431 raft_consensus.cc:2243] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.657333   431 raft_consensus.cc:2272] T c3925f5cd8b14c538c2e7738f60338ef P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.660599   431 tablet_replica.cc:333] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d: stopping tablet replica
I20260709 13:02:36.661453   431 raft_consensus.cc:2243] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:02:36.661679 10296 consensus_peers.cc:597] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:36.662375   431 raft_consensus.cc:2272] T c85ac435325c4f70a2b4cbe53df70a18 P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.664834   431 tablet_replica.cc:333] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d: stopping tablet replica
I20260709 13:02:36.665634   431 raft_consensus.cc:2243] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.666530   431 raft_consensus.cc:2272] T acc8b897939f4b9b96848ce5b8c6f6bd P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.669267   431 tablet_replica.cc:333] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d: stopping tablet replica
W20260709 13:02:36.669709 10370 consensus_peers.cc:597] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 -> Peer 46860c315f4640f5ac4cbd25c1d0719d (127.0.107.194:33161): Couldn't send request to peer 46860c315f4640f5ac4cbd25c1d0719d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:36.670110   431 raft_consensus.cc:2243] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.670943   431 raft_consensus.cc:2272] T ab16eef5f6224488bf94ab6994023596 P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.673035   431 tablet_replica.cc:333] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d: stopping tablet replica
I20260709 13:02:36.673570   431 raft_consensus.cc:2243] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.674016   431 raft_consensus.cc:2272] T 5554190bca4340d58a6bd621f2f307b5 P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:36.675455 10203 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:36.676719   431 tablet_replica.cc:333] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d: stopping tablet replica
I20260709 13:02:36.677386   431 raft_consensus.cc:2243] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.677806   431 raft_consensus.cc:2272] T 157a8b8ce94541508975e963ced659d5 P 46860c315f4640f5ac4cbd25c1d0719d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.679947   431 tablet_replica.cc:333] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d: stopping tablet replica
I20260709 13:02:36.680469   431 raft_consensus.cc:2243] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.681202   431 raft_consensus.cc:2272] T 8fab90839de2476cb7bb6e1d0534181a P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.683164   431 tablet_replica.cc:333] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d: stopping tablet replica
I20260709 13:02:36.683717   431 raft_consensus.cc:2243] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.684449   431 raft_consensus.cc:2272] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46860c315f4640f5ac4cbd25c1d0719d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.687747   431 tablet_replica.cc:333] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d: stopping tablet replica
I20260709 13:02:36.688287   431 raft_consensus.cc:2243] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.688793   431 raft_consensus.cc:2272] T ea171107b1b9440eb3175176f6ec28a6 P 46860c315f4640f5ac4cbd25c1d0719d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:36.725472 10370 consensus_peers.cc:597] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 -> Peer e0a7f04feabc43db88767fe91713ce91 (127.0.107.193:37037): Couldn't send request to peer e0a7f04feabc43db88767fe91713ce91. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:36.804774   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:02:36.830211   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:02:36.856487   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:36.857275   431 tablet_replica.cc:333] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284: stopping tablet replica
I20260709 13:02:36.858453   431 raft_consensus.cc:2243] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.858984   431 raft_consensus.cc:2272] T c85ac435325c4f70a2b4cbe53df70a18 P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.862447   431 tablet_replica.cc:333] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284: stopping tablet replica
I20260709 13:02:36.862977   431 raft_consensus.cc:2243] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.863826   431 raft_consensus.cc:2272] T c3925f5cd8b14c538c2e7738f60338ef P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.866217   431 tablet_replica.cc:333] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284: stopping tablet replica
I20260709 13:02:36.866762   431 raft_consensus.cc:2243] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.867436   431 raft_consensus.cc:2272] T 5554190bca4340d58a6bd621f2f307b5 P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.869762   431 tablet_replica.cc:333] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284: stopping tablet replica
I20260709 13:02:36.870440   431 raft_consensus.cc:2243] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.870798   431 raft_consensus.cc:2272] T 5ba8f845f3dc4317b48fc0a0d92bc54d P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.873147   431 tablet_replica.cc:333] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284: stopping tablet replica
I20260709 13:02:36.873660   431 raft_consensus.cc:2243] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.874018   431 raft_consensus.cc:2272] T ab16eef5f6224488bf94ab6994023596 P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.876085   431 tablet_replica.cc:333] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284: stopping tablet replica
I20260709 13:02:36.876605   431 raft_consensus.cc:2243] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.876972   431 raft_consensus.cc:2272] T acc8b897939f4b9b96848ce5b8c6f6bd P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.879101   431 tablet_replica.cc:333] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284: stopping tablet replica
I20260709 13:02:36.879885   431 raft_consensus.cc:2243] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.880715   431 raft_consensus.cc:2272] T 157a8b8ce94541508975e963ced659d5 P 46d76034a38d4bd1812f4d0b46507284 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.882664   431 tablet_replica.cc:333] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284: stopping tablet replica
I20260709 13:02:36.883160   431 raft_consensus.cc:2243] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.883559   431 raft_consensus.cc:2272] T 8fab90839de2476cb7bb6e1d0534181a P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.885496   431 tablet_replica.cc:333] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284: stopping tablet replica
I20260709 13:02:36.886025   431 raft_consensus.cc:2243] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:36.886518   431 raft_consensus.cc:2272] T 5515b4df2def48fb9d9590161adf539a P 46d76034a38d4bd1812f4d0b46507284 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.888370   431 tablet_replica.cc:333] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284: stopping tablet replica
I20260709 13:02:36.888829   431 raft_consensus.cc:2243] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.889580   431 raft_consensus.cc:2272] T ea171107b1b9440eb3175176f6ec28a6 P 46d76034a38d4bd1812f4d0b46507284 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.920753   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:36.945405   431 master.cc:562] Master@127.0.107.254:43107 shutting down...
I20260709 13:02:36.967900   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:36.968508   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:36.968881   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1ebddc538aac40199220e3b480615bc3: stopping tablet replica
I20260709 13:02:36.989980   431 master.cc:584] Master@127.0.107.254:43107 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13508 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:02:37.040518   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:44103
I20260709 13:02:37.041774   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:37.047755 10739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:37.047847 10738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:37.048228 10741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:37.049227   431 server_base.cc:1061] running on GCE node
I20260709 13:02:37.050237   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:37.050485   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:37.050614   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602157050602 us; error 0 us; skew 500 ppm
I20260709 13:02:37.051059   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:37.053306   431 webserver.cc:533] Webserver started at http://127.0.107.254:41315/ using document root <none> and password file <none>
I20260709 13:02:37.053750   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:37.053895   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:37.054186   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:37.055265   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/master-0-root/instance:
uuid: "6a727be1cf884f899ebd11a2880076c6"
format_stamp: "Formatted at 2026-07-09 13:02:37 on dist-test-slave-zhdc"
I20260709 13:02:37.059433   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:02:37.062603 10746 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.063377   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:02:37.063669   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/master-0-root
uuid: "6a727be1cf884f899ebd11a2880076c6"
format_stamp: "Formatted at 2026-07-09 13:02:37 on dist-test-slave-zhdc"
I20260709 13:02:37.063954   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:37.079068   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:37.080340   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:37.120384   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:44103
I20260709 13:02:37.120474 10797 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:44103 every 8 connection(s)
I20260709 13:02:37.124307 10798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.136482 10798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6: Bootstrap starting.
I20260709 13:02:37.141479 10798 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.145955 10798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6: No bootstrap required, opened a new log
I20260709 13:02:37.148250 10798 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a727be1cf884f899ebd11a2880076c6" member_type: VOTER }
I20260709 13:02:37.148633 10798 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.148902 10798 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a727be1cf884f899ebd11a2880076c6, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.149538 10798 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a727be1cf884f899ebd11a2880076c6" member_type: VOTER }
I20260709 13:02:37.149992 10798 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:37.150241 10798 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:37.150534 10798 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.155400 10798 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a727be1cf884f899ebd11a2880076c6" member_type: VOTER }
I20260709 13:02:37.155912 10798 leader_election.cc:304] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a727be1cf884f899ebd11a2880076c6; no voters: 
I20260709 13:02:37.156998 10798 leader_election.cc:290] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:37.157361 10801 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:37.158843 10801 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [term 1 LEADER]: Becoming Leader. State: Replica: 6a727be1cf884f899ebd11a2880076c6, State: Running, Role: LEADER
I20260709 13:02:37.159515 10801 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a727be1cf884f899ebd11a2880076c6" member_type: VOTER }
I20260709 13:02:37.159899 10798 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:37.164093 10802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a727be1cf884f899ebd11a2880076c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a727be1cf884f899ebd11a2880076c6" member_type: VOTER } }
I20260709 13:02:37.164821 10802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:37.166201 10803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a727be1cf884f899ebd11a2880076c6. Latest consensus state: current_term: 1 leader_uuid: "6a727be1cf884f899ebd11a2880076c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a727be1cf884f899ebd11a2880076c6" member_type: VOTER } }
I20260709 13:02:37.166941 10803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:37.167915 10808 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:37.174778 10808 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:37.175839   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:37.183988 10808 catalog_manager.cc:1383] Generated new cluster ID: cd1c5d34dfb54d70bd4919546f23a08c
I20260709 13:02:37.184330 10808 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:37.199743 10808 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:37.201105 10808 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:37.223273 10808 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6: Generated new TSK 0
I20260709 13:02:37.223901 10808 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:37.242473   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:37.248695 10819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:37.249890 10820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:37.251803 10822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:37.251860   431 server_base.cc:1061] running on GCE node
I20260709 13:02:37.253013   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:37.253207   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:37.253422   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602157253382 us; error 0 us; skew 500 ppm
I20260709 13:02:37.254009   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:37.256361   431 webserver.cc:533] Webserver started at http://127.0.107.193:33775/ using document root <none> and password file <none>
I20260709 13:02:37.256866   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:37.257062   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:37.257359   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:37.258574   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-0-root/instance:
uuid: "3554853e2e2c477cba7be2eb2ba73480"
format_stamp: "Formatted at 2026-07-09 13:02:37 on dist-test-slave-zhdc"
I20260709 13:02:37.263218   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:37.266789 10827 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.267657   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:37.267957   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-0-root
uuid: "3554853e2e2c477cba7be2eb2ba73480"
format_stamp: "Formatted at 2026-07-09 13:02:37 on dist-test-slave-zhdc"
I20260709 13:02:37.268210   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:37.281800   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:37.283162   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:37.284778   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:37.287102   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:37.287340   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.287587   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:37.287788   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.336476   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:42457
I20260709 13:02:37.336575 10889 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:42457 every 8 connection(s)
I20260709 13:02:37.341699   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:37.349175 10894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:37.350371 10895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:37.353618   431 server_base.cc:1061] running on GCE node
W20260709 13:02:37.353595 10897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:37.354993   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:37.355219   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:37.355409   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602157355390 us; error 0 us; skew 500 ppm
I20260709 13:02:37.356011   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:37.356042 10890 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44103
I20260709 13:02:37.356528 10890 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:37.357415 10890 heartbeater.cc:507] Master 127.0.107.254:44103 requested a full tablet report, sending...
I20260709 13:02:37.358605   431 webserver.cc:533] Webserver started at http://127.0.107.194:43067/ using document root <none> and password file <none>
I20260709 13:02:37.359280   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:37.359513   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:37.359840   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:37.359967 10763 ts_manager.cc:194] Registered new tserver with Master: 3554853e2e2c477cba7be2eb2ba73480 (127.0.107.193:42457)
I20260709 13:02:37.361476   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-1-root/instance:
uuid: "6cc3d92d19da473f843ff1eab6742c71"
format_stamp: "Formatted at 2026-07-09 13:02:37 on dist-test-slave-zhdc"
I20260709 13:02:37.362741 10763 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33130
I20260709 13:02:37.367069   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:02:37.370811 10902 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.371543   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:02:37.371795   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-1-root
uuid: "6cc3d92d19da473f843ff1eab6742c71"
format_stamp: "Formatted at 2026-07-09 13:02:37 on dist-test-slave-zhdc"
I20260709 13:02:37.372031   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:37.388816   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:37.390024   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:37.391573   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:37.393814   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:37.394017   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.394353   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:37.394519   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.436275   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:45057
I20260709 13:02:37.436390 10964 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:45057 every 8 connection(s)
I20260709 13:02:37.441149   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:37.449764 10969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:37.451007 10968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:37.454391 10965 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44103
I20260709 13:02:37.454978 10965 heartbeater.cc:461] Registering TS with master...
W20260709 13:02:37.455042 10971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:37.455200   431 server_base.cc:1061] running on GCE node
I20260709 13:02:37.456015 10965 heartbeater.cc:507] Master 127.0.107.254:44103 requested a full tablet report, sending...
I20260709 13:02:37.456319   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:37.456609   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:37.456796   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602157456774 us; error 0 us; skew 500 ppm
I20260709 13:02:37.457403   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:37.458398 10763 ts_manager.cc:194] Registered new tserver with Master: 6cc3d92d19da473f843ff1eab6742c71 (127.0.107.194:45057)
I20260709 13:02:37.459843 10763 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33134
I20260709 13:02:37.460342   431 webserver.cc:533] Webserver started at http://127.0.107.195:42871/ using document root <none> and password file <none>
I20260709 13:02:37.461050   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:37.461283   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:37.461607   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:37.462873   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-2-root/instance:
uuid: "a8665053ba9f43a49c1772a662dfc083"
format_stamp: "Formatted at 2026-07-09 13:02:37 on dist-test-slave-zhdc"
I20260709 13:02:37.467566   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:37.471372 10976 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.472297   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:02:37.472571   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-2-root
uuid: "a8665053ba9f43a49c1772a662dfc083"
format_stamp: "Formatted at 2026-07-09 13:02:37 on dist-test-slave-zhdc"
I20260709 13:02:37.472841   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601840662384-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:37.486478   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:37.487725   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:37.489248   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:37.491689   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:37.491936   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.492331   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:37.492595   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:37.533962   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:40799
I20260709 13:02:37.534173 11038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:40799 every 8 connection(s)
I20260709 13:02:37.548496 11039 heartbeater.cc:344] Connected to a master server at 127.0.107.254:44103
I20260709 13:02:37.549031 11039 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:37.549814 11039 heartbeater.cc:507] Master 127.0.107.254:44103 requested a full tablet report, sending...
I20260709 13:02:37.551760 10763 ts_manager.cc:194] Registered new tserver with Master: a8665053ba9f43a49c1772a662dfc083 (127.0.107.195:40799)
I20260709 13:02:37.551903   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014755504s
I20260709 13:02:37.553633 10763 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33142
I20260709 13:02:37.579222 10763 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33154:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:37.581331 10763 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:37.642524 10930 tablet_service.cc:1511] Processing CreateTablet for tablet c0e792646a464991b6aff5612520e254 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=51cfb398f2df4b79a8722e87f2385965]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:37.643599 10855 tablet_service.cc:1511] Processing CreateTablet for tablet c0e792646a464991b6aff5612520e254 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=51cfb398f2df4b79a8722e87f2385965]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:37.644050 10930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e792646a464991b6aff5612520e254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.645087 10855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e792646a464991b6aff5612520e254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.644912 11004 tablet_service.cc:1511] Processing CreateTablet for tablet c0e792646a464991b6aff5612520e254 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=51cfb398f2df4b79a8722e87f2385965]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:37.645946 11003 tablet_service.cc:1511] Processing CreateTablet for tablet 1963bd1f94b94ee89f4d8908eadab197 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=51cfb398f2df4b79a8722e87f2385965]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:37.646389 11004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e792646a464991b6aff5612520e254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.647310 11003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1963bd1f94b94ee89f4d8908eadab197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.649521 10854 tablet_service.cc:1511] Processing CreateTablet for tablet 1963bd1f94b94ee89f4d8908eadab197 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=51cfb398f2df4b79a8722e87f2385965]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:37.650835 10854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1963bd1f94b94ee89f4d8908eadab197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.655297 10929 tablet_service.cc:1511] Processing CreateTablet for tablet 1963bd1f94b94ee89f4d8908eadab197 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=51cfb398f2df4b79a8722e87f2385965]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:37.656595 10929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1963bd1f94b94ee89f4d8908eadab197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.674947 11054 tablet_bootstrap.cc:492] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083: Bootstrap starting.
I20260709 13:02:37.683310 11054 tablet_bootstrap.cc:654] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.686115 11055 tablet_bootstrap.cc:492] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71: Bootstrap starting.
I20260709 13:02:37.689705 11056 tablet_bootstrap.cc:492] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480: Bootstrap starting.
I20260709 13:02:37.692152 11054 tablet_bootstrap.cc:492] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083: No bootstrap required, opened a new log
I20260709 13:02:37.692757 11054 ts_tablet_manager.cc:1403] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:02:37.693271 11055 tablet_bootstrap.cc:654] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.695976 11054 raft_consensus.cc:359] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.696799 11054 raft_consensus.cc:385] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.697261 11056 tablet_bootstrap.cc:654] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.697137 11054 raft_consensus.cc:740] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8665053ba9f43a49c1772a662dfc083, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.698256 11055 tablet_bootstrap.cc:492] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71: No bootstrap required, opened a new log
I20260709 13:02:37.698258 11054 consensus_queue.cc:260] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.698961 11055 ts_tablet_manager.cc:1403] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:02:37.702909 11055 raft_consensus.cc:359] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.703894 11055 raft_consensus.cc:385] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.704243 11055 raft_consensus.cc:740] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc3d92d19da473f843ff1eab6742c71, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.704918 11039 heartbeater.cc:499] Master 127.0.107.254:44103 was elected leader, sending a full tablet report...
I20260709 13:02:37.705005 11054 ts_tablet_manager.cc:1434] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.004s
I20260709 13:02:37.705367 11055 consensus_queue.cc:260] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.706359 11054 tablet_bootstrap.cc:492] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083: Bootstrap starting.
I20260709 13:02:37.707769 11056 tablet_bootstrap.cc:492] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480: No bootstrap required, opened a new log
I20260709 13:02:37.708338 11056 ts_tablet_manager.cc:1403] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.009s
I20260709 13:02:37.711444 11056 raft_consensus.cc:359] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.712248 11056 raft_consensus.cc:385] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.712607 11056 raft_consensus.cc:740] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3554853e2e2c477cba7be2eb2ba73480, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.713443 11056 consensus_queue.cc:260] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.715504 11054 tablet_bootstrap.cc:654] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.726563 11055 ts_tablet_manager.cc:1434] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71: Time spent starting tablet: real 0.027s	user 0.018s	sys 0.008s
I20260709 13:02:37.728292 10890 heartbeater.cc:499] Master 127.0.107.254:44103 was elected leader, sending a full tablet report...
I20260709 13:02:37.728395 10965 heartbeater.cc:499] Master 127.0.107.254:44103 was elected leader, sending a full tablet report...
I20260709 13:02:37.728659 11054 tablet_bootstrap.cc:492] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083: No bootstrap required, opened a new log
I20260709 13:02:37.728852 11056 ts_tablet_manager.cc:1434] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480: Time spent starting tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:02:37.729183 11054 ts_tablet_manager.cc:1403] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.011s
I20260709 13:02:37.729980 11056 tablet_bootstrap.cc:492] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480: Bootstrap starting.
I20260709 13:02:37.730875 11055 tablet_bootstrap.cc:492] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71: Bootstrap starting.
I20260709 13:02:37.732338 11054 raft_consensus.cc:359] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.733109 11054 raft_consensus.cc:385] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.733417 11054 raft_consensus.cc:740] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8665053ba9f43a49c1772a662dfc083, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.734200 11054 consensus_queue.cc:260] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.736418 11054 ts_tablet_manager.cc:1434] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:02:37.737215 11056 tablet_bootstrap.cc:654] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.740116 11055 tablet_bootstrap.cc:654] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.748944 11056 tablet_bootstrap.cc:492] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480: No bootstrap required, opened a new log
I20260709 13:02:37.749583 11056 ts_tablet_manager.cc:1403] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:02:37.752775 11056 raft_consensus.cc:359] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.753636 11056 raft_consensus.cc:385] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.754014 11056 raft_consensus.cc:740] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3554853e2e2c477cba7be2eb2ba73480, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.755313 11055 tablet_bootstrap.cc:492] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71: No bootstrap required, opened a new log
I20260709 13:02:37.754951 11056 consensus_queue.cc:260] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.755906 11055 ts_tablet_manager.cc:1403] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:02:37.757578 11056 ts_tablet_manager.cc:1434] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:02:37.758863 11055 raft_consensus.cc:359] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.759519 11055 raft_consensus.cc:385] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.759763 11055 raft_consensus.cc:740] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc3d92d19da473f843ff1eab6742c71, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.760357 11055 consensus_queue.cc:260] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.762404 11055 ts_tablet_manager.cc:1434] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:37.766121 11062 raft_consensus.cc:493] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.766673 11062 raft_consensus.cc:515] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.770669 11062 leader_election.cc:290] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cc3d92d19da473f843ff1eab6742c71 (127.0.107.194:45057), a8665053ba9f43a49c1772a662dfc083 (127.0.107.195:40799)
I20260709 13:02:37.780802 11014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1963bd1f94b94ee89f4d8908eadab197" candidate_uuid: "3554853e2e2c477cba7be2eb2ba73480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8665053ba9f43a49c1772a662dfc083" is_pre_election: true
I20260709 13:02:37.781769 11014 raft_consensus.cc:2468] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3554853e2e2c477cba7be2eb2ba73480 in term 0.
I20260709 13:02:37.780798 10940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1963bd1f94b94ee89f4d8908eadab197" candidate_uuid: "3554853e2e2c477cba7be2eb2ba73480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc3d92d19da473f843ff1eab6742c71" is_pre_election: true
I20260709 13:02:37.782851 10940 raft_consensus.cc:2468] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3554853e2e2c477cba7be2eb2ba73480 in term 0.
I20260709 13:02:37.783313 10831 leader_election.cc:304] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3554853e2e2c477cba7be2eb2ba73480, a8665053ba9f43a49c1772a662dfc083; no voters: 
I20260709 13:02:37.784235 11062 raft_consensus.cc:2804] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:37.784592 11062 raft_consensus.cc:493] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.784858 11062 raft_consensus.cc:3060] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.790028 11062 raft_consensus.cc:515] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.791793 11062 leader_election.cc:290] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [CANDIDATE]: Term 1 election: Requested vote from peers 6cc3d92d19da473f843ff1eab6742c71 (127.0.107.194:45057), a8665053ba9f43a49c1772a662dfc083 (127.0.107.195:40799)
I20260709 13:02:37.792531 10940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1963bd1f94b94ee89f4d8908eadab197" candidate_uuid: "3554853e2e2c477cba7be2eb2ba73480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc3d92d19da473f843ff1eab6742c71"
I20260709 13:02:37.792796 11014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1963bd1f94b94ee89f4d8908eadab197" candidate_uuid: "3554853e2e2c477cba7be2eb2ba73480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8665053ba9f43a49c1772a662dfc083"
I20260709 13:02:37.793159 10940 raft_consensus.cc:3060] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.793403 11014 raft_consensus.cc:3060] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.798776 10940 raft_consensus.cc:2468] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3554853e2e2c477cba7be2eb2ba73480 in term 1.
I20260709 13:02:37.798823 11014 raft_consensus.cc:2468] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3554853e2e2c477cba7be2eb2ba73480 in term 1.
I20260709 13:02:37.800052 10830 leader_election.cc:304] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3554853e2e2c477cba7be2eb2ba73480, 6cc3d92d19da473f843ff1eab6742c71; no voters: 
I20260709 13:02:37.800768 11062 raft_consensus.cc:2804] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:37.801949 11062 raft_consensus.cc:697] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 1 LEADER]: Becoming Leader. State: Replica: 3554853e2e2c477cba7be2eb2ba73480, State: Running, Role: LEADER
I20260709 13:02:37.802794 11062 consensus_queue.cc:237] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.809545 10763 catalog_manager.cc:5697] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3554853e2e2c477cba7be2eb2ba73480 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3554853e2e2c477cba7be2eb2ba73480" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.990088 11059 raft_consensus.cc:493] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.990681 11059 raft_consensus.cc:515] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:37.992760 11059 leader_election.cc:290] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3554853e2e2c477cba7be2eb2ba73480 (127.0.107.193:42457), 6cc3d92d19da473f843ff1eab6742c71 (127.0.107.194:45057)
I20260709 13:02:38.002487 10865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e792646a464991b6aff5612520e254" candidate_uuid: "a8665053ba9f43a49c1772a662dfc083" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3554853e2e2c477cba7be2eb2ba73480" is_pre_election: true
I20260709 13:02:38.003319 10865 raft_consensus.cc:2468] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8665053ba9f43a49c1772a662dfc083 in term 0.
I20260709 13:02:38.003858 10940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e792646a464991b6aff5612520e254" candidate_uuid: "a8665053ba9f43a49c1772a662dfc083" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc3d92d19da473f843ff1eab6742c71" is_pre_election: true
I20260709 13:02:38.004562 10980 leader_election.cc:304] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3554853e2e2c477cba7be2eb2ba73480, a8665053ba9f43a49c1772a662dfc083; no voters: 
I20260709 13:02:38.004575 10940 raft_consensus.cc:2468] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8665053ba9f43a49c1772a662dfc083 in term 0.
I20260709 13:02:38.005366 11059 raft_consensus.cc:2804] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.005748 11059 raft_consensus.cc:493] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.006026 11059 raft_consensus.cc:3060] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.011317 11059 raft_consensus.cc:515] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.012959 11059 leader_election.cc:290] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [CANDIDATE]: Term 1 election: Requested vote from peers 3554853e2e2c477cba7be2eb2ba73480 (127.0.107.193:42457), 6cc3d92d19da473f843ff1eab6742c71 (127.0.107.194:45057)
I20260709 13:02:38.013943 10865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e792646a464991b6aff5612520e254" candidate_uuid: "a8665053ba9f43a49c1772a662dfc083" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3554853e2e2c477cba7be2eb2ba73480"
I20260709 13:02:38.014045 10940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e792646a464991b6aff5612520e254" candidate_uuid: "a8665053ba9f43a49c1772a662dfc083" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc3d92d19da473f843ff1eab6742c71"
I20260709 13:02:38.014668 10865 raft_consensus.cc:3060] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.014809 10940 raft_consensus.cc:3060] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.019691 10940 raft_consensus.cc:2468] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8665053ba9f43a49c1772a662dfc083 in term 1.
I20260709 13:02:38.019845 10865 raft_consensus.cc:2468] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8665053ba9f43a49c1772a662dfc083 in term 1.
I20260709 13:02:38.020793 10979 leader_election.cc:304] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc3d92d19da473f843ff1eab6742c71, a8665053ba9f43a49c1772a662dfc083; no voters: 
I20260709 13:02:38.021522 11059 raft_consensus.cc:2804] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.022456 11059 raft_consensus.cc:697] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 1 LEADER]: Becoming Leader. State: Replica: a8665053ba9f43a49c1772a662dfc083, State: Running, Role: LEADER
I20260709 13:02:38.023108 11059 consensus_queue.cc:237] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.029964 10763 catalog_manager.cc:5697] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8665053ba9f43a49c1772a662dfc083 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a8665053ba9f43a49c1772a662dfc083" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.113292 10763 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56296:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:38.115269 10763 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:38.137580 10855 tablet_service.cc:1511] Processing CreateTablet for tablet b9906b9e6b1e45fd8f5cbdb5370f2d71 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a01bfb7b5cdf4c3f915e924f7091bd4d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:38.138948 10855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9906b9e6b1e45fd8f5cbdb5370f2d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.138842 10929 tablet_service.cc:1511] Processing CreateTablet for tablet b9906b9e6b1e45fd8f5cbdb5370f2d71 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a01bfb7b5cdf4c3f915e924f7091bd4d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:38.140304 10929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9906b9e6b1e45fd8f5cbdb5370f2d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.142616 11004 tablet_service.cc:1511] Processing CreateTablet for tablet b9906b9e6b1e45fd8f5cbdb5370f2d71 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a01bfb7b5cdf4c3f915e924f7091bd4d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:38.143963 11004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9906b9e6b1e45fd8f5cbdb5370f2d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.144260 10930 tablet_service.cc:1511] Processing CreateTablet for tablet 35eedea1c0e846478166290a84bd633d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a01bfb7b5cdf4c3f915e924f7091bd4d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:38.145511 10930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35eedea1c0e846478166290a84bd633d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.149097 11003 tablet_service.cc:1511] Processing CreateTablet for tablet 35eedea1c0e846478166290a84bd633d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a01bfb7b5cdf4c3f915e924f7091bd4d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:38.150411 11003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35eedea1c0e846478166290a84bd633d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.142649 10854 tablet_service.cc:1511] Processing CreateTablet for tablet 35eedea1c0e846478166290a84bd633d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a01bfb7b5cdf4c3f915e924f7091bd4d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:38.151469 10854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35eedea1c0e846478166290a84bd633d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.157477 11056 tablet_bootstrap.cc:492] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480: Bootstrap starting.
I20260709 13:02:38.161574 11055 tablet_bootstrap.cc:492] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71: Bootstrap starting.
I20260709 13:02:38.163869 11056 tablet_bootstrap.cc:654] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.168669 11055 tablet_bootstrap.cc:654] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:38.170270 10811 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:38.173447 11054 tablet_bootstrap.cc:492] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083: Bootstrap starting.
I20260709 13:02:38.177896 11055 tablet_bootstrap.cc:492] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71: No bootstrap required, opened a new log
I20260709 13:02:38.178576 11055 ts_tablet_manager.cc:1403] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.008s
I20260709 13:02:38.181557 11055 raft_consensus.cc:359] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.182464 11055 raft_consensus.cc:385] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.182821 11055 raft_consensus.cc:740] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc3d92d19da473f843ff1eab6742c71, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.183748 11055 consensus_queue.cc:260] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.184962 11054 tablet_bootstrap.cc:654] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.186443 11055 ts_tablet_manager.cc:1434] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:02:38.194690 11056 tablet_bootstrap.cc:492] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480: No bootstrap required, opened a new log
I20260709 13:02:38.195062 11062 consensus_queue.cc:1048] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:38.196563 11056 ts_tablet_manager.cc:1403] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.015s
I20260709 13:02:38.202907 11055 tablet_bootstrap.cc:492] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71: Bootstrap starting.
I20260709 13:02:38.202907 11056 raft_consensus.cc:359] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.205387 11056 raft_consensus.cc:385] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.205829 11056 raft_consensus.cc:740] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3554853e2e2c477cba7be2eb2ba73480, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.206955 11056 consensus_queue.cc:260] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.209630 11056 ts_tablet_manager.cc:1434] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:02:38.210904 11056 tablet_bootstrap.cc:492] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480: Bootstrap starting.
I20260709 13:02:38.212373 11055 tablet_bootstrap.cc:654] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.217728 11056 tablet_bootstrap.cc:654] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.225665 11055 tablet_bootstrap.cc:492] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71: No bootstrap required, opened a new log
I20260709 13:02:38.226452 11055 ts_tablet_manager.cc:1403] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.002s
I20260709 13:02:38.230329 11055 raft_consensus.cc:359] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.233086 11055 raft_consensus.cc:385] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.233475 11055 raft_consensus.cc:740] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc3d92d19da473f843ff1eab6742c71, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.234383 11055 consensus_queue.cc:260] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.236714 11054 tablet_bootstrap.cc:492] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083: No bootstrap required, opened a new log
I20260709 13:02:38.236912 11055 ts_tablet_manager.cc:1434] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:38.234843 11056 tablet_bootstrap.cc:492] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480: No bootstrap required, opened a new log
I20260709 13:02:38.237411 11054 ts_tablet_manager.cc:1403] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083: Time spent bootstrapping tablet: real 0.064s	user 0.020s	sys 0.032s
I20260709 13:02:38.237552 11056 ts_tablet_manager.cc:1403] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.008s
I20260709 13:02:38.240778 11054 raft_consensus.cc:359] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.241808 11054 raft_consensus.cc:385] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.242288 11054 raft_consensus.cc:740] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8665053ba9f43a49c1772a662dfc083, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.243505 11054 consensus_queue.cc:260] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.246232 11054 ts_tablet_manager.cc:1434] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:02:38.246583 11056 raft_consensus.cc:359] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.247402 11056 raft_consensus.cc:385] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.247715 11056 raft_consensus.cc:740] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3554853e2e2c477cba7be2eb2ba73480, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.248219 11054 tablet_bootstrap.cc:492] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083: Bootstrap starting.
I20260709 13:02:38.248459 11056 consensus_queue.cc:260] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.256299 11062 consensus_queue.cc:1048] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.256927 11054 tablet_bootstrap.cc:654] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.263581 11056 ts_tablet_manager.cc:1434] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.003s
I20260709 13:02:38.266165 11054 tablet_bootstrap.cc:492] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083: No bootstrap required, opened a new log
I20260709 13:02:38.266741 11054 ts_tablet_manager.cc:1403] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.002s
I20260709 13:02:38.269913 11054 raft_consensus.cc:359] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.273418 11054 raft_consensus.cc:385] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.273744 11054 raft_consensus.cc:740] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8665053ba9f43a49c1772a662dfc083, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.274873 11054 consensus_queue.cc:260] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.277102 11054 ts_tablet_manager.cc:1434] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:02:38.302817 11067 raft_consensus.cc:493] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.303440 11067 raft_consensus.cc:515] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.305548 11067 leader_election.cc:290] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cc3d92d19da473f843ff1eab6742c71 (127.0.107.194:45057), a8665053ba9f43a49c1772a662dfc083 (127.0.107.195:40799)
I20260709 13:02:38.306216 10940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35eedea1c0e846478166290a84bd633d" candidate_uuid: "3554853e2e2c477cba7be2eb2ba73480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc3d92d19da473f843ff1eab6742c71" is_pre_election: true
I20260709 13:02:38.306711 11014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35eedea1c0e846478166290a84bd633d" candidate_uuid: "3554853e2e2c477cba7be2eb2ba73480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8665053ba9f43a49c1772a662dfc083" is_pre_election: true
I20260709 13:02:38.306947 10940 raft_consensus.cc:2468] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3554853e2e2c477cba7be2eb2ba73480 in term 0.
I20260709 13:02:38.307372 11014 raft_consensus.cc:2468] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3554853e2e2c477cba7be2eb2ba73480 in term 0.
I20260709 13:02:38.308094 10830 leader_election.cc:304] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3554853e2e2c477cba7be2eb2ba73480, 6cc3d92d19da473f843ff1eab6742c71; no voters: 
I20260709 13:02:38.308851 11067 raft_consensus.cc:2804] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.309221 11067 raft_consensus.cc:493] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.309501 11067 raft_consensus.cc:3060] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.314708 11067 raft_consensus.cc:515] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.316401 11067 leader_election.cc:290] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [CANDIDATE]: Term 1 election: Requested vote from peers 6cc3d92d19da473f843ff1eab6742c71 (127.0.107.194:45057), a8665053ba9f43a49c1772a662dfc083 (127.0.107.195:40799)
I20260709 13:02:38.317201 10940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35eedea1c0e846478166290a84bd633d" candidate_uuid: "3554853e2e2c477cba7be2eb2ba73480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc3d92d19da473f843ff1eab6742c71"
I20260709 13:02:38.317435 11014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35eedea1c0e846478166290a84bd633d" candidate_uuid: "3554853e2e2c477cba7be2eb2ba73480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8665053ba9f43a49c1772a662dfc083"
I20260709 13:02:38.317844 10940 raft_consensus.cc:3060] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.317978 11014 raft_consensus.cc:3060] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.324914 10940 raft_consensus.cc:2468] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3554853e2e2c477cba7be2eb2ba73480 in term 1.
I20260709 13:02:38.324914 11014 raft_consensus.cc:2468] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3554853e2e2c477cba7be2eb2ba73480 in term 1.
I20260709 13:02:38.326265 10831 leader_election.cc:304] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3554853e2e2c477cba7be2eb2ba73480, a8665053ba9f43a49c1772a662dfc083; no voters: 
I20260709 13:02:38.327015 11067 raft_consensus.cc:2804] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.327422 11067 raft_consensus.cc:697] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [term 1 LEADER]: Becoming Leader. State: Replica: 3554853e2e2c477cba7be2eb2ba73480, State: Running, Role: LEADER
I20260709 13:02:38.328073 11067 consensus_queue.cc:237] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.335942 10759 catalog_manager.cc:5697] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3554853e2e2c477cba7be2eb2ba73480 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3554853e2e2c477cba7be2eb2ba73480" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.366613 11061 raft_consensus.cc:493] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.367220 11061 raft_consensus.cc:515] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.369463 11061 leader_election.cc:290] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3554853e2e2c477cba7be2eb2ba73480 (127.0.107.193:42457), a8665053ba9f43a49c1772a662dfc083 (127.0.107.195:40799)
I20260709 13:02:38.379649 10865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9906b9e6b1e45fd8f5cbdb5370f2d71" candidate_uuid: "6cc3d92d19da473f843ff1eab6742c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3554853e2e2c477cba7be2eb2ba73480" is_pre_election: true
I20260709 13:02:38.380375 10865 raft_consensus.cc:2468] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc3d92d19da473f843ff1eab6742c71 in term 0.
I20260709 13:02:38.381348 11014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9906b9e6b1e45fd8f5cbdb5370f2d71" candidate_uuid: "6cc3d92d19da473f843ff1eab6742c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8665053ba9f43a49c1772a662dfc083" is_pre_election: true
I20260709 13:02:38.381513 10906 leader_election.cc:304] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3554853e2e2c477cba7be2eb2ba73480, 6cc3d92d19da473f843ff1eab6742c71; no voters: 
I20260709 13:02:38.382164 11014 raft_consensus.cc:2468] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc3d92d19da473f843ff1eab6742c71 in term 0.
I20260709 13:02:38.382526 11061 raft_consensus.cc:2804] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.382990 11061 raft_consensus.cc:493] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.383347 11061 raft_consensus.cc:3060] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.389518 11061 raft_consensus.cc:515] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.391500 11061 leader_election.cc:290] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [CANDIDATE]: Term 1 election: Requested vote from peers 3554853e2e2c477cba7be2eb2ba73480 (127.0.107.193:42457), a8665053ba9f43a49c1772a662dfc083 (127.0.107.195:40799)
I20260709 13:02:38.392239 10865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9906b9e6b1e45fd8f5cbdb5370f2d71" candidate_uuid: "6cc3d92d19da473f843ff1eab6742c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3554853e2e2c477cba7be2eb2ba73480"
I20260709 13:02:38.392450 11014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9906b9e6b1e45fd8f5cbdb5370f2d71" candidate_uuid: "6cc3d92d19da473f843ff1eab6742c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8665053ba9f43a49c1772a662dfc083"
I20260709 13:02:38.392839 10865 raft_consensus.cc:3060] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.393070 11014 raft_consensus.cc:3060] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.397811 10865 raft_consensus.cc:2468] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc3d92d19da473f843ff1eab6742c71 in term 1.
I20260709 13:02:38.397926 11014 raft_consensus.cc:2468] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc3d92d19da473f843ff1eab6742c71 in term 1.
I20260709 13:02:38.398950 10906 leader_election.cc:304] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3554853e2e2c477cba7be2eb2ba73480, 6cc3d92d19da473f843ff1eab6742c71; no voters: 
I20260709 13:02:38.399739 11061 raft_consensus.cc:2804] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.400907 11061 raft_consensus.cc:697] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc3d92d19da473f843ff1eab6742c71, State: Running, Role: LEADER
I20260709 13:02:38.401832 11061 consensus_queue.cc:237] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.410646 10759 catalog_manager.cc:5697] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc3d92d19da473f843ff1eab6742c71 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "6cc3d92d19da473f843ff1eab6742c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.436939 11014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0e792646a464991b6aff5612520e254"
dest_uuid: "a8665053ba9f43a49c1772a662dfc083"
mode: GRACEFUL
new_leader_uuid: "3554853e2e2c477cba7be2eb2ba73480"
 from {username='slave'} at 127.0.0.1:57002
I20260709 13:02:38.437520 11014 raft_consensus.cc:606] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 1 LEADER]: Received request to transfer leadership to TS 3554853e2e2c477cba7be2eb2ba73480
I20260709 13:02:38.451665 10865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1963bd1f94b94ee89f4d8908eadab197"
dest_uuid: "3554853e2e2c477cba7be2eb2ba73480"
mode: GRACEFUL
new_leader_uuid: "6cc3d92d19da473f843ff1eab6742c71"
 from {username='slave'} at 127.0.0.1:44670
I20260709 13:02:38.452236 10865 raft_consensus.cc:606] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 1 LEADER]: Received request to transfer leadership to TS 6cc3d92d19da473f843ff1eab6742c71
I20260709 13:02:38.465577 10940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9906b9e6b1e45fd8f5cbdb5370f2d71"
dest_uuid: "6cc3d92d19da473f843ff1eab6742c71"
mode: GRACEFUL
new_leader_uuid: "3554853e2e2c477cba7be2eb2ba73480"
 from {username='slave'} at 127.0.0.1:56144
I20260709 13:02:38.466236 10940 raft_consensus.cc:606] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 1 LEADER]: Received request to transfer leadership to TS 3554853e2e2c477cba7be2eb2ba73480
I20260709 13:02:38.497994 11059 consensus_queue.cc:1048] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.505344 11070 raft_consensus.cc:993] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083: : Instructing follower 3554853e2e2c477cba7be2eb2ba73480 to start an election
I20260709 13:02:38.505980 11059 raft_consensus.cc:1081] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 1 LEADER]: Signalling peer 3554853e2e2c477cba7be2eb2ba73480 to start an election
I20260709 13:02:38.509256 10864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0e792646a464991b6aff5612520e254"
dest_uuid: "3554853e2e2c477cba7be2eb2ba73480"
 from {username='slave'} at 127.0.0.1:44658
I20260709 13:02:38.510075 10864 raft_consensus.cc:493] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:38.510841 10864 raft_consensus.cc:3060] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.515398 11059 consensus_queue.cc:1048] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:38.519274 10864 raft_consensus.cc:515] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.524075 10939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e792646a464991b6aff5612520e254" candidate_uuid: "3554853e2e2c477cba7be2eb2ba73480" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc3d92d19da473f843ff1eab6742c71"
I20260709 13:02:38.524111 10864 leader_election.cc:290] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [CANDIDATE]: Term 2 election: Requested vote from peers 6cc3d92d19da473f843ff1eab6742c71 (127.0.107.194:45057), a8665053ba9f43a49c1772a662dfc083 (127.0.107.195:40799)
I20260709 13:02:38.526360 11014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e792646a464991b6aff5612520e254" candidate_uuid: "3554853e2e2c477cba7be2eb2ba73480" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8665053ba9f43a49c1772a662dfc083"
I20260709 13:02:38.526934 11014 raft_consensus.cc:3055] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:38.527205 11014 raft_consensus.cc:740] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8665053ba9f43a49c1772a662dfc083, State: Running, Role: LEADER
I20260709 13:02:38.527959 11014 consensus_queue.cc:260] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.528813 11014 raft_consensus.cc:3060] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.535107 11014 raft_consensus.cc:2468] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3554853e2e2c477cba7be2eb2ba73480 in term 2.
I20260709 13:02:38.536181 10831 leader_election.cc:304] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3554853e2e2c477cba7be2eb2ba73480, a8665053ba9f43a49c1772a662dfc083; no voters: 6cc3d92d19da473f843ff1eab6742c71
I20260709 13:02:38.537012 11067 raft_consensus.cc:2804] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:38.537506 11067 raft_consensus.cc:697] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 LEADER]: Becoming Leader. State: Replica: 3554853e2e2c477cba7be2eb2ba73480, State: Running, Role: LEADER
I20260709 13:02:38.538347 11067 consensus_queue.cc:237] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.545195 10761 catalog_manager.cc:5697] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 reported cstate change: term changed from 1 to 2, leader changed from a8665053ba9f43a49c1772a662dfc083 (127.0.107.195) to 3554853e2e2c477cba7be2eb2ba73480 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3554853e2e2c477cba7be2eb2ba73480" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.715376 11099 consensus_queue.cc:1048] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.725790 11062 consensus_queue.cc:1048] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.833611 11067 raft_consensus.cc:993] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480: : Instructing follower 6cc3d92d19da473f843ff1eab6742c71 to start an election
I20260709 13:02:38.834106 11062 raft_consensus.cc:1081] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 1 LEADER]: Signalling peer 6cc3d92d19da473f843ff1eab6742c71 to start an election
I20260709 13:02:38.835590 10940 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1963bd1f94b94ee89f4d8908eadab197"
dest_uuid: "6cc3d92d19da473f843ff1eab6742c71"
 from {username='slave'} at 127.0.0.1:56132
I20260709 13:02:38.836218 10940 raft_consensus.cc:493] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:38.836586 10940 raft_consensus.cc:3060] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.839494 11061 consensus_queue.cc:1048] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.844395 10940 raft_consensus.cc:515] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.846872 10940 leader_election.cc:290] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [CANDIDATE]: Term 2 election: Requested vote from peers 3554853e2e2c477cba7be2eb2ba73480 (127.0.107.193:42457), a8665053ba9f43a49c1772a662dfc083 (127.0.107.195:40799)
I20260709 13:02:38.847748 11093 raft_consensus.cc:993] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71: : Instructing follower 3554853e2e2c477cba7be2eb2ba73480 to start an election
I20260709 13:02:38.848523 11061 raft_consensus.cc:1081] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 1 LEADER]: Signalling peer 3554853e2e2c477cba7be2eb2ba73480 to start an election
I20260709 13:02:38.848675 11014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1963bd1f94b94ee89f4d8908eadab197" candidate_uuid: "6cc3d92d19da473f843ff1eab6742c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8665053ba9f43a49c1772a662dfc083"
I20260709 13:02:38.849546 11014 raft_consensus.cc:3060] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.850008 10864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1963bd1f94b94ee89f4d8908eadab197" candidate_uuid: "6cc3d92d19da473f843ff1eab6742c71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3554853e2e2c477cba7be2eb2ba73480"
I20260709 13:02:38.850663 10864 raft_consensus.cc:3055] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:38.850958 10864 raft_consensus.cc:740] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3554853e2e2c477cba7be2eb2ba73480, State: Running, Role: LEADER
I20260709 13:02:38.851887 10864 consensus_queue.cc:260] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.853041 10864 raft_consensus.cc:3060] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.853473 10863 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9906b9e6b1e45fd8f5cbdb5370f2d71"
dest_uuid: "3554853e2e2c477cba7be2eb2ba73480"
 from {username='slave'} at 127.0.0.1:44666
I20260709 13:02:38.854115 10863 raft_consensus.cc:493] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:38.854472 10863 raft_consensus.cc:3060] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.857537 11103 consensus_queue.cc:1048] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:38.859880 11014 raft_consensus.cc:2468] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc3d92d19da473f843ff1eab6742c71 in term 2.
I20260709 13:02:38.861631 10864 raft_consensus.cc:2468] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc3d92d19da473f843ff1eab6742c71 in term 2.
I20260709 13:02:38.861991 10906 leader_election.cc:304] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc3d92d19da473f843ff1eab6742c71, a8665053ba9f43a49c1772a662dfc083; no voters: 
I20260709 13:02:38.863209 11061 raft_consensus.cc:2804] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:38.863878 11061 raft_consensus.cc:697] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [term 2 LEADER]: Becoming Leader. State: Replica: 6cc3d92d19da473f843ff1eab6742c71, State: Running, Role: LEADER
I20260709 13:02:38.864985 11061 consensus_queue.cc:237] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.867201 10863 raft_consensus.cc:515] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.870115 10863 leader_election.cc:290] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [CANDIDATE]: Term 2 election: Requested vote from peers 6cc3d92d19da473f843ff1eab6742c71 (127.0.107.194:45057), a8665053ba9f43a49c1772a662dfc083 (127.0.107.195:40799)
I20260709 13:02:38.871956 10940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9906b9e6b1e45fd8f5cbdb5370f2d71" candidate_uuid: "3554853e2e2c477cba7be2eb2ba73480" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc3d92d19da473f843ff1eab6742c71"
I20260709 13:02:38.872684 10940 raft_consensus.cc:3055] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:38.873071 10940 raft_consensus.cc:740] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cc3d92d19da473f843ff1eab6742c71, State: Running, Role: LEADER
I20260709 13:02:38.874243 10940 consensus_queue.cc:260] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.875394 11013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9906b9e6b1e45fd8f5cbdb5370f2d71" candidate_uuid: "3554853e2e2c477cba7be2eb2ba73480" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8665053ba9f43a49c1772a662dfc083"
I20260709 13:02:38.875725 10940 raft_consensus.cc:3060] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.876114 11013 raft_consensus.cc:3060] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.880527 10759 catalog_manager.cc:5697] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 reported cstate change: term changed from 1 to 2, leader changed from 3554853e2e2c477cba7be2eb2ba73480 (127.0.107.193) to 6cc3d92d19da473f843ff1eab6742c71 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "6cc3d92d19da473f843ff1eab6742c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.882812 10940 raft_consensus.cc:2468] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3554853e2e2c477cba7be2eb2ba73480 in term 2.
I20260709 13:02:38.883880 11013 raft_consensus.cc:2468] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3554853e2e2c477cba7be2eb2ba73480 in term 2.
I20260709 13:02:38.884084 10830 leader_election.cc:304] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3554853e2e2c477cba7be2eb2ba73480, 6cc3d92d19da473f843ff1eab6742c71; no voters: 
I20260709 13:02:38.884946 11062 raft_consensus.cc:2804] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:38.885407 11062 raft_consensus.cc:697] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 LEADER]: Becoming Leader. State: Replica: 3554853e2e2c477cba7be2eb2ba73480, State: Running, Role: LEADER
I20260709 13:02:38.886227 11062 consensus_queue.cc:237] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:38.892268 10759 catalog_manager.cc:5697] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 reported cstate change: term changed from 1 to 2, leader changed from 6cc3d92d19da473f843ff1eab6742c71 (127.0.107.194) to 3554853e2e2c477cba7be2eb2ba73480 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3554853e2e2c477cba7be2eb2ba73480" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.920039   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:02:38.921657   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:02:38.922128   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:02:38.933056 10863 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9906b9e6b1e45fd8f5cbdb5370f2d71"
dest_uuid: "3554853e2e2c477cba7be2eb2ba73480"
mode: GRACEFUL
new_leader_uuid: "a8665053ba9f43a49c1772a662dfc083"
 from {username='slave'} at 127.0.0.1:44674
I20260709 13:02:38.933601 10863 raft_consensus.cc:606] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 LEADER]: Received request to transfer leadership to TS a8665053ba9f43a49c1772a662dfc083
I20260709 13:02:38.934700   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:02:39.005324 10940 raft_consensus.cc:3060] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.011193 10940 raft_consensus.cc:1275] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71 [term 2 FOLLOWER]: Refusing update from remote peer 3554853e2e2c477cba7be2eb2ba73480: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.012490 11062 consensus_queue.cc:1048] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.020370 11013 raft_consensus.cc:1275] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 2 FOLLOWER]: Refusing update from remote peer 3554853e2e2c477cba7be2eb2ba73480: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.022219 11067 consensus_queue.cc:1048] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.332448 10940 raft_consensus.cc:1275] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 2 FOLLOWER]: Refusing update from remote peer 3554853e2e2c477cba7be2eb2ba73480: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.333871 11062 consensus_queue.cc:1048] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.341524 11013 raft_consensus.cc:1275] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 2 FOLLOWER]: Refusing update from remote peer 3554853e2e2c477cba7be2eb2ba73480: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.343889 11099 consensus_queue.cc:1048] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.351038 11067 raft_consensus.cc:993] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480: : Instructing follower a8665053ba9f43a49c1772a662dfc083 to start an election
I20260709 13:02:39.351532 11099 raft_consensus.cc:1081] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 LEADER]: Signalling peer a8665053ba9f43a49c1772a662dfc083 to start an election
I20260709 13:02:39.353240 11013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9906b9e6b1e45fd8f5cbdb5370f2d71"
dest_uuid: "a8665053ba9f43a49c1772a662dfc083"
 from {username='slave'} at 127.0.0.1:56986
I20260709 13:02:39.353776 11013 raft_consensus.cc:493] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:39.354106 11013 raft_consensus.cc:3060] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:39.359041 11013 raft_consensus.cc:515] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:39.360694 11013 leader_election.cc:290] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [CANDIDATE]: Term 3 election: Requested vote from peers 3554853e2e2c477cba7be2eb2ba73480 (127.0.107.193:42457), 6cc3d92d19da473f843ff1eab6742c71 (127.0.107.194:45057)
I20260709 13:02:39.361614 10863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9906b9e6b1e45fd8f5cbdb5370f2d71" candidate_uuid: "a8665053ba9f43a49c1772a662dfc083" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3554853e2e2c477cba7be2eb2ba73480"
I20260709 13:02:39.361783 10940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9906b9e6b1e45fd8f5cbdb5370f2d71" candidate_uuid: "a8665053ba9f43a49c1772a662dfc083" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6cc3d92d19da473f843ff1eab6742c71"
I20260709 13:02:39.362304 10863 raft_consensus.cc:3055] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:39.362493 10940 raft_consensus.cc:3060] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:39.362646 10863 raft_consensus.cc:740] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3554853e2e2c477cba7be2eb2ba73480, State: Running, Role: LEADER
I20260709 13:02:39.363489 10863 consensus_queue.cc:260] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:39.364449 10863 raft_consensus.cc:3060] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:39.368094 10940 raft_consensus.cc:2468] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8665053ba9f43a49c1772a662dfc083 in term 3.
I20260709 13:02:39.369481 10979 leader_election.cc:304] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc3d92d19da473f843ff1eab6742c71, a8665053ba9f43a49c1772a662dfc083; no voters: 
I20260709 13:02:39.370025 10863 raft_consensus.cc:2468] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8665053ba9f43a49c1772a662dfc083 in term 3.
I20260709 13:02:39.370276 11106 raft_consensus.cc:2804] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:39.370888 11106 raft_consensus.cc:697] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 3 LEADER]: Becoming Leader. State: Replica: a8665053ba9f43a49c1772a662dfc083, State: Running, Role: LEADER
I20260709 13:02:39.371654 11106 consensus_queue.cc:237] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } }
I20260709 13:02:39.378384 10761 catalog_manager.cc:5697] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 reported cstate change: term changed from 2 to 3, leader changed from 3554853e2e2c477cba7be2eb2ba73480 (127.0.107.193) to a8665053ba9f43a49c1772a662dfc083 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "a8665053ba9f43a49c1772a662dfc083" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc3d92d19da473f843ff1eab6742c71" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.402843 11013 raft_consensus.cc:1275] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083 [term 2 FOLLOWER]: Refusing update from remote peer 6cc3d92d19da473f843ff1eab6742c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.403947 10863 raft_consensus.cc:1275] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 FOLLOWER]: Refusing update from remote peer 6cc3d92d19da473f843ff1eab6742c71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.404215 11061 consensus_queue.cc:1048] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8665053ba9f43a49c1772a662dfc083" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.405465 11061 consensus_queue.cc:1048] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3554853e2e2c477cba7be2eb2ba73480" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.559880   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:02:39.580262   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:39.580894   431 tablet_replica.cc:333] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480: stopping tablet replica
I20260709 13:02:39.581487   431 raft_consensus.cc:2243] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:39.582001   431 raft_consensus.cc:2272] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 3554853e2e2c477cba7be2eb2ba73480 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.584735   431 tablet_replica.cc:333] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480: stopping tablet replica
I20260709 13:02:39.585445   431 raft_consensus.cc:2243] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:39.585887   431 raft_consensus.cc:2272] T 1963bd1f94b94ee89f4d8908eadab197 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.588016   431 tablet_replica.cc:333] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480: stopping tablet replica
I20260709 13:02:39.588531   431 raft_consensus.cc:2243] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:39.589270   431 raft_consensus.cc:2272] T 35eedea1c0e846478166290a84bd633d P 3554853e2e2c477cba7be2eb2ba73480 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.591534   431 tablet_replica.cc:333] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480: stopping tablet replica
I20260709 13:02:39.592180   431 raft_consensus.cc:2243] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:39.593029   431 raft_consensus.cc:2272] T c0e792646a464991b6aff5612520e254 P 3554853e2e2c477cba7be2eb2ba73480 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.616345   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:02:39.628147   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:02:39.646503   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:39.647179   431 tablet_replica.cc:333] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71: stopping tablet replica
I20260709 13:02:39.647763   431 raft_consensus.cc:2243] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:39.648268   431 raft_consensus.cc:2272] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P 6cc3d92d19da473f843ff1eab6742c71 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.650434   431 tablet_replica.cc:333] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71: stopping tablet replica
I20260709 13:02:39.650980   431 raft_consensus.cc:2243] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:39.651402   431 raft_consensus.cc:2272] T 35eedea1c0e846478166290a84bd633d P 6cc3d92d19da473f843ff1eab6742c71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.653601   431 tablet_replica.cc:333] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71: stopping tablet replica
I20260709 13:02:39.654268   431 raft_consensus.cc:2243] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:39.654667   431 raft_consensus.cc:2272] T c0e792646a464991b6aff5612520e254 P 6cc3d92d19da473f843ff1eab6742c71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.656759   431 tablet_replica.cc:333] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71: stopping tablet replica
I20260709 13:02:39.657186   431 raft_consensus.cc:2243] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:39.657930   431 raft_consensus.cc:2272] T 1963bd1f94b94ee89f4d8908eadab197 P 6cc3d92d19da473f843ff1eab6742c71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.681123   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:02:39.693424   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:02:39.710369   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:39.711058   431 tablet_replica.cc:333] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083: stopping tablet replica
I20260709 13:02:39.711619   431 raft_consensus.cc:2243] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:39.712289   431 pending_rounds.cc:70] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083: Trying to abort 1 pending ops.
I20260709 13:02:39.712479   431 pending_rounds.cc:77] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634444793888768 op_type: NO_OP noop_request { }
I20260709 13:02:39.712842   431 raft_consensus.cc:2889] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:39.713194   431 raft_consensus.cc:2272] T b9906b9e6b1e45fd8f5cbdb5370f2d71 P a8665053ba9f43a49c1772a662dfc083 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.715605   431 tablet_replica.cc:333] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083: stopping tablet replica
I20260709 13:02:39.716171   431 raft_consensus.cc:2243] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:39.716607   431 raft_consensus.cc:2272] T 1963bd1f94b94ee89f4d8908eadab197 P a8665053ba9f43a49c1772a662dfc083 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.719165   431 tablet_replica.cc:333] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083: stopping tablet replica
I20260709 13:02:39.719702   431 raft_consensus.cc:2243] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:39.720116   431 raft_consensus.cc:2272] T 35eedea1c0e846478166290a84bd633d P a8665053ba9f43a49c1772a662dfc083 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.722371   431 tablet_replica.cc:333] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083: stopping tablet replica
I20260709 13:02:39.722872   431 raft_consensus.cc:2243] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:39.723299   431 raft_consensus.cc:2272] T c0e792646a464991b6aff5612520e254 P a8665053ba9f43a49c1772a662dfc083 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.745857   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:39.758023   431 master.cc:562] Master@127.0.107.254:44103 shutting down...
I20260709 13:02:39.774325   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:39.774921   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.775264   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6a727be1cf884f899ebd11a2880076c6: stopping tablet replica
I20260709 13:02:39.794754   431 master.cc:584] Master@127.0.107.254:44103 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2782 ms)
[----------] 6 tests from LeaderRebalancerTest (318976 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:02:39.823144   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:39823
I20260709 13:02:39.824401   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:39.829491 11111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:39.830099 11112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:39.831238 11114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:39.832499   431 server_base.cc:1061] running on GCE node
I20260709 13:02:39.833532   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:39.833758   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:39.833982   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602159833936 us; error 0 us; skew 500 ppm
I20260709 13:02:39.834761   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:39.837515   431 webserver.cc:533] Webserver started at http://127.0.107.254:45583/ using document root <none> and password file <none>
I20260709 13:02:39.838125   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:39.838361   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:39.838683   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:39.839907   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/master-0-root/instance:
uuid: "401249b23da446bb8af19e3ec53b264c"
format_stamp: "Formatted at 2026-07-09 13:02:39 on dist-test-slave-zhdc"
I20260709 13:02:39.845005   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:02:39.848735 11119 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:39.849560   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:02:39.849903   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/master-0-root
uuid: "401249b23da446bb8af19e3ec53b264c"
format_stamp: "Formatted at 2026-07-09 13:02:39 on dist-test-slave-zhdc"
I20260709 13:02:39.850239   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:39.863932   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:39.865038   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:39.903750   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:39823
I20260709 13:02:39.903862 11170 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:39823 every 8 connection(s)
I20260709 13:02:39.908408 11171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.919503 11171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c: Bootstrap starting.
I20260709 13:02:39.923979 11171 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.928198 11171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c: No bootstrap required, opened a new log
I20260709 13:02:39.930347 11171 raft_consensus.cc:359] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401249b23da446bb8af19e3ec53b264c" member_type: VOTER }
I20260709 13:02:39.930720 11171 raft_consensus.cc:385] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.930981 11171 raft_consensus.cc:740] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 401249b23da446bb8af19e3ec53b264c, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.931507 11171 consensus_queue.cc:260] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401249b23da446bb8af19e3ec53b264c" member_type: VOTER }
I20260709 13:02:39.931910 11171 raft_consensus.cc:399] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:39.932101 11171 raft_consensus.cc:493] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:39.932303 11171 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.937175 11171 raft_consensus.cc:515] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401249b23da446bb8af19e3ec53b264c" member_type: VOTER }
I20260709 13:02:39.937659 11171 leader_election.cc:304] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 401249b23da446bb8af19e3ec53b264c; no voters: 
I20260709 13:02:39.938901 11171 leader_election.cc:290] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:39.939230 11174 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.940639 11174 raft_consensus.cc:697] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [term 1 LEADER]: Becoming Leader. State: Replica: 401249b23da446bb8af19e3ec53b264c, State: Running, Role: LEADER
I20260709 13:02:39.941352 11174 consensus_queue.cc:237] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401249b23da446bb8af19e3ec53b264c" member_type: VOTER }
I20260709 13:02:39.941836 11171 sys_catalog.cc:565] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:39.944337 11175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "401249b23da446bb8af19e3ec53b264c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401249b23da446bb8af19e3ec53b264c" member_type: VOTER } }
I20260709 13:02:39.944418 11176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 401249b23da446bb8af19e3ec53b264c. Latest consensus state: current_term: 1 leader_uuid: "401249b23da446bb8af19e3ec53b264c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401249b23da446bb8af19e3ec53b264c" member_type: VOTER } }
I20260709 13:02:39.945204 11176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:39.945235 11175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:39.956033 11180 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:39.960783 11180 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:39.962013   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:39.969969 11180 catalog_manager.cc:1383] Generated new cluster ID: 423c00949bc441ed94458813cf63b07a
I20260709 13:02:39.970340 11180 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:39.985100 11180 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:39.986614 11180 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:40.005160 11180 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c: Generated new TSK 0
I20260709 13:02:40.005879 11180 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:40.029306   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:40.035458 11192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:40.036689 11193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:40.038616   431 server_base.cc:1061] running on GCE node
W20260709 13:02:40.038795 11195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:40.039892   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:40.040117   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:40.040294   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602160040277 us; error 0 us; skew 500 ppm
I20260709 13:02:40.040863   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:40.043391   431 webserver.cc:533] Webserver started at http://127.0.107.193:41129/ using document root <none> and password file <none>
I20260709 13:02:40.043973   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:40.044183   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:40.044449   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:40.045559   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-0-root/instance:
uuid: "f44094f32c624cc28c94864650dcd0c3"
format_stamp: "Formatted at 2026-07-09 13:02:40 on dist-test-slave-zhdc"
I20260709 13:02:40.050366   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:02:40.054452 11200 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:40.055346   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:02:40.055733   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-0-root
uuid: "f44094f32c624cc28c94864650dcd0c3"
format_stamp: "Formatted at 2026-07-09 13:02:40 on dist-test-slave-zhdc"
I20260709 13:02:40.056051   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:40.082798   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:40.084028   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:40.085565   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:40.087910   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:40.088146   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:40.088402   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:40.088577   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:40.127422   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:39751
I20260709 13:02:40.127550 11262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:39751 every 8 connection(s)
I20260709 13:02:40.132658   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:40.139259 11267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:40.141299 11268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:40.144856 11271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:40.145406   431 server_base.cc:1061] running on GCE node
I20260709 13:02:40.145816 11263 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39823
I20260709 13:02:40.146325 11263 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:40.146606   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:40.146924   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:40.147135   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602160147115 us; error 0 us; skew 500 ppm
I20260709 13:02:40.147228 11263 heartbeater.cc:507] Master 127.0.107.254:39823 requested a full tablet report, sending...
I20260709 13:02:40.147921   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:40.149818 11136 ts_manager.cc:194] Registered new tserver with Master: f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751)
I20260709 13:02:40.150905   431 webserver.cc:533] Webserver started at http://127.0.107.194:43071/ using document root <none> and password file <none>
I20260709 13:02:40.151674   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:40.151922   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:40.152261   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:40.152295 11136 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39692
I20260709 13:02:40.153951   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-1-root/instance:
uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
format_stamp: "Formatted at 2026-07-09 13:02:40 on dist-test-slave-zhdc"
I20260709 13:02:40.158555   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:40.161808 11275 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:40.162596   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:02:40.162904   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-1-root
uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
format_stamp: "Formatted at 2026-07-09 13:02:40 on dist-test-slave-zhdc"
I20260709 13:02:40.163204   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:40.186177   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:40.187507   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:40.189144   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:40.191819   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:40.192102   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:40.192405   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:40.192631   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:40.233592   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39537
I20260709 13:02:40.233742 11337 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39537 every 8 connection(s)
I20260709 13:02:40.238983   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:40.247331 11341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:40.247677 11342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:40.251894 11338 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39823
I20260709 13:02:40.252398 11338 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:40.253229 11338 heartbeater.cc:507] Master 127.0.107.254:39823 requested a full tablet report, sending...
I20260709 13:02:40.255275   431 server_base.cc:1061] running on GCE node
W20260709 13:02:40.254810 11344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:40.255684 11136 ts_manager.cc:194] Registered new tserver with Master: c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:40.256606   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:40.256807   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:40.257040   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602160257023 us; error 0 us; skew 500 ppm
I20260709 13:02:40.257426 11136 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39694
I20260709 13:02:40.257802   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:40.260695   431 webserver.cc:533] Webserver started at http://127.0.107.195:42099/ using document root <none> and password file <none>
I20260709 13:02:40.261201   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:40.261410   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:40.261677   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:40.262817   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-2-root/instance:
uuid: "e04c761aac6144a5be44096d6127059f"
format_stamp: "Formatted at 2026-07-09 13:02:40 on dist-test-slave-zhdc"
I20260709 13:02:40.267071   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:40.270483 11349 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:40.271328   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:02:40.271703   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-2-root
uuid: "e04c761aac6144a5be44096d6127059f"
format_stamp: "Formatted at 2026-07-09 13:02:40 on dist-test-slave-zhdc"
I20260709 13:02:40.272035   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601840662384-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:40.285909   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:40.287194   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:40.288826   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:40.291503   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:40.291759   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:40.292011   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:40.292232   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:40.333154   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:39309
I20260709 13:02:40.333264 11411 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:39309 every 8 connection(s)
I20260709 13:02:40.347514 11412 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39823
I20260709 13:02:40.347950 11412 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:40.348791 11412 heartbeater.cc:507] Master 127.0.107.254:39823 requested a full tablet report, sending...
I20260709 13:02:40.350804 11136 ts_manager.cc:194] Registered new tserver with Master: e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:40.351176   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014759847s
I20260709 13:02:40.352367 11136 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39696
I20260709 13:02:40.377231 11136 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39700:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:40.379808 11136 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:40.460119 11377 tablet_service.cc:1511] Processing CreateTablet for tablet 55e58214248e4dbbb409d91296dfcc34 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:40.461548 11377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e58214248e4dbbb409d91296dfcc34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.463203 11375 tablet_service.cc:1511] Processing CreateTablet for tablet 5acf4412cd9743299ac27a0ca1af0b0f (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:40.464660 11375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acf4412cd9743299ac27a0ca1af0b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.466387 11376 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec600eee44f4439961ad3cc16760d82 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:40.467077 11374 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0a09e630c4464d90703b14b4b1412f (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:40.467852 11376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec600eee44f4439961ad3cc16760d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.468678 11374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0a09e630c4464d90703b14b4b1412f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.469307 11373 tablet_service.cc:1511] Processing CreateTablet for tablet 69c5c8c093714a7c964077488e492de7 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:40.470636 11373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69c5c8c093714a7c964077488e492de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.475140 11372 tablet_service.cc:1511] Processing CreateTablet for tablet 57da9b05fc45441b8f48e9cd60c46c45 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:40.476622 11372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57da9b05fc45441b8f48e9cd60c46c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.479147 11371 tablet_service.cc:1511] Processing CreateTablet for tablet 50075fe54a5d4d4c8feb65f777349817 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:40.480587 11371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50075fe54a5d4d4c8feb65f777349817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.482352 11370 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4b19c988b349f8b40bd3a43d02e0ff (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:40.483781 11370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4b19c988b349f8b40bd3a43d02e0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.488533 11228 tablet_service.cc:1511] Processing CreateTablet for tablet 55e58214248e4dbbb409d91296dfcc34 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:40.489975 11228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e58214248e4dbbb409d91296dfcc34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.490871 11369 tablet_service.cc:1511] Processing CreateTablet for tablet 6787048e662f4d2295ce5f8d30d58be5 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:40.492362 11369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6787048e662f4d2295ce5f8d30d58be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.495904 11227 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec600eee44f4439961ad3cc16760d82 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:40.497309 11227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec600eee44f4439961ad3cc16760d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.503612 11226 tablet_service.cc:1511] Processing CreateTablet for tablet 5acf4412cd9743299ac27a0ca1af0b0f (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:40.505033 11226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acf4412cd9743299ac27a0ca1af0b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.509495 11225 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0a09e630c4464d90703b14b4b1412f (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:40.511287 11225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0a09e630c4464d90703b14b4b1412f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.515494 11224 tablet_service.cc:1511] Processing CreateTablet for tablet 69c5c8c093714a7c964077488e492de7 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:40.516983 11224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69c5c8c093714a7c964077488e492de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.523667 11223 tablet_service.cc:1511] Processing CreateTablet for tablet 57da9b05fc45441b8f48e9cd60c46c45 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:40.525149 11223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57da9b05fc45441b8f48e9cd60c46c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.527714 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 50075fe54a5d4d4c8feb65f777349817 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:40.529191 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50075fe54a5d4d4c8feb65f777349817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.531047 11303 tablet_service.cc:1511] Processing CreateTablet for tablet 55e58214248e4dbbb409d91296dfcc34 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:40.535143 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4b19c988b349f8b40bd3a43d02e0ff (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:40.536514 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4b19c988b349f8b40bd3a43d02e0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.536585 11301 tablet_service.cc:1511] Processing CreateTablet for tablet 5acf4412cd9743299ac27a0ca1af0b0f (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:40.535162 11302 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec600eee44f4439961ad3cc16760d82 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:40.539618 11300 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0a09e630c4464d90703b14b4b1412f (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:40.542667 11299 tablet_service.cc:1511] Processing CreateTablet for tablet 69c5c8c093714a7c964077488e492de7 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:40.547058 11303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e58214248e4dbbb409d91296dfcc34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.550414 11302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec600eee44f4439961ad3cc16760d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.552404 11298 tablet_service.cc:1511] Processing CreateTablet for tablet 57da9b05fc45441b8f48e9cd60c46c45 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:40.557618 11297 tablet_service.cc:1511] Processing CreateTablet for tablet 50075fe54a5d4d4c8feb65f777349817 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:40.564806 11295 tablet_service.cc:1511] Processing CreateTablet for tablet 6787048e662f4d2295ce5f8d30d58be5 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:40.561548 11296 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4b19c988b349f8b40bd3a43d02e0ff (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:40.573325 11300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0a09e630c4464d90703b14b4b1412f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.578575 11296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4b19c988b349f8b40bd3a43d02e0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.579392 11220 tablet_service.cc:1511] Processing CreateTablet for tablet 6787048e662f4d2295ce5f8d30d58be5 (DEFAULT_TABLE table=test-workload [id=388cead3cd1d4d00ac1b7fa4c70b175e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:40.580816 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6787048e662f4d2295ce5f8d30d58be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.582126 11299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69c5c8c093714a7c964077488e492de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.587522 11297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50075fe54a5d4d4c8feb65f777349817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.589345 11295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6787048e662f4d2295ce5f8d30d58be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.598344 11301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acf4412cd9743299ac27a0ca1af0b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.604358 11298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57da9b05fc45441b8f48e9cd60c46c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.614004 11426 tablet_bootstrap.cc:492] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:40.618350 11427 tablet_bootstrap.cc:492] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:40.654913 11426 tablet_bootstrap.cc:654] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.665174 11428 tablet_bootstrap.cc:492] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:40.670854 11427 tablet_bootstrap.cc:654] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.673116 11428 tablet_bootstrap.cc:654] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.676863 11426 tablet_bootstrap.cc:492] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:40.677701 11426 ts_tablet_manager.cc:1403] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.005s
I20260709 13:02:40.681711 11426 raft_consensus.cc:359] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.682541 11426 raft_consensus.cc:385] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.682941 11426 raft_consensus.cc:740] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.684217 11428 tablet_bootstrap.cc:492] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:40.683852 11426 consensus_queue.cc:260] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.684485 11427 tablet_bootstrap.cc:492] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:40.684749 11428 ts_tablet_manager.cc:1403] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 13:02:40.685243 11427 ts_tablet_manager.cc:1403] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.008s
I20260709 13:02:40.687144 11412 heartbeater.cc:499] Master 127.0.107.254:39823 was elected leader, sending a full tablet report...
I20260709 13:02:40.687700 11426 ts_tablet_manager.cc:1434] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.007s
I20260709 13:02:40.687592 11428 raft_consensus.cc:359] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.688373 11428 raft_consensus.cc:385] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.688683 11428 raft_consensus.cc:740] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.688802 11426 tablet_bootstrap.cc:492] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:40.688926 11427 raft_consensus.cc:359] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.689831 11427 raft_consensus.cc:385] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.689443 11428 consensus_queue.cc:260] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.690296 11427 raft_consensus.cc:740] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.691190 11427 consensus_queue.cc:260] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.696214 11426 tablet_bootstrap.cc:654] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.697793 11427 ts_tablet_manager.cc:1434] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:02:40.698664 11263 heartbeater.cc:499] Master 127.0.107.254:39823 was elected leader, sending a full tablet report...
I20260709 13:02:40.710098 11427 tablet_bootstrap.cc:492] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:40.722867 11428 ts_tablet_manager.cc:1434] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.038s	user 0.018s	sys 0.021s
I20260709 13:02:40.723825 11338 heartbeater.cc:499] Master 127.0.107.254:39823 was elected leader, sending a full tablet report...
I20260709 13:02:40.724166 11428 tablet_bootstrap.cc:492] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:40.724424 11427 tablet_bootstrap.cc:654] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.730564 11428 tablet_bootstrap.cc:654] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.735833 11426 tablet_bootstrap.cc:492] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:40.736451 11426 ts_tablet_manager.cc:1403] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.017s
I20260709 13:02:40.736590 11427 tablet_bootstrap.cc:492] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:40.737107 11427 ts_tablet_manager.cc:1403] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.000s
I20260709 13:02:40.740070 11427 raft_consensus.cc:359] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.740339 11426 raft_consensus.cc:359] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.740873 11427 raft_consensus.cc:385] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.741161 11426 raft_consensus.cc:385] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.741207 11427 raft_consensus.cc:740] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.741634 11426 raft_consensus.cc:740] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.742241 11427 consensus_queue.cc:260] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.742601 11426 consensus_queue.cc:260] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.744760 11427 ts_tablet_manager.cc:1434] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:40.744820 11426 ts_tablet_manager.cc:1434] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:02:40.745857 11427 tablet_bootstrap.cc:492] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:40.745919 11426 tablet_bootstrap.cc:492] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:40.752360 11428 tablet_bootstrap.cc:492] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:40.752707 11427 tablet_bootstrap.cc:654] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.752779 11426 tablet_bootstrap.cc:654] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.752972 11428 ts_tablet_manager.cc:1403] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.029s	user 0.003s	sys 0.008s
I20260709 13:02:40.756809 11428 raft_consensus.cc:359] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.757629 11428 raft_consensus.cc:385] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.757946 11428 raft_consensus.cc:740] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.758808 11428 consensus_queue.cc:260] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.767980 11426 tablet_bootstrap.cc:492] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:40.768601 11426 ts_tablet_manager.cc:1403] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 13:02:40.768918 11428 ts_tablet_manager.cc:1434] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:02:40.769975 11428 tablet_bootstrap.cc:492] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:40.771775 11427 tablet_bootstrap.cc:492] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:40.771646 11426 raft_consensus.cc:359] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.772480 11427 ts_tablet_manager.cc:1403] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.008s
I20260709 13:02:40.772706 11426 raft_consensus.cc:385] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.773159 11426 raft_consensus.cc:740] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.774241 11426 consensus_queue.cc:260] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.775615 11427 raft_consensus.cc:359] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.776417 11427 raft_consensus.cc:385] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.776744 11427 raft_consensus.cc:740] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.776825 11428 tablet_bootstrap.cc:654] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.777575 11427 consensus_queue.cc:260] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.780181 11427 ts_tablet_manager.cc:1434] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:40.781128 11427 tablet_bootstrap.cc:492] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:40.782321 11426 ts_tablet_manager.cc:1434] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:02:40.785616 11426 tablet_bootstrap.cc:492] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:40.788925 11427 tablet_bootstrap.cc:654] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.790262 11428 tablet_bootstrap.cc:492] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:40.790899 11428 ts_tablet_manager.cc:1403] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 13:02:40.792371 11426 tablet_bootstrap.cc:654] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.794734 11428 raft_consensus.cc:359] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.796211 11428 raft_consensus.cc:385] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.796787 11428 raft_consensus.cc:740] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.798110 11428 consensus_queue.cc:260] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.803778 11428 ts_tablet_manager.cc:1434] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:02:40.804036 11426 tablet_bootstrap.cc:492] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:40.804742 11426 ts_tablet_manager.cc:1403] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:02:40.805188 11428 tablet_bootstrap.cc:492] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:40.808178 11427 tablet_bootstrap.cc:492] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:40.807889 11426 raft_consensus.cc:359] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.808908 11426 raft_consensus.cc:385] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.808908 11427 ts_tablet_manager.cc:1403] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.008s
I20260709 13:02:40.809419 11426 raft_consensus.cc:740] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.810456 11426 consensus_queue.cc:260] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.812350 11427 raft_consensus.cc:359] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.812809 11428 tablet_bootstrap.cc:654] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.813220 11427 raft_consensus.cc:385] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.813575 11427 raft_consensus.cc:740] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.814805 11426 ts_tablet_manager.cc:1434] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:02:40.814421 11427 consensus_queue.cc:260] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.815990 11426 tablet_bootstrap.cc:492] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:40.819954 11427 ts_tablet_manager.cc:1434] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:40.821516 11427 tablet_bootstrap.cc:492] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:40.824872 11428 tablet_bootstrap.cc:492] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:40.825559 11428 ts_tablet_manager.cc:1403] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:02:40.826902 11426 tablet_bootstrap.cc:654] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.828016 11427 tablet_bootstrap.cc:654] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.828724 11428 raft_consensus.cc:359] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.829437 11432 raft_consensus.cc:493] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.829775 11428 raft_consensus.cc:385] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.830190 11428 raft_consensus.cc:740] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.830029 11432 raft_consensus.cc:515] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.831543 11428 consensus_queue.cc:260] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.834779 11432 leader_election.cc:290] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:40.835382 11428 ts_tablet_manager.cc:1434] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:40.839763 11428 tablet_bootstrap.cc:492] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:40.839926 11432 raft_consensus.cc:493] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.840629 11432 raft_consensus.cc:515] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.843132 11433 raft_consensus.cc:493] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.843472 11432 leader_election.cc:290] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:40.843689 11433 raft_consensus.cc:515] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.853809 11427 tablet_bootstrap.cc:492] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:40.847965 11433 leader_election.cc:290] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:40.854632 11427 ts_tablet_manager.cc:1403] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.008s
I20260709 13:02:40.846315 11426 tablet_bootstrap.cc:492] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:40.857733 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0a09e630c4464d90703b14b4b1412f" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:40.858670 11426 ts_tablet_manager.cc:1403] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.000s
I20260709 13:02:40.858850 11238 raft_consensus.cc:2468] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 0.
I20260709 13:02:40.860345 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da9b05fc45441b8f48e9cd60c46c45" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:40.863255 11351 leader_election.cc:304] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:40.863826 11428 tablet_bootstrap.cc:654] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.864220 11432 raft_consensus.cc:2804] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:40.864338 11351 leader_election.cc:343] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.864668 11432 raft_consensus.cc:493] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.865350 11432 raft_consensus.cc:3060] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.865942 11427 raft_consensus.cc:359] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.866712 11427 raft_consensus.cc:385] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.867030 11427 raft_consensus.cc:740] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.862187 11426 raft_consensus.cc:359] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.867653 11426 raft_consensus.cc:385] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.867995 11426 raft_consensus.cc:740] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.867865 11427 consensus_queue.cc:260] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.875530 11426 consensus_queue.cc:260] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.879895 11427 ts_tablet_manager.cc:1434] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:02:40.882834 11427 tablet_bootstrap.cc:492] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:40.889572 11432 raft_consensus.cc:515] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.896303 11426 ts_tablet_manager.cc:1434] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.037s	user 0.017s	sys 0.008s
I20260709 13:02:40.897450 11426 tablet_bootstrap.cc:492] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:40.898468 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0a09e630c4464d90703b14b4b1412f" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:40.899124 11237 raft_consensus.cc:3060] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.900533 11427 tablet_bootstrap.cc:654] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.907176 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50075fe54a5d4d4c8feb65f777349817" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:40.907894 11238 raft_consensus.cc:2468] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 0.
I20260709 13:02:40.910136 11426 tablet_bootstrap.cc:654] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.909934 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0a09e630c4464d90703b14b4b1412f" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:40.910719 11313 raft_consensus.cc:2468] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 0.
I20260709 13:02:40.912293 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da9b05fc45441b8f48e9cd60c46c45" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:40.912937 11313 raft_consensus.cc:2468] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 0.
I20260709 13:02:40.916191 11277 leader_election.cc:304] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:40.917412 11433 raft_consensus.cc:2804] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.917881 11433 raft_consensus.cc:493] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.918308 11433 raft_consensus.cc:3060] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.918548 11351 leader_election.cc:304] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, e04c761aac6144a5be44096d6127059f; no voters: f44094f32c624cc28c94864650dcd0c3
I20260709 13:02:40.920418 11450 raft_consensus.cc:2804] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.920913 11450 raft_consensus.cc:493] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.921332 11450 raft_consensus.cc:3060] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.935490 11432 leader_election.cc:290] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:40.938407 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0a09e630c4464d90703b14b4b1412f" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:40.939113 11313 raft_consensus.cc:3060] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.946512 11237 raft_consensus.cc:2468] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 1.
I20260709 13:02:40.947918 11351 leader_election.cc:304] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:40.948897 11432 raft_consensus.cc:2804] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.943171 11433 raft_consensus.cc:515] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
W20260709 13:02:40.951854 11184 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:40.952214 11427 tablet_bootstrap.cc:492] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:40.953012 11427 ts_tablet_manager.cc:1403] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.020s
I20260709 13:02:40.955348 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50075fe54a5d4d4c8feb65f777349817" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:40.956079 11237 raft_consensus.cc:3060] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.956816 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50075fe54a5d4d4c8feb65f777349817" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f" is_pre_election: true
I20260709 13:02:40.956655 11427 raft_consensus.cc:359] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.957490 11427 raft_consensus.cc:385] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.957568 11387 raft_consensus.cc:2468] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 0.
I20260709 13:02:40.959710 11428 tablet_bootstrap.cc:492] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:40.959656 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50075fe54a5d4d4c8feb65f777349817" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:40.960309 11387 raft_consensus.cc:3060] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.960446 11428 ts_tablet_manager.cc:1403] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.033s
I20260709 13:02:40.960743 11433 leader_election.cc:290] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:40.960388 11450 raft_consensus.cc:515] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.963351 11450 leader_election.cc:290] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:40.957854 11427 raft_consensus.cc:740] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.963750 11428 raft_consensus.cc:359] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.957934 11313 raft_consensus.cc:2468] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 1.
I20260709 13:02:40.964869 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da9b05fc45441b8f48e9cd60c46c45" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:40.964815 11427 consensus_queue.cc:260] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.964072 11237 raft_consensus.cc:2468] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 1.
I20260709 13:02:40.965917 11238 raft_consensus.cc:3060] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.966827 11277 leader_election.cc:304] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:40.967407 11427 ts_tablet_manager.cc:1434] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 13:02:40.967731 11433 raft_consensus.cc:2804] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.968477 11427 tablet_bootstrap.cc:492] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:40.969489 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da9b05fc45441b8f48e9cd60c46c45" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:40.970168 11312 raft_consensus.cc:3060] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.975865 11427 tablet_bootstrap.cc:654] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.976061 11238 raft_consensus.cc:2468] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 1.
I20260709 13:02:40.977262 11428 raft_consensus.cc:385] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.977638 11428 raft_consensus.cc:740] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.978410 11428 consensus_queue.cc:260] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.985455 11312 raft_consensus.cc:2468] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 1.
I20260709 13:02:40.978585 11351 leader_election.cc:304] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:40.994889 11450 raft_consensus.cc:2804] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.995419 11450 raft_consensus.cc:697] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Becoming Leader. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:40.995543 11428 ts_tablet_manager.cc:1434] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.035s	user 0.013s	sys 0.005s
I20260709 13:02:40.996652 11428 tablet_bootstrap.cc:492] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:40.996349 11450 consensus_queue.cc:237] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:40.999755 11426 tablet_bootstrap.cc:492] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:41.006932 11426 ts_tablet_manager.cc:1403] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.006s
I20260709 13:02:41.017545 11428 tablet_bootstrap.cc:654] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.019989 11433 raft_consensus.cc:697] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Becoming Leader. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:41.017664 11387 raft_consensus.cc:2468] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 1.
I20260709 13:02:41.011420 11426 raft_consensus.cc:359] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.021374 11433 consensus_queue.cc:237] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.022644 11426 raft_consensus.cc:385] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.023157 11426 raft_consensus.cc:740] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.024012 11432 raft_consensus.cc:697] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Becoming Leader. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:41.024724 11426 consensus_queue.cc:260] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.024963 11432 consensus_queue.cc:237] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.027673 11426 ts_tablet_manager.cc:1434] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:02:41.025450 11427 tablet_bootstrap.cc:492] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:41.028930 11450 raft_consensus.cc:493] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.029309 11427 ts_tablet_manager.cc:1403] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.018s
I20260709 13:02:41.029533 11450 raft_consensus.cc:515] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.031984 11450 leader_election.cc:290] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:41.033260 11427 raft_consensus.cc:359] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.034371 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec600eee44f4439961ad3cc16760d82" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:41.035208 11238 raft_consensus.cc:2468] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 0.
I20260709 13:02:41.034636 11427 raft_consensus.cc:385] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.035852 11427 raft_consensus.cc:740] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.036752 11427 consensus_queue.cc:260] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.038782 11351 leader_election.cc:304] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:41.037712 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec600eee44f4439961ad3cc16760d82" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:41.040359 11312 raft_consensus.cc:2468] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 0.
I20260709 13:02:41.041806 11427 ts_tablet_manager.cc:1434] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:02:41.045775 11427 tablet_bootstrap.cc:492] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:41.042428 11450 raft_consensus.cc:2804] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.047490 11450 raft_consensus.cc:493] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.047902 11450 raft_consensus.cc:3060] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.049166 11432 raft_consensus.cc:493] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.049715 11432 raft_consensus.cc:515] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.043253 11426 tablet_bootstrap.cc:492] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:41.054036 11432 leader_election.cc:290] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:41.054715 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4b19c988b349f8b40bd3a43d02e0ff" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:41.054258 11135 catalog_manager.cc:5697] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f reported cstate change: term changed from 0 to 1, leader changed from <none> to e04c761aac6144a5be44096d6127059f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e04c761aac6144a5be44096d6127059f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:41.056725 11351 leader_election.cc:343] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.059082 11427 tablet_bootstrap.cc:654] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.070492 11428 tablet_bootstrap.cc:492] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:41.062772 11450 raft_consensus.cc:515] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.067123 11426 tablet_bootstrap.cc:654] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.060058 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4b19c988b349f8b40bd3a43d02e0ff" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:41.072808 11450 leader_election.cc:290] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:41.073678 11428 ts_tablet_manager.cc:1403] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.077s	user 0.039s	sys 0.017s
I20260709 13:02:41.073690 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec600eee44f4439961ad3cc16760d82" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:41.074839 11237 raft_consensus.cc:3060] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.077499 11428 raft_consensus.cc:359] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } }
I20260709 13:02:41.078428 11428 raft_consensus.cc:385] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.078781 11428 raft_consensus.cc:740] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.079957 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec600eee44f4439961ad3cc16760d82" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:41.079720 11428 consensus_queue.cc:260] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } }
I20260709 13:02:41.080868 11312 raft_consensus.cc:3060] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.083202 11428 ts_tablet_manager.cc:1434] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:02:41.084872 11428 tablet_bootstrap.cc:492] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:41.092453 11428 tablet_bootstrap.cc:654] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.093623 11426 tablet_bootstrap.cc:492] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:41.094451 11426 ts_tablet_manager.cc:1403] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.006s
I20260709 13:02:41.072228 11238 raft_consensus.cc:2468] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 0.
I20260709 13:02:41.098803 11426 raft_consensus.cc:359] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.099942 11426 raft_consensus.cc:385] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.100088 11351 leader_election.cc:304] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: c990dfc7f02f4e4eb447f9b18d1e7263
I20260709 13:02:41.100409 11426 raft_consensus.cc:740] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.101471 11450 raft_consensus.cc:2804] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.102152 11450 raft_consensus.cc:493] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.102721 11450 raft_consensus.cc:3060] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.110742 11133 catalog_manager.cc:5697] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 reported cstate change: term changed from 0 to 1, leader changed from <none> to c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.102015 11426 consensus_queue.cc:260] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.116799 11312 raft_consensus.cc:2468] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 1.
I20260709 13:02:41.118029 11426 ts_tablet_manager.cc:1434] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 13:02:41.121202 11428 tablet_bootstrap.cc:492] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:41.122117 11428 ts_tablet_manager.cc:1403] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.037s	user 0.026s	sys 0.011s
I20260709 13:02:41.122008 11351 leader_election.cc:304] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, e04c761aac6144a5be44096d6127059f; no voters: 
I20260709 13:02:41.123546 11432 raft_consensus.cc:2804] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.124039 11432 raft_consensus.cc:697] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Becoming Leader. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:41.124830 11432 consensus_queue.cc:237] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.126928 11426 tablet_bootstrap.cc:492] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:41.126606 11428 raft_consensus.cc:359] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.127524 11428 raft_consensus.cc:385] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.127887 11427 tablet_bootstrap.cc:492] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:41.127923 11428 raft_consensus.cc:740] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.128495 11427 ts_tablet_manager.cc:1403] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.083s	user 0.024s	sys 0.036s
I20260709 13:02:41.129299 11428 consensus_queue.cc:260] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.131485 11427 raft_consensus.cc:359] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } }
I20260709 13:02:41.132279 11427 raft_consensus.cc:385] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.132607 11427 raft_consensus.cc:740] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.131924 11428 ts_tablet_manager.cc:1434] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:02:41.133481 11427 consensus_queue.cc:260] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } }
I20260709 13:02:41.118794 11237 raft_consensus.cc:2468] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 1.
I20260709 13:02:41.140949 11434 raft_consensus.cc:493] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.141481 11434 raft_consensus.cc:515] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.142515 11433 raft_consensus.cc:493] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.143366 11433 raft_consensus.cc:515] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.119746 11450 raft_consensus.cc:515] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.173286 11427 ts_tablet_manager.cc:1434] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.044s	user 0.021s	sys 0.024s
I20260709 13:02:41.173580 11433 leader_election.cc:290] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:41.174508 11434 leader_election.cc:290] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:41.174659 11427 tablet_bootstrap.cc:492] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:41.174896 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acf4412cd9743299ac27a0ca1af0b0f" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:41.181567 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acf4412cd9743299ac27a0ca1af0b0f" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f" is_pre_election: true
I20260709 13:02:41.175401 11450 leader_election.cc:290] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:41.182231 11387 raft_consensus.cc:2468] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 0.
I20260709 13:02:41.177050 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4b19c988b349f8b40bd3a43d02e0ff" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:41.181103 11434 raft_consensus.cc:493] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.183483 11434 raft_consensus.cc:515] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.185567 11434 leader_election.cc:290] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:41.175980 11428 tablet_bootstrap.cc:492] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:41.186913 11426 tablet_bootstrap.cc:654] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.188135 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4b19c988b349f8b40bd3a43d02e0ff" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:41.188784 11238 raft_consensus.cc:3060] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.193171 11428 tablet_bootstrap.cc:654] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.194262 11237 raft_consensus.cc:2468] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 0.
I20260709 13:02:41.196966 11238 raft_consensus.cc:2468] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 1.
I20260709 13:02:41.197242 11277 leader_election.cc:304] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:41.198223 11433 raft_consensus.cc:2804] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.198606 11433 raft_consensus.cc:493] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.198935 11433 raft_consensus.cc:3060] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.199884 11427 tablet_bootstrap.cc:654] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.203300 11351 leader_election.cc:304] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
W20260709 13:02:41.209177 11351 leader_election.cc:343] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.209558 11432 raft_consensus.cc:2804] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.210115 11432 raft_consensus.cc:697] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Becoming Leader. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:41.211475 11432 consensus_queue.cc:237] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.212775 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c5c8c093714a7c964077488e492de7" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:41.214128 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acf4412cd9743299ac27a0ca1af0b0f" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:41.214273 11433 raft_consensus.cc:515] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
W20260709 13:02:41.214886 11202 leader_election.cc:343] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.217442 11426 tablet_bootstrap.cc:492] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:41.217329 11433 leader_election.cc:290] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:41.218010 11426 ts_tablet_manager.cc:1403] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.000s
I20260709 13:02:41.218127 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acf4412cd9743299ac27a0ca1af0b0f" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:41.218779 11387 raft_consensus.cc:3060] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.219172 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acf4412cd9743299ac27a0ca1af0b0f" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:41.219666 11237 raft_consensus.cc:3060] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.220876 11426 raft_consensus.cc:359] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.221560 11426 raft_consensus.cc:385] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.221933 11426 raft_consensus.cc:740] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.222443 11313 raft_consensus.cc:2393] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f44094f32c624cc28c94864650dcd0c3 in current term 1: Already voted for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in this term.
I20260709 13:02:41.222698 11426 consensus_queue.cc:260] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.230923 11426 ts_tablet_manager.cc:1434] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:41.231915 11426 tablet_bootstrap.cc:492] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:41.234488 11427 tablet_bootstrap.cc:492] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:41.234990 11427 ts_tablet_manager.cc:1403] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.000s
I20260709 13:02:41.238685 11426 tablet_bootstrap.cc:654] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.240437 11386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c5c8c093714a7c964077488e492de7" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f" is_pre_election: true
I20260709 13:02:41.240990 11237 raft_consensus.cc:2468] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 1.
I20260709 13:02:41.241232 11386 raft_consensus.cc:2468] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 0.
I20260709 13:02:41.242424 11277 leader_election.cc:304] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:41.243332 11386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acf4412cd9743299ac27a0ca1af0b0f" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f" is_pre_election: true
I20260709 13:02:41.243872 11433 raft_consensus.cc:2804] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.244099 11428 tablet_bootstrap.cc:492] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:41.245162 11202 leader_election.cc:304] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: c990dfc7f02f4e4eb447f9b18d1e7263
I20260709 13:02:41.248473 11428 ts_tablet_manager.cc:1403] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.003s
I20260709 13:02:41.248622 11434 raft_consensus.cc:2804] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.249063 11434 raft_consensus.cc:493] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.249444 11434 raft_consensus.cc:3060] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.249897 11426 tablet_bootstrap.cc:492] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:41.250497 11426 ts_tablet_manager.cc:1403] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:02:41.252478 11428 raft_consensus.cc:359] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.253484 11428 raft_consensus.cc:385] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.253827 11428 raft_consensus.cc:740] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.255271 11433 raft_consensus.cc:697] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Becoming Leader. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:41.256125 11426 raft_consensus.cc:359] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } }
I20260709 13:02:41.256897 11426 raft_consensus.cc:385] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.257198 11426 raft_consensus.cc:740] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.258141 11428 consensus_queue.cc:260] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.256470 11433 consensus_queue.cc:237] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.261484 11202 leader_election.cc:304] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f44094f32c624cc28c94864650dcd0c3; no voters: c990dfc7f02f4e4eb447f9b18d1e7263, e04c761aac6144a5be44096d6127059f
I20260709 13:02:41.239857 11427 raft_consensus.cc:359] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.262583 11467 raft_consensus.cc:2749] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.262687 11427 raft_consensus.cc:385] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.263350 11427 raft_consensus.cc:740] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.259123 11434 raft_consensus.cc:515] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.264377 11426 consensus_queue.cc:260] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } }
I20260709 13:02:41.266830 11428 ts_tablet_manager.cc:1434] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:02:41.266896 11426 ts_tablet_manager.cc:1434] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:02:41.267205 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c5c8c093714a7c964077488e492de7" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:41.268151 11428 tablet_bootstrap.cc:492] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:41.268019 11313 raft_consensus.cc:3060] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.264421 11427 consensus_queue.cc:260] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.268842 11386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c5c8c093714a7c964077488e492de7" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:41.269974 11386 raft_consensus.cc:3060] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.270712 11427 ts_tablet_manager.cc:1434] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:02:41.275068 11434 leader_election.cc:290] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 election: Requested vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:41.246896 11387 raft_consensus.cc:2468] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 1.
I20260709 13:02:41.278275 11313 raft_consensus.cc:2468] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 1.
I20260709 13:02:41.278600 11450 raft_consensus.cc:493] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.279399 11450 raft_consensus.cc:515] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.281958 11450 leader_election.cc:290] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:41.284983 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6787048e662f4d2295ce5f8d30d58be5" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:41.285529 11202 leader_election.cc:304] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:41.285763 11237 raft_consensus.cc:2468] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 0.
I20260709 13:02:41.286593 11434 raft_consensus.cc:2804] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.287070 11351 leader_election.cc:304] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:41.287276 11386 raft_consensus.cc:2468] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 1.
I20260709 13:02:41.285521 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6787048e662f4d2295ce5f8d30d58be5" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:41.287079 11434 raft_consensus.cc:697] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Becoming Leader. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:41.288208 11313 raft_consensus.cc:2468] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 0.
I20260709 13:02:41.289070 11432 raft_consensus.cc:2804] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.288774 11434 consensus_queue.cc:237] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.289484 11432 raft_consensus.cc:493] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.289887 11432 raft_consensus.cc:3060] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.299371 11428 tablet_bootstrap.cc:654] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.298839 11133 catalog_manager.cc:5697] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f44094f32c624cc28c94864650dcd0c3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f44094f32c624cc28c94864650dcd0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.300544 11135 catalog_manager.cc:5697] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 reported cstate change: term changed from 0 to 1, leader changed from <none> to c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.297758 11432 raft_consensus.cc:515] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.303448 11432 leader_election.cc:290] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:41.304517 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6787048e662f4d2295ce5f8d30d58be5" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:41.305125 11313 raft_consensus.cc:3060] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.307610 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6787048e662f4d2295ce5f8d30d58be5" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:41.308251 11237 raft_consensus.cc:3060] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.312999 11313 raft_consensus.cc:2468] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 1.
I20260709 13:02:41.314399 11351 leader_election.cc:304] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, e04c761aac6144a5be44096d6127059f; no voters: 
I20260709 13:02:41.315238 11432 raft_consensus.cc:2804] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.315501 11237 raft_consensus.cc:2468] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 1.
I20260709 13:02:41.315883 11432 raft_consensus.cc:697] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Becoming Leader. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:41.317543 11432 consensus_queue.cc:237] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.320433 11428 tablet_bootstrap.cc:492] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:41.321018 11428 ts_tablet_manager.cc:1403] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.003s
I20260709 13:02:41.323576 11428 raft_consensus.cc:359] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.324254 11428 raft_consensus.cc:385] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.324550 11428 raft_consensus.cc:740] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.325464 11450 raft_consensus.cc:493] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.325229 11428 consensus_queue.cc:260] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.325985 11450 raft_consensus.cc:515] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } }
I20260709 13:02:41.327368 11428 ts_tablet_manager.cc:1434] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:41.326720 11132 catalog_manager.cc:5697] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f reported cstate change: term changed from 0 to 1, leader changed from <none> to e04c761aac6144a5be44096d6127059f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e04c761aac6144a5be44096d6127059f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.328049 11450 leader_election.cc:290] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751)
I20260709 13:02:41.329373 11433 raft_consensus.cc:493] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.330019 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e58214248e4dbbb409d91296dfcc34" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:41.329945 11433 raft_consensus.cc:515] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.330875 11237 raft_consensus.cc:2468] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 0.
I20260709 13:02:41.331159 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e58214248e4dbbb409d91296dfcc34" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:41.331821 11313 raft_consensus.cc:2468] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 0.
I20260709 13:02:41.332237 11351 leader_election.cc:304] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:41.329876 11132 catalog_manager.cc:5697] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f reported cstate change: term changed from 0 to 1, leader changed from <none> to e04c761aac6144a5be44096d6127059f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e04c761aac6144a5be44096d6127059f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.333673 11432 raft_consensus.cc:2804] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.334075 11432 raft_consensus.cc:493] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.334424 11432 raft_consensus.cc:3060] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.335250 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4b19c988b349f8b40bd3a43d02e0ff" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:41.335898 11433 leader_election.cc:290] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:41.336056 11237 raft_consensus.cc:2393] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c990dfc7f02f4e4eb447f9b18d1e7263 in current term 1: Already voted for candidate e04c761aac6144a5be44096d6127059f in this term.
I20260709 13:02:41.334470 11132 catalog_manager.cc:5697] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f reported cstate change: term changed from 0 to 1, leader changed from <none> to e04c761aac6144a5be44096d6127059f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e04c761aac6144a5be44096d6127059f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.337248 11386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4b19c988b349f8b40bd3a43d02e0ff" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f" is_pre_election: true
I20260709 13:02:41.338758 11277 leader_election.cc:304] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263; no voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3
I20260709 13:02:41.339529 11433 raft_consensus.cc:3060] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.344175 11432 raft_consensus.cc:515] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } }
I20260709 13:02:41.346417 11432 leader_election.cc:290] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Requested vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751)
I20260709 13:02:41.347155 11433 raft_consensus.cc:2749] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.348129 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e58214248e4dbbb409d91296dfcc34" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:41.348325 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e58214248e4dbbb409d91296dfcc34" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:41.348887 11313 raft_consensus.cc:3060] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.349053 11237 raft_consensus.cc:3060] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.356868 11313 raft_consensus.cc:2468] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 1.
I20260709 13:02:41.358290 11351 leader_election.cc:304] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, e04c761aac6144a5be44096d6127059f; no voters: 
I20260709 13:02:41.359421 11432 raft_consensus.cc:2804] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.360101 11432 raft_consensus.cc:697] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Becoming Leader. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:41.361039 11432 consensus_queue.cc:237] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } }
I20260709 13:02:41.361737 11237 raft_consensus.cc:2468] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 1.
I20260709 13:02:41.361196 11132 catalog_manager.cc:5697] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f reported cstate change: term changed from 0 to 1, leader changed from <none> to e04c761aac6144a5be44096d6127059f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e04c761aac6144a5be44096d6127059f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.430892 11132 catalog_manager.cc:5697] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f reported cstate change: term changed from 0 to 1, leader changed from <none> to e04c761aac6144a5be44096d6127059f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e04c761aac6144a5be44096d6127059f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.448151 11433 consensus_queue.cc:1048] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.467008 11457 consensus_queue.cc:1048] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.473757 11432 consensus_queue.cc:1048] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.493830 11454 consensus_queue.cc:1048] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.505184 11454 consensus_queue.cc:1048] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.522449 11454 consensus_queue.cc:1048] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.574532 11454 consensus_queue.cc:1048] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.587224 11454 consensus_queue.cc:1048] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.651468 11386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55e58214248e4dbbb409d91296dfcc34"
dest_uuid: "e04c761aac6144a5be44096d6127059f"
mode: GRACEFUL
new_leader_uuid: "f44094f32c624cc28c94864650dcd0c3"
 from {username='slave'} at 127.0.0.1:60874
I20260709 13:02:41.652285 11386 raft_consensus.cc:606] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Received request to transfer leadership to TS f44094f32c624cc28c94864650dcd0c3
I20260709 13:02:41.658037 11386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ec600eee44f4439961ad3cc16760d82"
dest_uuid: "e04c761aac6144a5be44096d6127059f"
mode: GRACEFUL
new_leader_uuid: "f44094f32c624cc28c94864650dcd0c3"
 from {username='slave'} at 127.0.0.1:60874
I20260709 13:02:41.658631 11386 raft_consensus.cc:606] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Received request to transfer leadership to TS f44094f32c624cc28c94864650dcd0c3
I20260709 13:02:41.672560 11313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5acf4412cd9743299ac27a0ca1af0b0f"
dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
mode: GRACEFUL
new_leader_uuid: "f44094f32c624cc28c94864650dcd0c3"
 from {username='slave'} at 127.0.0.1:44542
I20260709 13:02:41.673182 11313 raft_consensus.cc:606] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Received request to transfer leadership to TS f44094f32c624cc28c94864650dcd0c3
I20260709 13:02:41.678540 11386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b0a09e630c4464d90703b14b4b1412f"
dest_uuid: "e04c761aac6144a5be44096d6127059f"
mode: GRACEFUL
new_leader_uuid: "f44094f32c624cc28c94864650dcd0c3"
 from {username='slave'} at 127.0.0.1:60874
I20260709 13:02:41.679096 11386 raft_consensus.cc:606] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Received request to transfer leadership to TS f44094f32c624cc28c94864650dcd0c3
I20260709 13:02:41.693224 11238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69c5c8c093714a7c964077488e492de7"
dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
mode: GRACEFUL
new_leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
 from {username='slave'} at 127.0.0.1:44228
I20260709 13:02:41.693783 11238 raft_consensus.cc:606] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Received request to transfer leadership to TS c990dfc7f02f4e4eb447f9b18d1e7263
I20260709 13:02:41.699801 11386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57da9b05fc45441b8f48e9cd60c46c45"
dest_uuid: "e04c761aac6144a5be44096d6127059f"
mode: GRACEFUL
new_leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
 from {username='slave'} at 127.0.0.1:60874
I20260709 13:02:41.700348 11386 raft_consensus.cc:606] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Received request to transfer leadership to TS c990dfc7f02f4e4eb447f9b18d1e7263
I20260709 13:02:41.708560 11386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b4b19c988b349f8b40bd3a43d02e0ff"
dest_uuid: "e04c761aac6144a5be44096d6127059f"
mode: GRACEFUL
new_leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
 from {username='slave'} at 127.0.0.1:60874
I20260709 13:02:41.709182 11386 raft_consensus.cc:606] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Received request to transfer leadership to TS c990dfc7f02f4e4eb447f9b18d1e7263
I20260709 13:02:41.730603 11454 consensus_queue.cc:1048] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.731784 11450 consensus_queue.cc:1048] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.758505 11450 consensus_queue.cc:1048] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.756108 11432 consensus_queue.cc:1048] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:02:41.779575 11450 raft_consensus.cc:993] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f: : Instructing follower c990dfc7f02f4e4eb447f9b18d1e7263 to start an election
I20260709 13:02:41.780211 11450 raft_consensus.cc:1081] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Signalling peer c990dfc7f02f4e4eb447f9b18d1e7263 to start an election
I20260709 13:02:41.780196 11434 consensus_queue.cc:1048] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.782490 11312 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b4b19c988b349f8b40bd3a43d02e0ff"
dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
 from {username='slave'} at 127.0.0.1:44514
I20260709 13:02:41.784032 11312 raft_consensus.cc:493] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:41.784520 11312 raft_consensus.cc:3060] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.790380 11504 raft_consensus.cc:993] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3: : Instructing follower c990dfc7f02f4e4eb447f9b18d1e7263 to start an election
I20260709 13:02:41.791097 11434 raft_consensus.cc:1081] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Signalling peer c990dfc7f02f4e4eb447f9b18d1e7263 to start an election
I20260709 13:02:41.794565 11313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69c5c8c093714a7c964077488e492de7"
dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
 from {username='slave'} at 127.0.0.1:44526
I20260709 13:02:41.795068 11313 raft_consensus.cc:493] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:41.795399 11313 raft_consensus.cc:3060] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.798338 11312 raft_consensus.cc:515] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.802608 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4b19c988b349f8b40bd3a43d02e0ff" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:41.803414 11238 raft_consensus.cc:3060] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.803759 11313 raft_consensus.cc:515] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.804342 11434 consensus_queue.cc:1048] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.807540 11312 leader_election.cc:290] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 2 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:41.809827 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4b19c988b349f8b40bd3a43d02e0ff" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:41.810626 11387 raft_consensus.cc:3055] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:41.810986 11387 raft_consensus.cc:740] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:41.812197 11387 consensus_queue.cc:260] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.812868 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c5c8c093714a7c964077488e492de7" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:41.813596 11313 leader_election.cc:290] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 2 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:41.814397 11385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c5c8c093714a7c964077488e492de7" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:41.815155 11387 raft_consensus.cc:3060] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.813730 11237 raft_consensus.cc:3055] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:41.817075 11237 raft_consensus.cc:740] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:41.818009 11237 consensus_queue.cc:260] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.820302 11237 raft_consensus.cc:3060] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.822999 11238 raft_consensus.cc:2468] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 2.
I20260709 13:02:41.824615 11277 leader_election.cc:304] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:41.825789 11455 raft_consensus.cc:2804] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:41.826539 11455 raft_consensus.cc:697] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Becoming Leader. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:41.828272 11455 consensus_queue.cc:237] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.829577 11237 raft_consensus.cc:2468] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 2.
I20260709 13:02:41.831337 11277 leader_election.cc:304] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: e04c761aac6144a5be44096d6127059f
I20260709 13:02:41.832173 11455 raft_consensus.cc:2804] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:41.832669 11455 raft_consensus.cc:697] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Becoming Leader. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:41.833957 11455 consensus_queue.cc:237] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.837253 11457 consensus_queue.cc:1048] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.848335 11387 raft_consensus.cc:2468] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 2.
I20260709 13:02:41.849833 11135 catalog_manager.cc:5697] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 reported cstate change: term changed from 1 to 2, leader changed from f44094f32c624cc28c94864650dcd0c3 (127.0.107.193) to c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.852929 11457 consensus_queue.cc:1048] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.852097 11135 catalog_manager.cc:5697] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 reported cstate change: term changed from 1 to 2, leader changed from e04c761aac6144a5be44096d6127059f (127.0.107.195) to c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.863536 11457 raft_consensus.cc:993] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263: : Instructing follower f44094f32c624cc28c94864650dcd0c3 to start an election
I20260709 13:02:41.864180 11433 raft_consensus.cc:1081] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Signalling peer f44094f32c624cc28c94864650dcd0c3 to start an election
I20260709 13:02:41.869742 11237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5acf4412cd9743299ac27a0ca1af0b0f"
dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
 from {username='slave'} at 127.0.0.1:44226
I20260709 13:02:41.870721 11237 raft_consensus.cc:493] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:41.871341 11237 raft_consensus.cc:3060] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.880762 11237 raft_consensus.cc:515] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.882091 11238 raft_consensus.cc:1240] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Rejecting Update request from peer c990dfc7f02f4e4eb447f9b18d1e7263 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:41.884141 11237 leader_election.cc:290] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 2 election: Requested vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:41.884317 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acf4412cd9743299ac27a0ca1af0b0f" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:41.885113 11313 raft_consensus.cc:3055] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:41.885382 11313 raft_consensus.cc:740] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:41.885429 11385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acf4412cd9743299ac27a0ca1af0b0f" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:41.886134 11385 raft_consensus.cc:3060] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.886406 11313 consensus_queue.cc:260] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.887298 11509 consensus_queue.cc:1059] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.889640 11313 raft_consensus.cc:3060] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.894300 11450 consensus_queue.cc:1048] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.895557 11385 raft_consensus.cc:2468] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 2.
I20260709 13:02:41.897042 11450 consensus_queue.cc:1048] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.897151 11202 leader_election.cc:304] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:41.898267 11434 raft_consensus.cc:2804] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:41.898697 11313 raft_consensus.cc:2468] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 2.
I20260709 13:02:41.898821 11434 raft_consensus.cc:697] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Becoming Leader. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:41.900292 11434 consensus_queue.cc:237] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.905028 11450 raft_consensus.cc:993] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f: : Instructing follower f44094f32c624cc28c94864650dcd0c3 to start an election
I20260709 13:02:41.905656 11454 raft_consensus.cc:1081] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Signalling peer f44094f32c624cc28c94864650dcd0c3 to start an election
I20260709 13:02:41.908792 11238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b0a09e630c4464d90703b14b4b1412f"
dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
 from {username='slave'} at 127.0.0.1:44220
I20260709 13:02:41.909399 11238 raft_consensus.cc:493] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:41.909895 11238 raft_consensus.cc:3060] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.918030 11238 raft_consensus.cc:515] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.920588 11238 leader_election.cc:290] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 2 election: Requested vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:41.921236 11432 raft_consensus.cc:993] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f: : Instructing follower f44094f32c624cc28c94864650dcd0c3 to start an election
I20260709 13:02:41.921806 11432 raft_consensus.cc:1081] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Signalling peer f44094f32c624cc28c94864650dcd0c3 to start an election
I20260709 13:02:41.921747 11385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0a09e630c4464d90703b14b4b1412f" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:41.922565 11385 raft_consensus.cc:3055] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:41.922902 11385 raft_consensus.cc:740] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:41.923882 11385 consensus_queue.cc:260] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.924444 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0a09e630c4464d90703b14b4b1412f" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:41.925011 11385 raft_consensus.cc:3060] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.930071 11238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55e58214248e4dbbb409d91296dfcc34"
dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
 from {username='slave'} at 127.0.0.1:44220
I20260709 13:02:41.925180 11312 raft_consensus.cc:3060] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.933086 11238 raft_consensus.cc:493] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:41.933660 11238 raft_consensus.cc:3060] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.935427 11385 raft_consensus.cc:2468] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 2.
I20260709 13:02:41.926486 11135 catalog_manager.cc:5697] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 reported cstate change: term changed from 1 to 2, leader changed from c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194) to f44094f32c624cc28c94864650dcd0c3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f44094f32c624cc28c94864650dcd0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.936726 11202 leader_election.cc:304] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:41.937631 11434 raft_consensus.cc:2804] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:41.938143 11434 raft_consensus.cc:697] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Becoming Leader. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:41.939217 11434 consensus_queue.cc:237] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:41.941968 11238 raft_consensus.cc:515] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } }
I20260709 13:02:41.942725 11312 raft_consensus.cc:2468] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 2.
I20260709 13:02:41.945477 11238 leader_election.cc:290] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 2 election: Requested vote from peers e04c761aac6144a5be44096d6127059f (127.0.107.195:39309), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:41.947518 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e58214248e4dbbb409d91296dfcc34" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:41.948175 11387 raft_consensus.cc:3055] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:41.948529 11387 raft_consensus.cc:740] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:41.949631 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e58214248e4dbbb409d91296dfcc34" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:41.950325 11312 raft_consensus.cc:3060] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.949646 11387 consensus_queue.cc:260] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } }
I20260709 13:02:41.952744 11387 raft_consensus.cc:3060] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.957289 11312 raft_consensus.cc:2468] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 2.
I20260709 13:02:41.958933 11202 leader_election.cc:304] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:41.959856 11434 raft_consensus.cc:2804] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:41.960384 11434 raft_consensus.cc:697] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Becoming Leader. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:41.961431 11434 consensus_queue.cc:237] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } }
I20260709 13:02:41.961978 11387 raft_consensus.cc:2468] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 2.
I20260709 13:02:41.965662 11135 catalog_manager.cc:5697] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 reported cstate change: term changed from 1 to 2, leader changed from e04c761aac6144a5be44096d6127059f (127.0.107.195) to f44094f32c624cc28c94864650dcd0c3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f44094f32c624cc28c94864650dcd0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.980677 11133 catalog_manager.cc:5697] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 reported cstate change: term changed from 1 to 2, leader changed from e04c761aac6144a5be44096d6127059f (127.0.107.195) to f44094f32c624cc28c94864650dcd0c3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f44094f32c624cc28c94864650dcd0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:42.112778 11432 raft_consensus.cc:993] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f: : Instructing follower f44094f32c624cc28c94864650dcd0c3 to start an election
I20260709 13:02:42.113296 11454 raft_consensus.cc:1081] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Signalling peer f44094f32c624cc28c94864650dcd0c3 to start an election
I20260709 13:02:42.113672 11432 raft_consensus.cc:993] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f: : Instructing follower c990dfc7f02f4e4eb447f9b18d1e7263 to start an election
I20260709 13:02:42.114364 11500 raft_consensus.cc:1081] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Signalling peer c990dfc7f02f4e4eb447f9b18d1e7263 to start an election
I20260709 13:02:42.115069 11238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ec600eee44f4439961ad3cc16760d82"
dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
 from {username='slave'} at 127.0.0.1:44220
I20260709 13:02:42.115685 11238 raft_consensus.cc:493] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:42.115870 11312 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57da9b05fc45441b8f48e9cd60c46c45"
dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
 from {username='slave'} at 127.0.0.1:44514
I20260709 13:02:42.116127 11238 raft_consensus.cc:3060] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:42.116523 11312 raft_consensus.cc:493] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:42.116882 11312 raft_consensus.cc:3060] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:42.121917 11312 raft_consensus.cc:515] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:42.121939 11238 raft_consensus.cc:515] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:42.123795 11312 leader_election.cc:290] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 2 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:42.124661 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da9b05fc45441b8f48e9cd60c46c45" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:42.124759 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec600eee44f4439961ad3cc16760d82" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:42.124914 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec600eee44f4439961ad3cc16760d82" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:42.125404 11237 raft_consensus.cc:3060] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:42.125566 11313 raft_consensus.cc:3060] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:42.125582 11385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da9b05fc45441b8f48e9cd60c46c45" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:42.126498 11385 raft_consensus.cc:3055] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:42.126816 11385 raft_consensus.cc:740] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:42.127785 11385 consensus_queue.cc:260] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:42.129004 11385 raft_consensus.cc:3060] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:42.131455 11313 raft_consensus.cc:2468] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 2.
I20260709 13:02:42.124720 11238 leader_election.cc:290] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 2 election: Requested vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:42.132722 11202 leader_election.cc:304] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:42.133340 11237 raft_consensus.cc:2468] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 2.
I20260709 13:02:42.133678 11434 raft_consensus.cc:2804] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:42.125597 11387 raft_consensus.cc:3055] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:42.134373 11387 raft_consensus.cc:740] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:42.134863 11277 leader_election.cc:304] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:42.134368 11434 raft_consensus.cc:697] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Becoming Leader. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:42.135717 11433 raft_consensus.cc:2804] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:42.136298 11433 raft_consensus.cc:697] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Becoming Leader. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:42.135293 11387 consensus_queue.cc:260] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:42.136387 11385 raft_consensus.cc:2468] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 2.
I20260709 13:02:42.136307 11434 consensus_queue.cc:237] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:42.137467 11433 consensus_queue.cc:237] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:42.137991 11387 raft_consensus.cc:3060] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:42.144032 11387 raft_consensus.cc:2468] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 2.
I20260709 13:02:42.146278 11135 catalog_manager.cc:5697] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 reported cstate change: term changed from 1 to 2, leader changed from e04c761aac6144a5be44096d6127059f (127.0.107.195) to f44094f32c624cc28c94864650dcd0c3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f44094f32c624cc28c94864650dcd0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:42.146762 11133 catalog_manager.cc:5697] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 reported cstate change: term changed from 1 to 2, leader changed from e04c761aac6144a5be44096d6127059f (127.0.107.195) to c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:42.227779 11237 raft_consensus.cc:1275] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Refusing update from remote peer c990dfc7f02f4e4eb447f9b18d1e7263: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.229133 11433 consensus_queue.cc:1048] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.236840 11385 raft_consensus.cc:3060] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:42.244741 11385 raft_consensus.cc:1275] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Refusing update from remote peer c990dfc7f02f4e4eb447f9b18d1e7263: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.245883 11455 consensus_queue.cc:1048] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.344913 11385 raft_consensus.cc:1275] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Refusing update from remote peer f44094f32c624cc28c94864650dcd0c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.346333 11434 consensus_queue.cc:1048] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.359328 11313 raft_consensus.cc:1275] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Refusing update from remote peer f44094f32c624cc28c94864650dcd0c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.360936 11513 consensus_queue.cc:1048] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.365902 11385 raft_consensus.cc:1275] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Refusing update from remote peer c990dfc7f02f4e4eb447f9b18d1e7263: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.367818 11509 consensus_queue.cc:1048] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.373075 11313 raft_consensus.cc:1275] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Refusing update from remote peer f44094f32c624cc28c94864650dcd0c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.376307 11513 consensus_queue.cc:1048] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.376907 11237 raft_consensus.cc:1275] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Refusing update from remote peer c990dfc7f02f4e4eb447f9b18d1e7263: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.378453 11433 consensus_queue.cc:1048] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.391697 11385 raft_consensus.cc:1275] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Refusing update from remote peer f44094f32c624cc28c94864650dcd0c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.392879 11513 consensus_queue.cc:1048] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.453550 11313 raft_consensus.cc:1275] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Refusing update from remote peer f44094f32c624cc28c94864650dcd0c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.455010 11513 consensus_queue.cc:1048] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.465878 11385 raft_consensus.cc:1275] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Refusing update from remote peer f44094f32c624cc28c94864650dcd0c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.468497 11434 consensus_queue.cc:1048] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.573770 11313 raft_consensus.cc:1275] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Refusing update from remote peer f44094f32c624cc28c94864650dcd0c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.575331 11434 consensus_queue.cc:1048] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.582873 11387 raft_consensus.cc:1275] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Refusing update from remote peer f44094f32c624cc28c94864650dcd0c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.584910 11434 consensus_queue.cc:1048] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.665017 11237 raft_consensus.cc:1275] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Refusing update from remote peer c990dfc7f02f4e4eb447f9b18d1e7263: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.666488 11433 consensus_queue.cc:1048] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:42.677799 11387 raft_consensus.cc:1275] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Refusing update from remote peer c990dfc7f02f4e4eb447f9b18d1e7263: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:42.679265 11455 consensus_queue.cc:1048] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:44.752419 11132 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39706:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:44.755180 11132 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:44.809837 11220 tablet_service.cc:1511] Processing CreateTablet for tablet a08eb6c4745f437998dbe1a1d680e03a (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:44.811064 11296 tablet_service.cc:1511] Processing CreateTablet for tablet a08eb6c4745f437998dbe1a1d680e03a (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:44.811838 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08eb6c4745f437998dbe1a1d680e03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.812848 11296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08eb6c4745f437998dbe1a1d680e03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.815634 11377 tablet_service.cc:1511] Processing CreateTablet for tablet a08eb6c4745f437998dbe1a1d680e03a (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:44.816490 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 70c77c7b8f05428aa726e76cc156efa1 (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:44.818118 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70c77c7b8f05428aa726e76cc156efa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.818709 11374 tablet_service.cc:1511] Processing CreateTablet for tablet 70c77c7b8f05428aa726e76cc156efa1 (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:44.821038 11299 tablet_service.cc:1511] Processing CreateTablet for tablet 70c77c7b8f05428aa726e76cc156efa1 (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:44.821547 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 264ef7b553a2416b8d92bc5e4f79261a (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:44.823139 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264ef7b553a2416b8d92bc5e4f79261a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.823501 11301 tablet_service.cc:1511] Processing CreateTablet for tablet 264ef7b553a2416b8d92bc5e4f79261a (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:44.825634 11369 tablet_service.cc:1511] Processing CreateTablet for tablet 264ef7b553a2416b8d92bc5e4f79261a (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:44.827804 11299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70c77c7b8f05428aa726e76cc156efa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.830209 11301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264ef7b553a2416b8d92bc5e4f79261a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.830549 11228 tablet_service.cc:1511] Processing CreateTablet for tablet cd4a5da51934492babb41ee2504362bd (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:44.832145 11228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4a5da51934492babb41ee2504362bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.832751 11303 tablet_service.cc:1511] Processing CreateTablet for tablet cd4a5da51934492babb41ee2504362bd (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:44.833714 11377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08eb6c4745f437998dbe1a1d680e03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.834318 11303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4a5da51934492babb41ee2504362bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.838425 11369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264ef7b553a2416b8d92bc5e4f79261a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.842432 11374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70c77c7b8f05428aa726e76cc156efa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.849323 11375 tablet_service.cc:1511] Processing CreateTablet for tablet cd4a5da51934492babb41ee2504362bd (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:44.850991 11375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd4a5da51934492babb41ee2504362bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.859493 11227 tablet_service.cc:1511] Processing CreateTablet for tablet 325ec933e81248b0b098d5c3c6ec3537 (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:44.861167 11227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325ec933e81248b0b098d5c3c6ec3537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.861989 11300 tablet_service.cc:1511] Processing CreateTablet for tablet 325ec933e81248b0b098d5c3c6ec3537 (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:44.863621 11300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325ec933e81248b0b098d5c3c6ec3537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.884307 11373 tablet_service.cc:1511] Processing CreateTablet for tablet 325ec933e81248b0b098d5c3c6ec3537 (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:44.885917 11373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325ec933e81248b0b098d5c3c6ec3537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.922824 11295 tablet_service.cc:1511] Processing CreateTablet for tablet 23f1c74ef96f449db89325ff25b0a15e (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:44.924448 11295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f1c74ef96f449db89325ff25b0a15e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.925647 11223 tablet_service.cc:1511] Processing CreateTablet for tablet 23f1c74ef96f449db89325ff25b0a15e (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:44.928367 11223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f1c74ef96f449db89325ff25b0a15e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.928005 11376 tablet_service.cc:1511] Processing CreateTablet for tablet 23f1c74ef96f449db89325ff25b0a15e (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:44.929291 11528 tablet_bootstrap.cc:492] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:44.929518 11376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f1c74ef96f449db89325ff25b0a15e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.937085 11528 tablet_bootstrap.cc:654] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.950318 11529 tablet_bootstrap.cc:492] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:44.961308 11528 tablet_bootstrap.cc:492] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:44.961985 11528 ts_tablet_manager.cc:1403] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.013s
I20260709 13:02:44.967937 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 0affa1984c924b508ba596a892e03296 (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:44.972363 11528 raft_consensus.cc:359] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:44.976104 11528 raft_consensus.cc:385] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.976555 11528 raft_consensus.cc:740] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.969533 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0affa1984c924b508ba596a892e03296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.975049 11303 tablet_service.cc:1511] Processing CreateTablet for tablet 0affa1984c924b508ba596a892e03296 (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:44.980108 11303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0affa1984c924b508ba596a892e03296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.983691 11528 consensus_queue.cc:260] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:44.995590 11301 tablet_service.cc:1511] Processing CreateTablet for tablet 98ec28be99294210a14badc0101a5ab4 (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:44.996865 11528 ts_tablet_manager.cc:1434] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.034s	user 0.001s	sys 0.007s
I20260709 13:02:44.998214 11301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ec28be99294210a14badc0101a5ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.001535 11371 tablet_service.cc:1511] Processing CreateTablet for tablet 98ec28be99294210a14badc0101a5ab4 (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:44.991261 11374 tablet_service.cc:1511] Processing CreateTablet for tablet 0affa1984c924b508ba596a892e03296 (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:44.989239 11220 tablet_service.cc:1511] Processing CreateTablet for tablet 98ec28be99294210a14badc0101a5ab4 (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
W20260709 13:02:44.998757 11184 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:45.003088 11371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ec28be99294210a14badc0101a5ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.003397 11529 tablet_bootstrap.cc:654] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.007030 11374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0affa1984c924b508ba596a892e03296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.007755 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ec28be99294210a14badc0101a5ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.014889 11227 tablet_service.cc:1511] Processing CreateTablet for tablet 463a9c7a2ee8458ea7b9c2d6bcb0aeae (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:45.016299 11227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 463a9c7a2ee8458ea7b9c2d6bcb0aeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.019164 11300 tablet_service.cc:1511] Processing CreateTablet for tablet 463a9c7a2ee8458ea7b9c2d6bcb0aeae (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:45.021190 11300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 463a9c7a2ee8458ea7b9c2d6bcb0aeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.024240 11370 tablet_service.cc:1511] Processing CreateTablet for tablet 463a9c7a2ee8458ea7b9c2d6bcb0aeae (DEFAULT_TABLE table=soft_deleted_table [id=749de49105794e61a447d569a272a628]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:45.026398 11370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 463a9c7a2ee8458ea7b9c2d6bcb0aeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.006448 11528 tablet_bootstrap.cc:492] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:45.037906 11532 tablet_bootstrap.cc:492] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:45.050670 11528 tablet_bootstrap.cc:654] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.053757 11532 tablet_bootstrap.cc:654] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.107525 11532 tablet_bootstrap.cc:492] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:45.108187 11532 ts_tablet_manager.cc:1403] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.071s	user 0.029s	sys 0.015s
I20260709 13:02:45.110956 11529 tablet_bootstrap.cc:492] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:45.111618 11532 raft_consensus.cc:359] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.113222 11532 raft_consensus.cc:385] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.113339 11529 ts_tablet_manager.cc:1403] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.163s	user 0.024s	sys 0.039s
I20260709 13:02:45.113706 11532 raft_consensus.cc:740] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.114667 11532 consensus_queue.cc:260] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.117465 11532 ts_tablet_manager.cc:1434] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:02:45.117355 11529 raft_consensus.cc:359] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.118505 11529 raft_consensus.cc:385] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.118783 11529 raft_consensus.cc:740] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.119656 11529 consensus_queue.cc:260] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.121516 11528 tablet_bootstrap.cc:492] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:45.122202 11528 ts_tablet_manager.cc:1403] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.003s
I20260709 13:02:45.125560 11528 raft_consensus.cc:359] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.127336 11528 raft_consensus.cc:385] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.127753 11528 raft_consensus.cc:740] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.126910 11532 tablet_bootstrap.cc:492] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:45.131472 11529 ts_tablet_manager.cc:1434] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:02:45.132143 11528 consensus_queue.cc:260] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.139565 11528 ts_tablet_manager.cc:1434] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:02:45.140803 11528 tablet_bootstrap.cc:492] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:45.137295 11532 tablet_bootstrap.cc:654] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.141727 11529 tablet_bootstrap.cc:492] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:45.151940 11528 tablet_bootstrap.cc:654] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.152561 11529 tablet_bootstrap.cc:654] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.162139 11529 tablet_bootstrap.cc:492] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:45.162665 11529 ts_tablet_manager.cc:1403] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:02:45.167444 11529 raft_consensus.cc:359] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.168272 11529 raft_consensus.cc:385] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.168663 11529 raft_consensus.cc:740] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.169575 11529 consensus_queue.cc:260] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.170825 11528 tablet_bootstrap.cc:492] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:45.171433 11528 ts_tablet_manager.cc:1403] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.007s
I20260709 13:02:45.175035 11529 ts_tablet_manager.cc:1434] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:02:45.176326 11529 tablet_bootstrap.cc:492] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:45.175710 11528 raft_consensus.cc:359] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.176867 11528 raft_consensus.cc:385] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.177268 11528 raft_consensus.cc:740] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.178485 11528 consensus_queue.cc:260] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.180436 11531 raft_consensus.cc:493] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.180883 11531 raft_consensus.cc:515] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.182998 11531 leader_election.cc:290] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.184423 11529 tablet_bootstrap.cc:654] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.184715 11528 ts_tablet_manager.cc:1434] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 13:02:45.185819 11528 tablet_bootstrap.cc:492] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:45.187929 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08eb6c4745f437998dbe1a1d680e03a" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:45.189426 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08eb6c4745f437998dbe1a1d680e03a" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f" is_pre_election: true
W20260709 13:02:45.192744 11277 leader_election.cc:343] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e04c761aac6144a5be44096d6127059f (127.0.107.195:39309): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:45.193431 11277 leader_election.cc:343] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.193888 11277 leader_election.cc:304] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263; no voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3
I20260709 13:02:45.195024 11531 raft_consensus.cc:2749] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:45.195889 11528 tablet_bootstrap.cc:654] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.198406 11529 tablet_bootstrap.cc:492] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:45.198871 11532 tablet_bootstrap.cc:492] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:45.199008 11529 ts_tablet_manager.cc:1403] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.000s
I20260709 13:02:45.199455 11532 ts_tablet_manager.cc:1403] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.015s
I20260709 13:02:45.202587 11529 raft_consensus.cc:359] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.203439 11529 raft_consensus.cc:385] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.203802 11529 raft_consensus.cc:740] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.202811 11532 raft_consensus.cc:359] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.204895 11532 raft_consensus.cc:385] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.204617 11529 consensus_queue.cc:260] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.205230 11532 raft_consensus.cc:740] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.206103 11532 consensus_queue.cc:260] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.209098 11532 ts_tablet_manager.cc:1434] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:02:45.210199 11532 tablet_bootstrap.cc:492] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:45.210332 11529 ts_tablet_manager.cc:1434] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:02:45.211463 11529 tablet_bootstrap.cc:492] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:45.219026 11532 tablet_bootstrap.cc:654] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.219090 11529 tablet_bootstrap.cc:654] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.224975 11528 tablet_bootstrap.cc:492] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:45.225594 11528 ts_tablet_manager.cc:1403] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.009s
I20260709 13:02:45.228628 11528 raft_consensus.cc:359] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.229445 11528 raft_consensus.cc:385] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.229802 11528 raft_consensus.cc:740] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.230634 11528 consensus_queue.cc:260] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.232841 11529 tablet_bootstrap.cc:492] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:45.233498 11529 ts_tablet_manager.cc:1403] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 13:02:45.233851 11532 tablet_bootstrap.cc:492] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:45.234488 11532 ts_tablet_manager.cc:1403] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.006s
I20260709 13:02:45.235564 11528 ts_tablet_manager.cc:1434] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:45.236737 11528 tablet_bootstrap.cc:492] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:45.236863 11529 raft_consensus.cc:359] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.237663 11529 raft_consensus.cc:385] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.237653 11532 raft_consensus.cc:359] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.238220 11529 raft_consensus.cc:740] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.238574 11532 raft_consensus.cc:385] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.238997 11532 raft_consensus.cc:740] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.239046 11529 consensus_queue.cc:260] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.239935 11532 consensus_queue.cc:260] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.256126 11529 ts_tablet_manager.cc:1434] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.020s
I20260709 13:02:45.257236 11529 tablet_bootstrap.cc:492] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:45.258733 11500 raft_consensus.cc:493] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.259306 11500 raft_consensus.cc:515] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.261682 11500 leader_election.cc:290] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:45.262363 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f1c74ef96f449db89325ff25b0a15e" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:45.263612 11532 ts_tablet_manager.cc:1434] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.011s
W20260709 13:02:45.264003 11351 leader_election.cc:343] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.264181 11529 tablet_bootstrap.cc:654] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.265336 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f1c74ef96f449db89325ff25b0a15e" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:45.264776 11532 tablet_bootstrap.cc:492] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:45.266857 11528 tablet_bootstrap.cc:654] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:45.268761 11351 leader_election.cc:343] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.269261 11351 leader_election.cc:304] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e04c761aac6144a5be44096d6127059f; no voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3
I20260709 13:02:45.270147 11500 raft_consensus.cc:2749] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:45.275162 11532 tablet_bootstrap.cc:654] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.277700 11531 raft_consensus.cc:493] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.278425 11531 raft_consensus.cc:515] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.281069 11531 leader_election.cc:290] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.283396 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70c77c7b8f05428aa726e76cc156efa1" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:45.284114 11238 raft_consensus.cc:2468] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 0.
I20260709 13:02:45.284283 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70c77c7b8f05428aa726e76cc156efa1" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f" is_pre_election: true
I20260709 13:02:45.284978 11387 raft_consensus.cc:2468] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 0.
I20260709 13:02:45.285467 11277 leader_election.cc:304] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.285785 11528 tablet_bootstrap.cc:492] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:45.286522 11528 ts_tablet_manager.cc:1403] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.003s
I20260709 13:02:45.286816 11455 raft_consensus.cc:2804] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.287216 11455 raft_consensus.cc:493] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.287551 11455 raft_consensus.cc:3060] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.289041 11529 tablet_bootstrap.cc:492] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:45.289556 11529 ts_tablet_manager.cc:1403] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.033s	user 0.002s	sys 0.025s
I20260709 13:02:45.290138 11528 raft_consensus.cc:359] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.290979 11528 raft_consensus.cc:385] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.291325 11528 raft_consensus.cc:740] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.292268 11528 consensus_queue.cc:260] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.295706 11455 raft_consensus.cc:515] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.296208 11528 ts_tablet_manager.cc:1434] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:45.297310 11528 tablet_bootstrap.cc:492] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:45.297935 11455 leader_election.cc:290] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.298774 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70c77c7b8f05428aa726e76cc156efa1" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:45.293032 11529 raft_consensus.cc:359] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.299348 11238 raft_consensus.cc:3060] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.299599 11529 raft_consensus.cc:385] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.299624 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70c77c7b8f05428aa726e76cc156efa1" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:45.300230 11529 raft_consensus.cc:740] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.300707 11387 raft_consensus.cc:3060] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.301409 11529 consensus_queue.cc:260] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.304025 11529 ts_tablet_manager.cc:1434] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:02:45.305153 11529 tablet_bootstrap.cc:492] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:45.307538 11238 raft_consensus.cc:2468] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 1.
I20260709 13:02:45.310104 11277 leader_election.cc:304] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.312184 11529 tablet_bootstrap.cc:654] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.313364 11387 raft_consensus.cc:2468] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 1.
I20260709 13:02:45.317373 11532 tablet_bootstrap.cc:492] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:45.317936 11532 ts_tablet_manager.cc:1403] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.053s	user 0.003s	sys 0.013s
I20260709 13:02:45.313813 11455 raft_consensus.cc:2804] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.318773 11455 raft_consensus.cc:697] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Becoming Leader. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:45.319566 11528 tablet_bootstrap.cc:654] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.319671 11455 consensus_queue.cc:237] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.321862 11532 raft_consensus.cc:359] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.322703 11532 raft_consensus.cc:385] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.322986 11532 raft_consensus.cc:740] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.323791 11532 consensus_queue.cc:260] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.326152 11532 ts_tablet_manager.cc:1434] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:45.327829 11531 raft_consensus.cc:493] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.328485 11532 tablet_bootstrap.cc:492] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:45.328362 11531 raft_consensus.cc:515] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.330579 11531 leader_election.cc:290] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.332934 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ef7b553a2416b8d92bc5e4f79261a" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f" is_pre_election: true
I20260709 13:02:45.334434 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ef7b553a2416b8d92bc5e4f79261a" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:45.335232 11238 raft_consensus.cc:2468] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 0.
I20260709 13:02:45.336580 11277 leader_election.cc:304] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.337371 11529 tablet_bootstrap.cc:492] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
W20260709 13:02:45.337591 11277 leader_election.cc:343] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e04c761aac6144a5be44096d6127059f (127.0.107.195:39309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.338114 11529 ts_tablet_manager.cc:1403] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.021s
I20260709 13:02:45.338554 11531 raft_consensus.cc:2804] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.339010 11531 raft_consensus.cc:493] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.339350 11531 raft_consensus.cc:3060] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.340039 11532 tablet_bootstrap.cc:654] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.341586 11529 raft_consensus.cc:359] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.342424 11529 raft_consensus.cc:385] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.342790 11529 raft_consensus.cc:740] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.344049 11528 tablet_bootstrap.cc:492] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:45.344650 11528 ts_tablet_manager.cc:1403] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.003s
I20260709 13:02:45.345538 11529 consensus_queue.cc:260] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.347750 11528 raft_consensus.cc:359] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.348220 11529 ts_tablet_manager.cc:1434] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.006s
I20260709 13:02:45.348526 11528 raft_consensus.cc:385] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.348860 11528 raft_consensus.cc:740] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.349614 11528 consensus_queue.cc:260] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.350107 11529 tablet_bootstrap.cc:492] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:45.359787 11528 ts_tablet_manager.cc:1434] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:02:45.361171 11529 tablet_bootstrap.cc:654] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.362083 11528 tablet_bootstrap.cc:492] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:45.365025 11531 raft_consensus.cc:515] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.368074 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ef7b553a2416b8d92bc5e4f79261a" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:45.368681 11238 raft_consensus.cc:3060] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.373392 11528 tablet_bootstrap.cc:654] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.377210 11133 catalog_manager.cc:5697] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 reported cstate change: term changed from 0 to 1, leader changed from <none> to c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.380928 11529 tablet_bootstrap.cc:492] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:45.381804 11529 ts_tablet_manager.cc:1403] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.012s
I20260709 13:02:45.384025 11238 raft_consensus.cc:2468] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 1.
I20260709 13:02:45.385454 11277 leader_election.cc:304] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.386358 11455 raft_consensus.cc:2804] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.386240 11529 raft_consensus.cc:359] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.387248 11455 raft_consensus.cc:697] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Becoming Leader. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:45.387676 11529 raft_consensus.cc:385] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.388228 11529 raft_consensus.cc:740] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.388998 11455 consensus_queue.cc:237] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.389443 11529 consensus_queue.cc:260] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.391494 11531 leader_election.cc:290] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.393026 11529 ts_tablet_manager.cc:1434] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:02:45.394655 11529 tablet_bootstrap.cc:492] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:45.397565 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ef7b553a2416b8d92bc5e4f79261a" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:45.402160 11532 tablet_bootstrap.cc:492] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:45.402529 11529 tablet_bootstrap.cc:654] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.402757 11532 ts_tablet_manager.cc:1403] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.075s	user 0.034s	sys 0.022s
I20260709 13:02:45.403085 11528 tablet_bootstrap.cc:492] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:45.403599 11528 ts_tablet_manager.cc:1403] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.004s
W20260709 13:02:45.405612 11277 leader_election.cc:343] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e04c761aac6144a5be44096d6127059f (127.0.107.195:39309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.402688 11500 raft_consensus.cc:493] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.406870 11500 raft_consensus.cc:515] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.406590 11532 raft_consensus.cc:359] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.407755 11532 raft_consensus.cc:385] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.408152 11532 raft_consensus.cc:740] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.409423 11500 leader_election.cc:290] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:45.409835 11532 consensus_queue.cc:260] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.411643 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08eb6c4745f437998dbe1a1d680e03a" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:45.412210 11532 ts_tablet_manager.cc:1434] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:45.412400 11237 raft_consensus.cc:2468] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 0.
I20260709 13:02:45.406616 11528 raft_consensus.cc:359] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.413527 11528 raft_consensus.cc:385] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.413859 11528 raft_consensus.cc:740] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.414273 11351 leader_election.cc:304] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.414635 11528 consensus_queue.cc:260] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.415226 11529 tablet_bootstrap.cc:492] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:45.415822 11529 ts_tablet_manager.cc:1403] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.000s
I20260709 13:02:45.416280 11514 raft_consensus.cc:493] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.417141 11528 ts_tablet_manager.cc:1434] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:45.416958 11514 raft_consensus.cc:515] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.418234 11528 tablet_bootstrap.cc:492] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:45.419788 11529 raft_consensus.cc:359] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.420542 11529 raft_consensus.cc:385] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.420852 11529 raft_consensus.cc:740] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.421546 11529 consensus_queue.cc:260] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.425247 11532 tablet_bootstrap.cc:492] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:45.426935 11514 leader_election.cc:290] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.429440 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4a5da51934492babb41ee2504362bd" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f" is_pre_election: true
I20260709 13:02:45.430397 11387 raft_consensus.cc:2468] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 0.
I20260709 13:02:45.432792 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4a5da51934492babb41ee2504362bd" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:45.433089 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08eb6c4745f437998dbe1a1d680e03a" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:45.433485 11313 raft_consensus.cc:2468] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 0.
I20260709 13:02:45.433787 11532 tablet_bootstrap.cc:654] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.433758 11312 raft_consensus.cc:2468] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 0.
I20260709 13:02:45.436190 11529 ts_tablet_manager.cc:1434] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 13:02:45.436273 11500 raft_consensus.cc:2804] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.436902 11500 raft_consensus.cc:493] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.437340 11500 raft_consensus.cc:3060] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.437727 11529 tablet_bootstrap.cc:492] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3: Bootstrap starting.
I20260709 13:02:45.448552 11528 tablet_bootstrap.cc:654] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.453510 11529 tablet_bootstrap.cc:654] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:45.478976 11351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39751, user_credentials={real_user=slave}} blocked reactor thread for 64820.9us
I20260709 13:02:45.497949 11531 raft_consensus.cc:493] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.498700 11531 raft_consensus.cc:515] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.501621 11531 leader_election.cc:290] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.504338 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f1c74ef96f449db89325ff25b0a15e" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:45.505358 11238 raft_consensus.cc:2468] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 0.
I20260709 13:02:45.507133 11277 leader_election.cc:304] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.508266 11531 raft_consensus.cc:2804] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.508749 11531 raft_consensus.cc:493] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.509514 11531 raft_consensus.cc:3060] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.514669 11202 leader_election.cc:304] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.517385 11558 raft_consensus.cc:2804] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.517899 11558 raft_consensus.cc:493] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.518345 11558 raft_consensus.cc:3060] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.530285 11455 raft_consensus.cc:493] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.531133 11455 raft_consensus.cc:515] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.535027 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ec933e81248b0b098d5c3c6ec3537" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:45.535897 11237 raft_consensus.cc:2468] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 0.
I20260709 13:02:45.538122 11277 leader_election.cc:304] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.539119 11550 raft_consensus.cc:2804] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.539516 11550 raft_consensus.cc:493] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.539847 11550 raft_consensus.cc:3060] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.548823 11550 raft_consensus.cc:515] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.549068 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f1c74ef96f449db89325ff25b0a15e" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f" is_pre_election: true
I20260709 13:02:45.549788 11387 raft_consensus.cc:2468] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 0.
I20260709 13:02:45.551017 11550 leader_election.cc:290] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.554817 11455 leader_election.cc:290] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.555063 11559 raft_consensus.cc:493] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.556075 11559 raft_consensus.cc:515] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.561074 11528 tablet_bootstrap.cc:492] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:45.562166 11528 ts_tablet_manager.cc:1403] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.144s	user 0.035s	sys 0.025s
I20260709 13:02:45.566380 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ec933e81248b0b098d5c3c6ec3537" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:45.565501 11559 leader_election.cc:290] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.566967 11528 raft_consensus.cc:359] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.568492 11528 raft_consensus.cc:385] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.568832 11528 raft_consensus.cc:740] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.570604 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ec933e81248b0b098d5c3c6ec3537" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:45.571990 11529 tablet_bootstrap.cc:492] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3: No bootstrap required, opened a new log
I20260709 13:02:45.572546 11529 ts_tablet_manager.cc:1403] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3: Time spent bootstrapping tablet: real 0.135s	user 0.034s	sys 0.024s
I20260709 13:02:45.572801 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ec933e81248b0b098d5c3c6ec3537" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f" is_pre_election: true
I20260709 13:02:45.567348 11238 raft_consensus.cc:3060] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.580394 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0affa1984c924b508ba596a892e03296" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:45.581856 11528 consensus_queue.cc:260] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.576390 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0affa1984c924b508ba596a892e03296" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f" is_pre_election: true
I20260709 13:02:45.583205 11312 raft_consensus.cc:2468] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 0.
I20260709 13:02:45.583587 11387 raft_consensus.cc:2468] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 0.
I20260709 13:02:45.576365 11529 raft_consensus.cc:359] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.585922 11529 raft_consensus.cc:385] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.586338 11529 raft_consensus.cc:740] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.587366 11532 tablet_bootstrap.cc:492] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:45.587944 11532 ts_tablet_manager.cc:1403] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.163s	user 0.044s	sys 0.096s
I20260709 13:02:45.587661 11531 raft_consensus.cc:515] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.587172 11529 consensus_queue.cc:260] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.588114 11238 raft_consensus.cc:2468] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 1.
I20260709 13:02:45.591814 11529 ts_tablet_manager.cc:1434] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:02:45.560823 11500 raft_consensus.cc:515] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.591668 11558 raft_consensus.cc:515] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.592764 11202 leader_election.cc:304] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.593757 11559 raft_consensus.cc:2804] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.591884 11532 raft_consensus.cc:359] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.592760 11528 ts_tablet_manager.cc:1434] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:02:45.600594 11532 raft_consensus.cc:385] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.595391 11558 leader_election.cc:290] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 election: Requested vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.600922 11532 raft_consensus.cc:740] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.599361 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4a5da51934492babb41ee2504362bd" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:45.602015 11387 raft_consensus.cc:3060] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.601773 11532 consensus_queue.cc:260] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.601779 11528 tablet_bootstrap.cc:492] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263: Bootstrap starting.
I20260709 13:02:45.604199 11532 ts_tablet_manager.cc:1434] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.006s
I20260709 13:02:45.596328 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08eb6c4745f437998dbe1a1d680e03a" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:45.604889 11238 raft_consensus.cc:3060] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.605335 11531 leader_election.cc:290] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.599848 11500 leader_election.cc:290] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
W20260709 13:02:45.598914 11277 leader_election.cc:343] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e04c761aac6144a5be44096d6127059f (127.0.107.195:39309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.594143 11559 raft_consensus.cc:493] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.606402 11559 raft_consensus.cc:3060] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:45.606603 11277 leader_election.cc:343] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e04c761aac6144a5be44096d6127059f (127.0.107.195:39309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.609144 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08eb6c4745f437998dbe1a1d680e03a" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:45.609337 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd4a5da51934492babb41ee2504362bd" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:45.609871 11312 raft_consensus.cc:3060] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.609967 11313 raft_consensus.cc:3060] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.614663 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f1c74ef96f449db89325ff25b0a15e" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:45.615579 11236 raft_consensus.cc:3060] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.615679 11528 tablet_bootstrap.cc:654] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.619498 11277 leader_election.cc:304] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: e04c761aac6144a5be44096d6127059f
I20260709 13:02:45.620396 11532 tablet_bootstrap.cc:492] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:45.621076 11313 raft_consensus.cc:2468] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 1.
I20260709 13:02:45.622239 11550 raft_consensus.cc:2804] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.622788 11550 raft_consensus.cc:697] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Becoming Leader. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:45.623660 11550 consensus_queue.cc:237] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.626113 11559 raft_consensus.cc:515] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.627558 11202 leader_election.cc:304] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.628448 11532 tablet_bootstrap.cc:654] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.628723 11558 raft_consensus.cc:2804] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.629247 11558 raft_consensus.cc:697] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Becoming Leader. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:45.630084 11558 consensus_queue.cc:237] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.635070 11132 catalog_manager.cc:5697] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 reported cstate change: term changed from 0 to 1, leader changed from <none> to c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.637964 11385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f1c74ef96f449db89325ff25b0a15e" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:45.638898 11385 raft_consensus.cc:3060] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.639672 11559 leader_election.cc:290] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 election: Requested vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.645627 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0affa1984c924b508ba596a892e03296" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:45.646492 11313 raft_consensus.cc:3060] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.651158 11386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0affa1984c924b508ba596a892e03296" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:45.651857 11386 raft_consensus.cc:3060] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.656442 11238 raft_consensus.cc:2468] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 1.
I20260709 13:02:45.656741 11532 tablet_bootstrap.cc:492] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:45.665856 11313 raft_consensus.cc:2468] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 1.
I20260709 13:02:45.666399 11532 ts_tablet_manager.cc:1403] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.007s
I20260709 13:02:45.666998 11202 leader_election.cc:304] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.661820 11236 raft_consensus.cc:2468] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 1.
I20260709 13:02:45.663269 11132 catalog_manager.cc:5697] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f44094f32c624cc28c94864650dcd0c3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f44094f32c624cc28c94864650dcd0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.667873 11559 raft_consensus.cc:2804] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.663702 11386 raft_consensus.cc:2468] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 1.
I20260709 13:02:45.668360 11559 raft_consensus.cc:697] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Becoming Leader. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:45.669185 11559 consensus_queue.cc:237] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.664796 11387 raft_consensus.cc:2468] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 1.
I20260709 13:02:45.630075 11312 raft_consensus.cc:2468] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 1.
I20260709 13:02:45.672744 11532 raft_consensus.cc:359] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.673370 11532 raft_consensus.cc:385] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.673663 11532 raft_consensus.cc:740] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.674391 11532 consensus_queue.cc:260] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.675956 11532 ts_tablet_manager.cc:1434] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:02:45.676870 11532 tablet_bootstrap.cc:492] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:45.678493 11514 raft_consensus.cc:493] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.678965 11514 raft_consensus.cc:515] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.679718 11277 leader_election.cc:304] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.680621 11550 raft_consensus.cc:2804] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.680743 11514 leader_election.cc:290] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.681180 11550 raft_consensus.cc:697] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Becoming Leader. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:45.681887 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ec28be99294210a14badc0101a5ab4" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f" is_pre_election: true
I20260709 13:02:45.682122 11550 consensus_queue.cc:237] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.683138 11351 leader_election.cc:304] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.683507 11532 tablet_bootstrap.cc:654] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.666837 11528 tablet_bootstrap.cc:492] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263: No bootstrap required, opened a new log
I20260709 13:02:45.658953 11385 raft_consensus.cc:2468] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 1.
W20260709 13:02:45.684008 11202 leader_election.cc:343] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e04c761aac6144a5be44096d6127059f (127.0.107.195:39309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.686367 11528 ts_tablet_manager.cc:1403] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.004s
I20260709 13:02:45.687565 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ec28be99294210a14badc0101a5ab4" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:45.688630 11312 raft_consensus.cc:2468] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 0.
I20260709 13:02:45.688725 11528 raft_consensus.cc:359] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.689345 11528 raft_consensus.cc:385] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.689607 11528 raft_consensus.cc:740] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.690246 11500 raft_consensus.cc:2804] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.690171 11202 leader_election.cc:304] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: e04c761aac6144a5be44096d6127059f
I20260709 13:02:45.690865 11500 raft_consensus.cc:697] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Becoming Leader. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:45.691774 11559 raft_consensus.cc:2804] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.691740 11500 consensus_queue.cc:237] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.692291 11559 raft_consensus.cc:493] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.692775 11559 raft_consensus.cc:3060] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.695420 11532 tablet_bootstrap.cc:492] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:45.696130 11532 ts_tablet_manager.cc:1403] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:02:45.699396 11532 raft_consensus.cc:359] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.700083 11532 raft_consensus.cc:385] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.699491 11135 catalog_manager.cc:5697] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 reported cstate change: term changed from 0 to 1, leader changed from <none> to c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.700357 11532 raft_consensus.cc:740] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.701095 11532 consensus_queue.cc:260] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.703955 11532 ts_tablet_manager.cc:1434] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:45.704918 11532 tablet_bootstrap.cc:492] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f: Bootstrap starting.
I20260709 13:02:45.705925 11528 consensus_queue.cc:260] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.708565 11528 ts_tablet_manager.cc:1434] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 13:02:45.709597 11559 raft_consensus.cc:515] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.710906 11532 tablet_bootstrap.cc:654] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.713356 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ec28be99294210a14badc0101a5ab4" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:45.713973 11312 raft_consensus.cc:3060] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.714311 11559 leader_election.cc:290] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 election: Requested vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.714531 11385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ec28be99294210a14badc0101a5ab4" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:45.715176 11385 raft_consensus.cc:3060] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.724007 11385 raft_consensus.cc:2468] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 1.
I20260709 13:02:45.725628 11202 leader_election.cc:304] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.727104 11558 raft_consensus.cc:2804] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.727632 11558 raft_consensus.cc:697] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Becoming Leader. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:45.727210 11132 catalog_manager.cc:5697] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f44094f32c624cc28c94864650dcd0c3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f44094f32c624cc28c94864650dcd0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.727982 11312 raft_consensus.cc:2468] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 1.
I20260709 13:02:45.728889 11558 consensus_queue.cc:237] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.730336 11134 catalog_manager.cc:5697] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f reported cstate change: term changed from 0 to 1, leader changed from <none> to e04c761aac6144a5be44096d6127059f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "e04c761aac6144a5be44096d6127059f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.732865 11532 tablet_bootstrap.cc:492] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f: No bootstrap required, opened a new log
I20260709 13:02:45.733434 11532 ts_tablet_manager.cc:1403] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.006s
I20260709 13:02:45.736240 11532 raft_consensus.cc:359] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.736975 11532 raft_consensus.cc:385] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.737260 11532 raft_consensus.cc:740] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.738018 11532 consensus_queue.cc:260] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.740367 11532 ts_tablet_manager.cc:1434] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:02:45.742969 11558 raft_consensus.cc:493] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.743587 11558 raft_consensus.cc:515] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.746232 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463a9c7a2ee8458ea7b9c2d6bcb0aeae" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:45.746889 11312 raft_consensus.cc:2468] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 0.
I20260709 13:02:45.746891 11135 catalog_manager.cc:5697] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 reported cstate change: term changed from 0 to 1, leader changed from <none> to c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.749030 11385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463a9c7a2ee8458ea7b9c2d6bcb0aeae" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f" is_pre_election: true
I20260709 13:02:45.749709 11385 raft_consensus.cc:2468] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 0.
I20260709 13:02:45.749840 11558 leader_election.cc:290] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.749188 11134 catalog_manager.cc:5697] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f44094f32c624cc28c94864650dcd0c3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f44094f32c624cc28c94864650dcd0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.750844 11202 leader_election.cc:304] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.753577 11558 raft_consensus.cc:2804] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.754042 11558 raft_consensus.cc:493] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.754460 11558 raft_consensus.cc:3060] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.762362 11558 raft_consensus.cc:515] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.764173 11558 leader_election.cc:290] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 election: Requested vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:45.765568 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463a9c7a2ee8458ea7b9c2d6bcb0aeae" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:45.765683 11385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463a9c7a2ee8458ea7b9c2d6bcb0aeae" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:45.766331 11312 raft_consensus.cc:3060] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.766404 11385 raft_consensus.cc:3060] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.771437 11312 raft_consensus.cc:2468] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 1.
I20260709 13:02:45.771440 11385 raft_consensus.cc:2468] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 1.
I20260709 13:02:45.772749 11202 leader_election.cc:304] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:45.773420 11558 raft_consensus.cc:2804] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.773912 11558 raft_consensus.cc:697] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Becoming Leader. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:45.774684 11558 consensus_queue.cc:237] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.782653 11132 catalog_manager.cc:5697] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f44094f32c624cc28c94864650dcd0c3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f44094f32c624cc28c94864650dcd0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.788818 11500 raft_consensus.cc:493] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.789431 11500 raft_consensus.cc:515] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:45.792061 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ef7b553a2416b8d92bc5e4f79261a" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:45.791473 11500 leader_election.cc:290] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:45.792500 11312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ef7b553a2416b8d92bc5e4f79261a" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:45.792969 11238 raft_consensus.cc:2393] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e04c761aac6144a5be44096d6127059f in current term 1: Already voted for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in this term.
I20260709 13:02:45.794186 11351 leader_election.cc:304] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e04c761aac6144a5be44096d6127059f; no voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3
I20260709 13:02:45.794859 11500 raft_consensus.cc:3060] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.797680 11550 consensus_queue.cc:1048] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.800769 11500 raft_consensus.cc:2749] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:45.808887 11550 consensus_queue.cc:1048] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.814580 11550 consensus_queue.cc:1048] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:45.831331 11455 consensus_queue.cc:1048] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.919219 11385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08eb6c4745f437998dbe1a1d680e03a"
dest_uuid: "e04c761aac6144a5be44096d6127059f"
mode: GRACEFUL
new_leader_uuid: "f44094f32c624cc28c94864650dcd0c3"
 from {username='slave'} at 127.0.0.1:60874
I20260709 13:02:45.919924 11385 raft_consensus.cc:606] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Received request to transfer leadership to TS f44094f32c624cc28c94864650dcd0c3
I20260709 13:02:45.925227 11312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70c77c7b8f05428aa726e76cc156efa1"
dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
mode: GRACEFUL
new_leader_uuid: "f44094f32c624cc28c94864650dcd0c3"
 from {username='slave'} at 127.0.0.1:44542
I20260709 13:02:45.925766 11312 raft_consensus.cc:606] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Received request to transfer leadership to TS f44094f32c624cc28c94864650dcd0c3
I20260709 13:02:45.931182 11313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "264ef7b553a2416b8d92bc5e4f79261a"
dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
mode: GRACEFUL
new_leader_uuid: "f44094f32c624cc28c94864650dcd0c3"
 from {username='slave'} at 127.0.0.1:44542
I20260709 13:02:45.931746 11313 raft_consensus.cc:606] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Received request to transfer leadership to TS f44094f32c624cc28c94864650dcd0c3
I20260709 13:02:45.945276 11238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0affa1984c924b508ba596a892e03296"
dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
mode: GRACEFUL
new_leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
 from {username='slave'} at 127.0.0.1:44228
I20260709 13:02:45.945813 11238 raft_consensus.cc:606] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Received request to transfer leadership to TS c990dfc7f02f4e4eb447f9b18d1e7263
I20260709 13:02:45.950924 11238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98ec28be99294210a14badc0101a5ab4"
dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
mode: GRACEFUL
new_leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
 from {username='slave'} at 127.0.0.1:44228
I20260709 13:02:45.951464 11238 raft_consensus.cc:606] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Received request to transfer leadership to TS c990dfc7f02f4e4eb447f9b18d1e7263
I20260709 13:02:45.956792 11238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "463a9c7a2ee8458ea7b9c2d6bcb0aeae"
dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
mode: GRACEFUL
new_leader_uuid: "e04c761aac6144a5be44096d6127059f"
 from {username='slave'} at 127.0.0.1:44228
I20260709 13:02:45.957311 11238 raft_consensus.cc:606] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Received request to transfer leadership to TS e04c761aac6144a5be44096d6127059f
I20260709 13:02:46.041931 11500 raft_consensus.cc:493] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.042560 11500 raft_consensus.cc:515] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.044287 11500 leader_election.cc:290] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:46.045226 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ec933e81248b0b098d5c3c6ec3537" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f44094f32c624cc28c94864650dcd0c3" is_pre_election: true
I20260709 13:02:46.045430 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325ec933e81248b0b098d5c3c6ec3537" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" is_pre_election: true
I20260709 13:02:46.046027 11238 raft_consensus.cc:2393] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e04c761aac6144a5be44096d6127059f in current term 1: Already voted for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in this term.
I20260709 13:02:46.047163 11351 leader_election.cc:304] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e04c761aac6144a5be44096d6127059f; no voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3
I20260709 13:02:46.047812 11500 raft_consensus.cc:3060] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.054229 11500 raft_consensus.cc:2749] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.092159 11558 consensus_queue.cc:1048] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.102731 11514 consensus_queue.cc:1048] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.113487 11559 raft_consensus.cc:993] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3: : Instructing follower c990dfc7f02f4e4eb447f9b18d1e7263 to start an election
I20260709 13:02:46.113951 11514 raft_consensus.cc:1081] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Signalling peer c990dfc7f02f4e4eb447f9b18d1e7263 to start an election
I20260709 13:02:46.115474 11313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0affa1984c924b508ba596a892e03296"
dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
 from {username='slave'} at 127.0.0.1:44526
I20260709 13:02:46.117048 11313 raft_consensus.cc:493] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:46.117766 11313 raft_consensus.cc:3060] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.122932 11313 raft_consensus.cc:515] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.124428 11313 leader_election.cc:290] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 2 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:46.125358 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0affa1984c924b508ba596a892e03296" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:46.125617 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0affa1984c924b508ba596a892e03296" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:46.126082 11238 raft_consensus.cc:3055] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:46.126195 11387 raft_consensus.cc:3060] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.126452 11238 raft_consensus.cc:740] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:46.127285 11238 consensus_queue.cc:260] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.128473 11238 raft_consensus.cc:3060] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.133255 11387 raft_consensus.cc:2468] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 2.
I20260709 13:02:46.134385 11277 leader_election.cc:304] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, e04c761aac6144a5be44096d6127059f; no voters: 
I20260709 13:02:46.134884 11238 raft_consensus.cc:2468] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 2.
I20260709 13:02:46.135200 11455 raft_consensus.cc:2804] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:46.135751 11455 raft_consensus.cc:697] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Becoming Leader. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:46.136482 11455 consensus_queue.cc:237] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.142941 11132 catalog_manager.cc:5697] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 reported cstate change: term changed from 1 to 2, leader changed from f44094f32c624cc28c94864650dcd0c3 (127.0.107.193) to c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.153198 11455 consensus_queue.cc:1048] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.155691 11514 consensus_queue.cc:1048] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.163971 11514 consensus_queue.cc:1048] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.169281 11550 consensus_queue.cc:1048] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.173450 11514 raft_consensus.cc:993] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3: : Instructing follower c990dfc7f02f4e4eb447f9b18d1e7263 to start an election
I20260709 13:02:46.174638 11588 raft_consensus.cc:1081] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Signalling peer c990dfc7f02f4e4eb447f9b18d1e7263 to start an election
I20260709 13:02:46.184991 11559 consensus_queue.cc:1048] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.193542 11311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98ec28be99294210a14badc0101a5ab4"
dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
 from {username='slave'} at 127.0.0.1:44526
I20260709 13:02:46.194615 11311 raft_consensus.cc:493] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:46.195155 11311 raft_consensus.cc:3060] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.197983 11531 consensus_queue.cc:1048] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:46.199066 11559 consensus_queue.cc:1048] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.209131 11311 raft_consensus.cc:515] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.210328 11589 consensus_queue.cc:1048] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.211416 11311 leader_election.cc:290] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 2 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:46.217562 11550 consensus_queue.cc:1048] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.217973 11531 raft_consensus.cc:993] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263: : Instructing follower f44094f32c624cc28c94864650dcd0c3 to start an election
I20260709 13:02:46.218866 11531 raft_consensus.cc:1081] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Signalling peer f44094f32c624cc28c94864650dcd0c3 to start an election
I20260709 13:02:46.219110 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ec28be99294210a14badc0101a5ab4" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:46.219707 11236 raft_consensus.cc:3055] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:46.219987 11236 raft_consensus.cc:740] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:46.220762 11236 consensus_queue.cc:260] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.221912 11236 raft_consensus.cc:3060] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.226356 11386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ec28be99294210a14badc0101a5ab4" candidate_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:46.227507 11588 consensus_queue.cc:1048] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.244837 11235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "264ef7b553a2416b8d92bc5e4f79261a"
dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
 from {username='slave'} at 127.0.0.1:44226
I20260709 13:02:46.245507 11235 raft_consensus.cc:493] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:46.245924 11235 raft_consensus.cc:3060] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.260421 11235 raft_consensus.cc:515] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.263162 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ef7b553a2416b8d92bc5e4f79261a" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:46.263686 11313 raft_consensus.cc:3055] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:46.264011 11313 raft_consensus.cc:740] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:46.264773 11313 consensus_queue.cc:260] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.266353 11387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ef7b553a2416b8d92bc5e4f79261a" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:46.266993 11387 raft_consensus.cc:3060] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.267045 11236 raft_consensus.cc:2468] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c990dfc7f02f4e4eb447f9b18d1e7263 in term 2.
I20260709 13:02:46.265853 11313 raft_consensus.cc:3060] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.271663 11589 raft_consensus.cc:993] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3: : Instructing follower e04c761aac6144a5be44096d6127059f to start an election
I20260709 13:02:46.271859 11277 leader_election.cc:304] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, f44094f32c624cc28c94864650dcd0c3; no voters: e04c761aac6144a5be44096d6127059f
I20260709 13:02:46.272246 11589 raft_consensus.cc:1081] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Signalling peer e04c761aac6144a5be44096d6127059f to start an election
I20260709 13:02:46.272743 11564 raft_consensus.cc:2804] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:46.272775 11235 leader_election.cc:290] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 2 election: Requested vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:46.273362 11564 raft_consensus.cc:697] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Becoming Leader. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:46.274257 11564 consensus_queue.cc:237] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.276789 11386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "463a9c7a2ee8458ea7b9c2d6bcb0aeae"
dest_uuid: "e04c761aac6144a5be44096d6127059f"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:02:46.277415 11386 raft_consensus.cc:493] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:46.277791 11386 raft_consensus.cc:3060] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.279438 11387 raft_consensus.cc:2468] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 2.
I20260709 13:02:46.283612 11313 raft_consensus.cc:2468] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 2.
I20260709 13:02:46.287197 11202 leader_election.cc:304] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:46.287951 11500 consensus_queue.cc:1048] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.288107 11589 raft_consensus.cc:2804] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:46.288177 11386 raft_consensus.cc:515] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.289024 11589 raft_consensus.cc:697] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Becoming Leader. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:46.290009 11589 consensus_queue.cc:237] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.290587 11386 leader_election.cc:290] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 2 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:46.291725 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463a9c7a2ee8458ea7b9c2d6bcb0aeae" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:46.292505 11236 raft_consensus.cc:3055] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:46.297259 11134 catalog_manager.cc:5697] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 reported cstate change: term changed from 1 to 2, leader changed from f44094f32c624cc28c94864650dcd0c3 (127.0.107.193) to c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.305835 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463a9c7a2ee8458ea7b9c2d6bcb0aeae" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:46.306470 11313 raft_consensus.cc:3060] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.308943 11500 consensus_queue.cc:1048] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.292884 11236 raft_consensus.cc:740] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:46.311722 11236 consensus_queue.cc:260] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.312958 11236 raft_consensus.cc:3060] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.313172 11313 raft_consensus.cc:2468] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 2.
I20260709 13:02:46.313916 11312 raft_consensus.cc:1240] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Rejecting Update request from peer f44094f32c624cc28c94864650dcd0c3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:46.315166 11351 leader_election.cc:304] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, e04c761aac6144a5be44096d6127059f; no voters: 
I20260709 13:02:46.315979 11500 raft_consensus.cc:2804] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:46.328796 11500 raft_consensus.cc:697] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [term 2 LEADER]: Becoming Leader. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:46.332216 11236 raft_consensus.cc:2468] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 2.
I20260709 13:02:46.333814 11600 raft_consensus.cc:993] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f: : Instructing follower f44094f32c624cc28c94864650dcd0c3 to start an election
I20260709 13:02:46.334347 11600 raft_consensus.cc:1081] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Signalling peer f44094f32c624cc28c94864650dcd0c3 to start an election
I20260709 13:02:46.338020 11235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a08eb6c4745f437998dbe1a1d680e03a"
dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
 from {username='slave'} at 127.0.0.1:44220
I20260709 13:02:46.338658 11235 raft_consensus.cc:493] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:46.339056 11235 raft_consensus.cc:3060] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.332398 11500 consensus_queue.cc:237] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.347334 11235 raft_consensus.cc:515] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.349368 11531 raft_consensus.cc:993] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263: : Instructing follower f44094f32c624cc28c94864650dcd0c3 to start an election
I20260709 13:02:46.348955 11132 catalog_manager.cc:5697] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 reported cstate change: term changed from 1 to 2, leader changed from c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194) to f44094f32c624cc28c94864650dcd0c3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f44094f32c624cc28c94864650dcd0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.349942 11564 raft_consensus.cc:1081] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Signalling peer f44094f32c624cc28c94864650dcd0c3 to start an election
I20260709 13:02:46.350747 11235 leader_election.cc:290] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 2 election: Requested vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:46.351002 11386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08eb6c4745f437998dbe1a1d680e03a" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:46.351678 11386 raft_consensus.cc:3055] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:46.352074 11386 raft_consensus.cc:740] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:46.352962 11386 consensus_queue.cc:260] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.354358 11386 raft_consensus.cc:3060] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.356699 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08eb6c4745f437998dbe1a1d680e03a" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:46.357388 11313 raft_consensus.cc:3060] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.358552 11235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70c77c7b8f05428aa726e76cc156efa1"
dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
 from {username='slave'} at 127.0.0.1:44226
I20260709 13:02:46.359349 11235 raft_consensus.cc:493] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:46.358546 11134 catalog_manager.cc:5697] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f reported cstate change: term changed from 1 to 2, leader changed from f44094f32c624cc28c94864650dcd0c3 (127.0.107.193) to e04c761aac6144a5be44096d6127059f (127.0.107.195). New cstate: current_term: 2 leader_uuid: "e04c761aac6144a5be44096d6127059f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.359723 11235 raft_consensus.cc:3060] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.364547 11313 raft_consensus.cc:2468] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 2.
I20260709 13:02:46.364547 11386 raft_consensus.cc:2468] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 2.
I20260709 13:02:46.368081 11202 leader_election.cc:304] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:46.368770 11589 raft_consensus.cc:2804] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:46.369194 11589 raft_consensus.cc:697] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Becoming Leader. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:46.369971 11589 consensus_queue.cc:237] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.375473 11235 raft_consensus.cc:515] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.377503 11235 leader_election.cc:290] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 2 election: Requested vote from peers c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537), e04c761aac6144a5be44096d6127059f (127.0.107.195:39309)
I20260709 13:02:46.378178 11313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70c77c7b8f05428aa726e76cc156efa1" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:46.377667 11134 catalog_manager.cc:5697] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 reported cstate change: term changed from 1 to 2, leader changed from e04c761aac6144a5be44096d6127059f (127.0.107.195) to f44094f32c624cc28c94864650dcd0c3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f44094f32c624cc28c94864650dcd0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.378756 11313 raft_consensus.cc:3055] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:46.378894 11386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70c77c7b8f05428aa726e76cc156efa1" candidate_uuid: "f44094f32c624cc28c94864650dcd0c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e04c761aac6144a5be44096d6127059f"
I20260709 13:02:46.379108 11313 raft_consensus.cc:740] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:46.379567 11386 raft_consensus.cc:3060] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.379968 11313 consensus_queue.cc:260] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.381050 11313 raft_consensus.cc:3060] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.385665 11386 raft_consensus.cc:2468] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 2.
I20260709 13:02:46.387274 11202 leader_election.cc:304] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:46.387980 11589 raft_consensus.cc:2804] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:46.388423 11589 raft_consensus.cc:697] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Becoming Leader. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:46.389219 11313 raft_consensus.cc:2468] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f44094f32c624cc28c94864650dcd0c3 in term 2.
I20260709 13:02:46.389128 11589 consensus_queue.cc:237] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:46.396060 11132 catalog_manager.cc:5697] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 reported cstate change: term changed from 1 to 2, leader changed from c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194) to f44094f32c624cc28c94864650dcd0c3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f44094f32c624cc28c94864650dcd0c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.564641 11386 raft_consensus.cc:1275] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Refusing update from remote peer c990dfc7f02f4e4eb447f9b18d1e7263: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:46.566277 11564 consensus_queue.cc:1048] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:46.574640 11235 raft_consensus.cc:1275] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Refusing update from remote peer c990dfc7f02f4e4eb447f9b18d1e7263: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:46.579047 11564 consensus_queue.cc:1048] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:46.692071 11313 raft_consensus.cc:1275] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Refusing update from remote peer f44094f32c624cc28c94864650dcd0c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:46.693470 11589 consensus_queue.cc:1048] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:46.701752 11386 raft_consensus.cc:1275] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Refusing update from remote peer f44094f32c624cc28c94864650dcd0c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:46.703210 11589 consensus_queue.cc:1048] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:46.771900 11386 raft_consensus.cc:1275] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Refusing update from remote peer f44094f32c624cc28c94864650dcd0c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:46.773356 11589 consensus_queue.cc:1048] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:46.781440 11387 raft_consensus.cc:3060] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.788894 11387 raft_consensus.cc:1275] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Refusing update from remote peer c990dfc7f02f4e4eb447f9b18d1e7263: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:46.789101 11312 raft_consensus.cc:1275] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Refusing update from remote peer f44094f32c624cc28c94864650dcd0c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:46.790176 11564 consensus_queue.cc:1048] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:46.791047 11589 consensus_queue.cc:1048] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:46.800627 11236 raft_consensus.cc:1275] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Refusing update from remote peer c990dfc7f02f4e4eb447f9b18d1e7263: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:46.802037 11550 consensus_queue.cc:1048] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:46.872216 11312 raft_consensus.cc:1275] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Refusing update from remote peer f44094f32c624cc28c94864650dcd0c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:46.872218 11236 raft_consensus.cc:1275] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Refusing update from remote peer e04c761aac6144a5be44096d6127059f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:46.873716 11589 consensus_queue.cc:1048] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:46.873776 11500 consensus_queue.cc:1048] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:46.881943 11387 raft_consensus.cc:1275] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Refusing update from remote peer f44094f32c624cc28c94864650dcd0c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:46.889591 11312 raft_consensus.cc:1275] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Refusing update from remote peer e04c761aac6144a5be44096d6127059f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:46.890584 11589 consensus_queue.cc:1048] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:46.892722 11602 consensus_queue.cc:1048] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.961002 11132 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39706:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:02:48.981508 11132 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39706:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:02:49.045735   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:02:49.128641 11312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0affa1984c924b508ba596a892e03296"
dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
mode: GRACEFUL
new_leader_uuid: "e04c761aac6144a5be44096d6127059f"
 from {username='slave'} at 127.0.0.1:35820
I20260709 13:02:49.182988 11645 tablet.cc:1724] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.177244 11648 tablet.cc:1724] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.236721 11652 tablet.cc:1724] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.175092 11643 tablet.cc:1724] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:49.275879 11277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:39309, user_credentials={real_user=slave}} blocked reactor thread for 79997.2us
I20260709 13:02:49.340685 11659 tablet.cc:1724] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.373488 11662 tablet.cc:1724] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:49.406539 11277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:39309, user_credentials={real_user=slave}} blocked reactor thread for 56721.4us
I20260709 13:02:49.439261 11675 tablet.cc:1724] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.467249 11662 tablet.cc:1724] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:49.499187 11657 log.cc:927] Time spent T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3: Append to log took a long time: real 0.137s	user 0.001s	sys 0.001s
I20260709 13:02:49.514859 11672 tablet.cc:1724] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.515606 11648 tablet.cc:1724] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:49.517510 11658 log.cc:927] Time spent T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f: Append to log took a long time: real 0.169s	user 0.003s	sys 0.000s
I20260709 13:02:49.520324 11652 tablet.cc:1724] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.526929 11312 raft_consensus.cc:606] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Received request to transfer leadership to TS e04c761aac6144a5be44096d6127059f
W20260709 13:02:49.527982 11277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:39309, user_credentials={real_user=slave}} blocked reactor thread for 56165.2us
W20260709 13:02:49.533913 11202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39537, user_credentials={real_user=slave}} blocked reactor thread for 87520.5us
I20260709 13:02:49.505645 11645 tablet.cc:1724] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.550316 11676 tablet.cc:1724] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.529449 11659 tablet.cc:1724] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.560041 11652 tablet.cc:1724] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.567153 11678 tablet.cc:1724] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.570971 11643 tablet.cc:1724] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.588915 11648 tablet.cc:1724] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.594718 11681 tablet.cc:1724] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.598649 11662 tablet.cc:1724] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.599598 11608 raft_consensus.cc:993] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263: : Instructing follower e04c761aac6144a5be44096d6127059f to start an election
I20260709 13:02:49.600165 11608 raft_consensus.cc:1081] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Signalling peer e04c761aac6144a5be44096d6127059f to start an election
I20260709 13:02:49.602068 11385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0affa1984c924b508ba596a892e03296"
dest_uuid: "e04c761aac6144a5be44096d6127059f"
 from {username='slave'} at 127.0.0.1:60856
I20260709 13:02:49.602850 11385 raft_consensus.cc:493] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:49.603221 11385 raft_consensus.cc:3060] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.605216 11676 tablet.cc:1724] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.614111 11652 tablet.cc:1724] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.623544 11645 tablet.cc:1724] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.637748 11678 tablet.cc:1724] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.643123 11385 raft_consensus.cc:515] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:49.656433 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0affa1984c924b508ba596a892e03296" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:49.636255 11675 tablet.cc:1724] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.657015 11237 raft_consensus.cc:3060] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.640259 11659 tablet.cc:1724] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.664354 11385 leader_election.cc:290] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 3 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:49.665519 11645 tablet.cc:1724] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:49.666795 11311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0affa1984c924b508ba596a892e03296" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:49.667423 11311 raft_consensus.cc:3055] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:49.667721 11311 raft_consensus.cc:740] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:49.668502 11311 consensus_queue.cc:260] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:49.669736 11311 raft_consensus.cc:3060] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.664395 11237 raft_consensus.cc:2468] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 3.
I20260709 13:02:49.674297 11351 leader_election.cc:304] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:49.675271 11605 raft_consensus.cc:2804] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:49.675915 11605 raft_consensus.cc:697] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 3 LEADER]: Becoming Leader. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:49.676991 11605 consensus_queue.cc:237] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:49.687690 11311 raft_consensus.cc:2468] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 3.
I20260709 13:02:49.697023 11237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a08eb6c4745f437998dbe1a1d680e03a"
dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
mode: GRACEFUL
new_leader_uuid: "e04c761aac6144a5be44096d6127059f"
 from {username='slave'} at 127.0.0.1:57400
I20260709 13:02:49.697539 11237 raft_consensus.cc:606] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Received request to transfer leadership to TS e04c761aac6144a5be44096d6127059f
I20260709 13:02:49.698979   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:02:49.699512   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:49.702741 11134 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c: soft_deleted_table [id=749de49105794e61a447d569a272a628] alter complete (version 1)
I20260709 13:02:49.709946 11311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57da9b05fc45441b8f48e9cd60c46c45"
dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
mode: GRACEFUL
new_leader_uuid: "e04c761aac6144a5be44096d6127059f"
 from {username='slave'} at 127.0.0.1:35820
I20260709 13:02:49.710568 11311 raft_consensus.cc:606] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Received request to transfer leadership to TS e04c761aac6144a5be44096d6127059f
I20260709 13:02:49.714358 11237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5acf4412cd9743299ac27a0ca1af0b0f"
dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
mode: GRACEFUL
new_leader_uuid: "e04c761aac6144a5be44096d6127059f"
 from {username='slave'} at 127.0.0.1:57400
I20260709 13:02:49.714900 11237 raft_consensus.cc:606] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Received request to transfer leadership to TS e04c761aac6144a5be44096d6127059f
I20260709 13:02:49.716221   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:49.717027   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:49.720144 11134 catalog_manager.cc:5697] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f reported cstate change: term changed from 2 to 3, leader changed from c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194) to e04c761aac6144a5be44096d6127059f (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e04c761aac6144a5be44096d6127059f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.744596 11660 raft_consensus.cc:993] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263: : Instructing follower e04c761aac6144a5be44096d6127059f to start an election
I20260709 13:02:49.745180 11641 raft_consensus.cc:1081] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Signalling peer e04c761aac6144a5be44096d6127059f to start an election
I20260709 13:02:49.746528 11385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57da9b05fc45441b8f48e9cd60c46c45"
dest_uuid: "e04c761aac6144a5be44096d6127059f"
 from {username='slave'} at 127.0.0.1:60856
I20260709 13:02:49.747008 11385 raft_consensus.cc:493] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:49.747323 11385 raft_consensus.cc:3060] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.752719 11385 raft_consensus.cc:515] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:49.754540 11385 leader_election.cc:290] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 3 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:49.755316 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da9b05fc45441b8f48e9cd60c46c45" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:49.755683 11311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57da9b05fc45441b8f48e9cd60c46c45" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:49.755889 11237 raft_consensus.cc:3060] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.756307 11311 raft_consensus.cc:3055] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:49.756596 11311 raft_consensus.cc:740] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c990dfc7f02f4e4eb447f9b18d1e7263, State: Running, Role: LEADER
I20260709 13:02:49.757302 11311 consensus_queue.cc:260] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:49.758459 11311 raft_consensus.cc:3060] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.761240 11237 raft_consensus.cc:2468] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 3.
I20260709 13:02:49.762476 11351 leader_election.cc:304] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e04c761aac6144a5be44096d6127059f, f44094f32c624cc28c94864650dcd0c3; no voters: 
I20260709 13:02:49.763126 11605 raft_consensus.cc:2804] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:49.763643 11605 raft_consensus.cc:697] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 3 LEADER]: Becoming Leader. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:49.763525 11311 raft_consensus.cc:2468] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 3.
I20260709 13:02:49.764623 11605 consensus_queue.cc:237] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:49.771790 11134 catalog_manager.cc:5697] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f reported cstate change: term changed from 2 to 3, leader changed from c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194) to e04c761aac6144a5be44096d6127059f (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e04c761aac6144a5be44096d6127059f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.948566 11651 raft_consensus.cc:993] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3: : Instructing follower e04c761aac6144a5be44096d6127059f to start an election
I20260709 13:02:49.949174 11664 raft_consensus.cc:1081] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Signalling peer e04c761aac6144a5be44096d6127059f to start an election
I20260709 13:02:49.950536 11385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5acf4412cd9743299ac27a0ca1af0b0f"
dest_uuid: "e04c761aac6144a5be44096d6127059f"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:02:49.951088 11385 raft_consensus.cc:493] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:49.951391 11385 raft_consensus.cc:3060] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.956691 11385 raft_consensus.cc:515] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:49.958384 11385 leader_election.cc:290] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 3 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:49.959224 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acf4412cd9743299ac27a0ca1af0b0f" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:49.959529 11311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acf4412cd9743299ac27a0ca1af0b0f" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:49.959892 11237 raft_consensus.cc:3055] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:49.960199 11311 raft_consensus.cc:3060] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.960223 11237 raft_consensus.cc:740] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:49.960986 11237 consensus_queue.cc:260] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:49.961875 11237 raft_consensus.cc:3060] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.965538 11311 raft_consensus.cc:2468] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 3.
I20260709 13:02:49.966661 11351 leader_election.cc:304] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, e04c761aac6144a5be44096d6127059f; no voters: 
I20260709 13:02:49.966717 11237 raft_consensus.cc:2468] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 3.
I20260709 13:02:49.967497 11605 raft_consensus.cc:2804] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:49.968281 11605 raft_consensus.cc:697] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 3 LEADER]: Becoming Leader. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:49.969008 11605 consensus_queue.cc:237] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:49.975939 11134 catalog_manager.cc:5697] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f reported cstate change: term changed from 2 to 3, leader changed from f44094f32c624cc28c94864650dcd0c3 (127.0.107.193) to e04c761aac6144a5be44096d6127059f (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e04c761aac6144a5be44096d6127059f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.120577 11651 raft_consensus.cc:993] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3: : Instructing follower e04c761aac6144a5be44096d6127059f to start an election
I20260709 13:02:50.121040 11664 raft_consensus.cc:1081] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Signalling peer e04c761aac6144a5be44096d6127059f to start an election
I20260709 13:02:50.122432 11385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a08eb6c4745f437998dbe1a1d680e03a"
dest_uuid: "e04c761aac6144a5be44096d6127059f"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:02:50.122885 11385 raft_consensus.cc:493] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:50.123121 11385 raft_consensus.cc:3060] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.125567 11310 raft_consensus.cc:1275] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Refusing update from remote peer e04c761aac6144a5be44096d6127059f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:50.127151 11605 consensus_queue.cc:1048] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:50.128803 11385 raft_consensus.cc:515] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:50.130685 11385 leader_election.cc:290] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 3 election: Requested vote from peers f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751), c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537)
I20260709 13:02:50.132340 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08eb6c4745f437998dbe1a1d680e03a" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f44094f32c624cc28c94864650dcd0c3"
I20260709 13:02:50.132896 11237 raft_consensus.cc:3055] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:50.132754 11310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08eb6c4745f437998dbe1a1d680e03a" candidate_uuid: "e04c761aac6144a5be44096d6127059f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263"
I20260709 13:02:50.133235 11237 raft_consensus.cc:740] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f44094f32c624cc28c94864650dcd0c3, State: Running, Role: LEADER
I20260709 13:02:50.133490 11310 raft_consensus.cc:3060] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.134043 11237 consensus_queue.cc:260] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:50.135265 11237 raft_consensus.cc:3060] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.141750 11310 raft_consensus.cc:2468] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 3.
I20260709 13:02:50.143097 11351 leader_election.cc:304] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c990dfc7f02f4e4eb447f9b18d1e7263, e04c761aac6144a5be44096d6127059f; no voters: 
I20260709 13:02:50.143906 11665 raft_consensus.cc:2804] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:50.144837 11237 raft_consensus.cc:2468] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04c761aac6144a5be44096d6127059f in term 3.
I20260709 13:02:50.148301 11665 raft_consensus.cc:697] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 3 LEADER]: Becoming Leader. State: Replica: e04c761aac6144a5be44096d6127059f, State: Running, Role: LEADER
I20260709 13:02:50.149420 11665 consensus_queue.cc:237] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } }
I20260709 13:02:50.165175 11237 raft_consensus.cc:1275] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Refusing update from remote peer e04c761aac6144a5be44096d6127059f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:50.166626 11692 consensus_queue.cc:1048] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:50.167238 11134 catalog_manager.cc:5697] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f reported cstate change: term changed from 2 to 3, leader changed from f44094f32c624cc28c94864650dcd0c3 (127.0.107.193) to e04c761aac6144a5be44096d6127059f (127.0.107.195). New cstate: current_term: 3 leader_uuid: "e04c761aac6144a5be44096d6127059f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04c761aac6144a5be44096d6127059f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39309 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.176860 11311 raft_consensus.cc:1275] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Refusing update from remote peer e04c761aac6144a5be44096d6127059f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:50.179314 11693 consensus_queue.cc:1048] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.197775 11237 raft_consensus.cc:1275] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Refusing update from remote peer e04c761aac6144a5be44096d6127059f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:50.199297 11605 consensus_queue.cc:1048] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.350930 11237 raft_consensus.cc:1275] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Refusing update from remote peer e04c761aac6144a5be44096d6127059f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:50.352175 11605 consensus_queue.cc:1048] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.360651 11310 raft_consensus.cc:1275] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Refusing update from remote peer e04c761aac6144a5be44096d6127059f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:50.362123 11605 consensus_queue.cc:1048] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.749493 11310 raft_consensus.cc:1275] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Refusing update from remote peer e04c761aac6144a5be44096d6127059f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:50.750696 11605 consensus_queue.cc:1048] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c990dfc7f02f4e4eb447f9b18d1e7263" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:50.759532 11237 raft_consensus.cc:1275] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Refusing update from remote peer e04c761aac6144a5be44096d6127059f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:50.761094 11693 consensus_queue.cc:1048] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f44094f32c624cc28c94864650dcd0c3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:50.788071   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:02:50.792912   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:02:50.793337   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:50.797868   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:02:50.798251   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:51.829885   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:02:51.858042   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:51.859022   431 tablet_replica.cc:333] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.860421   431 raft_consensus.cc:2243] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.861166   431 raft_consensus.cc:2272] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.863970   431 tablet_replica.cc:333] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.864589   431 raft_consensus.cc:2243] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.865315   431 raft_consensus.cc:2272] T 98ec28be99294210a14badc0101a5ab4 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.867964   431 tablet_replica.cc:333] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.868582   431 raft_consensus.cc:2243] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.869138   431 raft_consensus.cc:2272] T 23f1c74ef96f449db89325ff25b0a15e P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.871790   431 tablet_replica.cc:333] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.872396   431 raft_consensus.cc:2243] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.873262   431 raft_consensus.cc:2272] T a08eb6c4745f437998dbe1a1d680e03a P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:51.875361 11277 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
I20260709 13:02:51.876754   431 tablet_replica.cc:333] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.877578   431 raft_consensus.cc:2243] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.878422   431 raft_consensus.cc:2272] T 325ec933e81248b0b098d5c3c6ec3537 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:51.879011 11277 consensus_peers.cc:597] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 -> Peer f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751): Couldn't send request to peer f44094f32c624cc28c94864650dcd0c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:51.881271   431 tablet_replica.cc:333] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.881894   431 raft_consensus.cc:2243] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:51.882858   431 raft_consensus.cc:2272] T 70c77c7b8f05428aa726e76cc156efa1 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.885380   431 tablet_replica.cc:333] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.885984   431 raft_consensus.cc:2243] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:51.886981   431 raft_consensus.cc:2272] T 55e58214248e4dbbb409d91296dfcc34 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.889364   431 tablet_replica.cc:333] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.889953   431 raft_consensus.cc:2243] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.890475   431 raft_consensus.cc:2272] T 6787048e662f4d2295ce5f8d30d58be5 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.892952   431 tablet_replica.cc:333] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.893436   431 raft_consensus.cc:2243] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.893914   431 raft_consensus.cc:2272] T 7b4b19c988b349f8b40bd3a43d02e0ff P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.896446   431 tablet_replica.cc:333] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.897125   431 raft_consensus.cc:2243] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:51.898602   431 raft_consensus.cc:2272] T 264ef7b553a2416b8d92bc5e4f79261a P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:51.902010 11351 consensus_peers.cc:597] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f -> Peer f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751): Couldn't send request to peer f44094f32c624cc28c94864650dcd0c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:51.902127   431 tablet_replica.cc:333] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.902915   431 raft_consensus.cc:2243] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.903576   431 raft_consensus.cc:2272] T 57da9b05fc45441b8f48e9cd60c46c45 P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.906361   431 tablet_replica.cc:333] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.906929   431 raft_consensus.cc:2243] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:51.907881   431 raft_consensus.cc:2272] T 0ec600eee44f4439961ad3cc16760d82 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.910326   431 tablet_replica.cc:333] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.910885   431 raft_consensus.cc:2243] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:51.911789   431 raft_consensus.cc:2272] T 9b0a09e630c4464d90703b14b4b1412f P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.914355   431 tablet_replica.cc:333] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.914937   431 raft_consensus.cc:2243] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.915410   431 raft_consensus.cc:2272] T 69c5c8c093714a7c964077488e492de7 P f44094f32c624cc28c94864650dcd0c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.918202   431 tablet_replica.cc:333] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.919152   431 raft_consensus.cc:2243] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.920123   431 raft_consensus.cc:2272] T 0affa1984c924b508ba596a892e03296 P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.922509   431 tablet_replica.cc:333] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.923025   431 raft_consensus.cc:2243] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.923473   431 raft_consensus.cc:2272] T 50075fe54a5d4d4c8feb65f777349817 P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.925864   431 tablet_replica.cc:333] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.926357   431 raft_consensus.cc:2243] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.926901   431 raft_consensus.cc:2272] T 5acf4412cd9743299ac27a0ca1af0b0f P f44094f32c624cc28c94864650dcd0c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.929173   431 tablet_replica.cc:333] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3: stopping tablet replica
I20260709 13:02:51.929641   431 raft_consensus.cc:2243] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:51.930670   431 raft_consensus.cc:2272] T cd4a5da51934492babb41ee2504362bd P f44094f32c624cc28c94864650dcd0c3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:51.937278 11277 consensus_peers.cc:597] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 -> Peer f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751): Couldn't send request to peer f44094f32c624cc28c94864650dcd0c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:51.948844 11351 consensus_peers.cc:597] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f -> Peer f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751): Couldn't send request to peer f44094f32c624cc28c94864650dcd0c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:51.987042   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:02:52.033190   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:02:52.041210 11351 consensus_peers.cc:597] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f -> Peer c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537): Couldn't send request to peer c990dfc7f02f4e4eb447f9b18d1e7263. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:52.063024 11277 consensus_peers.cc:597] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 -> Peer f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751): Couldn't send request to peer f44094f32c624cc28c94864650dcd0c3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:52.063467 11277 consensus_peers.cc:597] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 -> Peer f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751): Couldn't send request to peer f44094f32c624cc28c94864650dcd0c3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.079051   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:52.080140   431 tablet_replica.cc:333] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.081377   431 raft_consensus.cc:2243] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.081964   431 raft_consensus.cc:2272] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.084506   431 tablet_replica.cc:333] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.085175   431 raft_consensus.cc:2243] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:52.086323   431 raft_consensus.cc:2272] T 98ec28be99294210a14badc0101a5ab4 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.089231   431 tablet_replica.cc:333] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.090086   431 raft_consensus.cc:2243] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:52.091220   431 raft_consensus.cc:2272] T 325ec933e81248b0b098d5c3c6ec3537 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:52.091740 11351 consensus_peers.cc:597] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f -> Peer f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751): Couldn't send request to peer f44094f32c624cc28c94864650dcd0c3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.093751   431 tablet_replica.cc:333] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.094548   431 raft_consensus.cc:2243] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.095098   431 raft_consensus.cc:2272] T cd4a5da51934492babb41ee2504362bd P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.097316   431 tablet_replica.cc:333] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.097904   431 raft_consensus.cc:2243] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.098426   431 raft_consensus.cc:2272] T 70c77c7b8f05428aa726e76cc156efa1 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.100561   431 tablet_replica.cc:333] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.101094   431 raft_consensus.cc:2243] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:52.102257   431 raft_consensus.cc:2272] T 7b4b19c988b349f8b40bd3a43d02e0ff P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.105020   431 tablet_replica.cc:333] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.105612   431 raft_consensus.cc:2243] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.106310   431 raft_consensus.cc:2272] T 5acf4412cd9743299ac27a0ca1af0b0f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:52.106817 11351 consensus_peers.cc:597] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f -> Peer f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751): Couldn't send request to peer f44094f32c624cc28c94864650dcd0c3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.108670   431 tablet_replica.cc:333] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.109397   431 raft_consensus.cc:2243] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.109897   431 raft_consensus.cc:2272] T 55e58214248e4dbbb409d91296dfcc34 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.111986   431 tablet_replica.cc:333] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.112509   431 raft_consensus.cc:2243] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.112989   431 raft_consensus.cc:2272] T 6787048e662f4d2295ce5f8d30d58be5 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.115120   431 tablet_replica.cc:333] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.115687   431 raft_consensus.cc:2243] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:52.116520   431 raft_consensus.cc:2272] T 23f1c74ef96f449db89325ff25b0a15e P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.118803   431 tablet_replica.cc:333] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.119433   431 raft_consensus.cc:2243] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.119997   431 raft_consensus.cc:2272] T a08eb6c4745f437998dbe1a1d680e03a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.122202   431 tablet_replica.cc:333] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.122776   431 raft_consensus.cc:2243] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:52.123587   431 raft_consensus.cc:2272] T 69c5c8c093714a7c964077488e492de7 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.126698   431 tablet_replica.cc:333] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.127447   431 raft_consensus.cc:2243] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.128033   431 raft_consensus.cc:2272] T 9b0a09e630c4464d90703b14b4b1412f P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:52.128465 11351 consensus_peers.cc:597] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f -> Peer c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537): Couldn't send request to peer c990dfc7f02f4e4eb447f9b18d1e7263. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.130354   431 tablet_replica.cc:333] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.130975   431 raft_consensus.cc:2243] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.131593   431 raft_consensus.cc:2272] T 0affa1984c924b508ba596a892e03296 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.133853   431 tablet_replica.cc:333] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.134380   431 raft_consensus.cc:2243] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:52.135216   431 raft_consensus.cc:2272] T 50075fe54a5d4d4c8feb65f777349817 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.137271   431 tablet_replica.cc:333] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.137781   431 raft_consensus.cc:2243] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.138339   431 raft_consensus.cc:2272] T 264ef7b553a2416b8d92bc5e4f79261a P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.140391   431 tablet_replica.cc:333] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.140897   431 raft_consensus.cc:2243] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.141367   431 raft_consensus.cc:2272] T 0ec600eee44f4439961ad3cc16760d82 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.143790   431 tablet_replica.cc:333] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263: stopping tablet replica
I20260709 13:02:52.144279   431 raft_consensus.cc:2243] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.144801   431 raft_consensus.cc:2272] T 57da9b05fc45441b8f48e9cd60c46c45 P c990dfc7f02f4e4eb447f9b18d1e7263 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:52.158124 11351 consensus_peers.cc:597] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f -> Peer f44094f32c624cc28c94864650dcd0c3 (127.0.107.193:39751): Couldn't send request to peer f44094f32c624cc28c94864650dcd0c3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.190321   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:02:52.234349   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:02:52.253539 11351 consensus_peers.cc:597] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f -> Peer c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537): Couldn't send request to peer c990dfc7f02f4e4eb447f9b18d1e7263. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.261933   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:52.262717   431 tablet_replica.cc:333] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.263576   431 raft_consensus.cc:2243] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.264209   431 raft_consensus.cc:2272] T 325ec933e81248b0b098d5c3c6ec3537 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.267549   431 tablet_replica.cc:333] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.268487   431 raft_consensus.cc:2243] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:52.269130 11351 consensus_peers.cc:597] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f -> Peer c990dfc7f02f4e4eb447f9b18d1e7263 (127.0.107.194:39537): Couldn't send request to peer c990dfc7f02f4e4eb447f9b18d1e7263. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.269141   431 raft_consensus.cc:2272] T 98ec28be99294210a14badc0101a5ab4 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.271819   431 tablet_replica.cc:333] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.272406   431 raft_consensus.cc:2243] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:52.273264   431 raft_consensus.cc:2272] T 463a9c7a2ee8458ea7b9c2d6bcb0aeae P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.275624   431 tablet_replica.cc:333] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.276198   431 raft_consensus.cc:2243] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:52.277056   431 raft_consensus.cc:2272] T a08eb6c4745f437998dbe1a1d680e03a P e04c761aac6144a5be44096d6127059f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.279130   431 tablet_replica.cc:333] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.279734   431 raft_consensus.cc:2243] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.280232   431 raft_consensus.cc:2272] T 23f1c74ef96f449db89325ff25b0a15e P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.282371   431 tablet_replica.cc:333] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.282914   431 raft_consensus.cc:2243] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.283401   431 raft_consensus.cc:2272] T 70c77c7b8f05428aa726e76cc156efa1 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.285429   431 tablet_replica.cc:333] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.285955   431 raft_consensus.cc:2243] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:52.286790   431 raft_consensus.cc:2272] T 6787048e662f4d2295ce5f8d30d58be5 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.288938   431 tablet_replica.cc:333] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.289471   431 raft_consensus.cc:2243] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.289913   431 raft_consensus.cc:2272] T 55e58214248e4dbbb409d91296dfcc34 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.291947   431 tablet_replica.cc:333] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.292479   431 raft_consensus.cc:2243] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:52.293330   431 raft_consensus.cc:2272] T 5acf4412cd9743299ac27a0ca1af0b0f P e04c761aac6144a5be44096d6127059f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.295360   431 tablet_replica.cc:333] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.295931   431 raft_consensus.cc:2243] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.296379   431 raft_consensus.cc:2272] T 264ef7b553a2416b8d92bc5e4f79261a P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.298278   431 tablet_replica.cc:333] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.298791   431 raft_consensus.cc:2243] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:52.299615   431 raft_consensus.cc:2272] T 57da9b05fc45441b8f48e9cd60c46c45 P e04c761aac6144a5be44096d6127059f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.301679   431 tablet_replica.cc:333] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.302186   431 raft_consensus.cc:2243] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.302637   431 raft_consensus.cc:2272] T 0ec600eee44f4439961ad3cc16760d82 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.304613   431 tablet_replica.cc:333] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.305086   431 raft_consensus.cc:2243] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.305670   431 raft_consensus.cc:2272] T 69c5c8c093714a7c964077488e492de7 P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.307767   431 tablet_replica.cc:333] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.308279   431 raft_consensus.cc:2243] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.308725   431 raft_consensus.cc:2272] T 9b0a09e630c4464d90703b14b4b1412f P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.310842   431 tablet_replica.cc:333] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.311321   431 raft_consensus.cc:2243] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:52.312110   431 raft_consensus.cc:2272] T 0affa1984c924b508ba596a892e03296 P e04c761aac6144a5be44096d6127059f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.314136   431 tablet_replica.cc:333] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.314581   431 raft_consensus.cc:2243] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.315008   431 raft_consensus.cc:2272] T 50075fe54a5d4d4c8feb65f777349817 P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.317010   431 tablet_replica.cc:333] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.317473   431 raft_consensus.cc:2243] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.317930   431 raft_consensus.cc:2272] T 7b4b19c988b349f8b40bd3a43d02e0ff P e04c761aac6144a5be44096d6127059f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.320060   431 tablet_replica.cc:333] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f: stopping tablet replica
I20260709 13:02:52.320498   431 raft_consensus.cc:2243] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.320979   431 raft_consensus.cc:2272] T cd4a5da51934492babb41ee2504362bd P e04c761aac6144a5be44096d6127059f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.362461   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:52.399943   431 master.cc:562] Master@127.0.107.254:39823 shutting down...
I20260709 13:02:52.430223   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:52.430843   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.431278   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 401249b23da446bb8af19e3ec53b264c: stopping tablet replica
I20260709 13:02:52.454433   431 master.cc:584] Master@127.0.107.254:39823 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12688 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:02:52.512149   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:43639
I20260709 13:02:52.513307   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:52.519110 11712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:52.519158 11713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:52.519984 11715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:52.520632   431 server_base.cc:1061] running on GCE node
I20260709 13:02:52.521607   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:52.521811   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:52.521962   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602172521945 us; error 0 us; skew 500 ppm
I20260709 13:02:52.522928   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:52.525318   431 webserver.cc:533] Webserver started at http://127.0.107.254:37735/ using document root <none> and password file <none>
I20260709 13:02:52.525817   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:52.526017   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:52.526350   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:52.527498   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/master-0-root/instance:
uuid: "c557991237484662821f3b1ad7bdb682"
format_stamp: "Formatted at 2026-07-09 13:02:52 on dist-test-slave-zhdc"
I20260709 13:02:52.531971   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:52.535297 11720 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:52.536058   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:52.536350   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/master-0-root
uuid: "c557991237484662821f3b1ad7bdb682"
format_stamp: "Formatted at 2026-07-09 13:02:52 on dist-test-slave-zhdc"
I20260709 13:02:52.536626   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:52.546348   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:52.547555   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:52.586020   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:43639
I20260709 13:02:52.586326 11771 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:43639 every 8 connection(s)
I20260709 13:02:52.589906 11772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:52.601449 11772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682: Bootstrap starting.
I20260709 13:02:52.606397 11772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.610906 11772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682: No bootstrap required, opened a new log
I20260709 13:02:52.613281 11772 raft_consensus.cc:359] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c557991237484662821f3b1ad7bdb682" member_type: VOTER }
I20260709 13:02:52.613709 11772 raft_consensus.cc:385] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.613983 11772 raft_consensus.cc:740] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c557991237484662821f3b1ad7bdb682, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.614660 11772 consensus_queue.cc:260] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c557991237484662821f3b1ad7bdb682" member_type: VOTER }
I20260709 13:02:52.615150 11772 raft_consensus.cc:399] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:52.615375 11772 raft_consensus.cc:493] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:52.615648 11772 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.620481 11772 raft_consensus.cc:515] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c557991237484662821f3b1ad7bdb682" member_type: VOTER }
I20260709 13:02:52.621021 11772 leader_election.cc:304] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c557991237484662821f3b1ad7bdb682; no voters: 
I20260709 13:02:52.622259 11772 leader_election.cc:290] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:52.622664 11775 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:52.624018 11775 raft_consensus.cc:697] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [term 1 LEADER]: Becoming Leader. State: Replica: c557991237484662821f3b1ad7bdb682, State: Running, Role: LEADER
I20260709 13:02:52.624747 11775 consensus_queue.cc:237] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c557991237484662821f3b1ad7bdb682" member_type: VOTER }
I20260709 13:02:52.625278 11772 sys_catalog.cc:565] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:52.631110 11777 sys_catalog.cc:455] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c557991237484662821f3b1ad7bdb682. Latest consensus state: current_term: 1 leader_uuid: "c557991237484662821f3b1ad7bdb682" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c557991237484662821f3b1ad7bdb682" member_type: VOTER } }
I20260709 13:02:52.631878 11777 sys_catalog.cc:458] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:52.631673 11776 sys_catalog.cc:455] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c557991237484662821f3b1ad7bdb682" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c557991237484662821f3b1ad7bdb682" member_type: VOTER } }
I20260709 13:02:52.632355 11776 sys_catalog.cc:458] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:52.633926 11783 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:52.639798 11783 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:52.641170   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:52.649092 11783 catalog_manager.cc:1383] Generated new cluster ID: 4ad41628e9694f849e16dacc98940948
I20260709 13:02:52.649406 11783 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:52.667181 11783 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:52.668596 11783 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:52.681106 11783 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682: Generated new TSK 0
I20260709 13:02:52.681753 11783 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:52.708039   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:52.714466 11793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:52.715353 11794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:52.716988 11796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:52.717219   431 server_base.cc:1061] running on GCE node
I20260709 13:02:52.718250   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:52.718461   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:52.718619   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602172718599 us; error 0 us; skew 500 ppm
I20260709 13:02:52.719095   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:52.721354   431 webserver.cc:533] Webserver started at http://127.0.107.193:41163/ using document root <none> and password file <none>
I20260709 13:02:52.721845   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:52.722092   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:52.722364   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:52.723466   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-0-root/instance:
uuid: "b71b457f537044f1b8d7755d14e40cf4"
format_stamp: "Formatted at 2026-07-09 13:02:52 on dist-test-slave-zhdc"
I20260709 13:02:52.728147   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:52.731945 11801 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:52.732757   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:02:52.733059   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-0-root
uuid: "b71b457f537044f1b8d7755d14e40cf4"
format_stamp: "Formatted at 2026-07-09 13:02:52 on dist-test-slave-zhdc"
I20260709 13:02:52.733355   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:52.743717   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:52.745085   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:52.746666   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:52.748896   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:52.749112   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:52.749346   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:52.749528   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:52.789113   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:44253
I20260709 13:02:52.789247 11863 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:44253 every 8 connection(s)
I20260709 13:02:52.794164   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:52.802243 11868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:52.803360 11869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:52.806483 11871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:52.807399   431 server_base.cc:1061] running on GCE node
I20260709 13:02:52.807590 11864 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43639
I20260709 13:02:52.808084 11864 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:52.808800 11864 heartbeater.cc:507] Master 127.0.107.254:43639 requested a full tablet report, sending...
I20260709 13:02:52.808840   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:52.809183   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:52.809363   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602172809346 us; error 0 us; skew 500 ppm
I20260709 13:02:52.809985   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:52.811077 11737 ts_manager.cc:194] Registered new tserver with Master: b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253)
I20260709 13:02:52.812638   431 webserver.cc:533] Webserver started at http://127.0.107.194:38937/ using document root <none> and password file <none>
I20260709 13:02:52.813104   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:52.813251   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:52.813215 11737 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41466
I20260709 13:02:52.813732   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:52.815163   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-1-root/instance:
uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
format_stamp: "Formatted at 2026-07-09 13:02:52 on dist-test-slave-zhdc"
I20260709 13:02:52.819561   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:02:52.822955 11876 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:52.823740   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:52.824054   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-1-root
uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
format_stamp: "Formatted at 2026-07-09 13:02:52 on dist-test-slave-zhdc"
I20260709 13:02:52.824353   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:52.842442   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:52.843712   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:52.845292   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:52.847553   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:52.847798   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:52.848058   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:52.848227   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:52.888322   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:46409
I20260709 13:02:52.888423 11938 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:46409 every 8 connection(s)
I20260709 13:02:52.893077   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:52.900213 11942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:52.900802 11943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:52.903910 11945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:52.904431   431 server_base.cc:1061] running on GCE node
I20260709 13:02:52.904752 11939 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43639
I20260709 13:02:52.905246 11939 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:52.905635   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:52.905946   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:52.906180 11939 heartbeater.cc:507] Master 127.0.107.254:43639 requested a full tablet report, sending...
I20260709 13:02:52.906181   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602172906159 us; error 0 us; skew 500 ppm
I20260709 13:02:52.907307   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:52.908783 11737 ts_manager.cc:194] Registered new tserver with Master: 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:52.909930   431 webserver.cc:533] Webserver started at http://127.0.107.195:42501/ using document root <none> and password file <none>
I20260709 13:02:52.910470 11737 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41476
I20260709 13:02:52.910514   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:52.911011   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:52.911288   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:52.912935   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-2-root/instance:
uuid: "a4da76bc1235497d8b166fba4921f9d5"
format_stamp: "Formatted at 2026-07-09 13:02:52 on dist-test-slave-zhdc"
I20260709 13:02:52.917263   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:52.920539 11950 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:52.921264   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:02:52.921566   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-2-root
uuid: "a4da76bc1235497d8b166fba4921f9d5"
format_stamp: "Formatted at 2026-07-09 13:02:52 on dist-test-slave-zhdc"
I20260709 13:02:52.921866   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbEfgOl/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601840662384-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:52.934362   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:52.935747   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:52.937140   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:52.939481   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:52.939704   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:52.939934   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:52.940101   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:52.980051   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:38599
I20260709 13:02:52.980154 12012 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:38599 every 8 connection(s)
I20260709 13:02:52.994226 12013 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43639
I20260709 13:02:52.994794 12013 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:52.995561 12013 heartbeater.cc:507] Master 127.0.107.254:43639 requested a full tablet report, sending...
I20260709 13:02:52.997462 11737 ts_manager.cc:194] Registered new tserver with Master: a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:52.998039   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01470106s
I20260709 13:02:52.999243 11737 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41478
I20260709 13:02:53.024253 11737 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41488:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:53.027283 11737 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:53.101632 11829 tablet_service.cc:1511] Processing CreateTablet for tablet 25da72756e014bc384b32dfedec94ed6 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:53.103259 11829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25da72756e014bc384b32dfedec94ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.105115 11827 tablet_service.cc:1511] Processing CreateTablet for tablet 7f53ee9d77184cd7955f4f505094c64b (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:53.105207 11828 tablet_service.cc:1511] Processing CreateTablet for tablet 395018dba6604c1d87b6758b93bd91a3 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:53.110426 11828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 395018dba6604c1d87b6758b93bd91a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.110885 11904 tablet_service.cc:1511] Processing CreateTablet for tablet 25da72756e014bc384b32dfedec94ed6 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:53.112192 11904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25da72756e014bc384b32dfedec94ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.112010 11901 tablet_service.cc:1511] Processing CreateTablet for tablet bf79fb9c3f364b20aab797239f80e750 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:53.113366 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf79fb9c3f364b20aab797239f80e750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.114391 11977 tablet_service.cc:1511] Processing CreateTablet for tablet 395018dba6604c1d87b6758b93bd91a3 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:53.115267 11902 tablet_service.cc:1511] Processing CreateTablet for tablet 7f53ee9d77184cd7955f4f505094c64b (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:53.115792 11977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 395018dba6604c1d87b6758b93bd91a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.116627 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f53ee9d77184cd7955f4f505094c64b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.119294 11826 tablet_service.cc:1511] Processing CreateTablet for tablet bf79fb9c3f364b20aab797239f80e750 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:53.120623 11826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf79fb9c3f364b20aab797239f80e750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.122948 11903 tablet_service.cc:1511] Processing CreateTablet for tablet 395018dba6604c1d87b6758b93bd91a3 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:53.123234 11976 tablet_service.cc:1511] Processing CreateTablet for tablet 7f53ee9d77184cd7955f4f505094c64b (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:53.124339 11903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 395018dba6604c1d87b6758b93bd91a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.124501 11976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f53ee9d77184cd7955f4f505094c64b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.127216 11978 tablet_service.cc:1511] Processing CreateTablet for tablet 25da72756e014bc384b32dfedec94ed6 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:53.128571 11978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25da72756e014bc384b32dfedec94ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.137537 11827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f53ee9d77184cd7955f4f505094c64b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.153601 11975 tablet_service.cc:1511] Processing CreateTablet for tablet bf79fb9c3f364b20aab797239f80e750 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:53.155112 11975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf79fb9c3f364b20aab797239f80e750. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.160248 12028 tablet_bootstrap.cc:492] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:53.159900 11828 tablet_service.cc:1511] Processing CreateTablet for tablet 13b2802e84d54d2ba1ee80bf74dbedf3 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:53.161489 11828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b2802e84d54d2ba1ee80bf74dbedf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.165264 11900 tablet_service.cc:1511] Processing CreateTablet for tablet 13b2802e84d54d2ba1ee80bf74dbedf3 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:53.166765 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b2802e84d54d2ba1ee80bf74dbedf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.166743 11974 tablet_service.cc:1511] Processing CreateTablet for tablet 13b2802e84d54d2ba1ee80bf74dbedf3 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:53.168217 11974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b2802e84d54d2ba1ee80bf74dbedf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.183107 11899 tablet_service.cc:1511] Processing CreateTablet for tablet 8476de5b26434850a52f60fbc9eda471 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:53.184592 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8476de5b26434850a52f60fbc9eda471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.194013 11973 tablet_service.cc:1511] Processing CreateTablet for tablet 8476de5b26434850a52f60fbc9eda471 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:53.195670 11973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8476de5b26434850a52f60fbc9eda471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.198591 12028 tablet_bootstrap.cc:654] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.210964 11829 tablet_service.cc:1511] Processing CreateTablet for tablet c682e96f583341febaf99286ebe5e471 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:53.212566 11829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c682e96f583341febaf99286ebe5e471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.214352 11827 tablet_service.cc:1511] Processing CreateTablet for tablet 8476de5b26434850a52f60fbc9eda471 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:53.215720 11827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8476de5b26434850a52f60fbc9eda471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.217970 11903 tablet_service.cc:1511] Processing CreateTablet for tablet c682e96f583341febaf99286ebe5e471 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:53.226677 11903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c682e96f583341febaf99286ebe5e471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.248119 12028 tablet_bootstrap.cc:492] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:53.248932 12028 ts_tablet_manager.cc:1403] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.089s	user 0.007s	sys 0.004s
I20260709 13:02:53.253224 12028 raft_consensus.cc:359] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.269443 11974 tablet_service.cc:1511] Processing CreateTablet for tablet c682e96f583341febaf99286ebe5e471 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:53.270969 11974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c682e96f583341febaf99286ebe5e471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.267037 12028 raft_consensus.cc:385] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.276803 12029 tablet_bootstrap.cc:492] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:53.291019 12028 raft_consensus.cc:740] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.278345 12030 tablet_bootstrap.cc:492] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:53.291042 11977 tablet_service.cc:1511] Processing CreateTablet for tablet 9381d49d1114401f9e36b4fc29312ec1 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:53.292474 11977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9381d49d1114401f9e36b4fc29312ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.292191 12028 consensus_queue.cc:260] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.294499 11864 heartbeater.cc:499] Master 127.0.107.254:43639 was elected leader, sending a full tablet report...
I20260709 13:02:53.297847 12030 tablet_bootstrap.cc:654] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.287182 11973 tablet_service.cc:1511] Processing CreateTablet for tablet 49c8ed1ce26d4ac790f7dce5d230c405 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:53.284919 11826 tablet_service.cc:1511] Processing CreateTablet for tablet 49c8ed1ce26d4ac790f7dce5d230c405 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:53.288365 11828 tablet_service.cc:1511] Processing CreateTablet for tablet 9381d49d1114401f9e36b4fc29312ec1 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:53.303961 11973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c8ed1ce26d4ac790f7dce5d230c405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.289851 11903 tablet_service.cc:1511] Processing CreateTablet for tablet 9381d49d1114401f9e36b4fc29312ec1 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:53.285784 11900 tablet_service.cc:1511] Processing CreateTablet for tablet 49c8ed1ce26d4ac790f7dce5d230c405 (DEFAULT_TABLE table=test-workload [id=d9e29b0aea584aca8d5d7f757a7c0cb1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:53.299752 12028 ts_tablet_manager.cc:1434] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.002s
I20260709 13:02:53.303961 11826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c8ed1ce26d4ac790f7dce5d230c405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.308763 11828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9381d49d1114401f9e36b4fc29312ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.314751 12028 tablet_bootstrap.cc:492] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:53.317613 12029 tablet_bootstrap.cc:654] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.307761 11903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9381d49d1114401f9e36b4fc29312ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.323407 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c8ed1ce26d4ac790f7dce5d230c405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.325822 12028 tablet_bootstrap.cc:654] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.335999 12030 tablet_bootstrap.cc:492] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:53.336607 12030 ts_tablet_manager.cc:1403] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 13:02:53.337815 12029 tablet_bootstrap.cc:492] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:53.338508 12029 ts_tablet_manager.cc:1403] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.004s
I20260709 13:02:53.340576 12030 raft_consensus.cc:359] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.341645 12029 raft_consensus.cc:359] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.342482 12029 raft_consensus.cc:385] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.342787 12029 raft_consensus.cc:740] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.341645 12030 raft_consensus.cc:385] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.343920 12030 raft_consensus.cc:740] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.345160 12030 consensus_queue.cc:260] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.345750 12029 consensus_queue.cc:260] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.357560 12028 tablet_bootstrap.cc:492] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:53.357640 11939 heartbeater.cc:499] Master 127.0.107.254:43639 was elected leader, sending a full tablet report...
I20260709 13:02:53.358220 12030 ts_tablet_manager.cc:1434] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.021s	user 0.016s	sys 0.005s
I20260709 13:02:53.359277 12013 heartbeater.cc:499] Master 127.0.107.254:43639 was elected leader, sending a full tablet report...
I20260709 13:02:53.359397 12030 tablet_bootstrap.cc:492] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:53.359405 12028 ts_tablet_manager.cc:1403] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.010s
I20260709 13:02:53.362880 12028 raft_consensus.cc:359] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.363710 12028 raft_consensus.cc:385] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.364059 12028 raft_consensus.cc:740] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.365000 12028 consensus_queue.cc:260] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.366158 12030 tablet_bootstrap.cc:654] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.367341 12028 ts_tablet_manager.cc:1434] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:53.368499 12028 tablet_bootstrap.cc:492] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:53.372061 12029 ts_tablet_manager.cc:1434] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:02:53.373592 12029 tablet_bootstrap.cc:492] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:53.375259 12028 tablet_bootstrap.cc:654] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.382594 12029 tablet_bootstrap.cc:654] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.439241 12030 tablet_bootstrap.cc:492] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:53.439795 12030 ts_tablet_manager.cc:1403] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.081s	user 0.024s	sys 0.054s
I20260709 13:02:53.439839 12028 tablet_bootstrap.cc:492] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:53.440366 12029 tablet_bootstrap.cc:492] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:53.440430 12028 ts_tablet_manager.cc:1403] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.072s	user 0.036s	sys 0.031s
I20260709 13:02:53.440943 12029 ts_tablet_manager.cc:1403] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.068s	user 0.036s	sys 0.025s
I20260709 13:02:53.442974 12030 raft_consensus.cc:359] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } }
I20260709 13:02:53.443204 12029 raft_consensus.cc:359] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.443787 12030 raft_consensus.cc:385] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.443931 12029 raft_consensus.cc:385] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.443768 12028 raft_consensus.cc:359] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } }
I20260709 13:02:53.444444 12030 raft_consensus.cc:740] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.444520 12029 raft_consensus.cc:740] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.444629 12028 raft_consensus.cc:385] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.445179 12028 raft_consensus.cc:740] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.445449 12029 consensus_queue.cc:260] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.445420 12030 consensus_queue.cc:260] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } }
I20260709 13:02:53.446175 12028 consensus_queue.cc:260] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } }
I20260709 13:02:53.448025 12029 ts_tablet_manager.cc:1434] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:53.448998 12029 tablet_bootstrap.cc:492] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:53.450335 12030 ts_tablet_manager.cc:1434] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:02:53.450361 12028 ts_tablet_manager.cc:1434] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:53.451471 12030 tablet_bootstrap.cc:492] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:53.451582 12028 tablet_bootstrap.cc:492] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:53.455472 12029 tablet_bootstrap.cc:654] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.458889 12030 tablet_bootstrap.cc:654] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.458907 12028 tablet_bootstrap.cc:654] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.460328 12037 raft_consensus.cc:493] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.460873 12037 raft_consensus.cc:515] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.472424 12030 tablet_bootstrap.cc:492] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:53.473321 12030 ts_tablet_manager.cc:1403] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.002s
I20260709 13:02:53.477365 12030 raft_consensus.cc:359] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.478415 12030 raft_consensus.cc:385] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.478794 12030 raft_consensus.cc:740] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.480014 12030 consensus_queue.cc:260] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.483422 12030 ts_tablet_manager.cc:1434] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.005s
I20260709 13:02:53.484786 12030 tablet_bootstrap.cc:492] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:53.492620 12032 raft_consensus.cc:493] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.493420 12032 raft_consensus.cc:515] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.501144 12037 leader_election.cc:290] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:53.507361 12032 leader_election.cc:290] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:53.520946 12030 tablet_bootstrap.cc:654] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.540704 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f53ee9d77184cd7955f4f505094c64b" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:53.541862 12030 tablet_bootstrap.cc:492] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:53.542702 12030 ts_tablet_manager.cc:1403] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.002s
I20260709 13:02:53.544238 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f53ee9d77184cd7955f4f505094c64b" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:53.545239 11839 raft_consensus.cc:2468] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 0.
W20260709 13:02:53.547538 11951 leader_election.cc:343] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:53.548570 11951 leader_election.cc:304] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4; no voters: 9e1c09bf1ea04fa9a443809e4980fdd3
I20260709 13:02:53.550348 12037 raft_consensus.cc:2804] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:53.550947 12037 raft_consensus.cc:493] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.551381 12037 raft_consensus.cc:3060] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.554546 12030 raft_consensus.cc:359] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.555711 12030 raft_consensus.cc:385] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.556100 12030 raft_consensus.cc:740] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.560694 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f53ee9d77184cd7955f4f505094c64b" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:53.562386 12030 consensus_queue.cc:260] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.563886 11914 raft_consensus.cc:2468] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 0.
I20260709 13:02:53.570011 11802 leader_election.cc:304] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:53.571249 12032 raft_consensus.cc:2804] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:53.571771 12032 raft_consensus.cc:493] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.572227 12032 raft_consensus.cc:3060] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.578379 12029 tablet_bootstrap.cc:492] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:53.578577 12028 tablet_bootstrap.cc:492] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:53.578969 12029 ts_tablet_manager.cc:1403] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.130s	user 0.055s	sys 0.067s
I20260709 13:02:53.579115 12028 ts_tablet_manager.cc:1403] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.128s	user 0.050s	sys 0.064s
I20260709 13:02:53.581250 12032 raft_consensus.cc:515] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.582172 12029 raft_consensus.cc:359] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } }
I20260709 13:02:53.582468 12028 raft_consensus.cc:359] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.582942 12029 raft_consensus.cc:385] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.583212 12028 raft_consensus.cc:385] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.583304 12029 raft_consensus.cc:740] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.583626 12028 raft_consensus.cc:740] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.584141 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f53ee9d77184cd7955f4f505094c64b" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:53.584614 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f53ee9d77184cd7955f4f505094c64b" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:53.584342 12029 consensus_queue.cc:260] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } }
I20260709 13:02:53.585040 11914 raft_consensus.cc:3060] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.584517 12028 consensus_queue.cc:260] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.577493 12037 raft_consensus.cc:515] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.586778 11988 raft_consensus.cc:2393] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b71b457f537044f1b8d7755d14e40cf4 in current term 1: Already voted for candidate a4da76bc1235497d8b166fba4921f9d5 in this term.
I20260709 13:02:53.592339 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f53ee9d77184cd7955f4f505094c64b" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:53.593431 11839 raft_consensus.cc:2393] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a4da76bc1235497d8b166fba4921f9d5 in current term 1: Already voted for candidate b71b457f537044f1b8d7755d14e40cf4 in this term.
I20260709 13:02:53.593917 12029 ts_tablet_manager.cc:1434] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:02:53.594825 11914 raft_consensus.cc:2468] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 1.
I20260709 13:02:53.597769 11913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f53ee9d77184cd7955f4f505094c64b" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:53.601753 12029 tablet_bootstrap.cc:492] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:53.604307 12030 ts_tablet_manager.cc:1434] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.061s	user 0.012s	sys 0.000s
I20260709 13:02:53.605464 12030 tablet_bootstrap.cc:492] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:53.607719 12049 raft_consensus.cc:493] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.608294 12049 raft_consensus.cc:515] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.610210 12032 leader_election.cc:290] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:53.612494 11802 leader_election.cc:304] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:53.613423 12049 leader_election.cc:290] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:53.613499 12032 raft_consensus.cc:2804] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:53.614171 12032 raft_consensus.cc:697] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Becoming Leader. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:53.615142 12032 consensus_queue.cc:237] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.608489 11951 leader_election.cc:304] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5; no voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:53.617447 12029 tablet_bootstrap.cc:654] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.618839 12036 raft_consensus.cc:493] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.618983 12049 raft_consensus.cc:2749] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:53.619040 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "395018dba6604c1d87b6758b93bd91a3" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:53.619411 12036 raft_consensus.cc:515] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.620215 11839 raft_consensus.cc:2468] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 0.
I20260709 13:02:53.625161 12036 leader_election.cc:290] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:53.632413 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f53ee9d77184cd7955f4f505094c64b" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:53.633677 11988 raft_consensus.cc:2393] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b71b457f537044f1b8d7755d14e40cf4 in current term 1: Already voted for candidate a4da76bc1235497d8b166fba4921f9d5 in this term.
I20260709 13:02:53.634117 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "395018dba6604c1d87b6758b93bd91a3" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
W20260709 13:02:53.636271 11785 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:53.638461 11914 raft_consensus.cc:2468] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 0.
I20260709 13:02:53.637518 11951 leader_election.cc:304] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:53.639062 12028 ts_tablet_manager.cc:1434] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.060s	user 0.019s	sys 0.039s
I20260709 13:02:53.639436 12049 raft_consensus.cc:2804] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:53.639837 12049 raft_consensus.cc:493] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.640144 12049 raft_consensus.cc:3060] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.640602 12037 leader_election.cc:290] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:53.641644 12029 tablet_bootstrap.cc:492] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:53.645756 12029 ts_tablet_manager.cc:1403] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.011s
I20260709 13:02:53.649082 12029 raft_consensus.cc:359] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.650027 12049 raft_consensus.cc:515] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.649876 12029 raft_consensus.cc:385] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.644106 12030 tablet_bootstrap.cc:654] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.650874 12029 raft_consensus.cc:740] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.651721 12029 consensus_queue.cc:260] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.652415 11737 catalog_manager.cc:5697] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b71b457f537044f1b8d7755d14e40cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:53.654011 12029 ts_tablet_manager.cc:1434] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:02:53.655057 12029 tablet_bootstrap.cc:492] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:53.640136 12028 tablet_bootstrap.cc:492] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:53.657792 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "395018dba6604c1d87b6758b93bd91a3" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:53.658552 11839 raft_consensus.cc:2468] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 0.
I20260709 13:02:53.659895 11877 leader_election.cc:304] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:53.660964 12036 raft_consensus.cc:2804] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:53.661334 12036 raft_consensus.cc:493] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.661677 12036 raft_consensus.cc:3060] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.663578 12030 tablet_bootstrap.cc:492] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:53.664126 12030 ts_tablet_manager.cc:1403] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.010s
I20260709 13:02:53.665805 12049 leader_election.cc:290] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:53.666608 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "395018dba6604c1d87b6758b93bd91a3" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:53.667315 11839 raft_consensus.cc:3060] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.667487 12030 raft_consensus.cc:359] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.668313 12030 raft_consensus.cc:385] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.668607 12030 raft_consensus.cc:740] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.669486 12030 consensus_queue.cc:260] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.669982 12029 tablet_bootstrap.cc:654] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.671221 12028 tablet_bootstrap.cc:654] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.670405 12036 raft_consensus.cc:515] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.677188 11838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "395018dba6604c1d87b6758b93bd91a3" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:53.678658 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "395018dba6604c1d87b6758b93bd91a3" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:53.679808 11914 raft_consensus.cc:2393] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a4da76bc1235497d8b166fba4921f9d5 in current term 1: Already voted for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in this term.
I20260709 13:02:53.683514 12036 leader_election.cc:290] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:53.689041 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "395018dba6604c1d87b6758b93bd91a3" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:53.690892 11988 raft_consensus.cc:2393] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in current term 1: Already voted for candidate a4da76bc1235497d8b166fba4921f9d5 in this term.
I20260709 13:02:53.689071 11987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "395018dba6604c1d87b6758b93bd91a3" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:53.692287 11987 raft_consensus.cc:2393] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in current term 1: Already voted for candidate a4da76bc1235497d8b166fba4921f9d5 in this term.
I20260709 13:02:53.694941 11880 leader_election.cc:304] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3; no voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:53.697400 11839 raft_consensus.cc:2468] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 1.
I20260709 13:02:53.699216 11951 leader_election.cc:304] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4; no voters: 9e1c09bf1ea04fa9a443809e4980fdd3
I20260709 13:02:53.699030 12036 raft_consensus.cc:2749] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:53.700454 12049 raft_consensus.cc:2804] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:53.701287 12049 raft_consensus.cc:697] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Becoming Leader. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Running, Role: LEADER
I20260709 13:02:53.702454 12049 consensus_queue.cc:237] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.711213 12030 ts_tablet_manager.cc:1434] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.047s	user 0.013s	sys 0.015s
I20260709 13:02:53.712378 12030 tablet_bootstrap.cc:492] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:53.714790 12028 tablet_bootstrap.cc:492] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:53.715592 12028 ts_tablet_manager.cc:1403] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.022s
I20260709 13:02:53.716562 12029 tablet_bootstrap.cc:492] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:53.717178 12029 ts_tablet_manager.cc:1403] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.017s
I20260709 13:02:53.719059 12030 tablet_bootstrap.cc:654] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.718912 12032 raft_consensus.cc:493] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.719513 12032 raft_consensus.cc:515] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } }
I20260709 13:02:53.721318 12029 raft_consensus.cc:359] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.721884 12032 leader_election.cc:290] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:53.722182 12029 raft_consensus.cc:385] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.722612 12029 raft_consensus.cc:740] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.723433 12029 consensus_queue.cc:260] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.725085 11987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da72756e014bc384b32dfedec94ed6" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:53.725836 11987 raft_consensus.cc:2468] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 0.
I20260709 13:02:53.726131 12029 ts_tablet_manager.cc:1434] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:53.726925 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da72756e014bc384b32dfedec94ed6" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:53.727450 12029 tablet_bootstrap.cc:492] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:53.726647 11736 catalog_manager.cc:5697] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a4da76bc1235497d8b166fba4921f9d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:53.727593 11914 raft_consensus.cc:2468] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 0.
I20260709 13:02:53.730293 11802 leader_election.cc:304] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:53.727663 12028 raft_consensus.cc:359] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.731671 12028 raft_consensus.cc:385] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.732188 12032 raft_consensus.cc:2804] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:53.732651 12032 raft_consensus.cc:493] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.733032 12032 raft_consensus.cc:3060] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.731969 12028 raft_consensus.cc:740] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.735445 12029 tablet_bootstrap.cc:654] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.736373 12028 consensus_queue.cc:260] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.739720 12028 ts_tablet_manager.cc:1434] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:02:53.740718 12028 tablet_bootstrap.cc:492] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:53.742146 12032 raft_consensus.cc:515] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } }
I20260709 13:02:53.746093 11987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da72756e014bc384b32dfedec94ed6" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:53.746966 11987 raft_consensus.cc:3060] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.749136 12050 raft_consensus.cc:493] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.749665 12050 raft_consensus.cc:515] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.750094 12029 tablet_bootstrap.cc:492] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:53.750670 12029 ts_tablet_manager.cc:1403] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.001s
I20260709 13:02:53.751895 12050 leader_election.cc:290] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:53.753087 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b2802e84d54d2ba1ee80bf74dbedf3" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:53.753746 11988 raft_consensus.cc:2468] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 0.
I20260709 13:02:53.753805 12029 raft_consensus.cc:359] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.754510 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b2802e84d54d2ba1ee80bf74dbedf3" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:53.747195 12028 tablet_bootstrap.cc:654] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.755177 11805 leader_election.cc:304] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:53.756104 12050 raft_consensus.cc:2804] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:53.756645 12050 raft_consensus.cc:493] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.756969 12050 raft_consensus.cc:3060] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.757301 12061 raft_consensus.cc:493] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.757774 12061 raft_consensus.cc:515] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.754629 12029 raft_consensus.cc:385] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.762001 12029 raft_consensus.cc:740] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.762305 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf79fb9c3f364b20aab797239f80e750" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:53.763019 11839 raft_consensus.cc:2468] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 0.
I20260709 13:02:53.763165 12029 consensus_queue.cc:260] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.764508 11877 leader_election.cc:304] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:53.765506 12057 raft_consensus.cc:2804] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:53.765583 12032 leader_election.cc:290] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Requested vote from peers a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:53.765931 12057 raft_consensus.cc:493] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.766503 12057 raft_consensus.cc:3060] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.770547 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf79fb9c3f364b20aab797239f80e750" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:53.771087 12029 ts_tablet_manager.cc:1434] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:02:53.771231 11988 raft_consensus.cc:2468] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 0.
I20260709 13:02:53.772620 12029 tablet_bootstrap.cc:492] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:53.772811 12061 leader_election.cc:290] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
W20260709 13:02:53.756093 11802 leader_election.cc:343] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:53.777071 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25da72756e014bc384b32dfedec94ed6" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:53.777696 11914 raft_consensus.cc:3060] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.786623 11987 raft_consensus.cc:2468] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 1.
I20260709 13:02:53.787320 12050 raft_consensus.cc:515] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.790167 12029 tablet_bootstrap.cc:654] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.790896 12028 tablet_bootstrap.cc:492] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:53.791458 12028 ts_tablet_manager.cc:1403] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.016s
I20260709 13:02:53.788815 12057 raft_consensus.cc:515] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.791797 12050 leader_election.cc:290] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:53.794030 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf79fb9c3f364b20aab797239f80e750" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:53.794421 11913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b2802e84d54d2ba1ee80bf74dbedf3" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:53.794703 11839 raft_consensus.cc:3060] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.795140 12028 raft_consensus.cc:359] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.796144 12028 raft_consensus.cc:385] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.796504 12028 raft_consensus.cc:740] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.797695 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b2802e84d54d2ba1ee80bf74dbedf3" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:53.797469 12028 consensus_queue.cc:260] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
W20260709 13:02:53.798028 11802 leader_election.cc:343] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:53.798311 11988 raft_consensus.cc:3060] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.799196 11805 leader_election.cc:304] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:53.800001 12050 raft_consensus.cc:2804] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:53.800547 12050 raft_consensus.cc:697] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Becoming Leader. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:53.801555 12050 consensus_queue.cc:237] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } }
I20260709 13:02:53.809656 12028 ts_tablet_manager.cc:1434] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.002s
I20260709 13:02:53.810949 12028 tablet_bootstrap.cc:492] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:53.811635 12030 tablet_bootstrap.cc:492] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:53.812192 12030 ts_tablet_manager.cc:1403] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.100s	user 0.018s	sys 0.015s
I20260709 13:02:53.813225 11839 raft_consensus.cc:2468] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 1.
I20260709 13:02:53.814463 11877 leader_election.cc:304] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:53.815373 12061 raft_consensus.cc:2804] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:53.815454 12030 raft_consensus.cc:359] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.816339 12030 raft_consensus.cc:385] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.816625 12030 raft_consensus.cc:740] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.816653 12061 raft_consensus.cc:697] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 LEADER]: Becoming Leader. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Running, Role: LEADER
I20260709 13:02:53.817437 12028 tablet_bootstrap.cc:654] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.817723 12061 consensus_queue.cc:237] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.818307 12030 consensus_queue.cc:260] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.820020 11914 raft_consensus.cc:2468] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 1.
I20260709 13:02:53.823251 11988 raft_consensus.cc:2468] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 1.
I20260709 13:02:53.820719 12030 ts_tablet_manager.cc:1434] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:53.823737 11987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf79fb9c3f364b20aab797239f80e750" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:53.824432 11987 raft_consensus.cc:3060] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.824994 12030 tablet_bootstrap.cc:492] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:53.824827 11805 leader_election.cc:304] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4; no voters: 9e1c09bf1ea04fa9a443809e4980fdd3
I20260709 13:02:53.826179 12032 raft_consensus.cc:2804] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:53.826656 12032 raft_consensus.cc:697] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Becoming Leader. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:53.827512 12032 consensus_queue.cc:237] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.832146 12057 leader_election.cc:290] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:53.834970 11987 raft_consensus.cc:2468] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 1.
I20260709 13:02:53.839010 12029 tablet_bootstrap.cc:492] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:53.839625 12029 ts_tablet_manager.cc:1403] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.012s
I20260709 13:02:53.839010 11736 catalog_manager.cc:5697] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:53.850808 12030 tablet_bootstrap.cc:654] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.851886 11737 catalog_manager.cc:5697] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b71b457f537044f1b8d7755d14e40cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:53.855185 12029 raft_consensus.cc:359] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.856293 12029 raft_consensus.cc:385] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.856734 12029 raft_consensus.cc:740] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.857719 12029 consensus_queue.cc:260] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.860739 12029 ts_tablet_manager.cc:1434] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:02:53.862802 12029 tablet_bootstrap.cc:492] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:53.864578 12028 tablet_bootstrap.cc:492] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:53.865141 12028 ts_tablet_manager.cc:1403] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.022s
I20260709 13:02:53.865733 12030 tablet_bootstrap.cc:492] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:53.866308 12030 ts_tablet_manager.cc:1403] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.000s
I20260709 13:02:53.868237 12028 raft_consensus.cc:359] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.869048 12028 raft_consensus.cc:385] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.869407 12028 raft_consensus.cc:740] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.869151 12030 raft_consensus.cc:359] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.870008 12029 tablet_bootstrap.cc:654] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.870450 12028 consensus_queue.cc:260] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.870026 12030 raft_consensus.cc:385] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.872696 12030 raft_consensus.cc:740] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.873299 12028 ts_tablet_manager.cc:1434] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:53.873520 12030 consensus_queue.cc:260] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.874732 12028 tablet_bootstrap.cc:492] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:53.875969 12030 ts_tablet_manager.cc:1434] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:53.879431 12030 tablet_bootstrap.cc:492] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:53.884007 12028 tablet_bootstrap.cc:654] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.885607 12030 tablet_bootstrap.cc:654] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.897400 11736 catalog_manager.cc:5697] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b71b457f537044f1b8d7755d14e40cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:53.918080 12032 raft_consensus.cc:493] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.918897 12032 raft_consensus.cc:515] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.922140 12028 tablet_bootstrap.cc:492] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:53.922161 12029 tablet_bootstrap.cc:492] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:53.922698 12028 ts_tablet_manager.cc:1403] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.048s	user 0.028s	sys 0.017s
I20260709 13:02:53.923355 12029 ts_tablet_manager.cc:1403] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.062s	user 0.036s	sys 0.019s
I20260709 13:02:53.923658 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c682e96f583341febaf99286ebe5e471" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:53.924325 11914 raft_consensus.cc:2468] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 0.
I20260709 13:02:53.925051 12049 raft_consensus.cc:493] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.925550 12049 raft_consensus.cc:515] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.922494 11987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c682e96f583341febaf99286ebe5e471" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:53.926601 11987 raft_consensus.cc:2468] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 0.
I20260709 13:02:53.926620 12029 raft_consensus.cc:359] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.927309 12030 tablet_bootstrap.cc:492] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:53.927506 12029 raft_consensus.cc:385] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.927794 12030 ts_tablet_manager.cc:1403] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.018s
I20260709 13:02:53.927752 12049 leader_election.cc:290] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:53.927922 12029 raft_consensus.cc:740] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.925562 12028 raft_consensus.cc:359] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.929276 12028 raft_consensus.cc:385] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.929718 12028 raft_consensus.cc:740] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.930076 11805 leader_election.cc:304] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:53.930425 12028 consensus_queue.cc:260] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.930939 12050 raft_consensus.cc:2804] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:53.930789 12030 raft_consensus.cc:359] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.931380 12050 raft_consensus.cc:493] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.931560 12030 raft_consensus.cc:385] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.929065 12029 consensus_queue.cc:260] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.931843 12050 raft_consensus.cc:3060] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.931892 12030 raft_consensus.cc:740] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.932898 12030 consensus_queue.cc:260] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.933596 12029 ts_tablet_manager.cc:1434] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:53.934561 12029 tablet_bootstrap.cc:492] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:53.934867 12030 ts_tablet_manager.cc:1434] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:02:53.935261 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8476de5b26434850a52f60fbc9eda471" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:53.935925 12030 tablet_bootstrap.cc:492] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:53.935874 11914 raft_consensus.cc:2468] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 0.
I20260709 13:02:53.938465 12028 ts_tablet_manager.cc:1434] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:02:53.938843 11951 leader_election.cc:304] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: 
I20260709 13:02:53.939416 12028 tablet_bootstrap.cc:492] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:53.939677 12049 raft_consensus.cc:2804] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:53.940038 12049 raft_consensus.cc:493] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.940344 12049 raft_consensus.cc:3060] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.941772 12030 tablet_bootstrap.cc:654] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.945268 12028 tablet_bootstrap.cc:654] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.950734 12029 tablet_bootstrap.cc:654] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.929126 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8476de5b26434850a52f60fbc9eda471" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:53.952308 11839 raft_consensus.cc:2468] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 0.
I20260709 13:02:53.953491 12030 tablet_bootstrap.cc:492] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:53.953984 12030 ts_tablet_manager.cc:1403] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:02:53.954007 12032 leader_election.cc:290] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:53.957223 12030 raft_consensus.cc:359] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.958130 12030 raft_consensus.cc:385] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.958485 12030 raft_consensus.cc:740] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.959671 12030 consensus_queue.cc:260] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.959687 12050 raft_consensus.cc:515] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.962136 12049 raft_consensus.cc:515] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.964850 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8476de5b26434850a52f60fbc9eda471" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:53.965444 11839 raft_consensus.cc:3060] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.966169 12030 ts_tablet_manager.cc:1434] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:02:53.966712 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c682e96f583341febaf99286ebe5e471" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:53.967269 11914 raft_consensus.cc:3060] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.971262 11987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c682e96f583341febaf99286ebe5e471" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:53.971923 11987 raft_consensus.cc:3060] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.966735 12050 leader_election.cc:290] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:53.974253 11839 raft_consensus.cc:2468] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 1.
I20260709 13:02:53.975489 11951 leader_election.cc:304] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:53.976274 12037 raft_consensus.cc:2804] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:53.976744 12037 raft_consensus.cc:697] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Becoming Leader. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Running, Role: LEADER
I20260709 13:02:53.977568 12037 consensus_queue.cc:237] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.980792 12049 leader_election.cc:290] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:53.982244 12028 tablet_bootstrap.cc:492] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:53.982707 11913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8476de5b26434850a52f60fbc9eda471" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:53.983184 11987 raft_consensus.cc:2468] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 1.
I20260709 13:02:53.983449 11913 raft_consensus.cc:3060] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.984414 11914 raft_consensus.cc:2468] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 1.
I20260709 13:02:53.985499 12029 tablet_bootstrap.cc:492] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:53.985528 11802 leader_election.cc:304] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:53.986271 12029 ts_tablet_manager.cc:1403] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.052s	user 0.024s	sys 0.012s
I20260709 13:02:53.986600 12050 raft_consensus.cc:2804] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:53.987841 12050 raft_consensus.cc:697] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Becoming Leader. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:53.988662 12050 consensus_queue.cc:237] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.989297 12029 raft_consensus.cc:359] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.990111 12029 raft_consensus.cc:385] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.990448 12029 raft_consensus.cc:740] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.982779 12028 ts_tablet_manager.cc:1403] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.003s
I20260709 13:02:53.991173 12029 consensus_queue.cc:260] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.993144 12029 ts_tablet_manager.cc:1434] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:53.995397 12028 raft_consensus.cc:359] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.995673 11913 raft_consensus.cc:2468] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 1.
I20260709 13:02:53.996137 12028 raft_consensus.cc:385] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.996418 12028 raft_consensus.cc:740] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.997107 12028 consensus_queue.cc:260] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:53.999220 12028 ts_tablet_manager.cc:1434] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:54.002411 11737 catalog_manager.cc:5697] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a4da76bc1235497d8b166fba4921f9d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:54.003010 11736 catalog_manager.cc:5697] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b71b457f537044f1b8d7755d14e40cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:54.087437 12050 consensus_queue.cc:1048] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.094859 12032 consensus_queue.cc:1048] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.099936 12061 raft_consensus.cc:493] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.100616 12061 raft_consensus.cc:515] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.104347 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c8ed1ce26d4ac790f7dce5d230c405" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:54.106648 11839 raft_consensus.cc:2468] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 0.
I20260709 13:02:54.108393 11877 leader_election.cc:304] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:54.109591 12057 raft_consensus.cc:2804] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:54.110083 12057 raft_consensus.cc:493] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.110530 12057 raft_consensus.cc:3060] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:54.111464 12061 leader_election.cc:290] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:54.114863 11987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c8ed1ce26d4ac790f7dce5d230c405" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:54.115628 11987 raft_consensus.cc:2468] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 0.
I20260709 13:02:54.121645 12057 raft_consensus.cc:515] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.124750 12057 leader_election.cc:290] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:54.124712 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c8ed1ce26d4ac790f7dce5d230c405" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:54.125064 11987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c8ed1ce26d4ac790f7dce5d230c405" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:54.125471 11839 raft_consensus.cc:3060] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:54.125857 11987 raft_consensus.cc:3060] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:54.131745 11987 raft_consensus.cc:2468] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 1.
I20260709 13:02:54.132637 11839 raft_consensus.cc:2468] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 1.
I20260709 13:02:54.132730 11880 leader_election.cc:304] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: 
I20260709 13:02:54.133796 12057 raft_consensus.cc:2804] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:54.134208 12057 raft_consensus.cc:697] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 LEADER]: Becoming Leader. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Running, Role: LEADER
I20260709 13:02:54.134927 12057 consensus_queue.cc:237] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.141745 11737 catalog_manager.cc:5697] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:54.181259 12037 consensus_queue.cc:1048] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.193164 12051 consensus_queue.cc:1048] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:54.232717 12057 consensus_queue.cc:1048] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.243819 12061 consensus_queue.cc:1048] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.253729 11913 raft_consensus.cc:3060] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:54.262184 12050 consensus_queue.cc:1048] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.273639 12032 consensus_queue.cc:1048] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.317787 12051 raft_consensus.cc:493] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.318321 12051 raft_consensus.cc:515] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.320072 12051 leader_election.cc:290] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:54.320973 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9381d49d1114401f9e36b4fc29312ec1" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:54.321266 11913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9381d49d1114401f9e36b4fc29312ec1" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:54.321595 11839 raft_consensus.cc:2468] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 0.
I20260709 13:02:54.321935 11913 raft_consensus.cc:2468] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 0.
I20260709 13:02:54.322618 11951 leader_election.cc:304] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:54.323443 12051 raft_consensus.cc:2804] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:54.323803 12051 raft_consensus.cc:493] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.324100 12051 raft_consensus.cc:3060] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:54.329631 12051 raft_consensus.cc:515] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.331373 12051 leader_election.cc:290] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:54.332140 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9381d49d1114401f9e36b4fc29312ec1" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:54.332281 11913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9381d49d1114401f9e36b4fc29312ec1" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:54.332855 11839 raft_consensus.cc:3060] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:54.332930 11913 raft_consensus.cc:3060] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:54.338541 11913 raft_consensus.cc:2468] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 1.
I20260709 13:02:54.338654 11839 raft_consensus.cc:2468] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 1.
I20260709 13:02:54.339648 11951 leader_election.cc:304] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: 
I20260709 13:02:54.340325 12051 raft_consensus.cc:2804] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:54.340816 12051 raft_consensus.cc:697] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Becoming Leader. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Running, Role: LEADER
I20260709 13:02:54.341454 12051 consensus_queue.cc:237] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.349155 11736 catalog_manager.cc:5697] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a4da76bc1235497d8b166fba4921f9d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:54.391098 12051 consensus_queue.cc:1048] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.403133 12037 consensus_queue.cc:1048] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:54.404016 12032 consensus_queue.cc:1048] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:54.419981 12032 consensus_queue.cc:1048] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.473513 12050 consensus_queue.cc:1048] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.484220 12032 consensus_queue.cc:1048] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.516407 12061 consensus_queue.cc:1048] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.519654 11987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "395018dba6604c1d87b6758b93bd91a3"
dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
mode: GRACEFUL
new_leader_uuid: "b71b457f537044f1b8d7755d14e40cf4"
 from {username='slave'} at 127.0.0.1:34532
I20260709 13:02:54.520413 11987 raft_consensus.cc:606] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Received request to transfer leadership to TS b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:54.528177 12057 consensus_queue.cc:1048] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.547808 11913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf79fb9c3f364b20aab797239f80e750"
dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
mode: GRACEFUL
new_leader_uuid: "b71b457f537044f1b8d7755d14e40cf4"
 from {username='slave'} at 127.0.0.1:42284
I20260709 13:02:54.548547 11913 raft_consensus.cc:606] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 LEADER]: Received request to transfer leadership to TS b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:54.562547 11839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13b2802e84d54d2ba1ee80bf74dbedf3"
dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
mode: GRACEFUL
new_leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
 from {username='slave'} at 127.0.0.1:55818
I20260709 13:02:54.563107 11839 raft_consensus.cc:606] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Received request to transfer leadership to TS 9e1c09bf1ea04fa9a443809e4980fdd3
I20260709 13:02:54.568781 11988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8476de5b26434850a52f60fbc9eda471"
dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
mode: GRACEFUL
new_leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
 from {username='slave'} at 127.0.0.1:34532
I20260709 13:02:54.569296 11988 raft_consensus.cc:606] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Received request to transfer leadership to TS 9e1c09bf1ea04fa9a443809e4980fdd3
I20260709 13:02:54.574771 11839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c682e96f583341febaf99286ebe5e471"
dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
mode: GRACEFUL
new_leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
 from {username='slave'} at 127.0.0.1:55818
I20260709 13:02:54.575350 11839 raft_consensus.cc:606] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Received request to transfer leadership to TS 9e1c09bf1ea04fa9a443809e4980fdd3
I20260709 13:02:54.698227 12051 raft_consensus.cc:993] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5: : Instructing follower b71b457f537044f1b8d7755d14e40cf4 to start an election
I20260709 13:02:54.698784 12051 raft_consensus.cc:1081] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Signalling peer b71b457f537044f1b8d7755d14e40cf4 to start an election
I20260709 13:02:54.700240 11839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "395018dba6604c1d87b6758b93bd91a3"
dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
 from {username='slave'} at 127.0.0.1:55802
I20260709 13:02:54.700757 11839 raft_consensus.cc:493] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:54.701061 11839 raft_consensus.cc:3060] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.705978 11839 raft_consensus.cc:515] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.707608 11839 leader_election.cc:290] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 2 election: Requested vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:54.708571 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "395018dba6604c1d87b6758b93bd91a3" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:54.708571 11913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "395018dba6604c1d87b6758b93bd91a3" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:54.709277 11988 raft_consensus.cc:3055] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:54.709512 11913 raft_consensus.cc:3060] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.709657 11988 raft_consensus.cc:740] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Running, Role: LEADER
I20260709 13:02:54.710541 11988 consensus_queue.cc:260] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.711781 11988 raft_consensus.cc:3060] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.716651 11913 raft_consensus.cc:2468] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 2.
I20260709 13:02:54.717940 11802 leader_election.cc:304] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:54.718786 12032 raft_consensus.cc:2804] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:54.719007 11988 raft_consensus.cc:2468] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 2.
I20260709 13:02:54.719231 12032 raft_consensus.cc:697] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [term 2 LEADER]: Becoming Leader. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:54.720273 12032 consensus_queue.cc:237] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.726621 11736 catalog_manager.cc:5697] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 reported cstate change: term changed from 1 to 2, leader changed from a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195) to b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b71b457f537044f1b8d7755d14e40cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:54.734728 12036 raft_consensus.cc:993] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3: : Instructing follower b71b457f537044f1b8d7755d14e40cf4 to start an election
I20260709 13:02:54.735303 12036 raft_consensus.cc:1081] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 LEADER]: Signalling peer b71b457f537044f1b8d7755d14e40cf4 to start an election
I20260709 13:02:54.737028 11839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf79fb9c3f364b20aab797239f80e750"
dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
 from {username='slave'} at 127.0.0.1:55806
I20260709 13:02:54.737604 11839 raft_consensus.cc:493] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:54.738021 11839 raft_consensus.cc:3060] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.743130 11839 raft_consensus.cc:515] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.744654 11839 leader_election.cc:290] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 2 election: Requested vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:54.745579 11913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf79fb9c3f364b20aab797239f80e750" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:54.745798 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf79fb9c3f364b20aab797239f80e750" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:54.746177 11913 raft_consensus.cc:3055] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:54.746428 11988 raft_consensus.cc:3060] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.746557 11913 raft_consensus.cc:740] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Running, Role: LEADER
I20260709 13:02:54.747394 11913 consensus_queue.cc:260] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.748446 11913 raft_consensus.cc:3060] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.751595 11988 raft_consensus.cc:2468] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 2.
I20260709 13:02:54.752799 11805 leader_election.cc:304] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:54.753605 12032 raft_consensus.cc:2804] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:54.753634 11913 raft_consensus.cc:2468] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 2.
I20260709 13:02:54.754179 12032 raft_consensus.cc:697] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [term 2 LEADER]: Becoming Leader. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:54.755092 12032 consensus_queue.cc:237] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.761520 11735 catalog_manager.cc:5697] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 reported cstate change: term changed from 1 to 2, leader changed from 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194) to b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b71b457f537044f1b8d7755d14e40cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:54.876066 12085 raft_consensus.cc:993] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4: : Instructing follower 9e1c09bf1ea04fa9a443809e4980fdd3 to start an election
I20260709 13:02:54.876516 12032 raft_consensus.cc:1081] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Signalling peer 9e1c09bf1ea04fa9a443809e4980fdd3 to start an election
I20260709 13:02:54.877936 11913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13b2802e84d54d2ba1ee80bf74dbedf3"
dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
 from {username='slave'} at 127.0.0.1:42260
I20260709 13:02:54.878407 11913 raft_consensus.cc:493] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:54.878651 11913 raft_consensus.cc:3060] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.883548 11913 raft_consensus.cc:515] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.885093 11913 leader_election.cc:290] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 2 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:54.886085 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b2802e84d54d2ba1ee80bf74dbedf3" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:54.886293 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b2802e84d54d2ba1ee80bf74dbedf3" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:54.886927 11839 raft_consensus.cc:3055] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:54.886934 11988 raft_consensus.cc:3060] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.887400 11839 raft_consensus.cc:740] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:54.888274 11839 consensus_queue.cc:260] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.889552 11839 raft_consensus.cc:3060] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.893324 12051 consensus_queue.cc:1048] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.895650 11988 raft_consensus.cc:2468] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 2.
I20260709 13:02:54.896777 11839 raft_consensus.cc:2468] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 2.
I20260709 13:02:54.897042 11880 leader_election.cc:304] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: 
I20260709 13:02:54.898317 12036 raft_consensus.cc:2804] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:54.897068 12051 raft_consensus.cc:993] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5: : Instructing follower 9e1c09bf1ea04fa9a443809e4980fdd3 to start an election
I20260709 13:02:54.899400 12037 raft_consensus.cc:1081] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Signalling peer 9e1c09bf1ea04fa9a443809e4980fdd3 to start an election
I20260709 13:02:54.898814 12036 raft_consensus.cc:697] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Becoming Leader. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Running, Role: LEADER
I20260709 13:02:54.900754 12036 consensus_queue.cc:237] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.901939 11913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8476de5b26434850a52f60fbc9eda471"
dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
 from {username='slave'} at 127.0.0.1:42274
I20260709 13:02:54.902639 11913 raft_consensus.cc:493] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:54.903405 11913 raft_consensus.cc:3060] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.906863 12051 consensus_queue.cc:1048] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.910910 11913 raft_consensus.cc:515] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.912891 11735 catalog_manager.cc:5697] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 reported cstate change: term changed from 1 to 2, leader changed from b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193) to 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:54.915818 11913 leader_election.cc:290] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 2 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:54.918588 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8476de5b26434850a52f60fbc9eda471" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:54.919215 11988 raft_consensus.cc:3055] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:54.919576 11988 raft_consensus.cc:740] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Running, Role: LEADER
I20260709 13:02:54.920344 11988 consensus_queue.cc:260] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.921247 11838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8476de5b26434850a52f60fbc9eda471" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:54.921623 11988 raft_consensus.cc:3060] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.921873 11838 raft_consensus.cc:3060] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.929643 11838 raft_consensus.cc:2468] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 2.
I20260709 13:02:54.930786 11877 leader_election.cc:304] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:54.931653 12057 raft_consensus.cc:2804] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:54.932142 12057 raft_consensus.cc:697] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Becoming Leader. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Running, Role: LEADER
I20260709 13:02:54.932175 11988 raft_consensus.cc:2468] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 2.
I20260709 13:02:54.933087 12057 consensus_queue.cc:237] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.941697 11735 catalog_manager.cc:5697] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 reported cstate change: term changed from 1 to 2, leader changed from a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195) to 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:54.950917 12050 raft_consensus.cc:993] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4: : Instructing follower 9e1c09bf1ea04fa9a443809e4980fdd3 to start an election
I20260709 13:02:54.951479 12032 raft_consensus.cc:1081] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Signalling peer 9e1c09bf1ea04fa9a443809e4980fdd3 to start an election
I20260709 13:02:54.953156 11914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c682e96f583341febaf99286ebe5e471"
dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
 from {username='slave'} at 127.0.0.1:42260
I20260709 13:02:54.953740 11914 raft_consensus.cc:493] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:54.954130 11914 raft_consensus.cc:3060] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.959290 11914 raft_consensus.cc:515] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.960927 11914 leader_election.cc:290] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 2 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:54.961970 11838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c682e96f583341febaf99286ebe5e471" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:54.962036 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c682e96f583341febaf99286ebe5e471" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:54.962651 11838 raft_consensus.cc:3055] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:54.962805 11988 raft_consensus.cc:3060] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.962931 11838 raft_consensus.cc:740] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:54.963891 11838 consensus_queue.cc:260] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.964898 11838 raft_consensus.cc:3060] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.968288 11988 raft_consensus.cc:2468] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 2.
I20260709 13:02:54.969416 11880 leader_election.cc:304] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: 
I20260709 13:02:54.970093 11838 raft_consensus.cc:2468] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 2.
I20260709 13:02:54.970235 12057 raft_consensus.cc:2804] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:54.970794 12057 raft_consensus.cc:697] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Becoming Leader. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Running, Role: LEADER
I20260709 13:02:54.971553 12057 consensus_queue.cc:237] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:54.978281 11735 catalog_manager.cc:5697] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 reported cstate change: term changed from 1 to 2, leader changed from b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193) to 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.129611 11914 raft_consensus.cc:1275] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Refusing update from remote peer b71b457f537044f1b8d7755d14e40cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.130892 12032 consensus_queue.cc:1048] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:55.135344 11988 raft_consensus.cc:1275] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Refusing update from remote peer b71b457f537044f1b8d7755d14e40cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.137208 12050 consensus_queue.cc:1048] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:55.138698 11987 raft_consensus.cc:1275] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Refusing update from remote peer b71b457f537044f1b8d7755d14e40cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.140630 12085 consensus_queue.cc:1048] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:55.151803 11914 raft_consensus.cc:1275] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Refusing update from remote peer b71b457f537044f1b8d7755d14e40cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.154243 12113 consensus_queue.cc:1048] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:55.373979 11988 raft_consensus.cc:1275] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Refusing update from remote peer 9e1c09bf1ea04fa9a443809e4980fdd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.375481 12057 consensus_queue.cc:1048] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:55.383529 11838 raft_consensus.cc:1275] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Refusing update from remote peer 9e1c09bf1ea04fa9a443809e4980fdd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.385473 12036 consensus_queue.cc:1048] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:55.462292 11838 raft_consensus.cc:1275] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Refusing update from remote peer 9e1c09bf1ea04fa9a443809e4980fdd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.463941 12057 consensus_queue.cc:1048] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:55.465497 11838 raft_consensus.cc:1275] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Refusing update from remote peer 9e1c09bf1ea04fa9a443809e4980fdd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.466799 12057 consensus_queue.cc:1048] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:55.471765 11988 raft_consensus.cc:1275] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Refusing update from remote peer 9e1c09bf1ea04fa9a443809e4980fdd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.473919 12057 consensus_queue.cc:1048] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:55.488018 11988 raft_consensus.cc:1275] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Refusing update from remote peer 9e1c09bf1ea04fa9a443809e4980fdd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.489691 12057 consensus_queue.cc:1048] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.611938 11736 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41494:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:57.614118 11736 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:57.661727 11828 tablet_service.cc:1511] Processing CreateTablet for tablet c8dab636400e4f79af30715dd97d842d (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:57.662225 11903 tablet_service.cc:1511] Processing CreateTablet for tablet c8dab636400e4f79af30715dd97d842d (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:57.663190 11828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8dab636400e4f79af30715dd97d842d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.663646 11903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8dab636400e4f79af30715dd97d842d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.665247 11826 tablet_service.cc:1511] Processing CreateTablet for tablet 0b21719fd2d245bb91dc364a4f609b79 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:57.666512 11900 tablet_service.cc:1511] Processing CreateTablet for tablet 0b21719fd2d245bb91dc364a4f609b79 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:57.667465 11973 tablet_service.cc:1511] Processing CreateTablet for tablet c8dab636400e4f79af30715dd97d842d (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:57.667869 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b21719fd2d245bb91dc364a4f609b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.668726 11973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8dab636400e4f79af30715dd97d842d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.671283 11977 tablet_service.cc:1511] Processing CreateTablet for tablet 0b21719fd2d245bb91dc364a4f609b79 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:57.671770 11901 tablet_service.cc:1511] Processing CreateTablet for tablet a32cfea8ce174be884829120b366ba70 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:57.672546 11977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b21719fd2d245bb91dc364a4f609b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.673103 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32cfea8ce174be884829120b366ba70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.673461 11974 tablet_service.cc:1511] Processing CreateTablet for tablet a32cfea8ce174be884829120b366ba70 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:57.674714 11974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32cfea8ce174be884829120b366ba70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.675033 11827 tablet_service.cc:1511] Processing CreateTablet for tablet a32cfea8ce174be884829120b366ba70 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
W20260709 13:02:57.675673 11785 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:57.666528 11826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b21719fd2d245bb91dc364a4f609b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.679481 11899 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea093064eb74fb1a013c9fa0d118467 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:57.679885 11829 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea093064eb74fb1a013c9fa0d118467 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:57.680787 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea093064eb74fb1a013c9fa0d118467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.681197 11829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea093064eb74fb1a013c9fa0d118467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.682346 11827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32cfea8ce174be884829120b366ba70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.703186 11975 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea093064eb74fb1a013c9fa0d118467 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:57.704634 11975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea093064eb74fb1a013c9fa0d118467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.708094 11825 tablet_service.cc:1511] Processing CreateTablet for tablet 4c74977eed834b49a76e6733937c021e (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:57.709511 11825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c74977eed834b49a76e6733937c021e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.723498 11902 tablet_service.cc:1511] Processing CreateTablet for tablet 4c74977eed834b49a76e6733937c021e (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:57.724932 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c74977eed834b49a76e6733937c021e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.725235 11978 tablet_service.cc:1511] Processing CreateTablet for tablet 4c74977eed834b49a76e6733937c021e (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:57.726627 11978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c74977eed834b49a76e6733937c021e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.727752 11824 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa70a3d7c4e4b0390a657983f61c445 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:57.729112 11824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa70a3d7c4e4b0390a657983f61c445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.729660 11904 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa70a3d7c4e4b0390a657983f61c445 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:57.730950 11904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa70a3d7c4e4b0390a657983f61c445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.763767 11973 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa70a3d7c4e4b0390a657983f61c445 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:57.774214 11973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa70a3d7c4e4b0390a657983f61c445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.784165 11829 tablet_service.cc:1511] Processing CreateTablet for tablet 03751ad4dbde47399f596261a203b83b (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:57.785425 12130 tablet_bootstrap.cc:492] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:57.785739 11829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03751ad4dbde47399f596261a203b83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.788968 11974 tablet_service.cc:1511] Processing CreateTablet for tablet 03751ad4dbde47399f596261a203b83b (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:57.794349 11976 tablet_service.cc:1511] Processing CreateTablet for tablet de75bb8a79814bdaa27b558ba26f8067 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:57.796449 11972 tablet_service.cc:1511] Processing CreateTablet for tablet 475494752d0a4a8195941179b92404b2 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:57.796603 11823 tablet_service.cc:1511] Processing CreateTablet for tablet 475494752d0a4a8195941179b92404b2 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:57.796721 11904 tablet_service.cc:1511] Processing CreateTablet for tablet de75bb8a79814bdaa27b558ba26f8067 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:57.797988 11974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03751ad4dbde47399f596261a203b83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.798029 11904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de75bb8a79814bdaa27b558ba26f8067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.799365 11823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475494752d0a4a8195941179b92404b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.799892 11972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475494752d0a4a8195941179b92404b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.803581 11901 tablet_service.cc:1511] Processing CreateTablet for tablet 475494752d0a4a8195941179b92404b2 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:57.801129 11903 tablet_service.cc:1511] Processing CreateTablet for tablet 03751ad4dbde47399f596261a203b83b (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:57.810390 11976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de75bb8a79814bdaa27b558ba26f8067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.813799 11903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03751ad4dbde47399f596261a203b83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.811350 11828 tablet_service.cc:1511] Processing CreateTablet for tablet de75bb8a79814bdaa27b558ba26f8067 (DEFAULT_TABLE table=soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:57.822643 11828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de75bb8a79814bdaa27b558ba26f8067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.824879 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475494752d0a4a8195941179b92404b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.837447 12132 tablet_bootstrap.cc:492] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:57.842792 12131 tablet_bootstrap.cc:492] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
W20260709 13:02:57.816249 11877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:44253, user_credentials={real_user=slave}} blocked reactor thread for 58651us
I20260709 13:02:57.854930 12132 tablet_bootstrap.cc:654] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.865360 12131 tablet_bootstrap.cc:654] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.867738 12130 tablet_bootstrap.cc:654] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.872576 12131 tablet_bootstrap.cc:492] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:57.873226 12131 ts_tablet_manager.cc:1403] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.004s
I20260709 13:02:57.877959 12132 tablet_bootstrap.cc:492] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:57.878552 12132 ts_tablet_manager.cc:1403] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.007s
I20260709 13:02:57.881644 12132 raft_consensus.cc:359] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.882440 12132 raft_consensus.cc:385] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.882771 12132 raft_consensus.cc:740] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.883499 12132 consensus_queue.cc:260] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.884186 12130 tablet_bootstrap.cc:492] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:57.884872 12130 ts_tablet_manager.cc:1403] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.100s	user 0.007s	sys 0.006s
I20260709 13:02:57.885883 12132 ts_tablet_manager.cc:1434] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:02:57.886967 12132 tablet_bootstrap.cc:492] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:57.888108 12131 raft_consensus.cc:359] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.888885 12131 raft_consensus.cc:385] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.889159 12131 raft_consensus.cc:740] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.889869 12131 consensus_queue.cc:260] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.892319 12131 ts_tablet_manager.cc:1434] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:02:57.893697 12132 tablet_bootstrap.cc:654] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.893868 12130 raft_consensus.cc:359] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.894698 12130 raft_consensus.cc:385] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.894929 12131 tablet_bootstrap.cc:492] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:57.895001 12130 raft_consensus.cc:740] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.900966 12130 consensus_queue.cc:260] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.903656 12130 ts_tablet_manager.cc:1434] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:02:57.904632 12130 tablet_bootstrap.cc:492] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:57.907564 12131 tablet_bootstrap.cc:654] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.920403 12130 tablet_bootstrap.cc:654] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.927258 12131 tablet_bootstrap.cc:492] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:57.927281 12132 tablet_bootstrap.cc:492] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:57.927896 12131 ts_tablet_manager.cc:1403] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.013s
I20260709 13:02:57.927928 12132 ts_tablet_manager.cc:1403] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.023s
I20260709 13:02:57.928503 12130 tablet_bootstrap.cc:492] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:57.929040 12130 ts_tablet_manager.cc:1403] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 13:02:57.931212 12131 raft_consensus.cc:359] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.932004 12131 raft_consensus.cc:385] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.931552 12132 raft_consensus.cc:359] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.931594 12130 raft_consensus.cc:359] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.932359 12131 raft_consensus.cc:740] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.932467 12132 raft_consensus.cc:385] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.932621 12130 raft_consensus.cc:385] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.932878 12132 raft_consensus.cc:740] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.933070 12130 raft_consensus.cc:740] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.933276 12131 consensus_queue.cc:260] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.933796 12132 consensus_queue.cc:260] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.933933 12130 consensus_queue.cc:260] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.935932 12131 ts_tablet_manager.cc:1434] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.006s
I20260709 13:02:57.936875 12130 ts_tablet_manager.cc:1434] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:02:57.937062 12131 tablet_bootstrap.cc:492] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:57.938082 12130 tablet_bootstrap.cc:492] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:57.938453 12132 ts_tablet_manager.cc:1434] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:02:57.939509 12132 tablet_bootstrap.cc:492] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:57.944671 12131 tablet_bootstrap.cc:654] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.945948 12132 tablet_bootstrap.cc:654] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.953096 12130 tablet_bootstrap.cc:654] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:57.953740 11940 tablet.cc:2406] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:57.967881 12131 tablet_bootstrap.cc:492] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:57.968569 12131 ts_tablet_manager.cc:1403] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.013s
I20260709 13:02:57.969599 12130 tablet_bootstrap.cc:492] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:57.967881 12132 tablet_bootstrap.cc:492] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:57.970201 12130 ts_tablet_manager.cc:1403] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.010s
I20260709 13:02:57.970862 12132 ts_tablet_manager.cc:1403] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.004s
I20260709 13:02:57.971830 12131 raft_consensus.cc:359] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.972627 12131 raft_consensus.cc:385] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.972929 12131 raft_consensus.cc:740] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.973472 12130 raft_consensus.cc:359] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.973690 12131 consensus_queue.cc:260] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.974308 12130 raft_consensus.cc:385] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.974642 12130 raft_consensus.cc:740] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.975541 12130 consensus_queue.cc:260] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.976286 12131 ts_tablet_manager.cc:1434] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:57.977249 12132 raft_consensus.cc:359] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.977916 12130 ts_tablet_manager.cc:1434] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:57.978000 12132 raft_consensus.cc:385] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.978554 12132 raft_consensus.cc:740] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.979369 12131 tablet_bootstrap.cc:492] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:57.979283 12132 consensus_queue.cc:260] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.981197 12130 tablet_bootstrap.cc:492] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:57.981873 12132 ts_tablet_manager.cc:1434] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:02:57.982950 12132 tablet_bootstrap.cc:492] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:57.986797 12131 tablet_bootstrap.cc:654] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.987210 12133 raft_consensus.cc:493] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.987761 12133 raft_consensus.cc:515] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:57.988611 12130 tablet_bootstrap.cc:654] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.990626 12132 tablet_bootstrap.cc:654] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.994200 12133 leader_election.cc:290] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.002110 12131 tablet_bootstrap.cc:492] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:57.995956 11838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa70a3d7c4e4b0390a657983f61c445" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:58.002388 12037 raft_consensus.cc:493] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.002780 12131 ts_tablet_manager.cc:1403] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 13:02:57.997872 11986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa70a3d7c4e4b0390a657983f61c445" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:58.002899 12037 raft_consensus.cc:515] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
W20260709 13:02:58.003638 11877 leader_election.cc:343] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:58.004566 11880 leader_election.cc:343] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.005039 11880 leader_election.cc:304] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3; no voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:58.006222 12133 raft_consensus.cc:2749] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:57.998793 12130 tablet_bootstrap.cc:492] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:58.007053 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b21719fd2d245bb91dc364a4f609b79" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:58.007195 12130 ts_tablet_manager.cc:1403] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.007s
I20260709 13:02:58.011677 12130 raft_consensus.cc:359] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.012481 12130 raft_consensus.cc:385] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.012845 12130 raft_consensus.cc:740] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.006513 11838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b21719fd2d245bb91dc364a4f609b79" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:58.013695 12130 consensus_queue.cc:260] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
W20260709 13:02:58.014909 11951 leader_election.cc:343] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.017721 12130 ts_tablet_manager.cc:1434] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:02:58.006356 12131 raft_consensus.cc:359] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.005062 12037 leader_election.cc:290] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:58.018697 12131 raft_consensus.cc:385] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.018936 12130 tablet_bootstrap.cc:492] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:58.019109 12131 raft_consensus.cc:740] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
W20260709 13:02:58.019795 11951 leader_election.cc:343] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.020318 11951 leader_election.cc:304] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5; no voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:58.020164 12131 consensus_queue.cc:260] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.018970 12037 raft_consensus.cc:493] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.028972 12130 tablet_bootstrap.cc:654] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.038895 12037 raft_consensus.cc:515] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.045034 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dab636400e4f79af30715dd97d842d" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:58.045878 11914 raft_consensus.cc:2468] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 0.
I20260709 13:02:58.047406 11951 leader_election.cc:304] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: 
I20260709 13:02:58.041723 12037 leader_election.cc:290] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:58.053421 12037 raft_consensus.cc:2749] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:58.057662 12037 raft_consensus.cc:2804] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.058189 12037 raft_consensus.cc:493] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.059067 12037 raft_consensus.cc:3060] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.075990 12037 raft_consensus.cc:515] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.080721 12149 raft_consensus.cc:493] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.081643 12149 raft_consensus.cc:515] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.088685 12132 tablet_bootstrap.cc:492] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:58.089267 12132 ts_tablet_manager.cc:1403] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.107s	user 0.008s	sys 0.003s
I20260709 13:02:58.093016 12130 tablet_bootstrap.cc:492] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:58.093643 12130 ts_tablet_manager.cc:1403] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.075s	user 0.025s	sys 0.026s
I20260709 13:02:58.093513 12132 raft_consensus.cc:359] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.094038 12149 leader_election.cc:290] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:58.094452 12132 raft_consensus.cc:385] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.094821 12132 raft_consensus.cc:740] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.095620 12132 consensus_queue.cc:260] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.096758 12037 leader_election.cc:290] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:58.097404 12130 raft_consensus.cc:359] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.097975 12132 ts_tablet_manager.cc:1434] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 13:02:58.098253 12130 raft_consensus.cc:385] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.098569 12130 raft_consensus.cc:740] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.099259 12132 tablet_bootstrap.cc:492] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:58.099296 12131 ts_tablet_manager.cc:1434] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.031s
I20260709 13:02:58.099306 12130 consensus_queue.cc:260] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.102185 12130 ts_tablet_manager.cc:1434] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.003s
I20260709 13:02:58.103966 12131 tablet_bootstrap.cc:492] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:58.103281 12130 tablet_bootstrap.cc:492] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:58.113586 12131 tablet_bootstrap.cc:654] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.113586 12130 tablet_bootstrap.cc:654] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.114971 12132 tablet_bootstrap.cc:654] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.124982 12130 tablet_bootstrap.cc:492] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:58.125510 12130 ts_tablet_manager.cc:1403] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.011s
I20260709 13:02:58.127828 12131 tablet_bootstrap.cc:492] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:58.128450 12131 ts_tablet_manager.cc:1403] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.005s
I20260709 13:02:58.128494 12130 raft_consensus.cc:359] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.129369 12130 raft_consensus.cc:385] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.129660 12130 raft_consensus.cc:740] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.130470 12130 consensus_queue.cc:260] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.132037 12131 raft_consensus.cc:359] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.132894 12130 ts_tablet_manager.cc:1434] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:58.132915 12131 raft_consensus.cc:385] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.133564 12131 raft_consensus.cc:740] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.134159 12130 tablet_bootstrap.cc:492] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:58.134423 12131 consensus_queue.cc:260] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.137341 12131 ts_tablet_manager.cc:1434] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:58.138624 12131 tablet_bootstrap.cc:492] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:58.144605 12130 tablet_bootstrap.cc:654] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.146839 12131 tablet_bootstrap.cc:654] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.149957 11838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dab636400e4f79af30715dd97d842d" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:58.151108 11838 raft_consensus.cc:2468] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 0.
I20260709 13:02:58.153301 12119 raft_consensus.cc:493] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.154157 12119 raft_consensus.cc:515] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.158021 11839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32cfea8ce174be884829120b366ba70" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:58.158813 12130 tablet_bootstrap.cc:492] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:58.159072 11839 raft_consensus.cc:2468] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 0.
I20260709 13:02:58.159631 12130 ts_tablet_manager.cc:1403] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.011s
I20260709 13:02:58.163880 12130 raft_consensus.cc:359] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.164844 12130 raft_consensus.cc:385] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.165232 12130 raft_consensus.cc:740] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.166924 11837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dab636400e4f79af30715dd97d842d" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:58.167930 11837 raft_consensus.cc:3060] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.171391 12130 consensus_queue.cc:260] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.173118 12131 tablet_bootstrap.cc:492] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:58.173784 12131 ts_tablet_manager.cc:1403] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.018s
I20260709 13:02:58.174015 12130 ts_tablet_manager.cc:1434] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 13:02:58.179639 12119 leader_election.cc:290] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.241129 11913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32cfea8ce174be884829120b366ba70" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:58.241555 11912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dab636400e4f79af30715dd97d842d" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:58.241880 11913 raft_consensus.cc:2468] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 0.
I20260709 13:02:58.242259 11912 raft_consensus.cc:3060] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.246147 11837 raft_consensus.cc:2468] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 1.
I20260709 13:02:58.249737 12133 raft_consensus.cc:493] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.250310 12133 raft_consensus.cc:515] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.252326 12133 leader_election.cc:290] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.252568 11912 raft_consensus.cc:2468] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 1.
I20260709 13:02:58.254211 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b21719fd2d245bb91dc364a4f609b79" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:58.254621 12133 raft_consensus.cc:493] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.255023 11988 raft_consensus.cc:2468] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 0.
I20260709 13:02:58.255174 12133 raft_consensus.cc:515] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.256472 11880 leader_election.cc:304] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: 
I20260709 13:02:58.257761 12133 leader_election.cc:290] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.258347 12133 raft_consensus.cc:2804] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.258651 12133 raft_consensus.cc:493] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.258864 12133 raft_consensus.cc:3060] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.258812 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea093064eb74fb1a013c9fa0d118467" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:58.259485 11951 leader_election.cc:304] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: 
W20260709 13:02:58.260272 11880 leader_election.cc:343] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.260432 11951 leader_election.cc:304] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: 
I20260709 13:02:58.261339 12147 raft_consensus.cc:2804] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.261662 12147 raft_consensus.cc:493] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.261977 12147 raft_consensus.cc:3060] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.261857 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea093064eb74fb1a013c9fa0d118467" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
W20260709 13:02:58.264281 11805 leader_election.cc:343] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.266885 12133 raft_consensus.cc:515] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.268647 12133 leader_election.cc:290] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.268869 12147 raft_consensus.cc:515] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.271042 12147 leader_election.cc:290] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:58.271600 12147 raft_consensus.cc:2804] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.272146 12147 raft_consensus.cc:697] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Becoming Leader. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Running, Role: LEADER
I20260709 13:02:58.271382 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b21719fd2d245bb91dc364a4f609b79" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:58.273051 11837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32cfea8ce174be884829120b366ba70" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:58.273005 12147 consensus_queue.cc:237] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.273969 11837 raft_consensus.cc:3060] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.272957 11988 raft_consensus.cc:3060] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.281634 11837 raft_consensus.cc:2468] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 1.
I20260709 13:02:58.282266 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32cfea8ce174be884829120b366ba70" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:58.282701 12132 tablet_bootstrap.cc:492] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:58.282953 11914 raft_consensus.cc:3060] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.283339 12132 ts_tablet_manager.cc:1403] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.184s	user 0.037s	sys 0.036s
I20260709 13:02:58.286569 11951 leader_election.cc:304] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:58.287861 11912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea093064eb74fb1a013c9fa0d118467" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:58.288219 12037 raft_consensus.cc:2804] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.288543 11912 raft_consensus.cc:2468] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 0.
I20260709 13:02:58.288805 12037 raft_consensus.cc:697] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Becoming Leader. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Running, Role: LEADER
I20260709 13:02:58.286505 12132 raft_consensus.cc:359] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.285705 12131 raft_consensus.cc:359] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.289798 11802 leader_election.cc:304] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: a4da76bc1235497d8b166fba4921f9d5
I20260709 13:02:58.289718 12037 consensus_queue.cc:237] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.290853 12155 raft_consensus.cc:2804] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.291255 12155 raft_consensus.cc:493] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.291672 12155 raft_consensus.cc:3060] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.290159 12131 raft_consensus.cc:385] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.298414 12131 raft_consensus.cc:740] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.299767 12131 consensus_queue.cc:260] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.303156 12131 ts_tablet_manager.cc:1434] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.129s	user 0.009s	sys 0.002s
I20260709 13:02:58.304165 12131 tablet_bootstrap.cc:492] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:58.312520 11914 raft_consensus.cc:2468] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 1.
I20260709 13:02:58.313005 12155 raft_consensus.cc:515] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.313730 12130 tablet_bootstrap.cc:492] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
I20260709 13:02:58.316253 12132 raft_consensus.cc:385] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.319557 12132 raft_consensus.cc:740] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.320384 12132 consensus_queue.cc:260] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.323817 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea093064eb74fb1a013c9fa0d118467" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:58.324525 11914 raft_consensus.cc:3060] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.322705 12132 ts_tablet_manager.cc:1434] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.004s
I20260709 13:02:58.327592 12155 leader_election.cc:290] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.332834 12130 tablet_bootstrap.cc:654] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.334357 12132 tablet_bootstrap.cc:492] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:58.332086 12131 tablet_bootstrap.cc:654] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.339323 11988 raft_consensus.cc:2468] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 1.
I20260709 13:02:58.342684 11880 leader_election.cc:304] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: 
I20260709 13:02:58.347339 11837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b21719fd2d245bb91dc364a4f609b79" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:58.348929 11914 raft_consensus.cc:2468] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 1.
I20260709 13:02:58.349885 11837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea093064eb74fb1a013c9fa0d118467" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:58.350417 11802 leader_election.cc:304] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:58.350736 11837 raft_consensus.cc:2393] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in current term 1: Already voted for candidate b71b457f537044f1b8d7755d14e40cf4 in this term.
I20260709 13:02:58.347354 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea093064eb74fb1a013c9fa0d118467" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:58.349373 12159 raft_consensus.cc:2804] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.351989 12159 raft_consensus.cc:697] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 LEADER]: Becoming Leader. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Running, Role: LEADER
I20260709 13:02:58.353513 12159 consensus_queue.cc:237] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.354378 12156 raft_consensus.cc:2804] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.354920 12156 raft_consensus.cc:697] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Becoming Leader. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
W20260709 13:02:58.356004 11877 leader_election.cc:343] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.355684 12156 consensus_queue.cc:237] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.356169 12130 tablet_bootstrap.cc:492] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:58.357753 11737 catalog_manager.cc:5697] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a4da76bc1235497d8b166fba4921f9d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.358875 12130 ts_tablet_manager.cc:1403] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.184s	user 0.012s	sys 0.004s
I20260709 13:02:58.351951 12037 raft_consensus.cc:493] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.361320 11737 catalog_manager.cc:5697] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a4da76bc1235497d8b166fba4921f9d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:58.363538 11805 leader_election.cc:343] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.364794 12131 tablet_bootstrap.cc:492] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:58.361982 12037 raft_consensus.cc:515] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.367406 11837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b21719fd2d245bb91dc364a4f609b79" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:58.370324 12131 ts_tablet_manager.cc:1403] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.066s	user 0.007s	sys 0.006s
I20260709 13:02:58.369560 12130 raft_consensus.cc:359] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.371564 12130 raft_consensus.cc:385] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.371884 12130 raft_consensus.cc:740] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.372231 11836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03751ad4dbde47399f596261a203b83b" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:58.372537 12130 consensus_queue.cc:260] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.374493 11877 leader_election.cc:304] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3; no voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:58.375110 12037 leader_election.cc:290] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:58.374744 12131 raft_consensus.cc:359] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
W20260709 13:02:58.374529 11951 leader_election.cc:343] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.374671 12130 ts_tablet_manager.cc:1434] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:02:58.498807 12131 raft_consensus.cc:385] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.499816 12131 raft_consensus.cc:740] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.500718 12131 consensus_queue.cc:260] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
W20260709 13:02:58.499248 12120 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.0.107.254:43639, user_credentials={real_user=slave}} blocked reactor thread for 108025us
I20260709 13:02:58.499404 12130 tablet_bootstrap.cc:492] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3: Bootstrap starting.
W20260709 13:02:58.502698 11877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:44253, user_credentials={real_user=slave}} blocked reactor thread for 128288us
I20260709 13:02:58.454816 12147 raft_consensus.cc:493] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.378854 12057 raft_consensus.cc:2749] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:58.503510 12147 raft_consensus.cc:515] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.505473 12131 ts_tablet_manager.cc:1434] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.135s	user 0.019s	sys 0.017s
I20260709 13:02:58.505693 12147 leader_election.cc:290] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:58.474947 12155 raft_consensus.cc:493] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.507493 12132 tablet_bootstrap.cc:654] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.511073 12155 raft_consensus.cc:515] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.511746 12131 tablet_bootstrap.cc:492] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:58.513815 12155 leader_election.cc:290] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
W20260709 13:02:58.510226 11951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:44253, user_credentials={real_user=slave}} blocked reactor thread for 135854us
W20260709 13:02:58.509368 11877 leader_election.cc:343] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.512794 11736 catalog_manager.cc:5697] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b71b457f537044f1b8d7755d14e40cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.515714 11836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75bb8a79814bdaa27b558ba26f8067" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:58.516175 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa70a3d7c4e4b0390a657983f61c445" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:58.516827 11914 raft_consensus.cc:2468] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 0.
I20260709 13:02:58.519688 11985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa70a3d7c4e4b0390a657983f61c445" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
W20260709 13:02:58.522480 11805 leader_election.cc:343] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:58.523614 11951 leader_election.cc:343] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.525619 12130 tablet_bootstrap.cc:654] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.396800 12133 raft_consensus.cc:493] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.529366 12155 raft_consensus.cc:493] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.530143 12155 raft_consensus.cc:515] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.532418 12155 leader_election.cc:290] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.530110 12133 raft_consensus.cc:515] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.533998 12131 tablet_bootstrap.cc:654] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.535727 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03751ad4dbde47399f596261a203b83b" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:58.535888 12133 leader_election.cc:290] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.534284 11985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c74977eed834b49a76e6733937c021e" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:58.536796 11836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75bb8a79814bdaa27b558ba26f8067" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:58.537005 11985 raft_consensus.cc:2468] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 0.
W20260709 13:02:58.538406 11877 leader_election.cc:343] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.538785 11805 leader_election.cc:304] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:58.540963 12155 raft_consensus.cc:2804] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.541554 12155 raft_consensus.cc:493] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.541882 12155 raft_consensus.cc:3060] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.542138 11802 leader_election.cc:304] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: a4da76bc1235497d8b166fba4921f9d5
I20260709 13:02:58.543565 12156 raft_consensus.cc:2804] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.543923 12156 raft_consensus.cc:493] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.544220 12156 raft_consensus.cc:3060] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.549342 12155 raft_consensus.cc:515] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.550984 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75bb8a79814bdaa27b558ba26f8067" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:58.551684 11914 raft_consensus.cc:2468] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 0.
I20260709 13:02:58.552397 12155 leader_election.cc:290] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.553076 11985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c74977eed834b49a76e6733937c021e" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:58.555641 11985 raft_consensus.cc:3060] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.554953 11912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c74977eed834b49a76e6733937c021e" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:58.557327 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75bb8a79814bdaa27b558ba26f8067" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:58.558498 11912 raft_consensus.cc:2468] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 0.
I20260709 13:02:58.559077 11988 raft_consensus.cc:2468] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 0.
I20260709 13:02:58.561337 12159 raft_consensus.cc:493] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.561102 12156 raft_consensus.cc:515] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.561831 12159 raft_consensus.cc:515] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
W20260709 13:02:58.564322 11951 leader_election.cc:343] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.564697 11836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475494752d0a4a8195941179b92404b2" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:58.564781 11951 leader_election.cc:304] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5; no voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:58.566112 12147 raft_consensus.cc:2749] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:58.566398 11877 leader_election.cc:343] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.567415 12159 leader_election.cc:290] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.567868 11951 leader_election.cc:304] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:58.568636 12147 raft_consensus.cc:2804] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.569002 12147 raft_consensus.cc:493] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.569355 12147 raft_consensus.cc:3060] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.570830 11912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa70a3d7c4e4b0390a657983f61c445" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:58.570951 11987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475494752d0a4a8195941179b92404b2" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:58.571462 11912 raft_consensus.cc:3060] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.577885 12147 raft_consensus.cc:515] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
W20260709 13:02:58.578598 11880 leader_election.cc:343] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.579113 11880 leader_election.cc:304] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3; no voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:58.580250 12147 leader_election.cc:290] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:58.581293 11836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75bb8a79814bdaa27b558ba26f8067" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:58.582259 12159 raft_consensus.cc:2749] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:58.582661 11951 leader_election.cc:343] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.583582 11912 raft_consensus.cc:2468] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 1.
I20260709 13:02:58.584614 11802 leader_election.cc:304] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:58.586934 12155 raft_consensus.cc:2804] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.558938 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c74977eed834b49a76e6733937c021e" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:58.605993 12155 raft_consensus.cc:697] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Becoming Leader. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:58.606925 12155 consensus_queue.cc:237] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.607338 12131 tablet_bootstrap.cc:492] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:58.607985 12131 ts_tablet_manager.cc:1403] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.097s	user 0.014s	sys 0.003s
I20260709 13:02:58.610707 12131 raft_consensus.cc:359] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.611445 12131 raft_consensus.cc:385] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.610531 11914 raft_consensus.cc:3060] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.611722 12131 raft_consensus.cc:740] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.612692 12131 consensus_queue.cc:260] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.615377 12131 ts_tablet_manager.cc:1434] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:58.616367 12131 tablet_bootstrap.cc:492] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5: Bootstrap starting.
I20260709 13:02:58.616891 12130 tablet_bootstrap.cc:492] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3: No bootstrap required, opened a new log
I20260709 13:02:58.617408 12130 ts_tablet_manager.cc:1403] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.006s
I20260709 13:02:58.617486 12156 leader_election.cc:290] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.618180 11880 leader_election.cc:304] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:58.618496 11912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75bb8a79814bdaa27b558ba26f8067" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:58.619127 11912 raft_consensus.cc:3060] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.620265 12130 raft_consensus.cc:359] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.621107 12130 raft_consensus.cc:385] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.621466 12130 raft_consensus.cc:740] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.623380 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa70a3d7c4e4b0390a657983f61c445" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:58.617066 11985 raft_consensus.cc:2468] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 1.
I20260709 13:02:58.622354 12130 consensus_queue.cc:260] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.625332 12131 tablet_bootstrap.cc:654] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:58.627094 11805 leader_election.cc:343] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.630867 12130 ts_tablet_manager.cc:1434] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:02:58.631652 11914 raft_consensus.cc:2468] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 1.
I20260709 13:02:58.633261 11802 leader_election.cc:304] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:58.634444 11912 raft_consensus.cc:2468] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 1.
I20260709 13:02:58.635543 12159 raft_consensus.cc:2764] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:02:58.638670 11951 leader_election.cc:304] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:58.639991 12147 raft_consensus.cc:2804] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.640508 12147 raft_consensus.cc:697] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Becoming Leader. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Running, Role: LEADER
I20260709 13:02:58.636246 12156 raft_consensus.cc:2804] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.641986 12156 raft_consensus.cc:697] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Becoming Leader. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:58.641775 12147 consensus_queue.cc:237] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.645946 12132 tablet_bootstrap.cc:492] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:58.646724 12132 ts_tablet_manager.cc:1403] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.313s	user 0.045s	sys 0.046s
I20260709 13:02:58.643293 12156 consensus_queue.cc:237] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.648460 11734 catalog_manager.cc:5697] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.654780 12132 raft_consensus.cc:359] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.655418 12132 raft_consensus.cc:385] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.655689 12132 raft_consensus.cc:740] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.656376 12132 consensus_queue.cc:260] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.658241 12131 tablet_bootstrap.cc:492] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5: No bootstrap required, opened a new log
I20260709 13:02:58.658785 12131 ts_tablet_manager.cc:1403] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.010s
I20260709 13:02:58.658864 12132 ts_tablet_manager.cc:1434] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:02:58.659786 12132 tablet_bootstrap.cc:492] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:58.661878 12131 raft_consensus.cc:359] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.662739 12131 raft_consensus.cc:385] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.663059 12131 raft_consensus.cc:740] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.663870 12131 consensus_queue.cc:260] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.666865 12131 ts_tablet_manager.cc:1434] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:58.672106 11736 catalog_manager.cc:5697] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b71b457f537044f1b8d7755d14e40cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.678355 12132 tablet_bootstrap.cc:654] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.683557 12159 raft_consensus.cc:493] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.684121 12159 raft_consensus.cc:515] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.684681 12132 tablet_bootstrap.cc:492] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:58.685246 12132 ts_tablet_manager.cc:1403] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.002s
I20260709 13:02:58.685400 11734 catalog_manager.cc:5697] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "a4da76bc1235497d8b166fba4921f9d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.686339 12159 leader_election.cc:290] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.688190 12132 raft_consensus.cc:359] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.688737 11836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03751ad4dbde47399f596261a203b83b" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:58.688943 12132 raft_consensus.cc:385] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.689298 12132 raft_consensus.cc:740] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.689815 11985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03751ad4dbde47399f596261a203b83b" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
W20260709 13:02:58.689980 11877 leader_election.cc:343] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.690497 11985 raft_consensus.cc:2468] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 0.
I20260709 13:02:58.690011 12132 consensus_queue.cc:260] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.691614 11880 leader_election.cc:304] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: b71b457f537044f1b8d7755d14e40cf4
W20260709 13:02:58.692428 11785 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:58.692648 12132 ts_tablet_manager.cc:1434] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:02:58.692994 12159 raft_consensus.cc:2804] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.693387 12159 raft_consensus.cc:493] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.693742 12159 raft_consensus.cc:3060] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.693784 12132 tablet_bootstrap.cc:492] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:58.697332 11736 catalog_manager.cc:5697] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b71b457f537044f1b8d7755d14e40cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.700677 12132 tablet_bootstrap.cc:654] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.703648 12159 raft_consensus.cc:515] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.705370 12132 tablet_bootstrap.cc:492] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:58.705861 12132 ts_tablet_manager.cc:1403] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:02:58.706670 11836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03751ad4dbde47399f596261a203b83b" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:58.706882 11985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03751ad4dbde47399f596261a203b83b" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:58.707522 11985 raft_consensus.cc:3060] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:58.708133 11877 leader_election.cc:343] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.708492 12132 raft_consensus.cc:359] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.709111 12132 raft_consensus.cc:385] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.709358 12132 raft_consensus.cc:740] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.709964 12132 consensus_queue.cc:260] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.712164 12132 ts_tablet_manager.cc:1434] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:58.713117 12132 tablet_bootstrap.cc:492] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4: Bootstrap starting.
I20260709 13:02:58.713582 11985 raft_consensus.cc:2468] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 1.
I20260709 13:02:58.714422 12159 leader_election.cc:290] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.714893 11880 leader_election.cc:304] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:58.715598 12159 raft_consensus.cc:2804] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.716259 12159 raft_consensus.cc:697] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 LEADER]: Becoming Leader. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Running, Role: LEADER
I20260709 13:02:58.716912 12159 consensus_queue.cc:237] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.719235 12132 tablet_bootstrap.cc:654] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.731992 12132 tablet_bootstrap.cc:492] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4: No bootstrap required, opened a new log
I20260709 13:02:58.732462 12132 ts_tablet_manager.cc:1403] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:02:58.734282 11736 catalog_manager.cc:5697] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.734560 12132 raft_consensus.cc:359] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.735273 12132 raft_consensus.cc:385] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.735548 12132 raft_consensus.cc:740] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.736214 12132 consensus_queue.cc:260] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.737908 12132 ts_tablet_manager.cc:1434] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:58.762210 12156 raft_consensus.cc:493] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.762748 12156 raft_consensus.cc:515] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.764822 12156 leader_election.cc:290] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.765552 11912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b21719fd2d245bb91dc364a4f609b79" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:58.766116 11985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b21719fd2d245bb91dc364a4f609b79" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:58.766873 11985 raft_consensus.cc:2393] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b71b457f537044f1b8d7755d14e40cf4 in current term 1: Already voted for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in this term.
I20260709 13:02:58.767807 12147 raft_consensus.cc:493] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.767681 11805 leader_election.cc:304] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b71b457f537044f1b8d7755d14e40cf4; no voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5
I20260709 13:02:58.768652 12156 raft_consensus.cc:3060] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.768389 12147 raft_consensus.cc:515] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.770520 12147 leader_election.cc:290] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:58.771173 11836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea093064eb74fb1a013c9fa0d118467" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:58.772117 11912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea093064eb74fb1a013c9fa0d118467" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:58.773054 11912 raft_consensus.cc:2393] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4da76bc1235497d8b166fba4921f9d5 in current term 1: Already voted for candidate b71b457f537044f1b8d7755d14e40cf4 in this term.
I20260709 13:02:58.773957 11951 leader_election.cc:304] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5; no voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:58.774682 12147 raft_consensus.cc:3060] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.776026 12156 raft_consensus.cc:2749] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:58.780365 12147 raft_consensus.cc:2749] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:58.780910 12037 consensus_queue.cc:1048] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.794242 12037 consensus_queue.cc:1048] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.803416 12037 consensus_queue.cc:1048] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.807549 12037 raft_consensus.cc:493] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.808063 12037 raft_consensus.cc:515] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.808946 12156 raft_consensus.cc:493] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.809501 12156 raft_consensus.cc:515] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.810194 12037 leader_election.cc:290] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:58.811578 12156 leader_election.cc:290] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.812387 11912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75bb8a79814bdaa27b558ba26f8067" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:58.813198 11912 raft_consensus.cc:2393] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b71b457f537044f1b8d7755d14e40cf4 in current term 1: Already voted for candidate a4da76bc1235497d8b166fba4921f9d5 in this term.
I20260709 13:02:58.813457 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa70a3d7c4e4b0390a657983f61c445" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:58.814275 11914 raft_consensus.cc:2393] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4da76bc1235497d8b166fba4921f9d5 in current term 1: Already voted for candidate b71b457f537044f1b8d7755d14e40cf4 in this term.
I20260709 13:02:58.815615 11836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa70a3d7c4e4b0390a657983f61c445" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b71b457f537044f1b8d7755d14e40cf4" is_pre_election: true
I20260709 13:02:58.816375 11985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75bb8a79814bdaa27b558ba26f8067" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:58.817063 11951 leader_election.cc:304] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5; no voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:58.818324 12037 raft_consensus.cc:3060] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.819149 11805 leader_election.cc:304] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b71b457f537044f1b8d7755d14e40cf4; no voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5
I20260709 13:02:58.819871 12156 raft_consensus.cc:3060] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.825325 12156 raft_consensus.cc:2749] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:58.828013 12037 raft_consensus.cc:2749] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:58.836089 12147 consensus_queue.cc:1048] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.859964 12156 consensus_queue.cc:1048] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.874014 12165 consensus_queue.cc:1048] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:58.874732 12119 consensus_queue.cc:1048] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.890147 12133 consensus_queue.cc:1048] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.916966 12119 raft_consensus.cc:493] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.917469 12119 raft_consensus.cc:515] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.919303 12119 leader_election.cc:290] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.920143 11912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475494752d0a4a8195941179b92404b2" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:58.920441 11985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475494752d0a4a8195941179b92404b2" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:58.920876 11912 raft_consensus.cc:2468] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 0.
I20260709 13:02:58.921165 11985 raft_consensus.cc:2468] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 0.
I20260709 13:02:58.922031 11802 leader_election.cc:304] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:58.922894 12119 raft_consensus.cc:2804] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.923251 12119 raft_consensus.cc:493] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.923522 12119 raft_consensus.cc:3060] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.928779 12119 raft_consensus.cc:515] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.930940 12119 leader_election.cc:290] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:58.931293 11912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475494752d0a4a8195941179b92404b2" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:58.931689 11985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475494752d0a4a8195941179b92404b2" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:58.931967 11912 raft_consensus.cc:3060] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.932330 11985 raft_consensus.cc:3060] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.937402 11912 raft_consensus.cc:2468] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 1.
I20260709 13:02:58.937794 11985 raft_consensus.cc:2468] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 1.
I20260709 13:02:58.938521 11802 leader_election.cc:304] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:58.939267 12119 raft_consensus.cc:2804] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.939648 12119 raft_consensus.cc:697] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Becoming Leader. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:58.940387 12119 consensus_queue.cc:237] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:58.947520 11736 catalog_manager.cc:5697] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b71b457f537044f1b8d7755d14e40cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.991303 12119 consensus_queue.cc:1048] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:59.003247 12156 consensus_queue.cc:1048] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:59.010524 12156 raft_consensus.cc:493] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.011013 12156 raft_consensus.cc:515] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.013374 12156 leader_election.cc:290] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:59.014147 11912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03751ad4dbde47399f596261a203b83b" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" is_pre_election: true
I20260709 13:02:59.014827 11985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03751ad4dbde47399f596261a203b83b" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4da76bc1235497d8b166fba4921f9d5" is_pre_election: true
I20260709 13:02:59.015656 11985 raft_consensus.cc:2393] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b71b457f537044f1b8d7755d14e40cf4 in current term 1: Already voted for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in this term.
I20260709 13:02:59.016656 11805 leader_election.cc:304] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b71b457f537044f1b8d7755d14e40cf4; no voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5
I20260709 13:02:59.017325 12156 raft_consensus.cc:3060] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:59.022547 12156 raft_consensus.cc:2749] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:59.070724 12187 consensus_queue.cc:1048] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:59.082095 12187 consensus_queue.cc:1048] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:59.084367 11985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8dab636400e4f79af30715dd97d842d"
dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
mode: GRACEFUL
new_leader_uuid: "b71b457f537044f1b8d7755d14e40cf4"
 from {username='slave'} at 127.0.0.1:34532
I20260709 13:02:59.084972 11985 raft_consensus.cc:606] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Received request to transfer leadership to TS b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:59.092865 11912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b21719fd2d245bb91dc364a4f609b79"
dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
mode: GRACEFUL
new_leader_uuid: "b71b457f537044f1b8d7755d14e40cf4"
 from {username='slave'} at 127.0.0.1:42284
I20260709 13:02:59.093466 11912 raft_consensus.cc:606] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 LEADER]: Received request to transfer leadership to TS b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:59.099359 11985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a32cfea8ce174be884829120b366ba70"
dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
mode: GRACEFUL
new_leader_uuid: "b71b457f537044f1b8d7755d14e40cf4"
 from {username='slave'} at 127.0.0.1:34532
I20260709 13:02:59.099956 11985 raft_consensus.cc:606] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Received request to transfer leadership to TS b71b457f537044f1b8d7755d14e40cf4
I20260709 13:02:59.107765 11837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c74977eed834b49a76e6733937c021e"
dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
mode: GRACEFUL
new_leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
 from {username='slave'} at 127.0.0.1:55818
I20260709 13:02:59.108310 11837 raft_consensus.cc:606] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Received request to transfer leadership to TS 9e1c09bf1ea04fa9a443809e4980fdd3
I20260709 13:02:59.113027 11837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fa70a3d7c4e4b0390a657983f61c445"
dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
mode: GRACEFUL
new_leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
 from {username='slave'} at 127.0.0.1:55818
I20260709 13:02:59.113545 11837 raft_consensus.cc:606] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Received request to transfer leadership to TS 9e1c09bf1ea04fa9a443809e4980fdd3
I20260709 13:02:59.120833 11985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de75bb8a79814bdaa27b558ba26f8067"
dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
mode: GRACEFUL
new_leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
 from {username='slave'} at 127.0.0.1:34532
I20260709 13:02:59.121443 11985 raft_consensus.cc:606] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Received request to transfer leadership to TS 9e1c09bf1ea04fa9a443809e4980fdd3
I20260709 13:02:59.126363 11837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "475494752d0a4a8195941179b92404b2"
dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
mode: GRACEFUL
new_leader_uuid: "a4da76bc1235497d8b166fba4921f9d5"
 from {username='slave'} at 127.0.0.1:55818
I20260709 13:02:59.127009 11837 raft_consensus.cc:606] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Received request to transfer leadership to TS a4da76bc1235497d8b166fba4921f9d5
I20260709 13:02:59.163249 12156 consensus_queue.cc:1048] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:59.169858 12155 raft_consensus.cc:993] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4: : Instructing follower 9e1c09bf1ea04fa9a443809e4980fdd3 to start an election
I20260709 13:02:59.170327 12155 raft_consensus.cc:1081] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Signalling peer 9e1c09bf1ea04fa9a443809e4980fdd3 to start an election
I20260709 13:02:59.172384 11914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c74977eed834b49a76e6733937c021e"
dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
 from {username='slave'} at 127.0.0.1:42260
I20260709 13:02:59.173386 11914 raft_consensus.cc:493] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.173763 11914 raft_consensus.cc:3060] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.174675 12119 consensus_queue.cc:1048] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:59.183125 11914 raft_consensus.cc:515] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.185426 11914 leader_election.cc:290] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 2 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:59.187443 11985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c74977eed834b49a76e6733937c021e" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:59.188141 11985 raft_consensus.cc:3060] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:59.190145 11935 debug-util.cc:398] Leaking SignalData structure 0x7b08002bf0a0 after lost signal to thread 434
I20260709 13:02:59.190346 11837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c74977eed834b49a76e6733937c021e" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:59.190970 11837 raft_consensus.cc:3055] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:59.191188 11837 raft_consensus.cc:740] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
W20260709 13:02:59.191308 11935 debug-util.cc:398] Leaking SignalData structure 0x7b08000a32c0 after lost signal to thread 11771
I20260709 13:02:59.191802 11837 consensus_queue.cc:260] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
W20260709 13:02:59.192689 11935 debug-util.cc:398] Leaking SignalData structure 0x7b080027b980 after lost signal to thread 11863
I20260709 13:02:59.192744 11837 raft_consensus.cc:3060] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:59.194020 11935 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4d40 after lost signal to thread 11938
I20260709 13:02:59.194636 11985 raft_consensus.cc:2468] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 2.
W20260709 13:02:59.195226 11935 debug-util.cc:398] Leaking SignalData structure 0x7b0800363ec0 after lost signal to thread 12012
I20260709 13:02:59.195796 11880 leader_election.cc:304] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: 
I20260709 13:02:59.196612 12133 raft_consensus.cc:2804] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:59.197059 12133 raft_consensus.cc:697] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Becoming Leader. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Running, Role: LEADER
I20260709 13:02:59.197872 12133 consensus_queue.cc:237] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.201874 11837 raft_consensus.cc:2468] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 2.
I20260709 13:02:59.207373 11736 catalog_manager.cc:5697] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 reported cstate change: term changed from 1 to 2, leader changed from b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193) to 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.217492 12187 raft_consensus.cc:993] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5: : Instructing follower b71b457f537044f1b8d7755d14e40cf4 to start an election
I20260709 13:02:59.218035 12037 raft_consensus.cc:1081] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Signalling peer b71b457f537044f1b8d7755d14e40cf4 to start an election
I20260709 13:02:59.219622 11837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8dab636400e4f79af30715dd97d842d"
dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
 from {username='slave'} at 127.0.0.1:55802
I20260709 13:02:59.220083 11837 raft_consensus.cc:493] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.220391 11837 raft_consensus.cc:3060] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.227273 11837 raft_consensus.cc:515] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.229730 11837 leader_election.cc:290] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 2 election: Requested vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:59.229872 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dab636400e4f79af30715dd97d842d" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:59.230633 11914 raft_consensus.cc:3060] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.231089 11985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dab636400e4f79af30715dd97d842d" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:59.231546 11985 raft_consensus.cc:3055] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:59.231755 11985 raft_consensus.cc:740] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Running, Role: LEADER
I20260709 13:02:59.232401 11985 consensus_queue.cc:260] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.233413 11985 raft_consensus.cc:3060] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.238561 11914 raft_consensus.cc:2468] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 2.
I20260709 13:02:59.238845 11985 raft_consensus.cc:2468] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 2.
I20260709 13:02:59.239933 11802 leader_election.cc:304] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:59.240816 12156 raft_consensus.cc:2804] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:59.241331 12156 raft_consensus.cc:697] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [term 2 LEADER]: Becoming Leader. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:59.242256 12156 consensus_queue.cc:237] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.245187 12133 consensus_queue.cc:1048] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:59.250036 11736 catalog_manager.cc:5697] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 reported cstate change: term changed from 1 to 2, leader changed from a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195) to b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b71b457f537044f1b8d7755d14e40cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.263972 12133 consensus_queue.cc:1048] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:59.357919 12147 raft_consensus.cc:993] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5: : Instructing follower b71b457f537044f1b8d7755d14e40cf4 to start an election
I20260709 13:02:59.358461 12037 raft_consensus.cc:1081] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Signalling peer b71b457f537044f1b8d7755d14e40cf4 to start an election
I20260709 13:02:59.359838 11837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a32cfea8ce174be884829120b366ba70"
dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
 from {username='slave'} at 127.0.0.1:55802
I20260709 13:02:59.360335 11837 raft_consensus.cc:493] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.360646 11837 raft_consensus.cc:3060] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.366573 11837 raft_consensus.cc:515] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.368911 11837 leader_election.cc:290] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 2 election: Requested vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:59.369423 11914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32cfea8ce174be884829120b366ba70" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:59.369920 11914 raft_consensus.cc:3060] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.370491 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32cfea8ce174be884829120b366ba70" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:59.371080 11988 raft_consensus.cc:3055] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:59.371402 11988 raft_consensus.cc:740] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Running, Role: LEADER
I20260709 13:02:59.372169 11988 consensus_queue.cc:260] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.373354 11988 raft_consensus.cc:3060] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.376422 11914 raft_consensus.cc:2468] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 2.
I20260709 13:02:59.377507 11802 leader_election.cc:304] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:59.378328 12119 raft_consensus.cc:2804] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:59.378870 12119 raft_consensus.cc:697] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [term 2 LEADER]: Becoming Leader. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:59.379751 11988 raft_consensus.cc:2468] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 2.
I20260709 13:02:59.379769 12119 consensus_queue.cc:237] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.388641 11736 catalog_manager.cc:5697] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 reported cstate change: term changed from 1 to 2, leader changed from a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195) to b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b71b457f537044f1b8d7755d14e40cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.416091 12119 consensus_queue.cc:1048] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:59.425479 12119 consensus_queue.cc:1048] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:59.426743 12156 raft_consensus.cc:993] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4: : Instructing follower a4da76bc1235497d8b166fba4921f9d5 to start an election
I20260709 13:02:59.427241 12119 raft_consensus.cc:1081] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Signalling peer a4da76bc1235497d8b166fba4921f9d5 to start an election
I20260709 13:02:59.429289 11987 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "475494752d0a4a8195941179b92404b2"
dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
 from {username='slave'} at 127.0.0.1:34512
I20260709 13:02:59.429868 11987 raft_consensus.cc:493] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.430258 11987 raft_consensus.cc:3060] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.435889 11987 raft_consensus.cc:515] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.437127 11985 raft_consensus.cc:1240] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Rejecting Update request from peer b71b457f537044f1b8d7755d14e40cf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:59.437851 11987 leader_election.cc:290] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 2 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:02:59.440111 11837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475494752d0a4a8195941179b92404b2" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:59.440513 11912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475494752d0a4a8195941179b92404b2" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:59.440735 11837 raft_consensus.cc:3055] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:59.441175 11837 raft_consensus.cc:740] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:59.442210 11837 consensus_queue.cc:260] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.448570 12119 consensus_queue.cc:1059] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:59.449873 11837 raft_consensus.cc:3060] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:59.452639 12203 consensus_queue.cc:1175] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:02:59.457291 11837 raft_consensus.cc:2468] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 2.
I20260709 13:02:59.458379 11951 leader_election.cc:304] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4; no voters: 9e1c09bf1ea04fa9a443809e4980fdd3
I20260709 13:02:59.459250 12037 raft_consensus.cc:2804] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:59.459685 12037 raft_consensus.cc:697] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [term 2 LEADER]: Becoming Leader. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Running, Role: LEADER
I20260709 13:02:59.460516 12037 consensus_queue.cc:237] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.468231 11736 catalog_manager.cc:5697] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 reported cstate change: term changed from 1 to 2, leader changed from b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193) to a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "a4da76bc1235497d8b166fba4921f9d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.494313 12133 raft_consensus.cc:993] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3: : Instructing follower b71b457f537044f1b8d7755d14e40cf4 to start an election
I20260709 13:02:59.494807 12166 raft_consensus.cc:1081] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 LEADER]: Signalling peer b71b457f537044f1b8d7755d14e40cf4 to start an election
I20260709 13:02:59.495388 12187 raft_consensus.cc:993] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5: : Instructing follower 9e1c09bf1ea04fa9a443809e4980fdd3 to start an election
I20260709 13:02:59.495927 12147 raft_consensus.cc:1081] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Signalling peer 9e1c09bf1ea04fa9a443809e4980fdd3 to start an election
I20260709 13:02:59.496564 11837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b21719fd2d245bb91dc364a4f609b79"
dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
 from {username='slave'} at 127.0.0.1:55806
I20260709 13:02:59.497208 11837 raft_consensus.cc:493] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.497583 11837 raft_consensus.cc:3060] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.497750 11914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de75bb8a79814bdaa27b558ba26f8067"
dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
 from {username='slave'} at 127.0.0.1:42274
I20260709 13:02:59.498394 11914 raft_consensus.cc:493] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.498749 11914 raft_consensus.cc:3060] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.503165 12156 raft_consensus.cc:993] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4: : Instructing follower 9e1c09bf1ea04fa9a443809e4980fdd3 to start an election
I20260709 13:02:59.503686 12156 raft_consensus.cc:1081] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Signalling peer 9e1c09bf1ea04fa9a443809e4980fdd3 to start an election
I20260709 13:02:59.505247 11912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fa70a3d7c4e4b0390a657983f61c445"
dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
 from {username='slave'} at 127.0.0.1:42260
I20260709 13:02:59.505847 11912 raft_consensus.cc:493] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:59.506292 11912 raft_consensus.cc:3060] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.505946 11914 raft_consensus.cc:515] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.507539 11837 raft_consensus.cc:515] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.508841 11836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75bb8a79814bdaa27b558ba26f8067" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:59.509559 11836 raft_consensus.cc:3060] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.510555 11837 leader_election.cc:290] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 2 election: Requested vote from peers 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:59.512899 11985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b21719fd2d245bb91dc364a4f609b79" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:59.513473 11985 raft_consensus.cc:3060] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.513677 11913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b21719fd2d245bb91dc364a4f609b79" candidate_uuid: "b71b457f537044f1b8d7755d14e40cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:02:59.514293 11913 raft_consensus.cc:3055] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:59.514593 11913 raft_consensus.cc:740] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Running, Role: LEADER
I20260709 13:02:59.515380 11913 consensus_queue.cc:260] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.515620 11912 raft_consensus.cc:515] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.516706 11913 raft_consensus.cc:3060] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.518839 11987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa70a3d7c4e4b0390a657983f61c445" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:59.519443 11987 raft_consensus.cc:3060] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.519311 11988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75bb8a79814bdaa27b558ba26f8067" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
I20260709 13:02:59.522212 11988 raft_consensus.cc:3055] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:59.522523 11988 raft_consensus.cc:740] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Running, Role: LEADER
I20260709 13:02:59.523262 11988 consensus_queue.cc:260] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.524315 11988 raft_consensus.cc:3060] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.528216 11913 raft_consensus.cc:2468] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 2.
I20260709 13:02:59.508945 11914 leader_election.cc:290] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 2 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:59.529162 11837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa70a3d7c4e4b0390a657983f61c445" candidate_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:02:59.530493 11802 leader_election.cc:304] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:02:59.531113 11837 raft_consensus.cc:3055] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:59.531464 12156 raft_consensus.cc:2804] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:59.532032 12156 raft_consensus.cc:697] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [term 2 LEADER]: Becoming Leader. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:59.532930 12156 consensus_queue.cc:237] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.532907 11987 raft_consensus.cc:2468] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 2.
I20260709 13:02:59.536468 11988 raft_consensus.cc:2468] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 2.
I20260709 13:02:59.536923 11912 leader_election.cc:290] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 2 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195:38599)
I20260709 13:02:59.537626 11880 leader_election.cc:304] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: 
I20260709 13:02:59.538993 11984 raft_consensus.cc:1240] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Rejecting Update request from peer b71b457f537044f1b8d7755d14e40cf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:59.538918 11880 leader_election.cc:304] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: 
I20260709 13:02:59.539201 12166 raft_consensus.cc:2804] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:59.539848 12166 raft_consensus.cc:697] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Becoming Leader. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Running, Role: LEADER
I20260709 13:02:59.539973 12133 raft_consensus.cc:2804] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:59.540777 12166 consensus_queue.cc:237] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.545819 12156 consensus_queue.cc:1059] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:59.531507 11837 raft_consensus.cc:740] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:02:59.551925 11836 raft_consensus.cc:2468] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 2.
I20260709 13:02:59.553062 11837 consensus_queue.cc:260] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.554319 11985 raft_consensus.cc:2468] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b71b457f537044f1b8d7755d14e40cf4 in term 2.
I20260709 13:02:59.549099 11736 catalog_manager.cc:5697] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 reported cstate change: term changed from 1 to 2, leader changed from 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194) to b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b71b457f537044f1b8d7755d14e40cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.554430 11837 raft_consensus.cc:3060] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.567595 12133 raft_consensus.cc:697] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Becoming Leader. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Running, Role: LEADER
I20260709 13:02:59.568639 12133 consensus_queue.cc:237] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:02:59.574249 11837 raft_consensus.cc:2468] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1c09bf1ea04fa9a443809e4980fdd3 in term 2.
W20260709 13:02:59.574801 12156 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:02:59.578990 11736 catalog_manager.cc:5697] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 reported cstate change: term changed from 1 to 2, leader changed from a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195) to 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.580120 11736 catalog_manager.cc:5697] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 reported cstate change: term changed from 1 to 2, leader changed from b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193) to 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:59.718174 11912 raft_consensus.cc:1275] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Refusing update from remote peer b71b457f537044f1b8d7755d14e40cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:59.719378 12156 consensus_queue.cc:1048] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:59.733233 11985 raft_consensus.cc:1275] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Refusing update from remote peer b71b457f537044f1b8d7755d14e40cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:59.736321 12156 consensus_queue.cc:1048] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:59.739102 11985 raft_consensus.cc:1275] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Refusing update from remote peer 9e1c09bf1ea04fa9a443809e4980fdd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:59.740597 12133 consensus_queue.cc:1048] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:59.750912 11836 raft_consensus.cc:1275] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Refusing update from remote peer 9e1c09bf1ea04fa9a443809e4980fdd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:59.752580 12159 consensus_queue.cc:1048] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:59.791319 11912 raft_consensus.cc:1275] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Refusing update from remote peer b71b457f537044f1b8d7755d14e40cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:59.792565 12156 consensus_queue.cc:1048] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:59.799928 11984 raft_consensus.cc:1275] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Refusing update from remote peer b71b457f537044f1b8d7755d14e40cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:59.801314 12203 consensus_queue.cc:1048] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:59.866227 11837 raft_consensus.cc:1275] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Refusing update from remote peer a4da76bc1235497d8b166fba4921f9d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:59.867638 12147 consensus_queue.cc:1048] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:59.879772 11912 raft_consensus.cc:3060] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.896922 11912 raft_consensus.cc:1275] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Refusing update from remote peer a4da76bc1235497d8b166fba4921f9d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:59.898399 12147 consensus_queue.cc:1048] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:00.018716 11912 raft_consensus.cc:1275] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Refusing update from remote peer b71b457f537044f1b8d7755d14e40cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:00.020129 12203 consensus_queue.cc:1048] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:00.029537 11985 raft_consensus.cc:1275] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Refusing update from remote peer b71b457f537044f1b8d7755d14e40cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:00.034936 12203 consensus_queue.cc:1048] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:00.049796 11837 raft_consensus.cc:1275] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Refusing update from remote peer 9e1c09bf1ea04fa9a443809e4980fdd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:00.051532 12159 consensus_queue.cc:1048] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:00.053426 11985 raft_consensus.cc:1275] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Refusing update from remote peer 9e1c09bf1ea04fa9a443809e4980fdd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:00.056305 12159 consensus_queue.cc:1048] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:00.061043 11985 raft_consensus.cc:1275] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Refusing update from remote peer 9e1c09bf1ea04fa9a443809e4980fdd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:00.063136 12166 consensus_queue.cc:1048] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:00.084270 11837 raft_consensus.cc:1275] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Refusing update from remote peer 9e1c09bf1ea04fa9a443809e4980fdd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:00.087612 12133 consensus_queue.cc:1048] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:02.131714 11736 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41494:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:03:02.160094 11736 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41494:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:03:02.233517   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:02.404042 12240 log.cc:927] Time spent T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:03:02.423763 12242 log.cc:927] Time spent T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:03:02.436782 12250 tablet.cc:1724] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:02.490031 12236 log.cc:927] Time spent T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3: Append to log took a long time: real 0.178s	user 0.006s	sys 0.000s
I20260709 13:03:02.523272 12257 tablet.cc:1724] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.530612 12266 tablet.cc:1724] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.548038 12262 tablet.cc:1724] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:02.577006 12256 log.cc:927] Time spent T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:03:02.589479 11837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f53ee9d77184cd7955f4f505094c64b"
dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
mode: GRACEFUL
new_leader_uuid: "a4da76bc1235497d8b166fba4921f9d5"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:03:02.590384 11837 raft_consensus.cc:606] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Received request to transfer leadership to TS a4da76bc1235497d8b166fba4921f9d5
I20260709 13:03:02.589805 12271 tablet.cc:1724] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.632222 12280 tablet.cc:1724] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.666518 12277 tablet.cc:1724] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.654650 12275 tablet.cc:1724] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.689777 12284 tablet.cc:1724] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.690558 12283 tablet.cc:1724] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.680665 12282 tablet.cc:1724] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.701143 12241 raft_consensus.cc:993] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4: : Instructing follower a4da76bc1235497d8b166fba4921f9d5 to start an election
I20260709 13:03:02.703884 12234 raft_consensus.cc:1081] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Signalling peer a4da76bc1235497d8b166fba4921f9d5 to start an election
I20260709 13:03:02.716809 12280 tablet.cc:1724] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.728811 12282 tablet.cc:1724] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.726562 12281 tablet.cc:1724] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.736907 12266 tablet.cc:1724] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.677973 12250 tablet.cc:1724] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.748893 12257 tablet.cc:1724] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.751022 12262 tablet.cc:1724] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.756409 11981 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f53ee9d77184cd7955f4f505094c64b"
dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
 from {username='slave'} at 127.0.0.1:34512
I20260709 13:03:02.757164 11981 raft_consensus.cc:493] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:02.757597 11981 raft_consensus.cc:3060] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:02.768340 12257 tablet.cc:1724] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.786346 12271 tablet.cc:1724] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.789912 11913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8476de5b26434850a52f60fbc9eda471"
dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
mode: GRACEFUL
new_leader_uuid: "a4da76bc1235497d8b166fba4921f9d5"
 from {username='slave'} at 127.0.0.1:42172
I20260709 13:03:02.790645 11913 raft_consensus.cc:606] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Received request to transfer leadership to TS a4da76bc1235497d8b166fba4921f9d5
I20260709 13:03:02.792132   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:02.792821   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:02.792868 12275 tablet.cc:1724] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.802561 11981 raft_consensus.cc:515] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:03:02.794332 12277 tablet.cc:1724] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.805258 11981 leader_election.cc:290] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 2 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:03:02.806213 11838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f53ee9d77184cd7955f4f505094c64b" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:03:02.806998 11838 raft_consensus.cc:3055] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:02.807340 11838 raft_consensus.cc:740] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b71b457f537044f1b8d7755d14e40cf4, State: Running, Role: LEADER
I20260709 13:03:02.808292 11838 consensus_queue.cc:260] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:03:02.809645 11838 raft_consensus.cc:3060] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:02.812880 12284 tablet.cc:1724] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.816845 12283 tablet.cc:1724] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.818600 11913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f53ee9d77184cd7955f4f505094c64b" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:03:02.778856 12282 tablet.cc:1724] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.819279 11913 raft_consensus.cc:3060] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:02.828348 11913 raft_consensus.cc:2468] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 2.
I20260709 13:03:02.829677 11951 leader_election.cc:304] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1c09bf1ea04fa9a443809e4980fdd3, a4da76bc1235497d8b166fba4921f9d5; no voters: 
I20260709 13:03:02.832572 12270 raft_consensus.cc:2804] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:02.833070 12270 raft_consensus.cc:697] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 2 LEADER]: Becoming Leader. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Running, Role: LEADER
I20260709 13:03:02.834021 12270 consensus_queue.cc:237] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:03:02.830961 12275 tablet.cc:1724] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.846848 12281 tablet.cc:1724] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:02.861080 11838 raft_consensus.cc:2468] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 2.
I20260709 13:03:02.882608 11736 catalog_manager.cc:5697] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 reported cstate change: term changed from 1 to 2, leader changed from b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193) to a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "a4da76bc1235497d8b166fba4921f9d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:02.895534 11735 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682: soft_deleted_table [id=8313e182f07e47d9b47ff049b7024363] alter complete (version 1)
I20260709 13:03:03.012512 12276 raft_consensus.cc:993] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3: : Instructing follower a4da76bc1235497d8b166fba4921f9d5 to start an election
I20260709 13:03:03.013168 12238 raft_consensus.cc:1081] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Signalling peer a4da76bc1235497d8b166fba4921f9d5 to start an election
I20260709 13:03:03.014897 11981 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8476de5b26434850a52f60fbc9eda471"
dest_uuid: "a4da76bc1235497d8b166fba4921f9d5"
 from {username='slave'} at 127.0.0.1:34520
I20260709 13:03:03.015462 11981 raft_consensus.cc:493] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:03.015856 11981 raft_consensus.cc:3060] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:03.022333 11981 raft_consensus.cc:515] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:03:03.024367 11981 leader_election.cc:290] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 3 election: Requested vote from peers b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253), 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409)
I20260709 13:03:03.025197 11838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8476de5b26434850a52f60fbc9eda471" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b71b457f537044f1b8d7755d14e40cf4"
I20260709 13:03:03.025497 11913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8476de5b26434850a52f60fbc9eda471" candidate_uuid: "a4da76bc1235497d8b166fba4921f9d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3"
I20260709 13:03:03.025843 11838 raft_consensus.cc:3060] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:03.026206 11913 raft_consensus.cc:3055] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:03.026556 11913 raft_consensus.cc:740] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e1c09bf1ea04fa9a443809e4980fdd3, State: Running, Role: LEADER
I20260709 13:03:03.027424 11913 consensus_queue.cc:260] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:03:03.028896 11913 raft_consensus.cc:3060] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:03.032343 11838 raft_consensus.cc:2468] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 3.
I20260709 13:03:03.033663 11951 leader_election.cc:304] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4da76bc1235497d8b166fba4921f9d5, b71b457f537044f1b8d7755d14e40cf4; no voters: 
I20260709 13:03:03.034483 12270 raft_consensus.cc:2804] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:03.034993 12270 raft_consensus.cc:697] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 3 LEADER]: Becoming Leader. State: Replica: a4da76bc1235497d8b166fba4921f9d5, State: Running, Role: LEADER
I20260709 13:03:03.036031 12270 consensus_queue.cc:237] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } }
I20260709 13:03:03.045632 11913 raft_consensus.cc:2468] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4da76bc1235497d8b166fba4921f9d5 in term 3.
I20260709 13:03:03.046036 11735 catalog_manager.cc:5697] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 reported cstate change: term changed from 2 to 3, leader changed from 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194) to a4da76bc1235497d8b166fba4921f9d5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "a4da76bc1235497d8b166fba4921f9d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4da76bc1235497d8b166fba4921f9d5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38599 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:03.319511 11838 raft_consensus.cc:1275] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Refusing update from remote peer a4da76bc1235497d8b166fba4921f9d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:03.320739 12270 consensus_queue.cc:1048] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:03.331672 11913 raft_consensus.cc:1275] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Refusing update from remote peer a4da76bc1235497d8b166fba4921f9d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:03.333271 12270 consensus_queue.cc:1048] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:03.496299 11913 raft_consensus.cc:1275] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 3 FOLLOWER]: Refusing update from remote peer a4da76bc1235497d8b166fba4921f9d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:03.497885 12270 consensus_queue.cc:1048] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1c09bf1ea04fa9a443809e4980fdd3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:03.513615 11838 raft_consensus.cc:1275] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [term 3 FOLLOWER]: Refusing update from remote peer a4da76bc1235497d8b166fba4921f9d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:03.515487 12212 consensus_queue.cc:1048] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b71b457f537044f1b8d7755d14e40cf4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:03.863653   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:03:03.876025 11877 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
W20260709 13:03:03.880407 11877 consensus_peers.cc:597] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 -> Peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Couldn't send request to peer b71b457f537044f1b8d7755d14e40cf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.918491   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:03.919575   431 tablet_replica.cc:333] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.920832   431 raft_consensus.cc:2243] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.921489   431 raft_consensus.cc:2272] T 03751ad4dbde47399f596261a203b83b P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.924795   431 tablet_replica.cc:333] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.925776   431 raft_consensus.cc:2243] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.926451   431 raft_consensus.cc:2272] T 4c74977eed834b49a76e6733937c021e P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.929363   431 tablet_replica.cc:333] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.930305   431 raft_consensus.cc:2243] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.931098   431 raft_consensus.cc:2272] T 5fa70a3d7c4e4b0390a657983f61c445 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.934273   431 tablet_replica.cc:333] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.935163   431 raft_consensus.cc:2243] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.936375   431 raft_consensus.cc:2272] T c8dab636400e4f79af30715dd97d842d P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.939595   431 tablet_replica.cc:333] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.940536   431 raft_consensus.cc:2243] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.941655   431 raft_consensus.cc:2272] T bf79fb9c3f364b20aab797239f80e750 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.945138   431 tablet_replica.cc:333] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.946312   431 raft_consensus.cc:2243] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.947441   431 raft_consensus.cc:2272] T 0ea093064eb74fb1a013c9fa0d118467 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.950881   431 tablet_replica.cc:333] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.951867   431 raft_consensus.cc:2243] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.952454   431 raft_consensus.cc:2272] T 7f53ee9d77184cd7955f4f505094c64b P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:03.954293 11951 consensus_peers.cc:597] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 -> Peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Couldn't send request to peer b71b457f537044f1b8d7755d14e40cf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.956995   431 tablet_replica.cc:333] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.958029   431 raft_consensus.cc:2243] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.958667   431 raft_consensus.cc:2272] T 49c8ed1ce26d4ac790f7dce5d230c405 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.961918   431 tablet_replica.cc:333] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.962813   431 raft_consensus.cc:2243] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.963996   431 raft_consensus.cc:2272] T 25da72756e014bc384b32dfedec94ed6 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.967223   431 tablet_replica.cc:333] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.967994   431 raft_consensus.cc:2243] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.969084   431 raft_consensus.cc:2272] T 0b21719fd2d245bb91dc364a4f609b79 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.972265   431 tablet_replica.cc:333] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.973097   431 raft_consensus.cc:2243] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:03.974196   431 raft_consensus.cc:2272] T a32cfea8ce174be884829120b366ba70 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.977177   431 tablet_replica.cc:333] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.977993   431 raft_consensus.cc:2243] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.978636   431 raft_consensus.cc:2272] T 9381d49d1114401f9e36b4fc29312ec1 P b71b457f537044f1b8d7755d14e40cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.981762   431 tablet_replica.cc:333] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.982674   431 raft_consensus.cc:2243] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.983273   431 raft_consensus.cc:2272] T de75bb8a79814bdaa27b558ba26f8067 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.986311   431 tablet_replica.cc:333] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.987118   431 raft_consensus.cc:2243] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.987726   431 raft_consensus.cc:2272] T c682e96f583341febaf99286ebe5e471 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.990850   431 tablet_replica.cc:333] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:03.991623   431 raft_consensus.cc:2243] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.992276   431 raft_consensus.cc:2272] T 13b2802e84d54d2ba1ee80bf74dbedf3 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:03.995604   431 tablet_replica.cc:333] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
W20260709 13:03:03.995879 11877 consensus_peers.cc:597] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 -> Peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Couldn't send request to peer b71b457f537044f1b8d7755d14e40cf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.996397   431 raft_consensus.cc:2243] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:03.997097   431 raft_consensus.cc:2272] T 8476de5b26434850a52f60fbc9eda471 P b71b457f537044f1b8d7755d14e40cf4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.000365   431 tablet_replica.cc:333] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:04.001147   431 raft_consensus.cc:2243] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.001771   431 raft_consensus.cc:2272] T 475494752d0a4a8195941179b92404b2 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.004526   431 tablet_replica.cc:333] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4: stopping tablet replica
I20260709 13:03:04.005211   431 raft_consensus.cc:2243] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:04.005492 11877 consensus_peers.cc:597] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 -> Peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Couldn't send request to peer b71b457f537044f1b8d7755d14e40cf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:04.006345   431 raft_consensus.cc:2272] T 395018dba6604c1d87b6758b93bd91a3 P b71b457f537044f1b8d7755d14e40cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.052778   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:04.074812 11877 consensus_peers.cc:597] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 -> Peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Couldn't send request to peer b71b457f537044f1b8d7755d14e40cf4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:04.095782 11877 consensus_peers.cc:597] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 -> Peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Couldn't send request to peer b71b457f537044f1b8d7755d14e40cf4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:04.096786   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:03:04.140974   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:04.141738   431 tablet_replica.cc:333] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.142694   431 raft_consensus.cc:2243] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:04.143549   431 raft_consensus.cc:2272] T 03751ad4dbde47399f596261a203b83b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.145881   431 tablet_replica.cc:333] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.146586   431 raft_consensus.cc:2243] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:04.147384   431 raft_consensus.cc:2272] T 4c74977eed834b49a76e6733937c021e P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.149403   431 tablet_replica.cc:333] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.150030   431 raft_consensus.cc:2243] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.150655   431 raft_consensus.cc:2272] T 0b21719fd2d245bb91dc364a4f609b79 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.152863   431 tablet_replica.cc:333] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.153491   431 raft_consensus.cc:2243] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.153944   431 raft_consensus.cc:2272] T a32cfea8ce174be884829120b366ba70 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.156541   431 tablet_replica.cc:333] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.157328   431 raft_consensus.cc:2243] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:04.158356   431 raft_consensus.cc:2272] T 5fa70a3d7c4e4b0390a657983f61c445 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:04.159080 11951 consensus_peers.cc:597] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 -> Peer 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409): Couldn't send request to peer 9e1c09bf1ea04fa9a443809e4980fdd3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:04.160568   431 tablet_replica.cc:333] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.161201   431 raft_consensus.cc:2243] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.161603   431 raft_consensus.cc:2272] T 7f53ee9d77184cd7955f4f505094c64b P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.164232   431 tablet_replica.cc:333] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.164803   431 raft_consensus.cc:2243] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:04.165597   431 raft_consensus.cc:2272] T 49c8ed1ce26d4ac790f7dce5d230c405 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.167788   431 tablet_replica.cc:333] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.168327   431 raft_consensus.cc:2243] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.168807   431 raft_consensus.cc:2272] T 9381d49d1114401f9e36b4fc29312ec1 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.170790   431 tablet_replica.cc:333] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.171317   431 raft_consensus.cc:2243] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:04.172075   431 raft_consensus.cc:2272] T 13b2802e84d54d2ba1ee80bf74dbedf3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.174204   431 tablet_replica.cc:333] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.174727   431 raft_consensus.cc:2243] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:04.175441   431 raft_consensus.cc:2272] T de75bb8a79814bdaa27b558ba26f8067 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.177213   431 tablet_replica.cc:333] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.177692   431 raft_consensus.cc:2243] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:04.178494   431 raft_consensus.cc:2272] T c682e96f583341febaf99286ebe5e471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.180393   431 tablet_replica.cc:333] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.180879   431 raft_consensus.cc:2243] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.181294   431 raft_consensus.cc:2272] T c8dab636400e4f79af30715dd97d842d P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.183128   431 tablet_replica.cc:333] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.183646   431 raft_consensus.cc:2243] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.184054   431 raft_consensus.cc:2272] T 475494752d0a4a8195941179b92404b2 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.185832   431 tablet_replica.cc:333] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.186383   431 raft_consensus.cc:2243] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.186792   431 raft_consensus.cc:2272] T 395018dba6604c1d87b6758b93bd91a3 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.188609   431 tablet_replica.cc:333] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.189093   431 raft_consensus.cc:2243] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.189476   431 raft_consensus.cc:2272] T 8476de5b26434850a52f60fbc9eda471 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.192487   431 tablet_replica.cc:333] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.193027   431 raft_consensus.cc:2243] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.193563   431 raft_consensus.cc:2272] T 25da72756e014bc384b32dfedec94ed6 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.195853   431 tablet_replica.cc:333] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
I20260709 13:03:04.196334   431 raft_consensus.cc:2243] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.196736   431 raft_consensus.cc:2272] T 0ea093064eb74fb1a013c9fa0d118467 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.198897   431 tablet_replica.cc:333] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3: stopping tablet replica
W20260709 13:03:04.199328 11951 consensus_peers.cc:597] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 -> Peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Couldn't send request to peer b71b457f537044f1b8d7755d14e40cf4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:04.199515   431 raft_consensus.cc:2243] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.200094   431 raft_consensus.cc:2272] T bf79fb9c3f364b20aab797239f80e750 P 9e1c09bf1ea04fa9a443809e4980fdd3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:04.240931 11951 consensus_peers.cc:597] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 -> Peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Couldn't send request to peer b71b457f537044f1b8d7755d14e40cf4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:04.254599 11951 consensus_peers.cc:597] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 -> Peer 9e1c09bf1ea04fa9a443809e4980fdd3 (127.0.107.194:46409): Couldn't send request to peer 9e1c09bf1ea04fa9a443809e4980fdd3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:04.265342   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:03:04.286496 11951 consensus_peers.cc:597] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 -> Peer b71b457f537044f1b8d7755d14e40cf4 (127.0.107.193:44253): Couldn't send request to peer b71b457f537044f1b8d7755d14e40cf4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:04.301281   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:04.330435   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:04.331218   431 tablet_replica.cc:333] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.332887   431 raft_consensus.cc:2243] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.333406   431 raft_consensus.cc:2272] T 5fa70a3d7c4e4b0390a657983f61c445 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.335647   431 tablet_replica.cc:333] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.336233   431 raft_consensus.cc:2243] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.336673   431 raft_consensus.cc:2272] T 03751ad4dbde47399f596261a203b83b P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.338692   431 tablet_replica.cc:333] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.339272   431 raft_consensus.cc:2243] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.339720   431 raft_consensus.cc:2272] T 4c74977eed834b49a76e6733937c021e P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.341665   431 tablet_replica.cc:333] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.342334   431 raft_consensus.cc:2243] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.342820   431 raft_consensus.cc:2272] T a32cfea8ce174be884829120b366ba70 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.345191   431 tablet_replica.cc:333] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.345731   431 raft_consensus.cc:2243] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.346232   431 raft_consensus.cc:2272] T 0b21719fd2d245bb91dc364a4f609b79 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.348120   431 tablet_replica.cc:333] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.348686   431 raft_consensus.cc:2243] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:04.349617   431 raft_consensus.cc:2272] T 7f53ee9d77184cd7955f4f505094c64b P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.352470   431 tablet_replica.cc:333] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.353106   431 raft_consensus.cc:2243] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.353806   431 raft_consensus.cc:2272] T 49c8ed1ce26d4ac790f7dce5d230c405 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.356083   431 tablet_replica.cc:333] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.356621   431 raft_consensus.cc:2243] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.357016   431 raft_consensus.cc:2272] T 0ea093064eb74fb1a013c9fa0d118467 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.359016   431 tablet_replica.cc:333] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.359500   431 raft_consensus.cc:2243] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.359900   431 raft_consensus.cc:2272] T bf79fb9c3f364b20aab797239f80e750 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.361833   431 tablet_replica.cc:333] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.362382   431 raft_consensus.cc:2243] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.362756   431 raft_consensus.cc:2272] T 25da72756e014bc384b32dfedec94ed6 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.364575   431 tablet_replica.cc:333] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.365036   431 raft_consensus.cc:2243] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:04.365753   431 raft_consensus.cc:2272] T 9381d49d1114401f9e36b4fc29312ec1 P a4da76bc1235497d8b166fba4921f9d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.367825   431 tablet_replica.cc:333] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.368301   431 raft_consensus.cc:2243] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.369040   431 raft_consensus.cc:2272] T de75bb8a79814bdaa27b558ba26f8067 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.371008   431 tablet_replica.cc:333] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.371515   431 raft_consensus.cc:2243] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.371937   431 raft_consensus.cc:2272] T c682e96f583341febaf99286ebe5e471 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.373929   431 tablet_replica.cc:333] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.374431   431 raft_consensus.cc:2243] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.374840   431 raft_consensus.cc:2272] T 13b2802e84d54d2ba1ee80bf74dbedf3 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.376691   431 tablet_replica.cc:333] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.377190   431 raft_consensus.cc:2243] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.377631   431 raft_consensus.cc:2272] T c8dab636400e4f79af30715dd97d842d P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.379508   431 tablet_replica.cc:333] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.380018   431 raft_consensus.cc:2243] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:04.380782   431 raft_consensus.cc:2272] T 8476de5b26434850a52f60fbc9eda471 P a4da76bc1235497d8b166fba4921f9d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.383224   431 tablet_replica.cc:333] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.383734   431 raft_consensus.cc:2243] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:04.384589   431 raft_consensus.cc:2272] T 475494752d0a4a8195941179b92404b2 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.386459   431 tablet_replica.cc:333] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5: stopping tablet replica
I20260709 13:03:04.386935   431 raft_consensus.cc:2243] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:04.387409   431 raft_consensus.cc:2272] T 395018dba6604c1d87b6758b93bd91a3 P a4da76bc1235497d8b166fba4921f9d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.429795   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:04.462901   431 master.cc:562] Master@127.0.107.254:43639 shutting down...
I20260709 13:03:04.488672   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:04.489272   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:04.489621   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P c557991237484662821f3b1ad7bdb682: stopping tablet replica
I20260709 13:03:04.510638   431 master.cc:584] Master@127.0.107.254:43639 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12049 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24738 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (343715 ms total)
[  PASSED  ] 8 tests.
I20260709 13:03:04.564656   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 419 messages since previous log ~537 seconds ago
I20260709 13:03:04.564916   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 419 messages since previous log ~537 seconds ago
I20260709 13:03:04.565112   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 418 messages since previous log ~537 seconds ago
I20260709 13:03:04.565330   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:03:04.565523   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:03:04.565716   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 2 messages since previous log ~101 seconds ago
I20260709 13:03:04.565932   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~128 seconds ago
I20260709 13:03:04.566233   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 11 messages since previous log ~0 seconds ago
I20260709 13:03:04.566437   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 25 messages since previous log ~6 seconds ago
